2023-12-14T13:52:22.743 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T13:52:22.743 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_choffman@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} --name choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi --verbose --archive /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228 -- /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/orig.config.yaml 2023-12-14T13:52:22.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T13:52:22.882 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228 branch: wip-choffman-62793 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} email: null first_in_suite: false job_id: '7491228' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-choffman-62793 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 1faa353368ad4f5aeb56d7107b638336f58659ed subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 1faa353368ad4f5aeb56d7107b638336f58659ed kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62793-testing sha1: bf026da9d69000f3d4a9d16360156095d6612a2d owner: scheduled_choffman@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3217 sha1: 1faa353368ad4f5aeb56d7107b638336f58659ed sleep_before_teardown: 0 suite: fs suite_branch: wip-62793-testing suite_path: /home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa suite_relpath: qa suite_repo: https://github.com/chrisphoffman/ceph.git suite_sha1: bf026da9d69000f3d4a9d16360156095d6612a2d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0MpaWITb2yPBjlsUtdX85sS/+Fm3iDVls/rpN3t132rN7VuoMxQ/K5xSJTzQxFppO2qfDQP9WBt1NdmoxFiSo= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEYoLpwep/KALGS9o8NFWPC0O8/CzDiojFPIfswo7IEWeQVMyw1Pyn/5bUxFPBf4iocSFgdkfxnGfVQ6LGGPu5k= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDrQjfaVi0brQbPkFg4ltWtvaLkwZy/PKKttmu5tLhOYgTZyPUjr5c7WJ9SgyPJCT7iIB5jFWUQrBkozNfNCq/0= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - fs/misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-14_13:45:56 tube: smithi user: choffman verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-14T13:52:22.883 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa; will attempt to use it 2023-12-14T13:52:22.883 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks 2023-12-14T13:52:22.883 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-14T13:52:22.885 INFO:teuthology.task.internal:Checking packages... 2023-12-14T13:52:22.908 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '1faa353368ad4f5aeb56d7107b638336f58659ed' 2023-12-14T13:52:22.908 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-14T13:52:22.908 INFO:teuthology.packaging:ref: None 2023-12-14T13:52:22.908 INFO:teuthology.packaging:tag: None 2023-12-14T13:52:22.908 INFO:teuthology.packaging:branch: wip-choffman-62793 2023-12-14T13:52:22.908 INFO:teuthology.packaging:sha1: 1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T13:52:22.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-choffman-62793 2023-12-14T13:52:23.133 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3905.g1faa3533 2023-12-14T13:52:23.135 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-14T13:52:23.144 INFO:teuthology.task.internal:no buildpackages task found 2023-12-14T13:52:23.144 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-14T13:52:23.157 INFO:teuthology.task.internal:Saving configuration 2023-12-14T13:52:23.187 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-14T13:52:23.199 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T13:52:23.226 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 13:46:38.794538', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0MpaWITb2yPBjlsUtdX85sS/+Fm3iDVls/rpN3t132rN7VuoMxQ/K5xSJTzQxFppO2qfDQP9WBt1NdmoxFiSo='} 2023-12-14T13:52:23.248 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 13:46:38.795791', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEYoLpwep/KALGS9o8NFWPC0O8/CzDiojFPIfswo7IEWeQVMyw1Pyn/5bUxFPBf4iocSFgdkfxnGfVQ6LGGPu5k='} 2023-12-14T13:52:23.273 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 13:46:38.793007', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDrQjfaVi0brQbPkFg4ltWtvaLkwZy/PKKttmu5tLhOYgTZyPUjr5c7WJ9SgyPJCT7iIB5jFWUQrBkozNfNCq/0='} 2023-12-14T13:52:23.273 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-14T13:52:23.281 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-12-14T13:52:23.281 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-12-14T13:52:23.282 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-12-14T13:52:23.282 INFO:teuthology.run_tasks:Running task console_log... 2023-12-14T13:52:23.385 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f44b66d2dc0>, signals=[15]) 2023-12-14T13:52:23.385 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-14T13:52:23.391 INFO:teuthology.task.internal:Opening connections... 2023-12-14T13:52:23.392 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T13:52:23.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T13:52:23.460 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-12-14T13:52:23.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T13:52:23.527 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2023-12-14T13:52:23.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T13:52:23.593 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-14T13:52:23.605 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-12-14T13:52:23.625 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-12-14T13:52:23.625 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.6" 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T13:52:23.684 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T13:52:23.685 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T13:52:23.685 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T13:52:23.685 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:52:23.685 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T13:52:23.685 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T13:52:23.685 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T13:52:23.685 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T13:52:23.685 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-12-14T13:52:23.706 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-12-14T13:52:23.726 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-12-14T13:52:23.727 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-12-14T13:52:23.786 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T13:52:23.786 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T13:52:23.786 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T13:52:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T13:52:23.788 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-12-14T13:52:23.806 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-12-14T13:52:23.827 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-12-14T13:52:23.827 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-12-14T13:52:23.886 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T13:52:23.886 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T13:52:23.886 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel" 2023-12-14T13:52:23.886 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora" 2023-12-14T13:52:23.886 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6" 2023-12-14T13:52:23.886 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-12-14T13:52:23.886 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T13:52:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T13:52:23.887 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-12-14T13:52:23.906 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-14T13:52:23.915 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-14T13:52:23.923 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-14T13:52:23.923 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2023-12-14T13:52:23.926 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-12-14T13:52:23.928 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2023-12-14T13:52:23.945 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-14T13:52:23.953 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-14T13:52:23.953 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2023-12-14T13:52:23.985 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-12-14T13:52:23.988 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2023-12-14T13:52:24.018 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-14T13:52:24.100 INFO:teuthology.run_tasks:Running task kernel... 2023-12-14T13:52:24.116 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-12-14T13:52:24.116 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-12-14T13:52:24.116 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-12-14T13:52:24.117 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-14T13:52:24.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T13:52:24.136 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2023-12-14T13:52:24.194 INFO:teuthology.orchestra.run.smithi069.stdout:4.18.0-513.9.1.el8_9.x86_64 2023-12-14T13:52:24.195 INFO:teuthology.task.kernel:Running kernel on smithi069: 4.18.0-513.9.1.el8_9.x86_64 2023-12-14T13:52:24.195 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum install -y kernel 2023-12-14T13:52:25.901 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T13:52:25.901 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-12-14T13:52:26.033 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:52:26.033 INFO:teuthology.orchestra.run.smithi069.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T13:52:26.033 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:52:27.692 INFO:teuthology.orchestra.run.smithi069.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-14T13:52:28.368 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 26 MB/s | 16 MB 00:00 2023-12-14T13:52:31.893 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 344 kB/s | 24 kB 00:00 2023-12-14T13:52:32.620 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2023-12-14T13:52:32.621 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-12-14T13:52:32.713 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-14T13:52:32.714 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-12-14T13:52:32.714 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-14T13:52:32.851 DEBUG:teuthology.orchestra.run.smithi069:> echo no | sudo yum reinstall kernel || true 2023-12-14T13:52:33.187 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T13:52:33.187 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-12-14T13:52:33.246 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:52:33.246 INFO:teuthology.orchestra.run.smithi069.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T13:52:33.246 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:52:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:02 ago on Thu 14 Dec 2023 01:52:31 PM UTC. 2023-12-14T13:52:33.626 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-14T13:52:33.626 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-14T13:52:33.660 INFO:teuthology.orchestra.run.smithi069.stderr:Error: No packages marked for reinstall. 2023-12-14T13:52:33.706 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum reinstall -y kernel || true 2023-12-14T13:52:34.040 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T13:52:34.041 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-12-14T13:52:34.104 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:52:34.104 INFO:teuthology.orchestra.run.smithi069.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T13:52:34.104 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:52:34.403 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:03 ago on Thu 14 Dec 2023 01:52:31 PM UTC. 2023-12-14T13:52:34.464 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-14T13:52:34.464 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-14T13:52:34.503 INFO:teuthology.orchestra.run.smithi069.stderr:Error: No packages marked for reinstall. 2023-12-14T13:52:34.549 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q kernel | sort -rV | head -n 1 2023-12-14T13:52:34.701 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2023-12-14T13:52:34.701 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2023-12-14T13:52:34.701 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-12-14T13:52:34.701 DEBUG:teuthology.parallel:result is None 2023-12-14T13:52:34.701 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-14T13:52:34.710 INFO:teuthology.task.internal:Creating test directory... 2023-12-14T13:52:34.711 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-14T13:52:34.713 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-14T13:52:34.715 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-14T13:52:34.735 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-14T13:52:34.753 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-14T13:52:34.766 INFO:teuthology.task.internal:Creating archive directory... 2023-12-14T13:52:34.767 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-14T13:52:34.770 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-14T13:52:34.775 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-14T13:52:34.808 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-14T13:52:34.819 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-14T13:52:34.819 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-14T13:52:34.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T13:52:34.857 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-14T13:52:34.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T13:52:34.875 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-14T13:52:34.877 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-14T13:52:34.899 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-14T13:52:34.911 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T13:52:34.928 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T13:52:34.940 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T13:52:34.956 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T13:52:34.960 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T13:52:34.975 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T13:52:34.976 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-14T13:52:34.987 INFO:teuthology.task.internal:Configuring sudo... 2023-12-14T13:52:34.987 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-14T13:52:34.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-14T13:52:34.992 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-14T13:52:35.021 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-14T13:52:35.030 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-14T13:52:35.031 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-14T13:52:35.057 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-14T13:52:35.062 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-14T13:52:35.079 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T13:52:35.156 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T13:52:35.205 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T13:52:35.289 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T13:52:35.329 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T13:52:35.329 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-14T13:52:35.395 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T13:52:35.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T13:52:35.496 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T13:52:35.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T13:52:35.628 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T13:52:35.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-14T13:52:35.698 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T13:52:35.740 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T13:52:35.798 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T13:52:35.886 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T13:52:35.930 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T13:52:35.930 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-14T13:52:36.000 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2023-12-14T13:52:36.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-12-14T13:52:36.005 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2023-12-14T13:52:36.059 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T13:52:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T13:52:36.106 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T13:52:36.538 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-14T13:52:36.545 INFO:teuthology.task.internal:Starting timer... 2023-12-14T13:52:36.546 INFO:teuthology.run_tasks:Running task pcp... 2023-12-14T13:52:36.556 INFO:teuthology.run_tasks:Running task selinux... 2023-12-14T13:52:36.563 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-12-14T13:52:36.564 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2023-12-14T13:52:36.624 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: 2023-12-14T13:52:36.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2023-12-14T13:52:36.688 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2023-12-14T13:52:36.690 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2023-12-14T13:52:36.793 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2023-12-14T13:52:36.796 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-14T13:52:36.796 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2023-12-14T13:52:36.818 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2023-12-14T13:52:36.818 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2023-12-14T13:52:36.843 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2023-12-14T13:52:36.844 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2023-12-14T13:52:36.864 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2023-12-14T13:52:36.864 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi069.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive'} 2023-12-14T13:52:36.865 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T13:52:36.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T13:52:36.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T13:52:36.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T13:52:36.919 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T13:52:36.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T13:52:36.946 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-14T13:52:36.946 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2023-12-14T13:52:36.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2023-12-14T13:52:37.001 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2023-12-14T13:52:37.027 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-14T13:52:37.038 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-14T13:52:37.038 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-14T13:52:37.053 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-14T13:52:37.056 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi069.front.sepia.ceph.com,smithi081.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-14T13:58:02.626 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2023-12-14T13:58:02.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-14T13:58:02.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T13:58:02.701 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-12-14T13:58:02.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-14T13:58:02.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-14T13:58:02.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T13:58:02.838 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-12-14T13:58:02.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-14T13:58:02.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-14T13:58:02.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T13:58:02.937 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-12-14T13:58:03.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-14T13:58:03.014 INFO:teuthology.run_tasks:Running task clock... 2023-12-14T13:58:03.025 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-14T13:58:03.025 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-14T13:58:03.025 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T13:58:03.028 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-14T13:58:03.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T13:58:03.030 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-14T13:58:03.030 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T13:58:03.060 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-14T13:58:03.061 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-14T13:58:03.076 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-14T13:58:03.077 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-14T13:58:03.090 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-14T13:58:03.107 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-14T13:58:03.142 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2023-12-14T13:58:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2023-12-14T13:58:03.154 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2023-12-14T13:58:03.162 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2023-12-14T13:58:03.168 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-14T13:58:03.177 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-14T13:58:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2023-12-14T13:58:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-14T13:58:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-14T13:58:03.195 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2023-12-14T13:58:03.210 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-14T13:58:03.224 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-14T13:58:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-12-14T13:58:03.252 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T13:58:03.252 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-12-14T13:58:03.252 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.252 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.252 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.252 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.260 INFO:teuthology.orchestra.run.smithi069.stderr:bash: ntpq: command not found 2023-12-14T13:58:03.263 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T13:58:03.263 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-12-14T13:58:03.264 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.264 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.264 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.264 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.302 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2023-12-14T13:58:03.305 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T13:58:03.305 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-12-14T13:58:03.306 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.306 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.306 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.306 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T13:58:03.307 INFO:teuthology.run_tasks:Running task pexec... 2023-12-14T13:58:03.316 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-14T13:58:03.316 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T13:58:03.317 DEBUG:teuthology.orchestra.run.smithi069:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-14T13:58:03.317 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi081.front.sepia.ceph.com 2023-12-14T13:58:03.317 DEBUG:teuthology.orchestra.run.smithi081:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-14T13:58:03.318 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi119.front.sepia.ceph.com 2023-12-14T13:58:03.318 DEBUG:teuthology.orchestra.run.smithi119:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-14T13:58:03.694 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:03.694 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:03.721 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 36 kB/s | 4.5 kB 00:00 2023-12-14T13:58:05.529 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 kB/s | 4.5 kB 00:00 2023-12-14T13:58:05.608 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 28 kB/s | 4.1 kB 00:00 2023-12-14T13:58:05.981 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2023-12-14T13:58:06.169 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 22 kB/s | 4.1 kB 00:00 2023-12-14T13:58:06.195 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 29 kB/s | 4.1 kB 00:00 2023-12-14T13:58:08.778 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-12-14T13:58:08.778 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-14T13:58:08.778 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2023-12-14T13:58:08.779 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-14T13:58:08.779 INFO:teuthology.orchestra.run.smithi081.stdout:Resetting modules: 2023-12-14T13:58:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: container-tools 2023-12-14T13:58:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:58:08.779 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-12-14T13:58:08.779 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-14T13:58:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:58:08.873 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-14T13:58:08.874 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-14T13:58:08.874 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2023-12-14T13:58:08.874 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-14T13:58:08.874 INFO:teuthology.orchestra.run.smithi119.stdout:Resetting modules: 2023-12-14T13:58:08.874 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools 2023-12-14T13:58:08.875 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:58:08.875 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-14T13:58:08.875 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-14T13:58:08.875 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:58:08.895 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-14T13:58:08.897 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-12-14T13:58:08.897 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2023-12-14T13:58:08.897 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-12-14T13:58:08.897 INFO:teuthology.orchestra.run.smithi069.stdout:Resetting modules: 2023-12-14T13:58:08.897 INFO:teuthology.orchestra.run.smithi069.stdout: container-tools 2023-12-14T13:58:08.897 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:58:08.897 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-12-14T13:58:08.897 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-12-14T13:58:08.897 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:58:22.839 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-12-14T13:58:23.169 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-14T13:58:23.325 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:23.637 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:23.937 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-14T13:58:24.437 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:25.106 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 67 kB/s | 4.1 kB 00:00 2023-12-14T13:58:25.410 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 kB/s | 4.5 kB 00:00 2023-12-14T13:58:25.488 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 kB/s | 4.5 kB 00:00 2023-12-14T13:58:26.092 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 24 kB/s | 4.1 kB 00:00 2023-12-14T13:58:26.170 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2023-12-14T13:58:26.875 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 26 kB/s | 4.1 kB 00:00 2023-12-14T13:58:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-12-14T13:58:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:========================================================================================================== 2023-12-14T13:58:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-12-14T13:58:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:========================================================================================================== 2023-12-14T13:58:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:Installing group/module packages: 2023-12-14T13:58:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-12-14T13:58:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2023-12-14T13:58:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2023-12-14T13:58:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout:Installing module profiles: 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: container-tools/common 2023-12-14T13:58:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:58:28.626 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling module streams: 2023-12-14T13:58:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: container-tools rhel8 2023-12-14T13:58:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:58:28.626 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-12-14T13:58:28.626 INFO:teuthology.orchestra.run.smithi081.stdout:========================================================================================================== 2023-12-14T13:58:28.626 INFO:teuthology.orchestra.run.smithi081.stdout:Install 13 Packages 2023-12-14T13:58:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:58:28.626 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 26 M 2023-12-14T13:58:28.627 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 87 M 2023-12-14T13:58:28.627 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-12-14T13:58:28.812 INFO:teuthology.orchestra.run.smithi081.stdout:(1/13): yajl-2.1.0-12.el8.x86_64.rpm 222 kB/s | 41 kB 00:00 2023-12-14T13:58:28.837 INFO:teuthology.orchestra.run.smithi081.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 118 kB/s | 25 kB 00:00 2023-12-14T13:58:28.862 INFO:teuthology.orchestra.run.smithi081.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 399 kB/s | 94 kB 00:00 2023-12-14T13:58:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:(4/13): cockpit-podman-75-1.module+el8.9.0+2032 9.6 MB/s | 739 kB 00:00 2023-12-14T13:58:28.986 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-14T13:58:28.988 INFO:teuthology.orchestra.run.smithi081.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 5.7 MB/s | 1.0 MB 00:00 2023-12-14T13:58:29.063 INFO:teuthology.orchestra.run.smithi081.stdout:(6/13): criu-libs-3.18-4.module+el8.9.0+20326+3 314 kB/s | 39 kB 00:00 2023-12-14T13:58:29.139 INFO:teuthology.orchestra.run.smithi069.stdout:========================================================================================================== 2023-12-14T13:58:29.139 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-12-14T13:58:29.139 INFO:teuthology.orchestra.run.smithi069.stdout:========================================================================================================== 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout:Installing group/module packages: 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-14T13:58:29.140 INFO:teuthology.orchestra.run.smithi069.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout:Installing weak dependencies: 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout:Installing module profiles: 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout: container-tools/common 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling module streams: 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout: container-tools rhel8 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout:========================================================================================================== 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout:Install 13 Packages 2023-12-14T13:58:29.141 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:58:29.142 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 26 M 2023-12-14T13:58:29.142 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 87 M 2023-12-14T13:58:29.142 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-12-14T13:58:29.180 INFO:teuthology.orchestra.run.smithi081.stdout:(7/13): buildah-1.31.3-1.module+el8.9.0+20326+3 26 MB/s | 8.8 MB 00:00 2023-12-14T13:58:29.206 INFO:teuthology.orchestra.run.smithi081.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+20326+38708 1.1 MB/s | 239 kB 00:00 2023-12-14T13:58:29.314 INFO:teuthology.orchestra.run.smithi081.stdout:(9/13): netavark-1.7.0-1.module+el8.9.0+20326+3 15 MB/s | 3.7 MB 00:00 2023-12-14T13:58:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 128 kB/s | 25 kB 00:00 2023-12-14T13:58:29.395 INFO:teuthology.orchestra.run.smithi069.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 372 kB/s | 94 kB 00:00 2023-12-14T13:58:29.453 INFO:teuthology.orchestra.run.smithi069.stdout:(3/13): yajl-2.1.0-12.el8.x86_64.rpm 132 kB/s | 41 kB 00:00 2023-12-14T13:58:29.490 INFO:teuthology.orchestra.run.smithi081.stdout:(10/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 14 MB/s | 2.5 MB 00:00 2023-12-14T13:58:29.504 INFO:teuthology.orchestra.run.smithi069.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 6.0 MB/s | 1.0 MB 00:00 2023-12-14T13:58:29.555 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-14T13:58:29.571 INFO:teuthology.orchestra.run.smithi069.stdout:(5/13): cockpit-podman-75-1.module+el8.9.0+2032 6.2 MB/s | 739 kB 00:00 2023-12-14T13:58:29.573 INFO:teuthology.orchestra.run.smithi081.stdout:(11/13): python3-podman-4.6.0-1.module+el8.9.0+ 391 kB/s | 153 kB 00:00 2023-12-14T13:58:29.598 INFO:teuthology.orchestra.run.smithi081.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+20326+38 456 kB/s | 49 kB 00:00 2023-12-14T13:58:29.688 INFO:teuthology.orchestra.run.smithi069.stdout:(6/13): buildah-1.31.3-1.module+el8.9.0+20326+3 30 MB/s | 8.8 MB 00:00 2023-12-14T13:58:29.704 INFO:teuthology.orchestra.run.smithi069.stdout:(7/13): criu-libs-3.18-4.module+el8.9.0+20326+3 196 kB/s | 39 kB 00:00 2023-12-14T13:58:29.710 INFO:teuthology.orchestra.run.smithi119.stdout:========================================================================================================== 2023-12-14T13:58:29.710 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-14T13:58:29.710 INFO:teuthology.orchestra.run.smithi119.stdout:========================================================================================================== 2023-12-14T13:58:29.710 INFO:teuthology.orchestra.run.smithi119.stdout:Installing group/module packages: 2023-12-14T13:58:29.710 INFO:teuthology.orchestra.run.smithi119.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-12-14T13:58:29.710 INFO:teuthology.orchestra.run.smithi119.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2023-12-14T13:58:29.710 INFO:teuthology.orchestra.run.smithi119.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout:Installing module profiles: 2023-12-14T13:58:29.711 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools/common 2023-12-14T13:58:29.712 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:58:29.712 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling module streams: 2023-12-14T13:58:29.712 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools rhel8 2023-12-14T13:58:29.712 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:58:29.712 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-14T13:58:29.712 INFO:teuthology.orchestra.run.smithi119.stdout:========================================================================================================== 2023-12-14T13:58:29.712 INFO:teuthology.orchestra.run.smithi119.stdout:Install 13 Packages 2023-12-14T13:58:29.712 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:58:29.712 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 26 M 2023-12-14T13:58:29.713 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 87 M 2023-12-14T13:58:29.713 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-14T13:58:29.729 INFO:teuthology.orchestra.run.smithi069.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+20326+38708 1.5 MB/s | 239 kB 00:00 2023-12-14T13:58:29.731 INFO:teuthology.orchestra.run.smithi081.stdout:(13/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 15 MB/s | 8.1 MB 00:00 2023-12-14T13:58:29.732 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-12-14T13:58:29.732 INFO:teuthology.orchestra.run.smithi081.stdout:Total 23 MB/s | 26 MB 00:01 2023-12-14T13:58:29.814 INFO:teuthology.orchestra.run.smithi069.stdout:(9/13): python3-podman-4.6.0-1.module+el8.9.0+2 1.4 MB/s | 153 kB 00:00 2023-12-14T13:58:29.841 INFO:teuthology.orchestra.run.smithi119.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 194 kB/s | 25 kB 00:00 2023-12-14T13:58:29.862 INFO:teuthology.orchestra.run.smithi119.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 632 kB/s | 94 kB 00:00 2023-12-14T13:58:29.895 INFO:teuthology.orchestra.run.smithi119.stdout:(3/13): yajl-2.1.0-12.el8.x86_64.rpm 225 kB/s | 41 kB 00:00 2023-12-14T13:58:29.905 INFO:teuthology.orchestra.run.smithi069.stdout:(10/13): netavark-1.7.0-1.module+el8.9.0+20326+ 17 MB/s | 3.7 MB 00:00 2023-12-14T13:58:30.004 INFO:teuthology.orchestra.run.smithi119.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 6.2 MB/s | 1.0 MB 00:00 2023-12-14T13:58:30.013 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-12-14T13:58:30.022 INFO:teuthology.orchestra.run.smithi069.stdout:(11/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 28 MB/s | 8.1 MB 00:00 2023-12-14T13:58:30.034 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-12-14T13:58:30.034 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-12-14T13:58:30.047 INFO:teuthology.orchestra.run.smithi069.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+20326+38 349 kB/s | 49 kB 00:00 2023-12-14T13:58:30.123 INFO:teuthology.orchestra.run.smithi069.stdout:(13/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 8.2 MB/s | 2.5 MB 00:00 2023-12-14T13:58:30.123 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-12-14T13:58:30.123 INFO:teuthology.orchestra.run.smithi069.stdout:Total 26 MB/s | 26 MB 00:00 2023-12-14T13:58:30.146 INFO:teuthology.orchestra.run.smithi119.stdout:(5/13): buildah-1.31.3-1.module+el8.9.0+20326+3 31 MB/s | 8.8 MB 00:00 2023-12-14T13:58:30.171 INFO:teuthology.orchestra.run.smithi119.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2032 2.6 MB/s | 739 kB 00:00 2023-12-14T13:58:30.188 INFO:teuthology.orchestra.run.smithi119.stdout:(7/13): criu-libs-3.18-4.module+el8.9.0+20326+3 214 kB/s | 39 kB 00:00 2023-12-14T13:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+20326+38708 1.5 MB/s | 239 kB 00:00 2023-12-14T13:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout:(9/13): python3-podman-4.6.0-1.module+el8.9.0+2 1.1 MB/s | 153 kB 00:00 2023-12-14T13:58:30.400 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-12-14T13:58:30.405 INFO:teuthology.orchestra.run.smithi119.stdout:(10/13): netavark-1.7.0-1.module+el8.9.0+20326+ 16 MB/s | 3.7 MB 00:00 2023-12-14T13:58:30.421 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-12-14T13:58:30.421 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-12-14T13:58:30.514 INFO:teuthology.orchestra.run.smithi119.stdout:(11/13): udica-0.2.6-20.module+el8.9.0+20326+38 456 kB/s | 49 kB 00:00 2023-12-14T13:58:30.614 INFO:teuthology.orchestra.run.smithi119.stdout:(12/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 26 MB/s | 8.1 MB 00:00 2023-12-14T13:58:30.665 INFO:teuthology.orchestra.run.smithi119.stdout:(13/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 7.4 MB/s | 2.5 MB 00:00 2023-12-14T13:58:30.665 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-14T13:58:30.665 INFO:teuthology.orchestra.run.smithi119.stdout:Total 27 MB/s | 26 MB 00:00 2023-12-14T13:58:30.709 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-12-14T13:58:30.717 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-12-14T13:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-14T13:58:30.964 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-14T13:58:30.964 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-14T13:58:31.032 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-12-14T13:58:31.041 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-12-14T13:58:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-12-14T13:58:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2023-12-14T13:58:31.614 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-14T13:58:31.623 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-14T13:58:31.665 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-12-14T13:58:31.917 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2023-12-14T13:58:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2023-12-14T13:58:32.270 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-14T13:58:32.293 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2023-12-14T13:58:32.492 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2023-12-14T13:58:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2023-12-14T13:58:32.525 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2023-12-14T13:58:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2023-12-14T13:58:32.722 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2023-12-14T13:58:32.893 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2023-12-14T13:58:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2023-12-14T13:58:33.064 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2023-12-14T13:58:33.080 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2023-12-14T13:58:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2023-12-14T13:58:33.281 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2023-12-14T13:58:33.322 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2023-12-14T13:58:33.502 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2023-12-14T13:58:33.557 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2023-12-14T13:58:33.672 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2023-12-14T13:58:33.922 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2023-12-14T13:58:34.104 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T13:58:34.150 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2023-12-14T13:58:34.365 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T13:58:34.466 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T13:58:34.693 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T13:58:34.742 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2023-12-14T13:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T13:58:35.095 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2023-12-14T13:58:35.345 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T13:58:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2023-12-14T13:58:35.754 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2023-12-14T13:58:35.893 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2023-12-14T13:58:35.991 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2023-12-14T13:58:36.094 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T13:58:36.258 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2023-12-14T13:58:36.462 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T13:58:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T13:58:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2023-12-14T13:58:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-14T13:58:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2023-12-14T13:58:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2023-12-14T13:58:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2023-12-14T13:58:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2023-12-14T13:58:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2023-12-14T13:58:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T13:58:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T13:58:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2023-12-14T13:58:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2023-12-14T13:58:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2023-12-14T13:58:36.657 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2023-12-14T13:58:36.864 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2023-12-14T13:58:36.865 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2023-12-14T13:58:36.889 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2023-12-14T13:58:37.121 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T13:58:37.530 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T13:58:37.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2023-12-14T13:58:37.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-14T13:58:37.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2023-12-14T13:58:37.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2023-12-14T13:58:37.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2023-12-14T13:58:37.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2023-12-14T13:58:37.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2023-12-14T13:58:37.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T13:58:37.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T13:58:37.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2023-12-14T13:58:37.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2023-12-14T13:58:37.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2023-12-14T13:58:47.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2023-12-14T13:58:47.399 INFO:teuthology.orchestra.run.smithi119.stdout:Installed products updated. 2023-12-14T13:58:47.955 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:58:47.955 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-14T13:58:47.955 INFO:teuthology.orchestra.run.smithi119.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:47.955 INFO:teuthology.orchestra.run.smithi119.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:47.955 INFO:teuthology.orchestra.run.smithi119.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T13:58:47.955 INFO:teuthology.orchestra.run.smithi119.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:58:47.956 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-14T13:58:48.123 DEBUG:teuthology.parallel:result is None 2023-12-14T13:58:50.853 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2023-12-14T13:58:50.853 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-12-14T13:58:51.290 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2023-12-14T13:58:51.290 INFO:teuthology.orchestra.run.smithi081.stdout:Installed products updated. 2023-12-14T13:58:51.372 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-14T13:58:51.373 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:58:51.374 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-14T13:58:51.560 DEBUG:teuthology.parallel:result is None 2023-12-14T13:58:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:58:51.838 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2023-12-14T13:58:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T13:58:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T13:58:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-14T13:58:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-14T13:58:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T13:58:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2023-12-14T13:58:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-14T13:58:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:58:51.839 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-12-14T13:58:52.030 DEBUG:teuthology.parallel:result is None 2023-12-14T13:58:52.030 INFO:teuthology.run_tasks:Running task install... 2023-12-14T13:58:52.039 DEBUG:teuthology.task.install:project ceph 2023-12-14T13:58:52.039 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed'}} 2023-12-14T13:58:52.039 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed'} 2023-12-14T13:58:52.039 INFO:teuthology.task.install:Using flavor: default 2023-12-14T13:58:52.045 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-14T13:58:52.045 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-14T13:58:52.046 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'tag': None, 'wait_for_package': False} 2023-12-14T13:58:52.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T13:58:52.048 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'tag': None, 'wait_for_package': False} 2023-12-14T13:58:52.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T13:58:52.049 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'tag': None, 'wait_for_package': False} 2023-12-14T13:58:52.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T13:58:52.264 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/ 2023-12-14T13:58:52.265 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3905.g1faa3533 2023-12-14T13:58:52.280 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/ 2023-12-14T13:58:52.281 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3905.g1faa3533 2023-12-14T13:58:52.298 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/ 2023-12-14T13:58:52.298 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3905.g1faa3533 2023-12-14T13:58:52.377 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-14T13:58:52.377 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T13:58:52.377 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-14T13:58:52.391 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-14T13:58:52.391 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T13:58:52.391 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-14T13:58:52.411 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-14T13:58:52.411 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1faa353368ad4f5aeb56d7107b638336f58659ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-14T13:58:52.423 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-14T13:58:52.423 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1faa353368ad4f5aeb56d7107b638336f58659ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-14T13:58:52.464 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-14T13:58:52.464 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T13:58:52.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-14T13:58:52.483 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-14T13:58:52.492 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-14T13:58:52.492 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1faa353368ad4f5aeb56d7107b638336f58659ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-14T13:58:52.495 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-14T13:58:52.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-14T13:58:52.564 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-14T13:58:52.575 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-14T13:58:52.632 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2023-12-14T13:58:52.634 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2023-12-14T13:58:52.636 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-14T13:58:52.642 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2023-12-14T13:58:52.644 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2023-12-14T13:58:52.702 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2023-12-14T13:58:52.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2023-12-14T13:58:53.011 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:53.020 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:53.079 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:54.411 INFO:teuthology.orchestra.run.smithi119.stdout:52 files removed 2023-12-14T13:58:54.462 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-14T13:58:54.475 INFO:teuthology.orchestra.run.smithi069.stdout:52 files removed 2023-12-14T13:58:54.526 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-14T13:58:54.594 INFO:teuthology.orchestra.run.smithi081.stdout:52 files removed 2023-12-14T13:58:54.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-14T13:58:54.798 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:54.863 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:54.982 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-12-14T13:58:56.512 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 253 kB/s | 80 kB 00:00 2023-12-14T13:58:56.820 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 209 kB/s | 80 kB 00:00 2023-12-14T13:58:56.871 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-12-14T13:58:56.878 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 322 kB/s | 80 kB 00:00 2023-12-14T13:58:57.179 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-12-14T13:58:57.205 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 4.8 kB/s | 1.5 kB 00:00 2023-12-14T13:58:57.246 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-12-14T13:58:57.355 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-12-14T13:58:57.497 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2023-12-14T13:58:57.563 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2023-12-14T13:58:57.639 INFO:teuthology.orchestra.run.smithi069.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-12-14T13:58:57.714 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-12-14T13:58:58.264 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-12-14T13:58:58.798 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-12-14T13:59:00.067 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 16 MB 00:02 2023-12-14T13:59:01.781 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 405 kB/s | 24 kB 00:00 2023-12-14T13:59:02.340 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 359 kB/s | 24 kB 00:00 2023-12-14T13:59:03.075 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2023-12-14T13:59:03.125 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 58 MB 00:01 2023-12-14T13:59:03.606 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 472 kB/s | 24 kB 00:00 2023-12-14T13:59:04.883 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 58 MB 00:01 2023-12-14T13:59:05.810 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 52 MB/s | 64 MB 00:01 2023-12-14T13:59:13.326 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2023-12-14T13:59:15.434 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 12 MB/s | 8.8 MB 00:00 2023-12-14T13:59:16.203 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 58 MB 00:01 2023-12-14T13:59:16.318 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 MB/s | 64 MB 00:01 2023-12-14T13:59:18.360 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 64 MB 00:01 2023-12-14T13:59:30.790 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T13:59:30.791 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T13:59:30.808 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-14T13:59:30.810 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-14T13:59:30.811 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-14T13:59:30.812 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-14T13:59:30.815 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-14T13:59:30.819 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-14T13:59:30.820 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-14T13:59:30.867 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T13:59:30.869 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T13:59:30.887 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-14T13:59:30.888 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-14T13:59:30.890 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-14T13:59:30.891 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-14T13:59:30.894 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-14T13:59:30.898 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-14T13:59:30.900 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-14T13:59:31.027 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-14T13:59:31.041 INFO:teuthology.orchestra.run.smithi119.stdout:=========================================================================================================================== 2023-12-14T13:59:31.041 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout:=========================================================================================================================== 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.4 k 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 5.3 M 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 847 k 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 165 k 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 1.5 M 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 127 k 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 1.7 M 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 7.4 M 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 47 k 2023-12-14T13:59:31.042 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 13 M 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 41 M 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 265 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 83 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 258 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 18 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 31 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 771 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 139 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-14T13:59:31.043 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 811 k 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 197 k 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 370 k 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 364 k 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 107 k 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 94 k 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.4 M 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 179 k 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-14T13:59:31.044 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.7 M 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.6 M 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 710 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-14T13:59:31.045 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 22 M 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 23 k 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 2.3 M 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 240 k 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 4.6 M 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 18 M 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 15 k 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 24 k 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-14T13:59:31.046 INFO:teuthology.orchestra.run.smithi119.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 137 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 473 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.5 M 2023-12-14T13:59:31.047 INFO:teuthology.orchestra.run.smithi119.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-14T13:59:31.048 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 45 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 119 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-14T13:59:31.049 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T13:59:31.050 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-14T13:59:31.051 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-14T13:59:31.052 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-14T13:59:31.053 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-14T13:59:31.053 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling module streams: 2023-12-14T13:59:31.053 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql 10 2023-12-14T13:59:31.053 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:59:31.053 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-14T13:59:31.053 INFO:teuthology.orchestra.run.smithi119.stdout:=========================================================================================================================== 2023-12-14T13:59:31.053 INFO:teuthology.orchestra.run.smithi119.stdout:Install 129 Packages 2023-12-14T13:59:31.053 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 16 Packages 2023-12-14T13:59:31.053 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T13:59:31.054 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 205 M 2023-12-14T13:59:31.054 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-14T13:59:31.098 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout:=========================================================================================================================== 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout:=========================================================================================================================== 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.4 k 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 5.3 M 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 847 k 2023-12-14T13:59:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 165 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 1.5 M 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 127 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 1.7 M 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 7.4 M 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 47 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 13 M 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 41 M 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 265 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 83 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 258 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 18 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-14T13:59:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 31 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 771 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 139 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 811 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 197 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 370 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 364 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 107 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 94 k 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.4 M 2023-12-14T13:59:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 179 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.7 M 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.6 M 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 710 k 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-14T13:59:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 22 M 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 23 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 2.3 M 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 240 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 4.6 M 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 18 M 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 15 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 24 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-14T13:59:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 137 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 473 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.5 M 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-14T13:59:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-14T13:59:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 45 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 119 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T13:59:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-14T13:59:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-14T13:59:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling module streams: 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql 10 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout:=========================================================================================================================== 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout:Install 129 Packages 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 16 Packages 2023-12-14T13:59:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T13:59:31.123 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 205 M 2023-12-14T13:59:31.123 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-12-14T13:59:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:(1/145): ceph-18.0.0-3905.g1faa3533.el8.x86_64. 30 kB/s | 6.4 kB 00:00 2023-12-14T13:59:31.493 INFO:teuthology.orchestra.run.smithi119.stdout:(1/145): ceph-18.0.0-3905.g1faa3533.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-12-14T13:59:32.144 INFO:teuthology.orchestra.run.smithi081.stdout:(2/145): ceph-fuse-18.0.0-3905.g1faa3533.el8.x8 1.1 MB/s | 847 kB 00:00 2023-12-14T13:59:32.370 INFO:teuthology.orchestra.run.smithi081.stdout:(3/145): ceph-immutable-object-cache-18.0.0-390 735 kB/s | 165 kB 00:00 2023-12-14T13:59:32.597 INFO:teuthology.orchestra.run.smithi119.stdout:(2/145): ceph-fuse-18.0.0-3905.g1faa3533.el8.x8 767 kB/s | 847 kB 00:01 2023-12-14T13:59:33.081 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T13:59:33.082 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T13:59:33.100 INFO:teuthology.orchestra.run.smithi069.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-14T13:59:33.101 INFO:teuthology.orchestra.run.smithi069.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-14T13:59:33.103 INFO:teuthology.orchestra.run.smithi069.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-14T13:59:33.104 INFO:teuthology.orchestra.run.smithi069.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-14T13:59:33.107 INFO:teuthology.orchestra.run.smithi069.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-14T13:59:33.111 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-14T13:59:33.112 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-14T13:59:33.317 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-14T13:59:33.331 INFO:teuthology.orchestra.run.smithi069.stdout:=========================================================================================================================== 2023-12-14T13:59:33.331 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-12-14T13:59:33.331 INFO:teuthology.orchestra.run.smithi069.stdout:=========================================================================================================================== 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.4 k 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 5.3 M 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 847 k 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 165 k 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 1.5 M 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 127 k 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 1.7 M 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 7.4 M 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 47 k 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 13 M 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 41 M 2023-12-14T13:59:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 265 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 83 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 258 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 18 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 31 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 771 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 139 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-14T13:59:33.333 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 811 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 197 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 370 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 364 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 107 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 94 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.4 M 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 179 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T13:59:33.334 INFO:teuthology.orchestra.run.smithi069.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.7 M 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.6 M 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: openssl x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 710 k 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 22 M 2023-12-14T13:59:33.335 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 23 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 2.3 M 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 240 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 4.6 M 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 18 M 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 15 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 24 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 137 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-14T13:59:33.336 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 473 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.5 M 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-14T13:59:33.337 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 45 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 119 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-14T13:59:33.338 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-14T13:59:33.339 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T13:59:33.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-14T13:59:33.341 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling module streams: 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql 10 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout:=========================================================================================================================== 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout:Install 129 Packages 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 16 Packages 2023-12-14T13:59:33.342 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T13:59:33.343 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 205 M 2023-12-14T13:59:33.343 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-12-14T13:59:33.585 INFO:teuthology.orchestra.run.smithi069.stdout:(1/145): ceph-18.0.0-3905.g1faa3533.el8.x86_64. 36 kB/s | 6.4 kB 00:00 2023-12-14T13:59:33.943 INFO:teuthology.orchestra.run.smithi069.stdout:(2/145): ceph-fuse-18.0.0-3905.g1faa3533.el8.x8 2.3 MB/s | 847 kB 00:00 2023-12-14T13:59:34.035 INFO:teuthology.orchestra.run.smithi069.stdout:(3/145): ceph-immutable-object-cache-18.0.0-390 1.8 MB/s | 165 kB 00:00 2023-12-14T13:59:38.620 INFO:teuthology.orchestra.run.smithi119.stdout:(3/145): ceph-immutable-object-cache-18.0.0-390 27 kB/s | 165 kB 00:06 2023-12-14T13:59:38.693 INFO:teuthology.orchestra.run.smithi069.stdout:(4/145): ceph-base-18.0.0-3905.g1faa3533.el8.x8 1.0 MB/s | 5.3 MB 00:05 2023-12-14T13:59:39.434 INFO:teuthology.orchestra.run.smithi119.stdout:(4/145): ceph-base-18.0.0-3905.g1faa3533.el8.x8 662 kB/s | 5.3 MB 00:08 2023-12-14T13:59:40.177 INFO:teuthology.orchestra.run.smithi069.stdout:(5/145): ceph-mds-18.0.0-3905.g1faa3533.el8.x86 380 kB/s | 2.3 MB 00:06 2023-12-14T13:59:40.543 INFO:teuthology.orchestra.run.smithi119.stdout:(5/145): ceph-mds-18.0.0-3905.g1faa3533.el8.x86 1.2 MB/s | 2.3 MB 00:01 2023-12-14T13:59:40.584 INFO:teuthology.orchestra.run.smithi119.stdout:(6/145): ceph-mgr-18.0.0-3905.g1faa3533.el8.x86 1.3 MB/s | 1.5 MB 00:01 2023-12-14T13:59:40.653 INFO:teuthology.orchestra.run.smithi081.stdout:(4/145): ceph-base-18.0.0-3905.g1faa3533.el8.x8 576 kB/s | 5.3 MB 00:09 2023-12-14T13:59:40.703 INFO:teuthology.orchestra.run.smithi081.stdout:(5/145): ceph-mds-18.0.0-3905.g1faa3533.el8.x86 280 kB/s | 2.3 MB 00:08 2023-12-14T13:59:41.485 INFO:teuthology.orchestra.run.smithi069.stdout:(6/145): ceph-mgr-18.0.0-3905.g1faa3533.el8.x86 568 kB/s | 1.5 MB 00:02 2023-12-14T13:59:41.570 INFO:teuthology.orchestra.run.smithi081.stdout:(6/145): ceph-mgr-18.0.0-3905.g1faa3533.el8.x86 1.7 MB/s | 1.5 MB 00:00 2023-12-14T13:59:41.927 INFO:teuthology.orchestra.run.smithi069.stdout:(7/145): ceph-common-18.0.0-3905.g1faa3533.el8. 2.5 MB/s | 22 MB 00:08 2023-12-14T13:59:42.239 INFO:teuthology.orchestra.run.smithi081.stdout:(7/145): ceph-common-18.0.0-3905.g1faa3533.el8. 2.0 MB/s | 22 MB 00:11 2023-12-14T13:59:43.494 INFO:teuthology.orchestra.run.smithi069.stdout:(8/145): ceph-mon-18.0.0-3905.g1faa3533.el8.x86 1.4 MB/s | 4.6 MB 00:03 2023-12-14T13:59:43.611 INFO:teuthology.orchestra.run.smithi069.stdout:(9/145): ceph-selinux-18.0.0-3905.g1faa3533.el8 209 kB/s | 24 kB 00:00 2023-12-14T13:59:44.531 INFO:teuthology.orchestra.run.smithi081.stdout:(8/145): ceph-mon-18.0.0-3905.g1faa3533.el8.x86 1.2 MB/s | 4.6 MB 00:03 2023-12-14T13:59:44.593 INFO:teuthology.orchestra.run.smithi119.stdout:(7/145): ceph-mon-18.0.0-3905.g1faa3533.el8.x86 1.1 MB/s | 4.6 MB 00:04 2023-12-14T13:59:44.623 INFO:teuthology.orchestra.run.smithi081.stdout:(9/145): ceph-selinux-18.0.0-3905.g1faa3533.el8 265 kB/s | 24 kB 00:00 2023-12-14T13:59:46.111 INFO:teuthology.orchestra.run.smithi069.stdout:(10/145): ceph-radosgw-18.0.0-3905.g1faa3533.el 3.1 MB/s | 13 MB 00:04 2023-12-14T13:59:46.236 INFO:teuthology.orchestra.run.smithi069.stdout:(11/145): cephfs-mirror-18.0.0-3905.g1faa3533.e 2.0 MB/s | 258 kB 00:00 2023-12-14T13:59:46.295 INFO:teuthology.orchestra.run.smithi069.stdout:(12/145): libcephfs-devel-18.0.0-3905.g1faa3533 534 kB/s | 31 kB 00:00 2023-12-14T13:59:46.495 INFO:teuthology.orchestra.run.smithi069.stdout:(13/145): libcephfs2-18.0.0-3905.g1faa3533.el8. 3.8 MB/s | 771 kB 00:00 2023-12-14T13:59:46.562 INFO:teuthology.orchestra.run.smithi069.stdout:(14/145): libcephsqlite-18.0.0-3905.g1faa3533.e 2.0 MB/s | 137 kB 00:00 2023-12-14T13:59:46.660 INFO:teuthology.orchestra.run.smithi069.stdout:(15/145): librados-devel-18.0.0-3905.g1faa3533. 1.4 MB/s | 139 kB 00:00 2023-12-14T13:59:46.787 INFO:teuthology.orchestra.run.smithi069.stdout:(16/145): libradosstriper1-18.0.0-3905.g1faa353 3.6 MB/s | 473 kB 00:00 2023-12-14T13:59:47.513 INFO:teuthology.orchestra.run.smithi069.stdout:(17/145): librgw2-18.0.0-3905.g1faa3533.el8.x86 9.0 MB/s | 6.5 MB 00:00 2023-12-14T13:59:47.563 INFO:teuthology.orchestra.run.smithi069.stdout:(18/145): python3-ceph-argparse-18.0.0-3905.g1f 897 kB/s | 45 kB 00:00 2023-12-14T13:59:47.613 INFO:teuthology.orchestra.run.smithi069.stdout:(19/145): python3-ceph-common-18.0.0-3905.g1faa 2.3 MB/s | 119 kB 00:00 2023-12-14T13:59:47.664 INFO:teuthology.orchestra.run.smithi069.stdout:(20/145): python3-cephfs-18.0.0-3905.g1faa3533. 3.9 MB/s | 197 kB 00:00 2023-12-14T13:59:47.731 INFO:teuthology.orchestra.run.smithi069.stdout:(21/145): python3-rados-18.0.0-3905.g1faa3533.e 5.4 MB/s | 370 kB 00:00 2023-12-14T13:59:47.814 INFO:teuthology.orchestra.run.smithi069.stdout:(22/145): python3-rbd-18.0.0-3905.g1faa3533.el8 4.3 MB/s | 364 kB 00:00 2023-12-14T13:59:52.356 INFO:teuthology.orchestra.run.smithi069.stdout:(23/145): python3-rgw-18.0.0-3905.g1faa3533.el8 23 kB/s | 107 kB 00:04 2023-12-14T13:59:52.439 INFO:teuthology.orchestra.run.smithi069.stdout:(24/145): rbd-fuse-18.0.0-3905.g1faa3533.el8.x8 1.1 MB/s | 94 kB 00:00 2023-12-14T13:59:52.830 INFO:teuthology.orchestra.run.smithi081.stdout:(10/145): ceph-radosgw-18.0.0-3905.g1faa3533.el 1.2 MB/s | 13 MB 00:10 2023-12-14T13:59:53.114 INFO:teuthology.orchestra.run.smithi081.stdout:(11/145): cephfs-mirror-18.0.0-3905.g1faa3533.e 912 kB/s | 258 kB 00:00 2023-12-14T13:59:53.206 INFO:teuthology.orchestra.run.smithi081.stdout:(12/145): libcephfs-devel-18.0.0-3905.g1faa3533 340 kB/s | 31 kB 00:00 2023-12-14T13:59:53.615 INFO:teuthology.orchestra.run.smithi081.stdout:(13/145): libcephfs2-18.0.0-3905.g1faa3533.el8. 1.8 MB/s | 771 kB 00:00 2023-12-14T13:59:53.615 INFO:teuthology.orchestra.run.smithi069.stdout:(25/145): rbd-mirror-18.0.0-3905.g1faa3533.el8. 2.9 MB/s | 3.4 MB 00:01 2023-12-14T13:59:53.698 INFO:teuthology.orchestra.run.smithi081.stdout:(14/145): libcephsqlite-18.0.0-3905.g1faa3533.e 1.6 MB/s | 137 kB 00:00 2023-12-14T13:59:53.706 INFO:teuthology.orchestra.run.smithi069.stdout:(26/145): rbd-nbd-18.0.0-3905.g1faa3533.el8.x86 1.9 MB/s | 179 kB 00:00 2023-12-14T13:59:53.824 INFO:teuthology.orchestra.run.smithi081.stdout:(15/145): librados-devel-18.0.0-3905.g1faa3533. 1.1 MB/s | 139 kB 00:00 2023-12-14T13:59:53.890 INFO:teuthology.orchestra.run.smithi069.stdout:(27/145): ceph-grafana-dashboards-18.0.0-3905.g 126 kB/s | 23 kB 00:00 2023-12-14T13:59:53.990 INFO:teuthology.orchestra.run.smithi069.stdout:(28/145): ceph-mgr-cephadm-18.0.0-3905.g1faa353 1.2 MB/s | 127 kB 00:00 2023-12-14T13:59:54.207 INFO:teuthology.orchestra.run.smithi081.stdout:(16/145): libradosstriper1-18.0.0-3905.g1faa353 1.2 MB/s | 473 kB 00:00 2023-12-14T13:59:54.607 INFO:teuthology.orchestra.run.smithi069.stdout:(29/145): ceph-mgr-dashboard-18.0.0-3905.g1faa3 2.8 MB/s | 1.7 MB 00:00 2023-12-14T13:59:56.982 INFO:teuthology.orchestra.run.smithi081.stdout:(17/145): ceph-osd-18.0.0-3905.g1faa3533.el8.x8 1.1 MB/s | 18 MB 00:15 2023-12-14T13:59:57.074 INFO:teuthology.orchestra.run.smithi081.stdout:(18/145): python3-ceph-argparse-18.0.0-3905.g1f 489 kB/s | 45 kB 00:00 2023-12-14T13:59:57.199 INFO:teuthology.orchestra.run.smithi081.stdout:(19/145): python3-ceph-common-18.0.0-3905.g1faa 951 kB/s | 119 kB 00:00 2023-12-14T13:59:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:(20/145): python3-cephfs-18.0.0-3905.g1faa3533. 1.0 MB/s | 197 kB 00:00 2023-12-14T13:59:57.407 INFO:teuthology.orchestra.run.smithi069.stdout:(30/145): ceph-mgr-diskprediction-local-18.0.0- 2.6 MB/s | 7.4 MB 00:02 2023-12-14T13:59:57.591 INFO:teuthology.orchestra.run.smithi081.stdout:(21/145): python3-rados-18.0.0-3905.g1faa3533.e 1.8 MB/s | 370 kB 00:00 2023-12-14T13:59:57.607 INFO:teuthology.orchestra.run.smithi069.stdout:(31/145): ceph-mgr-modules-core-18.0.0-3905.g1f 1.2 MB/s | 240 kB 00:00 2023-12-14T13:59:57.699 INFO:teuthology.orchestra.run.smithi069.stdout:(32/145): ceph-mgr-rook-18.0.0-3905.g1faa3533.e 518 kB/s | 47 kB 00:00 2023-12-14T13:59:57.791 INFO:teuthology.orchestra.run.smithi069.stdout:(33/145): ceph-prometheus-alerts-18.0.0-3905.g1 159 kB/s | 15 kB 00:00 2023-12-14T13:59:57.792 INFO:teuthology.orchestra.run.smithi081.stdout:(22/145): python3-rbd-18.0.0-3905.g1faa3533.el8 1.8 MB/s | 364 kB 00:00 2023-12-14T13:59:57.900 INFO:teuthology.orchestra.run.smithi081.stdout:(23/145): python3-rgw-18.0.0-3905.g1faa3533.el8 986 kB/s | 107 kB 00:00 2023-12-14T13:59:57.950 INFO:teuthology.orchestra.run.smithi069.stdout:(34/145): ceph-volume-18.0.0-3905.g1faa3533.el8 1.6 MB/s | 265 kB 00:00 2023-12-14T13:59:58.000 INFO:teuthology.orchestra.run.smithi119.stdout:(8/145): ceph-osd-18.0.0-3905.g1faa3533.el8.x86 1.0 MB/s | 18 MB 00:17 2023-12-14T13:59:58.009 INFO:teuthology.orchestra.run.smithi081.stdout:(24/145): rbd-fuse-18.0.0-3905.g1faa3533.el8.x8 871 kB/s | 94 kB 00:00 2023-12-14T13:59:58.042 INFO:teuthology.orchestra.run.smithi069.stdout:(35/145): cephadm-18.0.0-3905.g1faa3533.el8.noa 910 kB/s | 83 kB 00:00 2023-12-14T13:59:58.092 INFO:teuthology.orchestra.run.smithi119.stdout:(9/145): ceph-selinux-18.0.0-3905.g1faa3533.el8 266 kB/s | 24 kB 00:00 2023-12-14T13:59:58.101 INFO:teuthology.orchestra.run.smithi081.stdout:(25/145): librgw2-18.0.0-3905.g1faa3533.el8.x86 1.7 MB/s | 6.5 MB 00:03 2023-12-14T13:59:58.118 INFO:teuthology.orchestra.run.smithi069.stdout:(36/145): cephfs-top-18.0.0-3905.g1faa3533.el8. 239 kB/s | 18 kB 00:00 2023-12-14T13:59:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:(26/145): rbd-nbd-18.0.0-3905.g1faa3533.el8.x86 1.1 MB/s | 179 kB 00:00 2023-12-14T13:59:58.368 INFO:teuthology.orchestra.run.smithi081.stdout:(27/145): ceph-grafana-dashboards-18.0.0-3905.g 231 kB/s | 23 kB 00:00 2023-12-14T13:59:58.434 INFO:teuthology.orchestra.run.smithi069.stdout:(37/145): gperftools-libs-2.7-9.el8.x86_64.rpm 968 kB/s | 306 kB 00:00 2023-12-14T13:59:58.485 INFO:teuthology.orchestra.run.smithi081.stdout:(28/145): ceph-mgr-cephadm-18.0.0-3905.g1faa353 1.1 MB/s | 127 kB 00:00 2023-12-14T13:59:58.493 INFO:teuthology.orchestra.run.smithi069.stdout:(38/145): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-12-14T13:59:58.560 INFO:teuthology.orchestra.run.smithi069.stdout:(39/145): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-12-14T13:59:58.827 INFO:teuthology.orchestra.run.smithi069.stdout:(40/145): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-12-14T13:59:58.877 INFO:teuthology.orchestra.run.smithi069.stdout:(41/145): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2023-12-14T13:59:59.144 INFO:teuthology.orchestra.run.smithi069.stdout:(42/145): python3-beautifulsoup4-4.6.3-2.el8.1. 694 kB/s | 185 kB 00:00 2023-12-14T13:59:59.361 INFO:teuthology.orchestra.run.smithi069.stdout:(43/145): ceph-osd-18.0.0-3905.g1faa3533.el8.x8 1.0 MB/s | 18 MB 00:17 2023-12-14T13:59:59.387 INFO:teuthology.orchestra.run.smithi069.stdout:(44/145): python3-cachetools-3.1.1-4.el8.noarch 136 kB/s | 33 kB 00:00 2023-12-14T13:59:59.512 INFO:teuthology.orchestra.run.smithi069.stdout:(45/145): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-12-14T13:59:59.554 INFO:teuthology.orchestra.run.smithi069.stdout:(46/145): python3-certifi-2018.10.15-7.el8.noar 85 kB/s | 16 kB 00:00 2023-12-14T13:59:59.646 INFO:teuthology.orchestra.run.smithi069.stdout:(47/145): python3-google-auth-1.1.1-10.el8.noar 888 kB/s | 81 kB 00:00 2023-12-14T13:59:59.693 INFO:teuthology.orchestra.run.smithi081.stdout:(29/145): ceph-mgr-dashboard-18.0.0-3905.g1faa3 1.4 MB/s | 1.7 MB 00:01 2023-12-14T13:59:59.696 INFO:teuthology.orchestra.run.smithi069.stdout:(48/145): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2023-12-14T13:59:59.730 INFO:teuthology.orchestra.run.smithi069.stdout:(49/145): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-12-14T13:59:59.755 INFO:teuthology.orchestra.run.smithi069.stdout:(50/145): python3-jaraco-functools-2.0-4.el8.no 301 kB/s | 18 kB 00:00 2023-12-14T13:59:59.805 INFO:teuthology.orchestra.run.smithi069.stdout:(51/145): python3-logutils-0.3.5-11.el8.noarch. 974 kB/s | 49 kB 00:00 2023-12-14T13:59:59.842 INFO:teuthology.orchestra.run.smithi081.stdout:(30/145): rbd-mirror-18.0.0-3905.g1faa3533.el8. 1.9 MB/s | 3.4 MB 00:01 2023-12-14T13:59:59.914 INFO:teuthology.orchestra.run.smithi069.stdout:(52/145): python3-more-itertools-7.2.0-3.el8.no 542 kB/s | 59 kB 00:00 2023-12-14T13:59:59.947 INFO:teuthology.orchestra.run.smithi069.stdout:(53/145): python3-kubernetes-11.0.0-6.el8.noarc 5.4 MB/s | 1.2 MB 00:00 2023-12-14T13:59:59.998 INFO:teuthology.orchestra.run.smithi069.stdout:(54/145): python3-natsort-7.1.1-2.el8.noarch.rp 721 kB/s | 60 kB 00:00 2023-12-14T14:00:00.023 INFO:teuthology.orchestra.run.smithi069.stdout:(55/145): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-12-14T14:00:00.035 INFO:teuthology.orchestra.run.smithi081.stdout:(31/145): ceph-mgr-modules-core-18.0.0-3905.g1f 1.2 MB/s | 240 kB 00:00 2023-12-14T14:00:00.048 INFO:teuthology.orchestra.run.smithi069.stdout:(56/145): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-12-14T14:00:00.082 INFO:teuthology.orchestra.run.smithi069.stdout:(57/145): python3-repoze-lru-0.7-6.el8.noarch.r 573 kB/s | 34 kB 00:00 2023-12-14T14:00:00.140 INFO:teuthology.orchestra.run.smithi069.stdout:(58/145): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-12-14T14:00:00.153 INFO:teuthology.orchestra.run.smithi081.stdout:(32/145): ceph-mgr-rook-18.0.0-3905.g1faa3533.e 406 kB/s | 47 kB 00:00 2023-12-14T14:00:00.199 INFO:teuthology.orchestra.run.smithi069.stdout:(59/145): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-12-14T14:00:00.224 INFO:teuthology.orchestra.run.smithi069.stdout:(60/145): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2023-12-14T14:00:00.249 INFO:teuthology.orchestra.run.smithi069.stdout:(61/145): python3-singledispatch-3.4.0.3-18.el8 479 kB/s | 24 kB 00:00 2023-12-14T14:00:00.270 INFO:teuthology.orchestra.run.smithi081.stdout:(33/145): ceph-prometheus-alerts-18.0.0-3905.g1 124 kB/s | 15 kB 00:00 2023-12-14T14:00:00.283 INFO:teuthology.orchestra.run.smithi069.stdout:(62/145): python3-tempora-1.14.1-5.el8.noarch.r 499 kB/s | 29 kB 00:00 2023-12-14T14:00:00.317 INFO:teuthology.orchestra.run.smithi069.stdout:(63/145): python3-trustme-0.6.0-4.el8.noarch.rp 409 kB/s | 27 kB 00:00 2023-12-14T14:00:00.350 INFO:teuthology.orchestra.run.smithi069.stdout:(64/145): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2023-12-14T14:00:00.409 INFO:teuthology.orchestra.run.smithi069.stdout:(65/145): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-12-14T14:00:00.478 INFO:teuthology.orchestra.run.smithi081.stdout:(34/145): ceph-volume-18.0.0-3905.g1faa3533.el8 1.2 MB/s | 265 kB 00:00 2023-12-14T14:00:00.493 INFO:teuthology.orchestra.run.smithi069.stdout:(66/145): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-12-14T14:00:00.518 INFO:teuthology.orchestra.run.smithi069.stdout:(67/145): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2023-12-14T14:00:00.543 INFO:teuthology.orchestra.run.smithi069.stdout:(68/145): python3-zc-lockfile-2.0-2.el8.noarch. 457 kB/s | 23 kB 00:00 2023-12-14T14:00:00.577 INFO:teuthology.orchestra.run.smithi069.stdout:(69/145): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2023-12-14T14:00:00.817 INFO:teuthology.orchestra.run.smithi119.stdout:(10/145): ceph-radosgw-18.0.0-3905.g1faa3533.el 822 kB/s | 13 MB 00:16 2023-12-14T14:00:00.854 INFO:teuthology.orchestra.run.smithi081.stdout:(35/145): ceph-test-18.0.0-3905.g1faa3533.el8.x 2.5 MB/s | 41 MB 00:16 2023-12-14T14:00:00.869 INFO:teuthology.orchestra.run.smithi069.stdout:(70/145): python3-jsonpointer-1.10-11.el8.noarc 69 kB/s | 20 kB 00:00 2023-12-14T14:00:00.879 INFO:teuthology.orchestra.run.smithi081.stdout:(36/145): cephadm-18.0.0-3905.g1faa3533.el8.noa 208 kB/s | 83 kB 00:00 2023-12-14T14:00:00.929 INFO:teuthology.orchestra.run.smithi081.stdout:(37/145): cephfs-top-18.0.0-3905.g1faa3533.el8. 240 kB/s | 18 kB 00:00 2023-12-14T14:00:01.050 INFO:teuthology.orchestra.run.smithi119.stdout:(11/145): cephfs-mirror-18.0.0-3905.g1faa3533.e 1.1 MB/s | 258 kB 00:00 2023-12-14T14:00:01.071 INFO:teuthology.orchestra.run.smithi081.stdout:(38/145): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-12-14T14:00:01.086 INFO:teuthology.orchestra.run.smithi069.stdout:(71/145): python3-prettytable-0.7.2-14.el8.noar 203 kB/s | 44 kB 00:00 2023-12-14T14:00:01.096 INFO:teuthology.orchestra.run.smithi081.stdout:(39/145): liboath-2.6.2-3.el8.x86_64.rpm 352 kB/s | 59 kB 00:00 2023-12-14T14:00:01.122 INFO:teuthology.orchestra.run.smithi081.stdout:(40/145): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-12-14T14:00:01.150 INFO:teuthology.orchestra.run.smithi119.stdout:(12/145): libcephfs-devel-18.0.0-3905.g1faa3533 310 kB/s | 31 kB 00:00 2023-12-14T14:00:01.164 INFO:teuthology.orchestra.run.smithi081.stdout:(41/145): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-12-14T14:00:01.214 INFO:teuthology.orchestra.run.smithi081.stdout:(42/145): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-12-14T14:00:01.239 INFO:teuthology.orchestra.run.smithi081.stdout:(43/145): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2023-12-14T14:00:01.265 INFO:teuthology.orchestra.run.smithi081.stdout:(44/145): python3-cachetools-3.1.1-4.el8.noarch 658 kB/s | 33 kB 00:00 2023-12-14T14:00:01.290 INFO:teuthology.orchestra.run.smithi081.stdout:(45/145): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-12-14T14:00:01.295 INFO:teuthology.orchestra.run.smithi069.stdout:(72/145): python3-pyasn1-modules-0.3.7-6.el8.no 528 kB/s | 110 kB 00:00 2023-12-14T14:00:01.315 INFO:teuthology.orchestra.run.smithi081.stdout:(46/145): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-12-14T14:00:01.374 INFO:teuthology.orchestra.run.smithi081.stdout:(47/145): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-12-14T14:00:01.391 INFO:teuthology.orchestra.run.smithi081.stdout:(48/145): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-12-14T14:00:01.404 INFO:teuthology.orchestra.run.smithi069.stdout:(73/145): thrift-0.13.0-2.el8.x86_64.rpm 2.0 MB/s | 1.7 MB 00:00 2023-12-14T14:00:01.441 INFO:teuthology.orchestra.run.smithi081.stdout:(49/145): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-12-14T14:00:01.466 INFO:teuthology.orchestra.run.smithi081.stdout:(50/145): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-12-14T14:00:01.520 INFO:teuthology.orchestra.run.smithi069.stdout:(74/145): python3-jsonpatch-1.21-2.el8.noarch.r 118 kB/s | 27 kB 00:00 2023-12-14T14:00:01.525 INFO:teuthology.orchestra.run.smithi081.stdout:(51/145): python3-kubernetes-11.0.0-6.el8.noarc 14 MB/s | 1.2 MB 00:00 2023-12-14T14:00:01.550 INFO:teuthology.orchestra.run.smithi081.stdout:(52/145): python3-logutils-0.3.5-11.el8.noarch. 584 kB/s | 49 kB 00:00 2023-12-14T14:00:01.575 INFO:teuthology.orchestra.run.smithi081.stdout:(53/145): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-12-14T14:00:01.609 INFO:teuthology.orchestra.run.smithi081.stdout:(54/145): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-12-14T14:00:01.634 INFO:teuthology.orchestra.run.smithi081.stdout:(55/145): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-12-14T14:00:01.660 INFO:teuthology.orchestra.run.smithi081.stdout:(56/145): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-12-14T14:00:01.679 INFO:teuthology.orchestra.run.smithi069.stdout:(75/145): python3-pyasn1-0.3.7-6.el8.noarch.rpm 459 kB/s | 126 kB 00:00 2023-12-14T14:00:01.693 INFO:teuthology.orchestra.run.smithi081.stdout:(57/145): python3-repoze-lru-0.7-6.el8.noarch.r 576 kB/s | 34 kB 00:00 2023-12-14T14:00:01.734 INFO:teuthology.orchestra.run.smithi119.stdout:(13/145): libcephfs2-18.0.0-3905.g1faa3533.el8. 1.3 MB/s | 771 kB 00:00 2023-12-14T14:00:01.743 INFO:teuthology.orchestra.run.smithi081.stdout:(58/145): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-12-14T14:00:01.769 INFO:teuthology.orchestra.run.smithi081.stdout:(59/145): python3-rsa-4.9-2.el8.noarch.rpm 853 kB/s | 64 kB 00:00 2023-12-14T14:00:01.794 INFO:teuthology.orchestra.run.smithi081.stdout:(60/145): python3-simplegeneric-0.8.1-17.el8.no 372 kB/s | 19 kB 00:00 2023-12-14T14:00:01.828 INFO:teuthology.orchestra.run.smithi081.stdout:(61/145): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2023-12-14T14:00:01.853 INFO:teuthology.orchestra.run.smithi081.stdout:(62/145): python3-tempora-1.14.1-5.el8.noarch.r 497 kB/s | 29 kB 00:00 2023-12-14T14:00:01.878 INFO:teuthology.orchestra.run.smithi081.stdout:(63/145): python3-trustme-0.6.0-4.el8.noarch.rp 546 kB/s | 27 kB 00:00 2023-12-14T14:00:01.901 INFO:teuthology.orchestra.run.smithi119.stdout:(14/145): libcephsqlite-18.0.0-3905.g1faa3533.e 824 kB/s | 137 kB 00:00 2023-12-14T14:00:01.912 INFO:teuthology.orchestra.run.smithi069.stdout:(76/145): python3-werkzeug-0.12.2-4.el8.noarch. 1.1 MB/s | 457 kB 00:00 2023-12-14T14:00:01.912 INFO:teuthology.orchestra.run.smithi081.stdout:(64/145): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2023-12-14T14:00:01.937 INFO:teuthology.orchestra.run.smithi081.stdout:(65/145): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-12-14T14:00:01.963 INFO:teuthology.orchestra.run.smithi081.stdout:(66/145): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-12-14T14:00:01.988 INFO:teuthology.orchestra.run.smithi081.stdout:(67/145): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-12-14T14:00:02.004 INFO:teuthology.orchestra.run.smithi069.stdout:(77/145): bison-3.0.4-10.el8.x86_64.rpm 2.1 MB/s | 688 kB 00:00 2023-12-14T14:00:02.013 INFO:teuthology.orchestra.run.smithi081.stdout:(68/145): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-12-14T14:00:02.038 INFO:teuthology.orchestra.run.smithi081.stdout:(69/145): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-12-14T14:00:02.103 INFO:teuthology.orchestra.run.smithi081.stdout:(70/145): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-12-14T14:00:02.143 INFO:teuthology.orchestra.run.smithi119.stdout:(15/145): ceph-common-18.0.0-3905.g1faa3533.el8 715 kB/s | 22 MB 00:30 2023-12-14T14:00:02.146 INFO:teuthology.orchestra.run.smithi069.stdout:(78/145): flex-2.6.1-9.el8.x86_64.rpm 1.3 MB/s | 320 kB 00:00 2023-12-14T14:00:02.168 INFO:teuthology.orchestra.run.smithi119.stdout:(16/145): librados-devel-18.0.0-3905.g1faa3533. 520 kB/s | 139 kB 00:00 2023-12-14T14:00:02.214 INFO:teuthology.orchestra.run.smithi081.stdout:(71/145): libverto-devel-0.3.0-5.el8.x86_64.rpm 102 kB/s | 18 kB 00:00 2023-12-14T14:00:02.240 INFO:teuthology.orchestra.run.smithi081.stdout:(72/145): python3-jwt-1.6.1-2.el8.noarch.rpm 327 kB/s | 43 kB 00:00 2023-12-14T14:00:02.263 INFO:teuthology.orchestra.run.smithi069.stdout:(79/145): libtool-2.4.6-25.el8.x86_64.rpm 2.7 MB/s | 709 kB 00:00 2023-12-14T14:00:02.365 INFO:teuthology.orchestra.run.smithi081.stdout:(73/145): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2023-12-14T14:00:02.372 INFO:teuthology.orchestra.run.smithi069.stdout:(80/145): python3-markupsafe-0.23-19.el8.x86_64 172 kB/s | 39 kB 00:00 2023-12-14T14:00:02.460 INFO:teuthology.orchestra.run.smithi119.stdout:(17/145): libradosstriper1-18.0.0-3905.g1faa353 1.5 MB/s | 473 kB 00:00 2023-12-14T14:00:02.478 INFO:teuthology.orchestra.run.smithi081.stdout:(74/145): python3-pycparser-2.14-14.el8.noarch. 458 kB/s | 109 kB 00:00 2023-12-14T14:00:02.489 INFO:teuthology.orchestra.run.smithi069.stdout:(81/145): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2023-12-14T14:00:02.515 INFO:teuthology.orchestra.run.smithi081.stdout:(75/145): python3-requests-oauthlib-1.0.0-1.el8 284 kB/s | 43 kB 00:00 2023-12-14T14:00:02.568 INFO:teuthology.orchestra.run.smithi119.stdout:(18/145): python3-ceph-argparse-18.0.0-3905.g1f 413 kB/s | 45 kB 00:00 2023-12-14T14:00:02.614 INFO:teuthology.orchestra.run.smithi069.stdout:(82/145): uuid-1.6.2-43.el8.x86_64.rpm 512 kB/s | 64 kB 00:00 2023-12-14T14:00:02.616 INFO:teuthology.orchestra.run.smithi081.stdout:(76/145): libaio-devel-0.3.112-1.el8.x86_64.rpm 136 kB/s | 19 kB 00:00 2023-12-14T14:00:02.669 INFO:teuthology.orchestra.run.smithi119.stdout:(19/145): python3-ceph-common-18.0.0-3905.g1faa 1.2 MB/s | 119 kB 00:00 2023-12-14T14:00:02.714 INFO:teuthology.orchestra.run.smithi069.stdout:(83/145): oniguruma-6.8.2-2.el8.x86_64.rpm 548 kB/s | 187 kB 00:00 2023-12-14T14:00:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:(77/145): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-12-14T14:00:02.848 INFO:teuthology.orchestra.run.smithi069.stdout:(84/145): python3-pyOpenSSL-19.0.0-1.el8.noarch 443 kB/s | 103 kB 00:00 2023-12-14T14:00:02.852 INFO:teuthology.orchestra.run.smithi119.stdout:(20/145): python3-cephfs-18.0.0-3905.g1faa3533. 1.0 MB/s | 197 kB 00:00 2023-12-14T14:00:02.908 INFO:teuthology.orchestra.run.smithi081.stdout:(78/145): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2023-12-14T14:00:03.050 INFO:teuthology.orchestra.run.smithi081.stdout:(79/145): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-12-14T14:00:03.119 INFO:teuthology.orchestra.run.smithi119.stdout:(21/145): python3-rados-18.0.0-3905.g1faa3533.e 1.4 MB/s | 370 kB 00:00 2023-12-14T14:00:03.167 INFO:teuthology.orchestra.run.smithi081.stdout:(80/145): libselinux-devel-2.9-5.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2023-12-14T14:00:03.173 INFO:teuthology.orchestra.run.smithi069.stdout:(85/145): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-12-14T14:00:03.309 INFO:teuthology.orchestra.run.smithi081.stdout:(81/145): keyutils-libs-devel-1.5.10-9.el8.x86_ 340 kB/s | 48 kB 00:00 2023-12-14T14:00:03.315 INFO:teuthology.orchestra.run.smithi069.stdout:(86/145): python3-scipy-1.0.0-21.module+el8.5.0 23 MB/s | 14 MB 00:00 2023-12-14T14:00:03.336 INFO:teuthology.orchestra.run.smithi119.stdout:(22/145): python3-rbd-18.0.0-3905.g1faa3533.el8 1.6 MB/s | 364 kB 00:00 2023-12-14T14:00:03.382 INFO:teuthology.orchestra.run.smithi069.stdout:(87/145): python3-jinja2-2.10.1-3.el8.noarch.rp 2.5 MB/s | 538 kB 00:00 2023-12-14T14:00:03.420 INFO:teuthology.orchestra.run.smithi119.stdout:(23/145): python3-rgw-18.0.0-3905.g1faa3533.el8 1.3 MB/s | 107 kB 00:00 2023-12-14T14:00:03.476 INFO:teuthology.orchestra.run.smithi081.stdout:(82/145): ceph-mgr-diskprediction-local-18.0.0- 2.0 MB/s | 7.4 MB 00:03 2023-12-14T14:00:03.501 INFO:teuthology.orchestra.run.smithi081.stdout:(83/145): libsepol-devel-2.9-3.el8.x86_64.rpm 453 kB/s | 87 kB 00:00 2023-12-14T14:00:03.512 INFO:teuthology.orchestra.run.smithi119.stdout:(24/145): rbd-fuse-18.0.0-3905.g1faa3533.el8.x8 1.0 MB/s | 94 kB 00:00 2023-12-14T14:00:03.590 INFO:teuthology.orchestra.run.smithi069.stdout:(88/145): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-12-14T14:00:03.616 INFO:teuthology.orchestra.run.smithi069.stdout:(89/145): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2023-12-14T14:00:03.626 INFO:teuthology.orchestra.run.smithi081.stdout:(84/145): libcom_err-devel-1.45.6-4.el8.x86_64. 323 kB/s | 39 kB 00:00 2023-12-14T14:00:03.652 INFO:teuthology.orchestra.run.smithi081.stdout:(85/145): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 329 kB/s | 58 kB 00:00 2023-12-14T14:00:03.774 INFO:teuthology.orchestra.run.smithi069.stdout:(90/145): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2023-12-14T14:00:04.663 INFO:teuthology.orchestra.run.smithi119.stdout:(25/145): rbd-mirror-18.0.0-3905.g1faa3533.el8. 3.0 MB/s | 3.4 MB 00:01 2023-12-14T14:00:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:(26/145): rbd-nbd-18.0.0-3905.g1faa3533.el8.x86 2.3 MB/s | 179 kB 00:00 2023-12-14T14:00:04.793 INFO:teuthology.orchestra.run.smithi081.stdout:(86/145): fuse-2.9.7-17.el8.x86_64.rpm 73 kB/s | 83 kB 00:01 2023-12-14T14:00:04.804 INFO:teuthology.orchestra.run.smithi119.stdout:(27/145): ceph-grafana-dashboards-18.0.0-3905.g 346 kB/s | 23 kB 00:00 2023-12-14T14:00:04.863 INFO:teuthology.orchestra.run.smithi119.stdout:(28/145): ceph-mgr-cephadm-18.0.0-3905.g1faa353 2.1 MB/s | 127 kB 00:00 2023-12-14T14:00:05.358 INFO:teuthology.orchestra.run.smithi069.stdout:(91/145): python3-numpy-f2py-1.14.3-10.el8.x86_ 127 kB/s | 225 kB 00:01 2023-12-14T14:00:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:(29/145): ceph-mgr-dashboard-18.0.0-3905.g1faa3 3.2 MB/s | 1.7 MB 00:00 2023-12-14T14:00:05.502 INFO:teuthology.orchestra.run.smithi081.stdout:(87/145): openssl-devel-1.1.1k-9.el8_7.x86_64.r 1.2 MB/s | 2.3 MB 00:01 2023-12-14T14:00:05.592 INFO:teuthology.orchestra.run.smithi069.stdout:(92/145): openblas-threads-0.3.15-6.el8.x86_64. 2.9 MB/s | 5.2 MB 00:01 2023-12-14T14:00:05.844 INFO:teuthology.orchestra.run.smithi081.stdout:(88/145): libgfortran-8.5.0-20.el8.x86_64.rpm 614 kB/s | 645 kB 00:01 2023-12-14T14:00:05.938 INFO:teuthology.orchestra.run.smithi119.stdout:(30/145): librgw2-18.0.0-3905.g1faa3533.el8.x86 1.7 MB/s | 6.5 MB 00:03 2023-12-14T14:00:06.322 INFO:teuthology.orchestra.run.smithi119.stdout:(31/145): ceph-test-18.0.0-3905.g1faa3533.el8.x 4.9 MB/s | 41 MB 00:08 2023-12-14T14:00:06.347 INFO:teuthology.orchestra.run.smithi119.stdout:(32/145): ceph-mgr-modules-core-18.0.0-3905.g1f 588 kB/s | 240 kB 00:00 2023-12-14T14:00:06.372 INFO:teuthology.orchestra.run.smithi119.stdout:(33/145): ceph-mgr-rook-18.0.0-3905.g1faa3533.e 951 kB/s | 47 kB 00:00 2023-12-14T14:00:06.377 INFO:teuthology.orchestra.run.smithi081.stdout:(89/145): libquadmath-8.5.0-20.el8.x86_64.rpm 197 kB/s | 172 kB 00:00 2023-12-14T14:00:06.398 INFO:teuthology.orchestra.run.smithi119.stdout:(34/145): ceph-prometheus-alerts-18.0.0-3905.g1 290 kB/s | 15 kB 00:00 2023-12-14T14:00:06.448 INFO:teuthology.orchestra.run.smithi119.stdout:(35/145): ceph-volume-18.0.0-3905.g1faa3533.el8 3.4 MB/s | 265 kB 00:00 2023-12-14T14:00:06.473 INFO:teuthology.orchestra.run.smithi119.stdout:(36/145): cephadm-18.0.0-3905.g1faa3533.el8.noa 1.1 MB/s | 83 kB 00:00 2023-12-14T14:00:06.490 INFO:teuthology.orchestra.run.smithi119.stdout:(37/145): cephfs-top-18.0.0-3905.g1faa3533.el8. 431 kB/s | 18 kB 00:00 2023-12-14T14:00:06.492 INFO:teuthology.orchestra.run.smithi069.stdout:(93/145): python3-mako-1.0.6-14.el8.noarch.rpm 138 kB/s | 157 kB 00:01 2023-12-14T14:00:06.803 INFO:teuthology.orchestra.run.smithi081.stdout:(90/145): libzstd-devel-1.4.4-1.el8.x86_64.rpm 10 kB/s | 44 kB 00:04 2023-12-14T14:00:06.841 INFO:teuthology.orchestra.run.smithi119.stdout:(38/145): ceph-mgr-diskprediction-local-18.0.0- 5.2 MB/s | 7.4 MB 00:01 2023-12-14T14:00:07.049 INFO:teuthology.orchestra.run.smithi119.stdout:(39/145): libunwind-1.3.1-3.el8.x86_64.rpm 361 kB/s | 75 kB 00:00 2023-12-14T14:00:07.099 INFO:teuthology.orchestra.run.smithi119.stdout:(40/145): liboath-2.6.2-3.el8.x86_64.rpm 97 kB/s | 59 kB 00:00 2023-12-14T14:00:07.128 INFO:teuthology.orchestra.run.smithi081.stdout:(91/145): libuuid-devel-2.32.1-43.el8.x86_64.rp 78 kB/s | 100 kB 00:01 2023-12-14T14:00:07.216 INFO:teuthology.orchestra.run.smithi119.stdout:(41/145): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-12-14T14:00:07.242 INFO:teuthology.orchestra.run.smithi119.stdout:(42/145): gperftools-libs-2.7-9.el8.x86_64.rpm 399 kB/s | 306 kB 00:00 2023-12-14T14:00:07.267 INFO:teuthology.orchestra.run.smithi119.stdout:(43/145): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-12-14T14:00:07.287 INFO:teuthology.orchestra.run.smithi081.stdout:(92/145): python3-cffi-1.11.5-6.el8.x86_64.rpm 261 kB/s | 238 kB 00:00 2023-12-14T14:00:07.317 INFO:teuthology.orchestra.run.smithi119.stdout:(44/145): python3-cachetools-3.1.1-4.el8.noarch 438 kB/s | 33 kB 00:00 2023-12-14T14:00:07.342 INFO:teuthology.orchestra.run.smithi119.stdout:(45/145): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-12-14T14:00:07.368 INFO:teuthology.orchestra.run.smithi119.stdout:(46/145): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-12-14T14:00:07.380 INFO:teuthology.orchestra.run.smithi069.stdout:(94/145): openblas-0.3.15-6.el8.x86_64.rpm 2.8 MB/s | 5.0 MB 00:01 2023-12-14T14:00:07.393 INFO:teuthology.orchestra.run.smithi119.stdout:(47/145): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-12-14T14:00:07.418 INFO:teuthology.orchestra.run.smithi119.stdout:(48/145): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2023-12-14T14:00:07.443 INFO:teuthology.orchestra.run.smithi119.stdout:(49/145): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-12-14T14:00:07.469 INFO:teuthology.orchestra.run.smithi119.stdout:(50/145): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-12-14T14:00:07.494 INFO:teuthology.orchestra.run.smithi119.stdout:(51/145): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-12-14T14:00:07.544 INFO:teuthology.orchestra.run.smithi119.stdout:(52/145): python3-logutils-0.3.5-11.el8.noarch. 649 kB/s | 49 kB 00:00 2023-12-14T14:00:07.570 INFO:teuthology.orchestra.run.smithi119.stdout:(53/145): python3-more-itertools-7.2.0-3.el8.no 782 kB/s | 59 kB 00:00 2023-12-14T14:00:07.645 INFO:teuthology.orchestra.run.smithi119.stdout:(54/145): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2023-12-14T14:00:07.670 INFO:teuthology.orchestra.run.smithi119.stdout:(55/145): python3-natsort-7.1.1-2.el8.noarch.rp 480 kB/s | 60 kB 00:00 2023-12-14T14:00:07.695 INFO:teuthology.orchestra.run.smithi119.stdout:(56/145): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-12-14T14:00:07.721 INFO:teuthology.orchestra.run.smithi119.stdout:(57/145): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-12-14T14:00:07.746 INFO:teuthology.orchestra.run.smithi119.stdout:(58/145): python3-repoze-lru-0.7-6.el8.noarch.r 445 kB/s | 34 kB 00:00 2023-12-14T14:00:07.780 INFO:teuthology.orchestra.run.smithi119.stdout:(59/145): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-12-14T14:00:07.805 INFO:teuthology.orchestra.run.smithi119.stdout:(60/145): python3-rsa-4.9-2.el8.noarch.rpm 763 kB/s | 64 kB 00:00 2023-12-14T14:00:07.830 INFO:teuthology.orchestra.run.smithi119.stdout:(61/145): python3-simplegeneric-0.8.1-17.el8.no 223 kB/s | 19 kB 00:00 2023-12-14T14:00:07.864 INFO:teuthology.orchestra.run.smithi119.stdout:(62/145): python3-singledispatch-3.4.0.3-18.el8 285 kB/s | 24 kB 00:00 2023-12-14T14:00:07.889 INFO:teuthology.orchestra.run.smithi119.stdout:(63/145): python3-tempora-1.14.1-5.el8.noarch.r 349 kB/s | 29 kB 00:00 2023-12-14T14:00:07.915 INFO:teuthology.orchestra.run.smithi119.stdout:(64/145): python3-trustme-0.6.0-4.el8.noarch.rp 328 kB/s | 27 kB 00:00 2023-12-14T14:00:07.957 INFO:teuthology.orchestra.run.smithi119.stdout:(65/145): python3-waitress-1.4.3-1.el8.noarch.r 2.7 MB/s | 255 kB 00:00 2023-12-14T14:00:07.982 INFO:teuthology.orchestra.run.smithi119.stdout:(66/145): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2023-12-14T14:00:08.007 INFO:teuthology.orchestra.run.smithi119.stdout:(67/145): python3-websocket-client-0.56.0-5.el8 665 kB/s | 61 kB 00:00 2023-12-14T14:00:08.032 INFO:teuthology.orchestra.run.smithi119.stdout:(68/145): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-12-14T14:00:08.036 INFO:teuthology.orchestra.run.smithi081.stdout:(93/145): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 80 kB/s | 73 kB 00:00 2023-12-14T14:00:08.080 INFO:teuthology.orchestra.run.smithi119.stdout:(69/145): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-12-14T14:00:08.108 INFO:teuthology.orchestra.run.smithi119.stdout:(70/145): python3-zc-lockfile-2.0-2.el8.noarch. 183 kB/s | 23 kB 00:00 2023-12-14T14:00:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:(94/145): python3-cryptography-3.2.1-6.el8.x86_ 424 kB/s | 559 kB 00:01 2023-12-14T14:00:08.225 INFO:teuthology.orchestra.run.smithi119.stdout:(71/145): python3-jsonpointer-1.10-11.el8.noarc 138 kB/s | 20 kB 00:00 2023-12-14T14:00:08.246 INFO:teuthology.orchestra.run.smithi081.stdout:(95/145): NetworkManager-initscripts-updown-1.4 150 kB/s | 143 kB 00:00 2023-12-14T14:00:08.250 INFO:teuthology.orchestra.run.smithi119.stdout:(72/145): python3-prettytable-0.7.2-14.el8.noar 310 kB/s | 44 kB 00:00 2023-12-14T14:00:08.292 INFO:teuthology.orchestra.run.smithi119.stdout:(73/145): thrift-0.13.0-2.el8.x86_64.rpm 6.1 MB/s | 1.7 MB 00:00 2023-12-14T14:00:08.326 INFO:teuthology.orchestra.run.smithi119.stdout:(74/145): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2023-12-14T14:00:08.359 INFO:teuthology.orchestra.run.smithi119.stdout:(75/145): python3-jsonpatch-1.21-2.el8.noarch.r 244 kB/s | 27 kB 00:00 2023-12-14T14:00:08.476 INFO:teuthology.orchestra.run.smithi119.stdout:(76/145): python3-pyasn1-0.3.7-6.el8.noarch.rpm 688 kB/s | 126 kB 00:00 2023-12-14T14:00:08.540 INFO:teuthology.orchestra.run.smithi119.stdout:(77/145): bison-3.0.4-10.el8.x86_64.rpm 3.7 MB/s | 688 kB 00:00 2023-12-14T14:00:08.576 INFO:teuthology.orchestra.run.smithi119.stdout:(78/145): python3-werkzeug-0.12.2-4.el8.noarch. 1.8 MB/s | 457 kB 00:00 2023-12-14T14:00:08.618 INFO:teuthology.orchestra.run.smithi119.stdout:(79/145): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2023-12-14T14:00:08.685 INFO:teuthology.orchestra.run.smithi119.stdout:(80/145): libtool-2.4.6-25.el8.x86_64.rpm 4.8 MB/s | 709 kB 00:00 2023-12-14T14:00:08.759 INFO:teuthology.orchestra.run.smithi069.stdout:(95/145): postgresql-10.23-2.module+el8.8.0+194 680 kB/s | 1.5 MB 00:02 2023-12-14T14:00:08.769 INFO:teuthology.orchestra.run.smithi119.stdout:(81/145): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-12-14T14:00:08.786 INFO:teuthology.orchestra.run.smithi119.stdout:(82/145): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-12-14T14:00:08.928 INFO:teuthology.orchestra.run.smithi119.stdout:(83/145): uuid-1.6.2-43.el8.x86_64.rpm 403 kB/s | 64 kB 00:00 2023-12-14T14:00:08.953 INFO:teuthology.orchestra.run.smithi119.stdout:(84/145): python3-pyOpenSSL-19.0.0-1.el8.noarch 620 kB/s | 103 kB 00:00 2023-12-14T14:00:08.967 INFO:teuthology.orchestra.run.smithi069.stdout:(96/145): postgresql-contrib-10.23-2.module+el8 511 kB/s | 811 kB 00:01 2023-12-14T14:00:09.003 INFO:teuthology.orchestra.run.smithi119.stdout:(85/145): python3-markupsafe-0.23-19.el8.x86_64 91 kB/s | 39 kB 00:00 2023-12-14T14:00:09.171 INFO:teuthology.orchestra.run.smithi081.stdout:(96/145): librabbitmq-0.9.0-4.el8.x86_64.rpm 45 kB/s | 47 kB 00:01 2023-12-14T14:00:09.187 INFO:teuthology.orchestra.run.smithi119.stdout:(86/145): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-12-14T14:00:09.220 INFO:teuthology.orchestra.run.smithi119.stdout:(87/145): python3-jinja2-2.10.1-3.el8.noarch.rp 2.4 MB/s | 538 kB 00:00 2023-12-14T14:00:09.380 INFO:teuthology.orchestra.run.smithi081.stdout:(97/145): python3-jsonpointer-1.10-11.el8.noarc 96 kB/s | 20 kB 00:00 2023-12-14T14:00:09.387 INFO:teuthology.orchestra.run.smithi119.stdout:(88/145): python3-scipy-1.0.0-21.module+el8.5.0 30 MB/s | 14 MB 00:00 2023-12-14T14:00:09.437 INFO:teuthology.orchestra.run.smithi119.stdout:(89/145): socat-1.7.4.1-1.el8.x86_64.rpm 1.5 MB/s | 323 kB 00:00 2023-12-14T14:00:09.472 INFO:teuthology.orchestra.run.smithi081.stdout:(98/145): python3-prettytable-0.7.2-14.el8.noar 479 kB/s | 44 kB 00:00 2023-12-14T14:00:09.538 INFO:teuthology.orchestra.run.smithi119.stdout:(90/145): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2023-12-14T14:00:09.563 INFO:teuthology.orchestra.run.smithi119.stdout:(91/145): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.3 MB/s | 225 kB 00:00 2023-12-14T14:00:09.597 INFO:teuthology.orchestra.run.smithi081.stdout:(99/145): python3-pyasn1-modules-0.3.7-6.el8.no 881 kB/s | 110 kB 00:00 2023-12-14T14:00:09.647 INFO:teuthology.orchestra.run.smithi119.stdout:(92/145): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-12-14T14:00:09.755 INFO:teuthology.orchestra.run.smithi081.stdout:(100/145): python3-jsonpatch-1.21-2.el8.noarch. 168 kB/s | 27 kB 00:00 2023-12-14T14:00:09.764 INFO:teuthology.orchestra.run.smithi119.stdout:(93/145): openblas-threads-0.3.15-6.el8.x86_64. 23 MB/s | 5.2 MB 00:00 2023-12-14T14:00:09.789 INFO:teuthology.orchestra.run.smithi119.stdout:(94/145): python3-mako-1.0.6-14.el8.noarch.rpm 696 kB/s | 157 kB 00:00 2023-12-14T14:00:09.809 INFO:teuthology.orchestra.run.smithi069.stdout:(97/145): ceph-test-18.0.0-3905.g1faa3533.el8.x 1.5 MB/s | 41 MB 00:26 2023-12-14T14:00:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:(101/145): python3-pyasn1-0.3.7-6.el8.noarch.rp 758 kB/s | 126 kB 00:00 2023-12-14T14:00:09.948 INFO:teuthology.orchestra.run.smithi119.stdout:(95/145): postgresql-contrib-10.23-2.module+el8 5.0 MB/s | 811 kB 00:00 2023-12-14T14:00:09.948 INFO:teuthology.orchestra.run.smithi081.stdout:(102/145): krb5-devel-1.18.2-26.el8_9.x86_64.rp 330 kB/s | 562 kB 00:01 2023-12-14T14:00:10.015 INFO:teuthology.orchestra.run.smithi119.stdout:(96/145): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2023-12-14T14:00:10.189 INFO:teuthology.orchestra.run.smithi081.stdout:(103/145): python3-werkzeug-0.12.2-4.el8.noarch 1.7 MB/s | 457 kB 00:00 2023-12-14T14:00:10.315 INFO:teuthology.orchestra.run.smithi081.stdout:(104/145): flex-2.6.1-9.el8.x86_64.rpm 2.5 MB/s | 320 kB 00:00 2023-12-14T14:00:10.316 INFO:teuthology.orchestra.run.smithi119.stdout:(97/145): postgresql-10.23-2.module+el8.8.0+194 2.7 MB/s | 1.5 MB 00:00 2023-12-14T14:00:10.448 INFO:teuthology.orchestra.run.smithi081.stdout:(105/145): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2023-12-14T14:00:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:(106/145): bison-3.0.4-10.el8.x86_64.rpm 1.3 MB/s | 688 kB 00:00 2023-12-14T14:00:10.566 INFO:teuthology.orchestra.run.smithi081.stdout:(107/145): python3-markupsafe-0.23-19.el8.x86_6 332 kB/s | 39 kB 00:00 2023-12-14T14:00:10.601 INFO:teuthology.orchestra.run.smithi069.stdout:(98/145): automake-1.16.1-8.el8.noarch.rpm 437 kB/s | 714 kB 00:01 2023-12-14T14:00:10.616 INFO:teuthology.orchestra.run.smithi081.stdout:(108/145): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-12-14T14:00:10.741 INFO:teuthology.orchestra.run.smithi081.stdout:(109/145): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-12-14T14:00:10.761 INFO:teuthology.orchestra.run.smithi119.stdout:(98/145): automake-1.16.1-8.el8.noarch.rpm 956 kB/s | 714 kB 00:00 2023-12-14T14:00:10.800 INFO:teuthology.orchestra.run.smithi081.stdout:(110/145): uuid-1.6.2-43.el8.x86_64.rpm 348 kB/s | 64 kB 00:00 2023-12-14T14:00:10.890 INFO:teuthology.orchestra.run.smithi119.stdout:(99/145): postgresql-server-10.23-2.module+el8. 5.4 MB/s | 5.1 MB 00:00 2023-12-14T14:00:10.900 INFO:teuthology.orchestra.run.smithi081.stdout:(111/145): python3-pyOpenSSL-19.0.0-1.el8.noarc 652 kB/s | 103 kB 00:00 2023-12-14T14:00:11.109 INFO:teuthology.orchestra.run.smithi081.stdout:(112/145): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-12-14T14:00:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:(113/145): python3-scipy-1.0.0-21.module+el8.5. 30 MB/s | 14 MB 00:00 2023-12-14T14:00:11.293 INFO:teuthology.orchestra.run.smithi081.stdout:(114/145): python3-jinja2-2.10.1-3.el8.noarch.r 2.9 MB/s | 538 kB 00:00 2023-12-14T14:00:11.418 INFO:teuthology.orchestra.run.smithi081.stdout:(115/145): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-12-14T14:00:11.527 INFO:teuthology.orchestra.run.smithi081.stdout:(116/145): python3-numpy-f2py-1.14.3-10.el8.x86 2.0 MB/s | 225 kB 00:00 2023-12-14T14:00:11.568 INFO:teuthology.orchestra.run.smithi069.stdout:(99/145): libpq-13.11-1.el8.x86_64.rpm 113 kB/s | 198 kB 00:01 2023-12-14T14:00:11.635 INFO:teuthology.orchestra.run.smithi069.stdout:(100/145): postgresql-server-10.23-2.module+el8 1.8 MB/s | 5.1 MB 00:02 2023-12-14T14:00:11.660 INFO:teuthology.orchestra.run.smithi081.stdout:(117/145): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-12-14T14:00:11.727 INFO:teuthology.orchestra.run.smithi069.stdout:(101/145): libverto-devel-0.3.0-5.el8.x86_64.rp 196 kB/s | 18 kB 00:00 2023-12-14T14:00:11.735 INFO:teuthology.orchestra.run.smithi081.stdout:(118/145): python3-numpy-1.14.3-10.el8.x86_64.r 7.8 MB/s | 3.7 MB 00:00 2023-12-14T14:00:11.911 INFO:teuthology.orchestra.run.smithi081.stdout:(119/145): python3-mako-1.0.6-14.el8.noarch.rpm 895 kB/s | 157 kB 00:00 2023-12-14T14:00:11.994 INFO:teuthology.orchestra.run.smithi081.stdout:(120/145): openblas-threads-0.3.15-6.el8.x86_64 16 MB/s | 5.2 MB 00:00 2023-12-14T14:00:12.002 INFO:teuthology.orchestra.run.smithi069.stdout:(102/145): python3-jwt-1.6.1-2.el8.noarch.rpm 155 kB/s | 43 kB 00:00 2023-12-14T14:00:12.102 INFO:teuthology.orchestra.run.smithi069.stdout:(103/145): python3-oauthlib-2.1.0-1.el8.noarch. 1.5 MB/s | 155 kB 00:00 2023-12-14T14:00:12.119 INFO:teuthology.orchestra.run.smithi069.stdout:(104/145): jq-1.6-7.el8.x86_64.rpm 133 kB/s | 202 kB 00:01 2023-12-14T14:00:12.145 INFO:teuthology.orchestra.run.smithi081.stdout:(121/145): postgresql-10.23-2.module+el8.8.0+19 10 MB/s | 1.5 MB 00:00 2023-12-14T14:00:12.228 INFO:teuthology.orchestra.run.smithi081.stdout:(122/145): openblas-0.3.15-6.el8.x86_64.rpm 16 MB/s | 5.0 MB 00:00 2023-12-14T14:00:12.261 INFO:teuthology.orchestra.run.smithi069.stdout:(105/145): python3-pycparser-2.14-14.el8.noarch 688 kB/s | 109 kB 00:00 2023-12-14T14:00:12.295 INFO:teuthology.orchestra.run.smithi069.stdout:(106/145): python3-requests-oauthlib-1.0.0-1.el 243 kB/s | 43 kB 00:00 2023-12-14T14:00:12.312 INFO:teuthology.orchestra.run.smithi081.stdout:(123/145): postgresql-contrib-10.23-2.module+el 4.7 MB/s | 811 kB 00:00 2023-12-14T14:00:12.357 INFO:teuthology.orchestra.run.smithi119.stdout:(100/145): jq-1.6-7.el8.x86_64.rpm 127 kB/s | 202 kB 00:01 2023-12-14T14:00:12.370 INFO:teuthology.orchestra.run.smithi069.stdout:(107/145): libaio-devel-0.3.112-1.el8.x86_64.rp 172 kB/s | 19 kB 00:00 2023-12-14T14:00:12.382 INFO:teuthology.orchestra.run.smithi119.stdout:(101/145): python3-pytz-2017.2-11.el8.noarch.rp 36 kB/s | 54 kB 00:01 2023-12-14T14:00:12.429 INFO:teuthology.orchestra.run.smithi081.stdout:(124/145): postgresql-server-10.23-2.module+el8 25 MB/s | 5.1 MB 00:00 2023-12-14T14:00:12.487 INFO:teuthology.orchestra.run.smithi081.stdout:(125/145): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2023-12-14T14:00:12.513 INFO:teuthology.orchestra.run.smithi081.stdout:(126/145): elfutils-libelf-devel-0.189-3.el8.x8 14 kB/s | 62 kB 00:04 2023-12-14T14:00:12.529 INFO:teuthology.orchestra.run.smithi069.stdout:(108/145): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-12-14T14:00:12.572 INFO:teuthology.orchestra.run.smithi119.stdout:(102/145): libverto-devel-0.3.0-5.el8.x86_64.rp 83 kB/s | 18 kB 00:00 2023-12-14T14:00:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:(109/145): libzstd-devel-1.4.4-1.el8.x86_64.rpm 146 kB/s | 44 kB 00:00 2023-12-14T14:00:12.671 INFO:teuthology.orchestra.run.smithi081.stdout:(127/145): libpq-13.11-1.el8.x86_64.rpm 818 kB/s | 198 kB 00:00 2023-12-14T14:00:12.708 INFO:teuthology.orchestra.run.smithi119.stdout:(103/145): python3-jwt-1.6.1-2.el8.noarch.rpm 131 kB/s | 43 kB 00:00 2023-12-14T14:00:12.729 INFO:teuthology.orchestra.run.smithi069.stdout:(110/145): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.1 MB/s | 229 kB 00:00 2023-12-14T14:00:12.755 INFO:teuthology.orchestra.run.smithi069.stdout:(111/145): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-12-14T14:00:12.775 INFO:teuthology.orchestra.run.smithi119.stdout:(104/145): python3-oauthlib-2.1.0-1.el8.noarch. 766 kB/s | 155 kB 00:00 2023-12-14T14:00:12.788 INFO:teuthology.orchestra.run.smithi081.stdout:(128/145): jq-1.6-7.el8.x86_64.rpm 674 kB/s | 202 kB 00:00 2023-12-14T14:00:12.871 INFO:teuthology.orchestra.run.smithi069.stdout:(112/145): keyutils-libs-devel-1.5.10-9.el8.x86 413 kB/s | 48 kB 00:00 2023-12-14T14:00:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:(105/145): python3-requests-oauthlib-1.0.0-1.el 233 kB/s | 43 kB 00:00 2023-12-14T14:00:12.972 INFO:teuthology.orchestra.run.smithi069.stdout:(113/145): libselinux-devel-2.9-5.el8.x86_64.rp 826 kB/s | 200 kB 00:00 2023-12-14T14:00:12.984 INFO:teuthology.orchestra.run.smithi119.stdout:(106/145): python3-pycparser-2.14-14.el8.noarch 396 kB/s | 109 kB 00:00 2023-12-14T14:00:13.005 INFO:teuthology.orchestra.run.smithi081.stdout:(129/145): python3-pytz-2017.2-11.el8.noarch.rp 110 kB/s | 54 kB 00:00 2023-12-14T14:00:13.031 INFO:teuthology.orchestra.run.smithi069.stdout:(114/145): libsepol-devel-2.9-3.el8.x86_64.rpm 548 kB/s | 87 kB 00:00 2023-12-14T14:00:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:(115/145): python3-pytz-2017.2-11.el8.noarch.rp 36 kB/s | 54 kB 00:01 2023-12-14T14:00:13.084 INFO:teuthology.orchestra.run.smithi119.stdout:(107/145): libzstd-devel-1.4.4-1.el8.x86_64.rpm 438 kB/s | 44 kB 00:00 2023-12-14T14:00:13.106 INFO:teuthology.orchestra.run.smithi069.stdout:(116/145): libcom_err-devel-1.45.6-4.el8.x86_64 513 kB/s | 39 kB 00:00 2023-12-14T14:00:13.109 INFO:teuthology.orchestra.run.smithi119.stdout:(108/145): libaio-devel-0.3.112-1.el8.x86_64.rp 124 kB/s | 19 kB 00:00 2023-12-14T14:00:13.139 INFO:teuthology.orchestra.run.smithi081.stdout:(130/145): openssl-1.1.1k-9.el8_7.x86_64.rpm 5.2 MB/s | 710 kB 00:00 2023-12-14T14:00:13.240 INFO:teuthology.orchestra.run.smithi069.stdout:(117/145): zlib-devel-1.2.11-18.el8_5.x86_64.rp 216 kB/s | 58 kB 00:00 2023-12-14T14:00:13.268 INFO:teuthology.orchestra.run.smithi119.stdout:(109/145): pcre2-devel-10.32-2.el8.x86_64.rpm 3.2 MB/s | 605 kB 00:00 2023-12-14T14:00:13.293 INFO:teuthology.orchestra.run.smithi119.stdout:(110/145): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2023-12-14T14:00:13.340 INFO:teuthology.orchestra.run.smithi069.stdout:(118/145): openssl-devel-1.1.1k-9.el8_7.x86_64. 8.7 MB/s | 2.3 MB 00:00 2023-12-14T14:00:13.377 INFO:teuthology.orchestra.run.smithi119.stdout:(111/145): libselinux-devel-2.9-5.el8.x86_64.rp 2.3 MB/s | 200 kB 00:00 2023-12-14T14:00:13.422 INFO:teuthology.orchestra.run.smithi081.stdout:(131/145): librados2-18.0.0-3905.g1faa3533.el8. 4.9 MB/s | 3.7 MB 00:00 2023-12-14T14:00:13.424 INFO:teuthology.orchestra.run.smithi069.stdout:(119/145): libgfortran-8.5.0-20.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2023-12-14T14:00:13.472 INFO:teuthology.orchestra.run.smithi081.stdout:(132/145): openssl-libs-1.1.1k-9.el8_7.x86_64.r 4.4 MB/s | 1.5 MB 00:00 2023-12-14T14:00:13.474 INFO:teuthology.orchestra.run.smithi069.stdout:(120/145): fuse-2.9.7-17.el8.x86_64.rpm 226 kB/s | 83 kB 00:00 2023-12-14T14:00:13.477 INFO:teuthology.orchestra.run.smithi119.stdout:(112/145): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-12-14T14:00:13.519 INFO:teuthology.orchestra.run.smithi119.stdout:(113/145): keyutils-libs-devel-1.5.10-9.el8.x86 339 kB/s | 48 kB 00:00 2023-12-14T14:00:13.591 INFO:teuthology.orchestra.run.smithi069.stdout:(121/145): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.0 MB/s | 238 kB 00:00 2023-12-14T14:00:13.616 INFO:teuthology.orchestra.run.smithi069.stdout:(122/145): libquadmath-8.5.0-20.el8.x86_64.rpm 624 kB/s | 172 kB 00:00 2023-12-14T14:00:13.619 INFO:teuthology.orchestra.run.smithi119.stdout:(114/145): libsepol-devel-2.9-3.el8.x86_64.rpm 613 kB/s | 87 kB 00:00 2023-12-14T14:00:13.641 INFO:teuthology.orchestra.run.smithi069.stdout:(123/145): libuuid-devel-2.32.1-43.el8.x86_64.r 458 kB/s | 100 kB 00:00 2023-12-14T14:00:13.728 INFO:teuthology.orchestra.run.smithi119.stdout:(115/145): zlib-devel-1.2.11-18.el8_5.x86_64.rp 277 kB/s | 58 kB 00:00 2023-12-14T14:00:13.775 INFO:teuthology.orchestra.run.smithi069.stdout:(124/145): NetworkManager-initscripts-updown-1. 1.1 MB/s | 143 kB 00:00 2023-12-14T14:00:13.778 INFO:teuthology.orchestra.run.smithi119.stdout:(116/145): libcom_err-devel-1.45.6-4.el8.x86_64 243 kB/s | 39 kB 00:00 2023-12-14T14:00:13.809 INFO:teuthology.orchestra.run.smithi069.stdout:(125/145): xfsprogs-devel-5.0.0-12.el8.x86_64.r 378 kB/s | 73 kB 00:00 2023-12-14T14:00:13.845 INFO:teuthology.orchestra.run.smithi119.stdout:(117/145): fuse-2.9.7-17.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-12-14T14:00:13.909 INFO:teuthology.orchestra.run.smithi069.stdout:(126/145): elfutils-libelf-devel-0.189-3.el8.x8 462 kB/s | 62 kB 00:00 2023-12-14T14:00:13.934 INFO:teuthology.orchestra.run.smithi069.stdout:(127/145): librabbitmq-0.9.0-4.el8.x86_64.rpm 375 kB/s | 47 kB 00:00 2023-12-14T14:00:13.945 INFO:teuthology.orchestra.run.smithi119.stdout:(118/145): openssl-devel-1.1.1k-9.el8_7.x86_64. 11 MB/s | 2.3 MB 00:00 2023-12-14T14:00:13.968 INFO:teuthology.orchestra.run.smithi069.stdout:(128/145): python3-cryptography-3.2.1-6.el8.x86 1.4 MB/s | 559 kB 00:00 2023-12-14T14:00:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:(119/145): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-12-14T14:00:14.138 INFO:teuthology.orchestra.run.smithi119.stdout:(120/145): libgfortran-8.5.0-20.el8.x86_64.rpm 2.2 MB/s | 645 kB 00:00 2023-12-14T14:00:14.205 INFO:teuthology.orchestra.run.smithi119.stdout:(121/145): libuuid-devel-2.32.1-43.el8.x86_64.r 793 kB/s | 100 kB 00:00 2023-12-14T14:00:14.230 INFO:teuthology.orchestra.run.smithi119.stdout:(122/145): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-12-14T14:00:14.231 INFO:teuthology.orchestra.run.smithi081.stdout:(133/145): librbd1-18.0.0-3905.g1faa3533.el8.x8 2.5 MB/s | 3.6 MB 00:01 2023-12-14T14:00:14.234 INFO:teuthology.orchestra.run.smithi069.stdout:(129/145): krb5-devel-1.18.2-26.el8_9.x86_64.rp 1.7 MB/s | 562 kB 00:00 2023-12-14T14:00:14.265 INFO:teuthology.orchestra.run.smithi081.stdout:(134/145): elfutils-libs-0.189-3.el8.x86_64.rpm 382 kB/s | 303 kB 00:00 2023-12-14T14:00:14.313 INFO:teuthology.orchestra.run.smithi119.stdout:(123/145): python3-cryptography-3.2.1-6.el8.x86 5.0 MB/s | 559 kB 00:00 2023-12-14T14:00:14.415 INFO:teuthology.orchestra.run.smithi081.stdout:(135/145): elfutils-libelf-0.189-3.el8.x86_64.r 234 kB/s | 232 kB 00:00 2023-12-14T14:00:14.427 INFO:teuthology.orchestra.run.smithi069.stdout:(130/145): openssl-1.1.1k-9.el8_7.x86_64.rpm 3.6 MB/s | 710 kB 00:00 2023-12-14T14:00:14.447 INFO:teuthology.orchestra.run.smithi119.stdout:(124/145): NetworkManager-initscripts-updown-1. 1.1 MB/s | 143 kB 00:00 2023-12-14T14:00:14.544 INFO:teuthology.orchestra.run.smithi069.stdout:(131/145): openssl-libs-1.1.1k-9.el8_7.x86_64.r 13 MB/s | 1.5 MB 00:00 2023-12-14T14:00:14.572 INFO:teuthology.orchestra.run.smithi119.stdout:(125/145): elfutils-libelf-devel-0.189-3.el8.x8 494 kB/s | 62 kB 00:00 2023-12-14T14:00:14.614 INFO:teuthology.orchestra.run.smithi119.stdout:(126/145): libpq-13.11-1.el8.x86_64.rpm 46 kB/s | 198 kB 00:04 2023-12-14T14:00:14.639 INFO:teuthology.orchestra.run.smithi119.stdout:(127/145): librabbitmq-0.9.0-4.el8.x86_64.rpm 702 kB/s | 47 kB 00:00 2023-12-14T14:00:14.731 INFO:teuthology.orchestra.run.smithi119.stdout:(128/145): xfsprogs-devel-5.0.0-12.el8.x86_64.r 145 kB/s | 73 kB 00:00 2023-12-14T14:00:14.760 INFO:teuthology.orchestra.run.smithi069.stdout:(132/145): elfutils-libelf-0.189-3.el8.x86_64.r 1.0 MB/s | 232 kB 00:00 2023-12-14T14:00:14.807 INFO:teuthology.orchestra.run.smithi119.stdout:(129/145): krb5-devel-1.18.2-26.el8_9.x86_64.rp 2.9 MB/s | 562 kB 00:00 2023-12-14T14:00:14.932 INFO:teuthology.orchestra.run.smithi119.stdout:(130/145): openssl-1.1.1k-9.el8_7.x86_64.rpm 5.6 MB/s | 710 kB 00:00 2023-12-14T14:00:14.969 INFO:teuthology.orchestra.run.smithi069.stdout:(133/145): elfutils-libs-0.189-3.el8.x86_64.rpm 1.4 MB/s | 303 kB 00:00 2023-12-14T14:00:15.015 INFO:teuthology.orchestra.run.smithi119.stdout:(131/145): openssl-libs-1.1.1k-9.el8_7.x86_64.r 18 MB/s | 1.5 MB 00:00 2023-12-14T14:00:15.132 INFO:teuthology.orchestra.run.smithi081.stdout:(136/145): libmount-2.32.1-43.el8.x86_64.rpm 263 kB/s | 237 kB 00:00 2023-12-14T14:00:15.132 INFO:teuthology.orchestra.run.smithi119.stdout:(132/145): elfutils-libelf-0.189-3.el8.x86_64.r 1.9 MB/s | 232 kB 00:00 2023-12-14T14:00:15.541 INFO:teuthology.orchestra.run.smithi119.stdout:(133/145): elfutils-libs-0.189-3.el8.x86_64.rpm 742 kB/s | 303 kB 00:00 2023-12-14T14:00:15.699 INFO:teuthology.orchestra.run.smithi119.stdout:(134/145): libmount-2.32.1-43.el8.x86_64.rpm 1.5 MB/s | 237 kB 00:00 2023-12-14T14:00:15.844 INFO:teuthology.orchestra.run.smithi069.stdout:(134/145): libmount-2.32.1-43.el8.x86_64.rpm 270 kB/s | 237 kB 00:00 2023-12-14T14:00:15.903 INFO:teuthology.orchestra.run.smithi069.stdout:(135/145): librados2-18.0.0-3905.g1faa3533.el8. 1.9 MB/s | 3.7 MB 00:01 2023-12-14T14:00:15.908 INFO:teuthology.orchestra.run.smithi119.stdout:(135/145): librbd1-18.0.0-3905.g1faa3533.el8.x8 3.0 MB/s | 3.6 MB 00:01 2023-12-14T14:00:16.033 INFO:teuthology.orchestra.run.smithi119.stdout:(136/145): libsmartcols-2.32.1-43.el8.x86_64.rp 538 kB/s | 179 kB 00:00 2023-12-14T14:00:16.044 INFO:teuthology.orchestra.run.smithi069.stdout:(136/145): libsmartcols-2.32.1-43.el8.x86_64.rp 897 kB/s | 179 kB 00:00 2023-12-14T14:00:16.150 INFO:teuthology.orchestra.run.smithi119.stdout:(137/145): libuuid-2.32.1-43.el8.x86_64.rpm 409 kB/s | 99 kB 00:00 2023-12-14T14:00:16.166 INFO:teuthology.orchestra.run.smithi081.stdout:(137/145): libsmartcols-2.32.1-43.el8.x86_64.rp 94 kB/s | 179 kB 00:01 2023-12-14T14:00:16.212 INFO:teuthology.orchestra.run.smithi069.stdout:(137/145): libuuid-2.32.1-43.el8.x86_64.rpm 321 kB/s | 99 kB 00:00 2023-12-14T14:00:16.324 INFO:teuthology.orchestra.run.smithi081.stdout:(138/145): libuuid-2.32.1-43.el8.x86_64.rpm 52 kB/s | 99 kB 00:01 2023-12-14T14:00:16.566 INFO:teuthology.orchestra.run.smithi081.stdout:(139/145): util-linux-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 2.5 MB 00:01 2023-12-14T14:00:16.700 INFO:teuthology.orchestra.run.smithi119.stdout:(138/145): util-linux-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 2.5 MB 00:00 2023-12-14T14:00:16.983 INFO:teuthology.orchestra.run.smithi081.stdout:(140/145): util-linux-user-2.32.1-43.el8.x86_64 126 kB/s | 103 kB 00:00 2023-12-14T14:00:17.043 INFO:teuthology.orchestra.run.smithi119.stdout:(139/145): util-linux-user-2.32.1-43.el8.x86_64 115 kB/s | 103 kB 00:00 2023-12-14T14:00:17.212 INFO:teuthology.orchestra.run.smithi069.stdout:(138/145): librbd1-18.0.0-3905.g1faa3533.el8.x8 1.1 MB/s | 3.6 MB 00:03 2023-12-14T14:00:17.237 INFO:teuthology.orchestra.run.smithi069.stdout:(139/145): util-linux-user-2.32.1-43.el8.x86_64 100 kB/s | 103 kB 00:01 2023-12-14T14:00:17.579 INFO:teuthology.orchestra.run.smithi069.stdout:(140/145): util-linux-2.32.1-43.el8.x86_64.rpm 1.6 MB/s | 2.5 MB 00:01 2023-12-14T14:00:17.604 INFO:teuthology.orchestra.run.smithi069.stdout:(141/145): xfsdump-3.1.8-6.el8.x86_64.rpm 849 kB/s | 333 kB 00:00 2023-12-14T14:00:17.793 INFO:teuthology.orchestra.run.smithi119.stdout:(140/145): librados2-18.0.0-3905.g1faa3533.el8. 1.2 MB/s | 3.7 MB 00:03 2023-12-14T14:00:17.818 INFO:teuthology.orchestra.run.smithi119.stdout:(141/145): xfsdump-3.1.8-6.el8.x86_64.rpm 298 kB/s | 333 kB 00:01 2023-12-14T14:00:17.825 INFO:teuthology.orchestra.run.smithi081.stdout:(141/145): libblkid-2.32.1-43.el8.x86_64.rpm 262 kB/s | 220 kB 00:00 2023-12-14T14:00:17.858 INFO:teuthology.orchestra.run.smithi081.stdout:(142/145): xfsdump-3.1.8-6.el8.x86_64.rpm 217 kB/s | 333 kB 00:01 2023-12-14T14:00:18.243 INFO:teuthology.orchestra.run.smithi119.stdout:(142/145): iproute-6.2.0-5.el8_9.x86_64.rpm 711 kB/s | 854 kB 00:01 2023-12-14T14:00:18.368 INFO:teuthology.orchestra.run.smithi119.stdout:(143/145): libblkid-2.32.1-43.el8.x86_64.rpm 383 kB/s | 220 kB 00:00 2023-12-14T14:00:18.588 INFO:teuthology.orchestra.run.smithi069.stdout:(142/145): iproute-6.2.0-5.el8_9.x86_64.rpm 632 kB/s | 854 kB 00:01 2023-12-14T14:00:18.650 INFO:teuthology.orchestra.run.smithi081.stdout:(143/145): iproute-6.2.0-5.el8_9.x86_64.rpm 410 kB/s | 854 kB 00:02 2023-12-14T14:00:18.688 INFO:teuthology.orchestra.run.smithi069.stdout:(143/145): libfdisk-2.32.1-43.el8.x86_64.rpm 234 kB/s | 254 kB 00:01 2023-12-14T14:00:18.713 INFO:teuthology.orchestra.run.smithi069.stdout:(144/145): libblkid-2.32.1-43.el8.x86_64.rpm 194 kB/s | 220 kB 00:01 2023-12-14T14:00:18.877 INFO:teuthology.orchestra.run.smithi119.stdout:(144/145): libfdisk-2.32.1-43.el8.x86_64.rpm 240 kB/s | 254 kB 00:01 2023-12-14T14:00:19.034 INFO:teuthology.orchestra.run.smithi081.stdout:(144/145): libfdisk-2.32.1-43.el8.x86_64.rpm 210 kB/s | 254 kB 00:01 2023-12-14T14:00:19.209 INFO:teuthology.orchestra.run.smithi081.stdout:(145/145): xfsprogs-5.0.0-12.el8.x86_64.rpm 810 kB/s | 1.1 MB 00:01 2023-12-14T14:00:19.212 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-12-14T14:00:19.212 INFO:teuthology.orchestra.run.smithi081.stdout:Total 4.3 MB/s | 205 MB 00:48 2023-12-14T14:00:19.514 INFO:teuthology.orchestra.run.smithi069.stdout:(145/145): xfsprogs-5.0.0-12.el8.x86_64.rpm 1.2 MB/s | 1.1 MB 00:00 2023-12-14T14:00:19.517 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-12-14T14:00:19.517 INFO:teuthology.orchestra.run.smithi069.stdout:Total 4.4 MB/s | 205 MB 00:46 2023-12-14T14:00:19.985 INFO:teuthology.orchestra.run.smithi119.stdout:(145/145): xfsprogs-5.0.0-12.el8.x86_64.rpm 628 kB/s | 1.1 MB 00:01 2023-12-14T14:00:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-14T14:00:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:Total 4.2 MB/s | 205 MB 00:48 2023-12-14T14:00:20.204 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-12-14T14:00:20.491 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-12-14T14:00:20.595 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-12-14T14:00:20.595 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-12-14T14:00:20.884 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-12-14T14:00:20.884 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-12-14T14:00:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-14T14:00:21.404 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-14T14:00:21.405 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-14T14:00:22.136 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-12-14T14:00:22.147 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-12-14T14:00:22.425 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-12-14T14:00:22.435 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-12-14T14:00:22.935 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-14T14:00:22.946 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-14T14:00:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-12-14T14:00:27.927 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-12-14T14:00:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/1 2023-12-14T14:00:28.144 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/1 2023-12-14T14:00:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T14:00:28.412 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T14:00:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T14:00:28.429 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-14T14:00:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/161 2023-12-14T14:00:28.626 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/1 2023-12-14T14:00:28.647 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T14:00:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T14:00:28.884 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/161 2023-12-14T14:00:28.887 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T14:00:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T14:00:29.045 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T14:00:29.081 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T14:00:29.114 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T14:00:29.117 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T14:00:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T14:00:29.335 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/161 2023-12-14T14:00:29.344 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/161 2023-12-14T14:00:29.345 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T14:00:29.410 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T14:00:29.512 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T14:00:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/161 2023-12-14T14:00:29.608 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T14:00:29.635 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/161 2023-12-14T14:00:29.812 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/161 2023-12-14T14:00:29.812 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T14:00:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/161 2023-12-14T14:00:29.873 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T14:00:29.902 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/161 2023-12-14T14:00:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/161 2023-12-14T14:00:30.110 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/161 2023-12-14T14:00:30.127 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/161 2023-12-14T14:00:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T14:00:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/161 2023-12-14T14:00:30.336 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T14:00:30.357 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/161 2023-12-14T14:00:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T14:00:30.607 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/161 2023-12-14T14:00:30.770 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T14:00:30.829 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T14:00:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T14:00:31.020 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T14:00:31.251 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T14:00:31.271 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T14:00:31.406 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T14:00:31.456 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T14:00:31.470 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T14:00:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T14:00:31.628 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T14:00:31.752 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T14:00:31.781 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T14:00:31.869 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T14:00:31.877 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T14:00:31.937 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T14:00:32.031 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T14:00:32.070 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T14:00:32.197 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T14:00:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T14:00:32.367 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T14:00:32.395 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T14:00:32.495 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T14:00:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T14:00:32.595 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T14:00:32.595 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T14:00:32.691 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T14:00:32.834 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpq-13.11-1.el8.x86_64 14/161 2023-12-14T14:00:32.845 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T14:00:32.918 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libpq-13.11-1.el8.x86_64 14/161 2023-12-14T14:00:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/161 2023-12-14T14:00:33.145 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T14:00:33.172 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/161 2023-12-14T14:00:33.241 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T14:00:33.275 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/161 2023-12-14T14:00:33.373 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/161 2023-12-14T14:00:33.458 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpq-13.11-1.el8.x86_64 14/161 2023-12-14T14:00:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/161 2023-12-14T14:00:33.724 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/161 2023-12-14T14:00:33.728 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/161 2023-12-14T14:00:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 18/161 2023-12-14T14:00:33.915 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/161 2023-12-14T14:00:33.982 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 18/161 2023-12-14T14:00:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T14:00:34.127 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T14:00:34.153 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T14:00:34.239 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T14:00:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T14:00:34.319 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/161 2023-12-14T14:00:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T14:00:34.412 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T14:00:34.512 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T14:00:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/161 2023-12-14T14:00:34.590 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 18/161 2023-12-14T14:00:34.669 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/161 2023-12-14T14:00:34.745 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T14:00:34.805 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/161 2023-12-14T14:00:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/161 2023-12-14T14:00:34.852 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T14:00:34.961 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/161 2023-12-14T14:00:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T14:00:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/161 2023-12-14T14:00:35.138 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T14:00:35.222 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/161 2023-12-14T14:00:35.294 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/161 2023-12-14T14:00:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/161 2023-12-14T14:00:35.428 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/161 2023-12-14T14:00:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/161 2023-12-14T14:00:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/161 2023-12-14T14:00:35.615 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/161 2023-12-14T14:00:35.794 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/161 2023-12-14T14:00:36.101 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/161 2023-12-14T14:00:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/161 2023-12-14T14:00:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/161 2023-12-14T14:00:36.394 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/161 2023-12-14T14:00:36.403 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/161 2023-12-14T14:00:36.586 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/161 2023-12-14T14:00:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/161 2023-12-14T14:00:36.998 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/161 2023-12-14T14:00:37.013 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/161 2023-12-14T14:00:37.203 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/161 2023-12-14T14:00:37.280 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/161 2023-12-14T14:00:37.550 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/161 2023-12-14T14:00:37.699 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/161 2023-12-14T14:00:37.730 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/161 2023-12-14T14:00:37.855 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/161 2023-12-14T14:00:37.898 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/161 2023-12-14T14:00:37.986 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/161 2023-12-14T14:00:38.144 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/161 2023-12-14T14:00:38.168 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/161 2023-12-14T14:00:38.183 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/161 2023-12-14T14:00:38.341 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/161 2023-12-14T14:00:38.382 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/161 2023-12-14T14:00:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/161 2023-12-14T14:00:38.506 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/161 2023-12-14T14:00:38.611 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 31/161 2023-12-14T14:00:38.660 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/161 2023-12-14T14:00:38.765 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 32/161 2023-12-14T14:00:38.810 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/161 2023-12-14T14:00:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 31/161 2023-12-14T14:00:38.988 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 32/161 2023-12-14T14:00:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 33/161 2023-12-14T14:00:39.107 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/161 2023-12-14T14:00:39.196 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2023-12-14T14:00:39.262 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 33/161 2023-12-14T14:00:39.361 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/161 2023-12-14T14:00:39.558 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 31/161 2023-12-14T14:00:39.696 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 32/161 2023-12-14T14:00:39.955 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 33/161 2023-12-14T14:00:40.258 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/161 2023-12-14T14:00:40.556 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/161 2023-12-14T14:00:40.813 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/161 2023-12-14T14:00:40.916 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/161 2023-12-14T14:00:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2023-12-14T14:00:40.994 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/161 2023-12-14T14:00:41.232 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/161 2023-12-14T14:00:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 35/161 2023-12-14T14:00:41.505 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/161 2023-12-14T14:00:41.752 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/161 2023-12-14T14:00:42.278 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/161 2023-12-14T14:00:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/161 2023-12-14T14:00:42.753 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/161 2023-12-14T14:00:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/161 2023-12-14T14:00:43.043 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 38/161 2023-12-14T14:00:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/161 2023-12-14T14:00:43.288 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/161 2023-12-14T14:00:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/161 2023-12-14T14:00:43.496 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/161 2023-12-14T14:00:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 41/161 2023-12-14T14:00:43.515 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/161 2023-12-14T14:00:43.688 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 42/161 2023-12-14T14:00:43.715 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 41/161 2023-12-14T14:00:43.810 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 38/161 2023-12-14T14:00:43.845 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T14:00:43.899 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 42/161 2023-12-14T14:00:43.963 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T14:00:44.054 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/161 2023-12-14T14:00:44.101 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T14:00:44.163 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T14:00:44.195 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T14:00:44.262 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/161 2023-12-14T14:00:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T14:00:44.410 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T14:00:44.479 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T14:00:44.486 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 41/161 2023-12-14T14:00:44.520 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/161 2023-12-14T14:00:44.672 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 42/161 2023-12-14T14:00:44.705 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/161 2023-12-14T14:00:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/161 2023-12-14T14:00:44.876 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T14:00:44.943 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/161 2023-12-14T14:00:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T14:00:44.951 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T14:00:45.126 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T14:00:45.176 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T14:00:45.262 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T14:00:45.438 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T14:00:45.489 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/161 2023-12-14T14:00:45.612 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T14:00:45.796 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T14:00:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T14:00:45.935 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T14:00:45.951 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T14:00:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/161 2023-12-14T14:00:46.080 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.1-8.el8.noarch 49/161 2023-12-14T14:00:46.163 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/161 2023-12-14T14:00:46.226 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T14:00:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-43.el8.x86_64 50/161 2023-12-14T14:00:46.327 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 50/161 2023-12-14T14:00:46.380 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/161 2023-12-14T14:00:46.462 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 51/161 2023-12-14T14:00:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 51/161 2023-12-14T14:00:46.580 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/161 2023-12-14T14:00:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : jq-1.6-7.el8.x86_64 52/161 2023-12-14T14:00:46.737 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/161 2023-12-14T14:00:46.772 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T14:00:46.904 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/161 2023-12-14T14:00:46.927 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/161 2023-12-14T14:00:47.085 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T14:00:47.094 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/161 2023-12-14T14:00:47.102 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T14:00:47.172 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/161 2023-12-14T14:00:47.288 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/161 2023-12-14T14:00:47.314 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/161 2023-12-14T14:00:47.428 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/161 2023-12-14T14:00:47.479 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/161 2023-12-14T14:00:47.500 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/161 2023-12-14T14:00:47.656 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/161 2023-12-14T14:00:47.696 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/161 2023-12-14T14:00:47.718 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/161 2023-12-14T14:00:47.846 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/161 2023-12-14T14:00:47.861 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/161 2023-12-14T14:00:47.875 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/161 2023-12-14T14:00:48.070 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/161 2023-12-14T14:00:48.071 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/161 2023-12-14T14:00:48.090 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/161 2023-12-14T14:00:48.257 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/161 2023-12-14T14:00:48.339 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/161 2023-12-14T14:00:48.424 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/161 2023-12-14T14:00:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/161 2023-12-14T14:00:48.621 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/161 2023-12-14T14:00:48.737 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 60/161 2023-12-14T14:00:48.864 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/161 2023-12-14T14:00:48.873 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/161 2023-12-14T14:00:48.902 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/161 2023-12-14T14:00:49.055 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/161 2023-12-14T14:00:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/161 2023-12-14T14:00:49.156 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 62/161 2023-12-14T14:00:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/161 2023-12-14T14:00:49.287 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/161 2023-12-14T14:00:49.396 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 63/161 2023-12-14T14:00:49.472 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/161 2023-12-14T14:00:49.675 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/161 2023-12-14T14:00:49.723 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 64/161 2023-12-14T14:00:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/161 2023-12-14T14:00:49.916 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 65/161 2023-12-14T14:00:49.995 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 60/161 2023-12-14T14:00:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 67/161 2023-12-14T14:00:50.090 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 66/161 2023-12-14T14:00:50.160 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/161 2023-12-14T14:00:50.311 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/161 2023-12-14T14:00:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/161 2023-12-14T14:00:50.435 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 62/161 2023-12-14T14:00:50.498 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/161 2023-12-14T14:00:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/161 2023-12-14T14:00:50.688 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 63/161 2023-12-14T14:00:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/161 2023-12-14T14:00:50.896 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/161 2023-12-14T14:00:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 64/161 2023-12-14T14:00:51.110 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : automake-1.16.1-8.el8.noarch 70/161 2023-12-14T14:00:51.203 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/161 2023-12-14T14:00:51.308 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 65/161 2023-12-14T14:00:51.325 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : uuid-1.6.2-43.el8.x86_64 71/161 2023-12-14T14:00:51.407 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 71/161 2023-12-14T14:00:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/161 2023-12-14T14:00:51.533 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 66/161 2023-12-14T14:00:51.567 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 72/161 2023-12-14T14:00:51.648 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 72/161 2023-12-14T14:00:51.726 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/161 2023-12-14T14:00:51.811 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/161 2023-12-14T14:00:51.834 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : jq-1.6-7.el8.x86_64 73/161 2023-12-14T14:00:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/161 2023-12-14T14:00:52.016 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/161 2023-12-14T14:00:52.032 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/161 2023-12-14T14:00:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/161 2023-12-14T14:00:52.208 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/161 2023-12-14T14:00:52.372 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/161 2023-12-14T14:00:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/161 2023-12-14T14:00:52.393 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/161 2023-12-14T14:00:52.576 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.1-8.el8.noarch 70/161 2023-12-14T14:00:52.584 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 77/161 2023-12-14T14:00:52.595 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 77/161 2023-12-14T14:00:52.742 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-43.el8.x86_64 71/161 2023-12-14T14:00:52.746 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 78/161 2023-12-14T14:00:52.750 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 78/161 2023-12-14T14:00:52.811 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 71/161 2023-12-14T14:00:53.017 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 72/161 2023-12-14T14:00:53.031 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 79/161 2023-12-14T14:00:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 79/161 2023-12-14T14:00:53.094 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 72/161 2023-12-14T14:00:53.248 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 80/161 2023-12-14T14:00:53.283 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : jq-1.6-7.el8.x86_64 73/161 2023-12-14T14:00:53.327 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 80/161 2023-12-14T14:00:53.430 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 81/161 2023-12-14T14:00:53.498 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/161 2023-12-14T14:00:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 81/161 2023-12-14T14:00:53.611 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 82/161 2023-12-14T14:00:53.690 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/161 2023-12-14T14:00:53.722 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 82/161 2023-12-14T14:00:53.784 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 83/161 2023-12-14T14:00:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/161 2023-12-14T14:00:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 83/161 2023-12-14T14:00:53.963 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 84/161 2023-12-14T14:00:54.074 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 77/161 2023-12-14T14:00:54.188 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 84/161 2023-12-14T14:00:54.202 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 85/161 2023-12-14T14:00:54.237 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 78/161 2023-12-14T14:00:54.370 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 86/161 2023-12-14T14:00:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 85/161 2023-12-14T14:00:54.522 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 87/161 2023-12-14T14:00:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 79/161 2023-12-14T14:00:54.639 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 86/161 2023-12-14T14:00:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 88/161 2023-12-14T14:00:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 80/161 2023-12-14T14:00:54.825 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 87/161 2023-12-14T14:00:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 89/161 2023-12-14T14:00:54.971 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 81/161 2023-12-14T14:00:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 88/161 2023-12-14T14:00:55.080 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 90/161 2023-12-14T14:00:55.136 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 82/161 2023-12-14T14:00:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 89/161 2023-12-14T14:00:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-2.6-1.el8.noarch 91/161 2023-12-14T14:00:55.351 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 83/161 2023-12-14T14:00:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 90/161 2023-12-14T14:00:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 92/161 2023-12-14T14:00:55.582 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 84/161 2023-12-14T14:00:55.715 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-2.6-1.el8.noarch 91/161 2023-12-14T14:00:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/161 2023-12-14T14:00:55.811 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 85/161 2023-12-14T14:00:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/161 2023-12-14T14:00:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 92/161 2023-12-14T14:00:55.994 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 86/161 2023-12-14T14:00:56.180 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 87/161 2023-12-14T14:00:56.193 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/161 2023-12-14T14:00:56.412 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 88/161 2023-12-14T14:00:56.452 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/161 2023-12-14T14:00:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 89/161 2023-12-14T14:00:56.822 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 90/161 2023-12-14T14:00:57.012 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/161 2023-12-14T14:00:57.045 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-2.6-1.el8.noarch 91/161 2023-12-14T14:00:57.290 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 92/161 2023-12-14T14:00:57.320 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/161 2023-12-14T14:00:57.472 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/161 2023-12-14T14:00:57.531 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/161 2023-12-14T14:00:57.557 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/161 2023-12-14T14:00:57.714 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/161 2023-12-14T14:00:57.864 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/161 2023-12-14T14:00:57.864 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 98/161 2023-12-14T14:00:58.068 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/161 2023-12-14T14:00:58.139 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/161 2023-12-14T14:00:58.386 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/161 2023-12-14T14:00:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 98/161 2023-12-14T14:00:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/161 2023-12-14T14:00:58.778 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/161 2023-12-14T14:00:58.934 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/161 2023-12-14T14:00:59.103 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/161 2023-12-14T14:00:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/161 2023-12-14T14:00:59.364 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/161 2023-12-14T14:00:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T14:00:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T14:00:59.616 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 103/161 2023-12-14T14:00:59.665 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 98/161 2023-12-14T14:00:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/161 2023-12-14T14:00:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T14:00:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T14:00:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/161 2023-12-14T14:01:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 103/161 2023-12-14T14:01:00.181 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/161 2023-12-14T14:01:00.961 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/161 2023-12-14T14:01:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T14:01:01.265 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T14:01:01.940 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 103/161 2023-12-14T14:01:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T14:01:04.282 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T14:01:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T14:01:04.888 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T14:01:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T14:01:05.173 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T14:01:05.263 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T14:01:05.428 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T14:01:05.693 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T14:01:05.699 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T14:01:05.932 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T14:01:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T14:01:06.045 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T14:01:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T14:01:06.532 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T14:01:06.831 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T14:01:06.924 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T14:01:07.308 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T14:01:24.749 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T14:01:24.750 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2023-12-14T14:01:24.750 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2023-12-14T14:01:24.750 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /dev 2023-12-14T14:01:24.750 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /run 2023-12-14T14:01:24.750 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2023-12-14T14:01:24.750 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2023-12-14T14:01:24.751 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2023-12-14T14:01:24.751 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2023-12-14T14:01:24.751 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /dev 2023-12-14T14:01:24.751 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:01:25.112 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T14:01:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T14:01:25.604 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2023-12-14T14:01:25.604 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2023-12-14T14:01:25.604 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-12-14T14:01:25.604 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /run 2023-12-14T14:01:25.605 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2023-12-14T14:01:25.605 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2023-12-14T14:01:25.605 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2023-12-14T14:01:25.605 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2023-12-14T14:01:25.605 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-12-14T14:01:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T14:01:25.974 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T14:01:26.688 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T14:01:26.870 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T14:01:27.089 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T14:01:27.254 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /run 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2023-12-14T14:01:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2023-12-14T14:01:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T14:01:27.546 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T14:01:27.645 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T14:01:27.709 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T14:01:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T14:01:27.870 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T14:01:27.887 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T14:01:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T14:01:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T14:01:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T14:01:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T14:01:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T14:01:29.224 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T14:01:29.453 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T14:01:29.605 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T14:01:29.672 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T14:01:29.739 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T14:01:29.859 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 112/161 2023-12-14T14:01:29.870 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T14:01:30.067 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 113/161 2023-12-14T14:01:30.269 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T14:01:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T14:01:30.478 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T14:01:30.488 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T14:01:30.495 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T14:01:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T14:01:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T14:01:30.794 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T14:01:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 112/161 2023-12-14T14:01:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 113/161 2023-12-14T14:01:31.265 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T14:01:31.481 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T14:01:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T14:01:31.766 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T14:01:31.944 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T14:01:32.036 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T14:01:32.215 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T14:01:32.388 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T14:01:32.390 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 117/161 2023-12-14T14:01:32.525 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 112/161 2023-12-14T14:01:32.561 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T14:01:32.597 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T14:01:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T14:01:32.727 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T14:01:32.738 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T14:01:32.753 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 113/161 2023-12-14T14:01:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T14:01:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T14:01:33.010 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T14:01:33.254 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T14:01:33.306 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 117/161 2023-12-14T14:01:33.471 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T14:01:33.506 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T14:01:33.526 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T14:01:33.672 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T14:01:33.684 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T14:01:33.987 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 120/161 2023-12-14T14:01:34.377 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T14:01:34.412 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T14:01:34.490 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T14:01:34.585 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T14:01:34.628 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T14:01:34.676 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T14:01:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T14:01:34.793 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T14:01:34.952 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 120/161 2023-12-14T14:01:35.138 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 117/161 2023-12-14T14:01:35.140 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T14:01:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T14:01:35.327 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T14:01:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T14:01:35.363 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T14:01:35.377 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T14:01:35.501 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T14:01:35.513 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T14:01:35.539 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T14:01:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T14:01:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T14:01:36.077 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T14:01:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T14:01:36.766 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 120/161 2023-12-14T14:01:37.035 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T14:01:37.070 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T14:01:37.260 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T14:01:37.303 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T14:01:37.510 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T14:01:37.857 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T14:01:38.077 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T14:01:39.315 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T14:01:39.759 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 125/161 2023-12-14T14:01:40.116 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 126/161 2023-12-14T14:01:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T14:01:40.334 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libtool-2.4.6-25.el8.x86_64 127/161 2023-12-14T14:01:41.018 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 127/161 2023-12-14T14:01:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 125/161 2023-12-14T14:01:41.330 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openssl-devel-1:1.1.1k-9.el8_7.x86_64 128/161 2023-12-14T14:01:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:1.1.1k-9.el8_7.x86_64 126/161 2023-12-14T14:01:41.624 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 129/161 2023-12-14T14:01:41.720 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/161 2023-12-14T14:01:41.832 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 130/161 2023-12-14T14:01:41.988 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T14:01:42.045 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 131/161 2023-12-14T14:01:42.130 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 128/161 2023-12-14T14:01:42.247 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 132/161 2023-12-14T14:01:42.410 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 133/161 2023-12-14T14:01:42.484 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 125/161 2023-12-14T14:01:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 129/161 2023-12-14T14:01:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-25.el8.x86_64 130/161 2023-12-14T14:01:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 130/161 2023-12-14T14:01:42.816 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 126/161 2023-12-14T14:01:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 131/161 2023-12-14T14:01:43.041 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-25.el8.x86_64 127/161 2023-12-14T14:01:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 132/161 2023-12-14T14:01:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 133/161 2023-12-14T14:01:43.726 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 127/161 2023-12-14T14:01:44.046 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:1.1.1k-9.el8_7.x86_64 128/161 2023-12-14T14:01:44.340 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 129/161 2023-12-14T14:01:44.556 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 130/161 2023-12-14T14:01:44.696 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T14:01:44.803 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 131/161 2023-12-14T14:01:44.975 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T14:01:44.988 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 132/161 2023-12-14T14:01:45.022 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T14:01:45.184 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 133/161 2023-12-14T14:01:45.505 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 135/161 2023-12-14T14:01:45.743 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T14:01:45.861 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 136/161 2023-12-14T14:01:46.063 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T14:01:46.113 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 137/161 2023-12-14T14:01:46.123 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T14:01:46.300 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 138/161 2023-12-14T14:01:46.507 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 139/161 2023-12-14T14:01:46.590 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 135/161 2023-12-14T14:01:46.771 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 140/161 2023-12-14T14:01:46.974 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 136/161 2023-12-14T14:01:47.035 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-1:1.1.1k-9.el8_7.x86_64 141/161 2023-12-14T14:01:47.199 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 142/161 2023-12-14T14:01:47.208 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 142/161 2023-12-14T14:01:47.258 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 137/161 2023-12-14T14:01:47.418 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 143/161 2023-12-14T14:01:47.435 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T14:01:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 138/161 2023-12-14T14:01:47.616 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flex-2.6.1-9.el8.x86_64 144/161 2023-12-14T14:01:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 139/161 2023-12-14T14:01:47.699 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 144/161 2023-12-14T14:01:47.750 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T14:01:47.796 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T14:01:47.942 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : bison-3.0.4-10.el8.x86_64 145/161 2023-12-14T14:01:47.954 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 145/161 2023-12-14T14:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 140/161 2023-12-14T14:01:48.129 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 146/161 2023-12-14T14:01:48.282 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 135/161 2023-12-14T14:01:48.287 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:1.1.1k-9.el8_7.x86_64 141/161 2023-12-14T14:01:48.318 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 147/161 2023-12-14T14:01:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/161 2023-12-14T14:01:48.480 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 148/161 2023-12-14T14:01:48.480 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T14:01:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/161 2023-12-14T14:01:48.661 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 136/161 2023-12-14T14:01:48.761 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T14:01:48.761 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T14:01:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/161 2023-12-14T14:01:48.784 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/161 2023-12-14T14:01:48.895 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 137/161 2023-12-14T14:01:48.962 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 144/161 2023-12-14T14:01:48.971 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 144/161 2023-12-14T14:01:48.986 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T14:01:48.986 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T14:01:49.058 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 138/161 2023-12-14T14:01:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 145/161 2023-12-14T14:01:49.240 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T14:01:49.299 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 139/161 2023-12-14T14:01:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 146/161 2023-12-14T14:01:49.451 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 152/161 2023-12-14T14:01:49.489 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 147/161 2023-12-14T14:01:49.595 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 140/161 2023-12-14T14:01:49.649 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 153/161 2023-12-14T14:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 148/161 2023-12-14T14:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T14:01:49.902 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 154/161 2023-12-14T14:01:49.902 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T14:01:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:1.1.1k-9.el8_7.x86_64 141/161 2023-12-14T14:01:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T14:01:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T14:01:50.074 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 142/161 2023-12-14T14:01:50.085 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 142/161 2023-12-14T14:01:50.127 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T14:01:50.127 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T14:01:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T14:01:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T14:01:50.292 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 143/161 2023-12-14T14:01:50.377 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T14:01:50.377 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T14:01:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T14:01:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.1-9.el8.x86_64 144/161 2023-12-14T14:01:50.594 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T14:01:50.594 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T14:01:50.632 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 144/161 2023-12-14T14:01:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 152/161 2023-12-14T14:01:50.816 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.0.4-10.el8.x86_64 145/161 2023-12-14T14:01:50.829 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 145/161 2023-12-14T14:01:50.860 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T14:01:50.860 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T14:01:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 153/161 2023-12-14T14:01:51.004 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 146/161 2023-12-14T14:01:51.085 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T14:01:51.147 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 154/161 2023-12-14T14:01:51.148 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T14:01:51.209 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 147/161 2023-12-14T14:01:51.252 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 160/161 2023-12-14T14:01:51.252 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T14:01:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T14:01:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T14:01:51.403 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 148/161 2023-12-14T14:01:51.403 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T14:01:51.648 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T14:01:51.648 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T14:01:51.719 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T14:01:51.719 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T14:01:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T14:01:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T14:01:51.961 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T14:01:51.961 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T14:01:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T14:01:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T14:01:52.172 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 1/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 3/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 4/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 5/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 6/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 7/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 8/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 13/161 2023-12-14T14:01:52.173 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 14/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 15/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 16/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 17/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 18/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 20/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 21/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 22/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 23/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 24/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 25/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 26/161 2023-12-14T14:01:52.174 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 27/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 28/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 29/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 30/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 31/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 32/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 33/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 34/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 35/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 36/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 37/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 38/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/161 2023-12-14T14:01:52.175 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/161 2023-12-14T14:01:52.176 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/161 2023-12-14T14:01:52.177 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 72/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 74/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 75/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 76/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flex-2.6.1-9.el8.x86_64 79/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 80/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 81/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 82/161 2023-12-14T14:01:52.178 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 83/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 86/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 87/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 88/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 89/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 90/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 91/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 92/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 93/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 94/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 95/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 96/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 97/161 2023-12-14T14:01:52.179 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-server-10.23-2.module+el8.8.0+19493+5 98/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : automake-1.16.1-8.el8.noarch 99/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libpq-13.11-1.el8.x86_64 100/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : jq-1.6-7.el8.x86_64 101/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 102/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 103/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 104/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 105/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 106/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 107/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 108/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 109/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/161 2023-12-14T14:01:52.180 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 112/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 113/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 114/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 115/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 116/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 117/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8_7.x86_64 118/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 122/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 123/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 124/161 2023-12-14T14:01:52.181 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 125/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 126/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 127/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 128/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 129/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 130/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 132/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:1.1.1k-9.el8_7.x86_64 134/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 135/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8_7.x86_64 136/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 138/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 139/161 2023-12-14T14:01:52.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 140/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 141/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 143/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 145/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 147/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 149/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 151/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/161 2023-12-14T14:01:52.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 154/161 2023-12-14T14:01:52.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 155/161 2023-12-14T14:01:52.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 156/161 2023-12-14T14:01:52.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T14:01:52.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 158/161 2023-12-14T14:01:52.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 159/161 2023-12-14T14:01:52.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 160/161 2023-12-14T14:01:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T14:01:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T14:01:52.450 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 152/161 2023-12-14T14:01:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 160/161 2023-12-14T14:01:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T14:01:52.658 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 153/161 2023-12-14T14:01:52.917 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 154/161 2023-12-14T14:01:52.918 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T14:01:53.126 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T14:01:53.126 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T14:01:53.385 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T14:01:53.385 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T14:01:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T14:01:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 1/161 2023-12-14T14:01:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2/161 2023-12-14T14:01:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 3/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 4/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 5/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 6/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 7/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 8/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 13/161 2023-12-14T14:01:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 14/161 2023-12-14T14:01:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 15/161 2023-12-14T14:01:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 16/161 2023-12-14T14:01:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 17/161 2023-12-14T14:01:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 18/161 2023-12-14T14:01:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T14:01:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 20/161 2023-12-14T14:01:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 21/161 2023-12-14T14:01:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 22/161 2023-12-14T14:01:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 23/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 24/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 25/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 26/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 27/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 28/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 29/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 30/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 31/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 32/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 33/161 2023-12-14T14:01:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 34/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 35/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 36/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 37/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 38/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/161 2023-12-14T14:01:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/161 2023-12-14T14:01:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/161 2023-12-14T14:01:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/161 2023-12-14T14:01:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8_7.x86_64 87/161 2023-12-14T14:01:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 91/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 92/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 93/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 94/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 95/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 96/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 97/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 98/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/161 2023-12-14T14:01:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/161 2023-12-14T14:01:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 110/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 113/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 114/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 115/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 116/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 117/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 118/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 119/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 120/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 121/161 2023-12-14T14:01:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 122/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 123/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 124/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-10.23-2.module+el8.8.0+19493+5 125/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.1-8.el8.noarch 126/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpq-13.11-1.el8.x86_64 127/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : jq-1.6-7.el8.x86_64 128/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 129/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 130/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 132/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/161 2023-12-14T14:01:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:1.1.1k-9.el8_7.x86_64 134/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 135/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8_7.x86_64 136/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 138/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 139/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 140/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 141/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 143/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 145/161 2023-12-14T14:01:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 147/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 149/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 151/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 154/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 155/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 156/161 2023-12-14T14:01:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T14:01:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 158/161 2023-12-14T14:01:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 159/161 2023-12-14T14:01:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 160/161 2023-12-14T14:01:53.634 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T14:01:53.635 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T14:01:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T14:01:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T14:01:54.117 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T14:01:54.301 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 160/161 2023-12-14T14:01:54.301 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T14:01:55.203 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T14:01:55.203 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 1/161 2023-12-14T14:01:55.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2/161 2023-12-14T14:01:55.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 3/161 2023-12-14T14:01:55.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 4/161 2023-12-14T14:01:55.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 5/161 2023-12-14T14:01:55.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 6/161 2023-12-14T14:01:55.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 7/161 2023-12-14T14:01:55.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 8/161 2023-12-14T14:01:55.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T14:01:55.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T14:01:55.205 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T14:01:55.205 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T14:01:55.205 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 13/161 2023-12-14T14:01:55.205 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 14/161 2023-12-14T14:01:55.205 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 15/161 2023-12-14T14:01:55.205 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 16/161 2023-12-14T14:01:55.205 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 17/161 2023-12-14T14:01:55.205 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 18/161 2023-12-14T14:01:55.205 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T14:01:55.206 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 20/161 2023-12-14T14:01:55.206 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 21/161 2023-12-14T14:01:55.206 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 22/161 2023-12-14T14:01:55.206 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 23/161 2023-12-14T14:01:55.206 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 24/161 2023-12-14T14:01:55.206 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 25/161 2023-12-14T14:01:55.206 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 26/161 2023-12-14T14:01:55.206 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 27/161 2023-12-14T14:01:55.206 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 28/161 2023-12-14T14:01:55.207 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 29/161 2023-12-14T14:01:55.207 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 30/161 2023-12-14T14:01:55.207 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 31/161 2023-12-14T14:01:55.207 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 32/161 2023-12-14T14:01:55.207 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 33/161 2023-12-14T14:01:55.207 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 34/161 2023-12-14T14:01:55.207 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 35/161 2023-12-14T14:01:55.207 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 36/161 2023-12-14T14:01:55.207 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 37/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 38/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/161 2023-12-14T14:01:55.208 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/161 2023-12-14T14:01:55.209 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/161 2023-12-14T14:01:55.209 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/161 2023-12-14T14:01:55.209 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/161 2023-12-14T14:01:55.209 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/161 2023-12-14T14:01:55.209 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/161 2023-12-14T14:01:55.209 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/161 2023-12-14T14:01:55.209 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/161 2023-12-14T14:01:55.209 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/161 2023-12-14T14:01:55.210 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 72/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 74/161 2023-12-14T14:01:55.211 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 75/161 2023-12-14T14:01:55.212 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 76/161 2023-12-14T14:01:55.212 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/161 2023-12-14T14:01:55.212 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/161 2023-12-14T14:01:55.212 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.1-9.el8.x86_64 79/161 2023-12-14T14:01:55.212 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 80/161 2023-12-14T14:01:55.212 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 81/161 2023-12-14T14:01:55.212 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 82/161 2023-12-14T14:01:55.212 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 83/161 2023-12-14T14:01:55.212 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/161 2023-12-14T14:01:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/161 2023-12-14T14:01:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 86/161 2023-12-14T14:01:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 87/161 2023-12-14T14:01:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 88/161 2023-12-14T14:01:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 89/161 2023-12-14T14:01:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 90/161 2023-12-14T14:01:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 91/161 2023-12-14T14:01:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 92/161 2023-12-14T14:01:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 93/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 94/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 95/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 96/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 97/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-10.23-2.module+el8.8.0+19493+5 98/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.1-8.el8.noarch 99/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpq-13.11-1.el8.x86_64 100/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : jq-1.6-7.el8.x86_64 101/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 102/161 2023-12-14T14:01:55.214 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 103/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 104/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 105/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 106/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 107/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 108/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 109/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 112/161 2023-12-14T14:01:55.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 113/161 2023-12-14T14:01:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 114/161 2023-12-14T14:01:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 115/161 2023-12-14T14:01:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 116/161 2023-12-14T14:01:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 117/161 2023-12-14T14:01:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8_7.x86_64 118/161 2023-12-14T14:01:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/161 2023-12-14T14:01:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/161 2023-12-14T14:01:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/161 2023-12-14T14:01:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 122/161 2023-12-14T14:01:55.217 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 123/161 2023-12-14T14:01:55.217 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 124/161 2023-12-14T14:01:55.217 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 125/161 2023-12-14T14:01:55.217 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 126/161 2023-12-14T14:01:55.217 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 127/161 2023-12-14T14:01:55.217 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 128/161 2023-12-14T14:01:55.217 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 129/161 2023-12-14T14:01:55.217 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 130/161 2023-12-14T14:01:55.217 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/161 2023-12-14T14:01:55.218 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 132/161 2023-12-14T14:01:55.218 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/161 2023-12-14T14:01:55.218 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:1.1.1k-9.el8_7.x86_64 134/161 2023-12-14T14:01:55.218 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 135/161 2023-12-14T14:01:55.218 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8_7.x86_64 136/161 2023-12-14T14:01:55.218 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/161 2023-12-14T14:01:55.218 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 138/161 2023-12-14T14:01:55.218 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 139/161 2023-12-14T14:01:55.218 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 140/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 141/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 143/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 145/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 147/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 149/161 2023-12-14T14:01:55.219 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/161 2023-12-14T14:01:55.220 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 151/161 2023-12-14T14:01:55.220 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/161 2023-12-14T14:01:55.220 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/161 2023-12-14T14:01:55.220 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 154/161 2023-12-14T14:01:55.220 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 155/161 2023-12-14T14:01:55.220 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 156/161 2023-12-14T14:01:55.220 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T14:01:55.220 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 158/161 2023-12-14T14:01:55.220 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 159/161 2023-12-14T14:01:55.221 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 160/161 2023-12-14T14:01:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 161/161 2023-12-14T14:01:58.614 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-12-14T14:01:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:01:59.212 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2023-12-14T14:01:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-14T14:01:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-14T14:01:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-14T14:01:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-14T14:01:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-14T14:01:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-1:1.1.1k-9.el8_7.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs-1:1.1.1k-9.el8_7.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-12-14T14:01:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: automake-1.16.1-8.el8.noarch 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: bison-3.0.4-10.el8.x86_64 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:01:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: flex-2.6.1-9.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: jq-1.6-7.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-14T14:01:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: libpq-13.11-1.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-14T14:01:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel-1:1.1.1k-9.el8_7.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T14:01:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-14T14:01:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-14T14:01:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-2.6-1.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-14T14:01:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-14T14:01:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-14T14:01:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:01:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-14T14:01:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-14T14:01:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-14T14:01:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-14T14:01:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-14T14:01:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-14T14:01:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:01:59.224 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-14T14:01:59.418 DEBUG:teuthology.parallel:result is None 2023-12-14T14:01:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 161/161 2023-12-14T14:01:59.630 INFO:teuthology.orchestra.run.smithi081.stdout:Installed products updated. 2023-12-14T14:02:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T14:02:00.209 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-12-14T14:02:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-14T14:02:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-14T14:02:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-14T14:02:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-14T14:02:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-14T14:02:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:1.1.1k-9.el8_7.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:1.1.1k-9.el8_7.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.1-8.el8.noarch 2023-12-14T14:02:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.0.4-10.el8.x86_64 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.1-9.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-14T14:02:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: jq-1.6-7.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: libpq-13.11-1.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-14T14:02:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-14T14:02:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:1.1.1k-9.el8_7.x86_64 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-14T14:02:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-2.6-1.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-14T14:02:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-14T14:02:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-14T14:02:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-14T14:02:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-14T14:02:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-14T14:02:00.220 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-12-14T14:02:00.434 DEBUG:teuthology.parallel:result is None 2023-12-14T14:02:01.838 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 161/161 2023-12-14T14:02:01.839 INFO:teuthology.orchestra.run.smithi119.stdout:Installed products updated. 2023-12-14T14:02:02.419 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T14:02:02.419 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2023-12-14T14:02:02.419 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:1.1.1k-9.el8_7.x86_64 2023-12-14T14:02:02.420 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:1.1.1k-9.el8_7.x86_64 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.1-8.el8.noarch 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.0.4-10.el8.x86_64 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.421 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.422 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.1-9.el8.x86_64 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-14T14:02:02.423 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: jq-1.6-7.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: libpq-13.11-1.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-14T14:02:02.424 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-14T14:02:02.425 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:1.1.1k-9.el8_7.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-14T14:02:02.426 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-14T14:02:02.427 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-14T14:02:02.428 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-2.6-1.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-14T14:02:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-14T14:02:02.430 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-14T14:02:02.431 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.431 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.431 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T14:02:02.431 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-14T14:02:02.431 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-14T14:02:02.431 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-14T14:02:02.431 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-14T14:02:02.431 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-14T14:02:02.432 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-14T14:02:02.432 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T14:02:02.432 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-14T14:02:04.035 DEBUG:teuthology.parallel:result is None 2023-12-14T14:02:04.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T14:02:04.179 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-14T14:02:04.209 INFO:teuthology.orchestra.run.smithi069.stdout:18.0.0-3905.g1faa3533.el8 2023-12-14T14:02:04.209 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3905.g1faa3533.el8 2023-12-14T14:02:04.210 INFO:teuthology.task.install:The correct ceph version 18.0.0-3905.g1faa3533 is installed. 2023-12-14T14:02:04.211 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T14:02:04.345 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-14T14:02:04.374 INFO:teuthology.orchestra.run.smithi081.stdout:18.0.0-3905.g1faa3533.el8 2023-12-14T14:02:04.375 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3905.g1faa3533.el8 2023-12-14T14:02:04.375 INFO:teuthology.task.install:The correct ceph version 18.0.0-3905.g1faa3533 is installed. 2023-12-14T14:02:04.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T14:02:04.512 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-14T14:02:04.537 INFO:teuthology.orchestra.run.smithi119.stdout:18.0.0-3905.g1faa3533.el8 2023-12-14T14:02:04.537 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3905.g1faa3533.el8 2023-12-14T14:02:04.537 INFO:teuthology.task.install:The correct ceph version 18.0.0-3905.g1faa3533 is installed. 2023-12-14T14:02:04.539 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-14T14:02:04.571 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:02:04.571 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-14T14:02:04.619 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T14:02:04.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-14T14:02:04.668 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T14:02:04.668 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-14T14:02:04.711 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-14T14:02:04.711 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:02:04.711 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2023-12-14T14:02:04.742 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-14T14:02:04.811 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T14:02:04.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-12-14T14:02:04.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-14T14:02:04.910 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T14:02:04.911 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2023-12-14T14:02:04.938 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-14T14:02:05.005 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-14T14:02:05.006 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:02:05.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-14T14:02:05.037 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-14T14:02:05.107 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T14:02:05.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-14T14:02:05.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-14T14:02:05.206 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T14:02:05.207 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-14T14:02:05.234 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-14T14:02:05.301 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-14T14:02:05.312 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:02:05.312 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2023-12-14T14:02:05.344 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-14T14:02:05.416 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T14:02:05.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-12-14T14:02:05.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-14T14:02:05.519 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T14:02:05.519 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2023-12-14T14:02:05.547 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-14T14:02:05.614 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-14T14:02:06.230 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-12-14T14:02:06.230 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T14:02:06.231 INFO:tasks.cephadm:Cluster fsid is 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:02:06.231 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-14T14:02:06.232 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.69', 'mon.b': '172.21.15.81', 'mon.c': '172.21.15.119'} 2023-12-14T14:02:06.232 INFO:tasks.cephadm:First mon is mon.a on smithi069 2023-12-14T14:02:06.232 INFO:tasks.cephadm:First mgr is x 2023-12-14T14:02:06.232 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-14T14:02:06.232 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname $(hostname -s) 2023-12-14T14:02:06.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2023-12-14T14:02:06.298 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname $(hostname -s) 2023-12-14T14:02:06.327 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-12-14T14:02:06.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T14:02:06.544 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/74952/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-3905-g1faa3533', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-3905.g1faa3533'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-12-13 17:15:35.607942', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-choffman-62793', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2023-12-14T14:02:06.678 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-choffman-62793, sha1 1faa353368ad4f5aeb56d7107b638336f58659ed from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T14:02:06.679 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/x86_64/flavors/default/cephadm 2023-12-14T14:02:06.680 DEBUG:teuthology.orchestra.run.smithi069:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-14T14:02:07.630 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r--. 1 ubuntu ubuntu 384133 Dec 14 14:02 /home/ubuntu/cephtest/cephadm 2023-12-14T14:02:07.630 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-14T14:02:08.567 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-rw-r--. 1 ubuntu ubuntu 384133 Dec 14 14:02 /home/ubuntu/cephtest/cephadm 2023-12-14T14:02:08.567 DEBUG:teuthology.orchestra.run.smithi119:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-14T14:02:09.098 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-rw-r--. 1 ubuntu ubuntu 384133 Dec 14 14:02 /home/ubuntu/cephtest/cephadm 2023-12-14T14:02:09.098 DEBUG:teuthology.orchestra.run.smithi069:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-14T14:02:09.122 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-14T14:02:09.144 DEBUG:teuthology.orchestra.run.smithi119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-14T14:02:09.183 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed on all hosts... 2023-12-14T14:02:09.183 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed pull 2023-12-14T14:02:09.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed pull 2023-12-14T14:02:09.188 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed pull 2023-12-14T14:02:11.318 INFO:teuthology.orchestra.run.smithi069.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T14:02:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T14:02:13.748 INFO:teuthology.orchestra.run.smithi119.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T14:02:48.001 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:02:48.001 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev)", 2023-12-14T14:02:48.001 INFO:teuthology.orchestra.run.smithi069.stdout: "image_id": "0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0", 2023-12-14T14:02:48.001 INFO:teuthology.orchestra.run.smithi069.stdout: "repo_digests": [ 2023-12-14T14:02:48.001 INFO:teuthology.orchestra.run.smithi069.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:4f00bb7c6b97266b68e12e45f4e426e52b86010cb97d3e773903241deee4098b" 2023-12-14T14:02:48.001 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:02:48.001 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:03:11.919 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T14:03:11.919 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev)", 2023-12-14T14:03:11.919 INFO:teuthology.orchestra.run.smithi119.stdout: "image_id": "0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0", 2023-12-14T14:03:11.919 INFO:teuthology.orchestra.run.smithi119.stdout: "repo_digests": [ 2023-12-14T14:03:11.919 INFO:teuthology.orchestra.run.smithi119.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:4f00bb7c6b97266b68e12e45f4e426e52b86010cb97d3e773903241deee4098b" 2023-12-14T14:03:11.919 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2023-12-14T14:03:11.919 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T14:03:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-12-14T14:03:21.230 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev)", 2023-12-14T14:03:21.230 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0", 2023-12-14T14:03:21.230 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2023-12-14T14:03:21.230 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:4f00bb7c6b97266b68e12e45f4e426e52b86010cb97d3e773903241deee4098b" 2023-12-14T14:03:21.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-12-14T14:03:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-12-14T14:03:21.249 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph 2023-12-14T14:03:21.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2023-12-14T14:03:21.319 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph 2023-12-14T14:03:21.357 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /etc/ceph 2023-12-14T14:03:21.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2023-12-14T14:03:21.415 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /etc/ceph 2023-12-14T14:03:21.446 INFO:tasks.cephadm:Writing seed config... 2023-12-14T14:03:21.473 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-12-14T14:03:21.474 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-12-14T14:03:21.475 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-12-14T14:03:21.476 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-12-14T14:03:21.477 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-14T14:03:21.477 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-14T14:03:21.477 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-12-14T14:03:21.477 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-14T14:03:21.477 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-14T14:03:21.477 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-14T14:03:21.477 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-14T14:03:21.477 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-14T14:03:21.477 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-14T14:03:21.478 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-12-14T14:03:21.478 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-12-14T14:03:21.479 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:03:21.479 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-14T14:03:21.499 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5d58180a-9a89-11ee-95a3-87774f69a715 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-14T14:03:21.500 DEBUG:teuthology.orchestra.run.smithi069:mon.a> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.a.service 2023-12-14T14:03:21.542 DEBUG:teuthology.orchestra.run.smithi069:mgr.x> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.x.service 2023-12-14T14:03:21.572 INFO:journalctl@ceph.mon.a.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:03:21.573 INFO:tasks.cephadm:Bootstrapping... 2023-12-14T14:03:21.573 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed -v bootstrap --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.69 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-14T14:03:21.601 INFO:journalctl@ceph.mgr.x.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:03:21.825 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-12-14T14:03:21.825 INFO:teuthology.orchestra.run.smithi069.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed', '-v', 'bootstrap', '--fsid', '5d58180a-9a89-11ee-95a3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.69', '--skip-admin-label'] 2023-12-14T14:03:21.853 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 4.6.1 2023-12-14T14:03:21.854 INFO:teuthology.orchestra.run.smithi069.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-14T14:03:21.854 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying podman|docker is present... 2023-12-14T14:03:21.884 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 4.6.1 2023-12-14T14:03:21.884 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying lvm2 is present... 2023-12-14T14:03:21.884 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying time synchronization is in place... 2023-12-14T14:03:21.891 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-14T14:03:21.892 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-14T14:03:21.898 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-14T14:03:21.898 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T14:03:21.904 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout enabled 2023-12-14T14:03:21.909 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout active 2023-12-14T14:03:21.909 INFO:teuthology.orchestra.run.smithi069.stdout:Unit chronyd.service is enabled and running 2023-12-14T14:03:21.910 INFO:teuthology.orchestra.run.smithi069.stdout:Repeating the final host check... 2023-12-14T14:03:21.936 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 4.6.1 2023-12-14T14:03:21.936 INFO:teuthology.orchestra.run.smithi069.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-14T14:03:21.936 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl is present 2023-12-14T14:03:21.936 INFO:teuthology.orchestra.run.smithi069.stdout:lvcreate is present 2023-12-14T14:03:21.942 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-14T14:03:21.942 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-14T14:03:21.948 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-14T14:03:21.948 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T14:03:21.954 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout enabled 2023-12-14T14:03:21.960 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout active 2023-12-14T14:03:21.960 INFO:teuthology.orchestra.run.smithi069.stdout:Unit chronyd.service is enabled and running 2023-12-14T14:03:21.960 INFO:teuthology.orchestra.run.smithi069.stdout:Host looks OK 2023-12-14T14:03:21.960 INFO:teuthology.orchestra.run.smithi069.stdout:Cluster fsid: 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:21.960 INFO:teuthology.orchestra.run.smithi069.stdout:Acquiring lock 140687134046696 on /run/cephadm/5d58180a-9a89-11ee-95a3-87774f69a715.lock 2023-12-14T14:03:21.960 INFO:teuthology.orchestra.run.smithi069.stdout:Lock 140687134046696 acquired on /run/cephadm/5d58180a-9a89-11ee-95a3-87774f69a715.lock 2023-12-14T14:03:21.961 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying IP 172.21.15.69 port 3300 ... 2023-12-14T14:03:21.961 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying IP 172.21.15.69 port 6789 ... 2023-12-14T14:03:21.961 INFO:teuthology.orchestra.run.smithi069.stdout:Base mon IP(s) is [172.21.15.69:3300, 172.21.15.69:6789], mon addrv is [v2:172.21.15.69:3300,v1:172.21.15.69:6789] 2023-12-14T14:03:21.965 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-12-14T14:03:21.965 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.69 metric 100 2023-12-14T14:03:21.968 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-14T14:03:21.968 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-12-14T14:03:21.968 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-12-14T14:03:21.971 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-14T14:03:21.971 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-14T14:03:21.971 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-14T14:03:21.971 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-14T14:03:21.971 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout inet6 fe80::1d34:72f5:1e53:57c0/64 scope link noprefixroute 2023-12-14T14:03:21.971 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-14T14:03:21.972 INFO:teuthology.orchestra.run.smithi069.stdout:Mon IP `172.21.15.69` is in CIDR network `172.21.0.0/20` 2023-12-14T14:03:21.972 INFO:teuthology.orchestra.run.smithi069.stdout:Mon IP `172.21.15.69` is in CIDR network `172.21.0.0/20` 2023-12-14T14:03:21.972 INFO:teuthology.orchestra.run.smithi069.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-14T14:03:21.973 INFO:teuthology.orchestra.run.smithi069.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-14T14:03:21.974 INFO:teuthology.orchestra.run.smithi069.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T14:03:22.371 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0 2023-12-14T14:03:22.371 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T14:03:22.371 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Getting image source signatures 2023-12-14T14:03:22.371 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying blob sha256:a83bc5fcf8de435b160e58e3bb5830aa8038f139ef00a293340a26641aa5a474 2023-12-14T14:03:22.371 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2023-12-14T14:03:22.371 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying config sha256:0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0 2023-12-14T14:03:22.371 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-14T14:03:23.046 INFO:teuthology.orchestra.run.smithi069.stdout:ceph: stdout ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev) 2023-12-14T14:03:23.046 INFO:teuthology.orchestra.run.smithi069.stdout:Ceph version: ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev) 2023-12-14T14:03:23.046 INFO:teuthology.orchestra.run.smithi069.stdout:Extracting ceph user uid/gid from container image... 2023-12-14T14:03:23.651 INFO:teuthology.orchestra.run.smithi069.stdout:stat: stdout 167 167 2023-12-14T14:03:23.651 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial keys... 2023-12-14T14:03:24.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQArC3tlRt1ANRAANIXIwRYnDHYks/1an6zzMA== 2023-12-14T14:03:24.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQAsC3tlxEzfHBAA8uVbExUcmHNeFi+1FLrT2Q== 2023-12-14T14:03:25.420 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQAtC3tlpZKNAxAA0n2vJA3/freeD3mjQwmPZg== 2023-12-14T14:03:25.421 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial monmap... 2023-12-14T14:03:26.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-14T14:03:26.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-12-14T14:03:26.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:26.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-14T14:03:26.068 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool for a [v2:172.21.15.69:3300,v1:172.21.15.69:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-14T14:03:26.068 INFO:teuthology.orchestra.run.smithi069.stdout:setting min_mon_release = pacific 2023-12-14T14:03:26.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: set fsid to 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:26.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-14T14:03:26.068 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:03:26.069 INFO:teuthology.orchestra.run.smithi069.stdout:Creating mon... 2023-12-14T14:03:26.684 INFO:teuthology.orchestra.run.smithi069.stdout:create mon.a on 2023-12-14T14:03:26.778 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-14T14:03:26.869 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-14T14:03:26.965 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5d58180a-9a89-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-5d58180a-9a89-11ee-95a3-87774f69a715.target. 2023-12-14T14:03:26.965 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5d58180a-9a89-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-5d58180a-9a89-11ee-95a3-87774f69a715.target. 2023-12-14T14:03:27.094 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.a 2023-12-14T14:03:27.094 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.a.service: Unit ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.a.service not loaded. 2023-12-14T14:03:27.180 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5d58180a-9a89-11ee-95a3-87774f69a715.target.wants/ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.a.service → /etc/systemd/system/ceph-5d58180a-9a89-11ee-95a3-87774f69a715@.service. 2023-12-14T14:03:27.619 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-14T14:03:27.619 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2023-12-14T14:03:27.627 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-14T14:03:27.627 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T14:03:27.627 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2023-12-14T14:03:27.627 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to enable service . firewalld.service is not available 2023-12-14T14:03:27.627 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mon to start... 2023-12-14T14:03:27.628 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mon... 2023-12-14T14:03:28.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:27 smithi069 ceph-mon[41554]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-14T14:03:28.451 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout cluster: 2023-12-14T14:03:28.451 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout id: 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:28.451 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-14T14:03:28.451 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:28.451 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout services: 2023-12-14T14:03:28.451 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.448336s) 2023-12-14T14:03:28.451 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-14T14:03:28.451 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout data: 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout pgs: 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.007+0000 7fb09a8f9700 1 Processor -- start 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.007+0000 7fb09a8f9700 1 -- start start 2023-12-14T14:03:28.452 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.008+0000 7fb09a8f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb0941063b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:28.453 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.008+0000 7fb09a8f9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb094106980 con 0x7fb094105fa0 2023-12-14T14:03:28.453 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.008+0000 7fb093fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb0941063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:28.453 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.008+0000 7fb093fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb0941063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57610/0 (socket says 172.21.15.69:57610) 2023-12-14T14:03:28.453 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.008+0000 7fb093fff700 1 -- 172.21.15.69:0/868417141 learned_addr learned my addr 172.21.15.69:0/868417141 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:28.453 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.008+0000 7fb093fff700 1 -- 172.21.15.69:0/868417141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb094106ac0 con 0x7fb094105fa0 2023-12-14T14:03:28.453 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb093fff700 1 --2- 172.21.15.69:0/868417141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb0941063b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb0840098a0 tx=0x7fb084009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe84ce8f883d582 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:28.453 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb092ffd700 1 -- 172.21.15.69:0/868417141 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb084004160 con 0x7fb094105fa0 2023-12-14T14:03:28.454 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb092ffd700 1 -- 172.21.15.69:0/868417141 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0840042c0 con 0x7fb094105fa0 2023-12-14T14:03:28.454 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb092ffd700 1 -- 172.21.15.69:0/868417141 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0840045a0 con 0x7fb094105fa0 2023-12-14T14:03:28.454 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb09a8f9700 1 -- 172.21.15.69:0/868417141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 msgr2=0x7fb0941063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:28.454 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb09a8f9700 1 --2- 172.21.15.69:0/868417141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb0941063b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb0840098a0 tx=0x7fb084009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:28.454 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb09a8f9700 1 -- 172.21.15.69:0/868417141 shutdown_connections 2023-12-14T14:03:28.454 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb09a8f9700 1 --2- 172.21.15.69:0/868417141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb0941063b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:28.454 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb09a8f9700 1 -- 172.21.15.69:0/868417141 >> 172.21.15.69:0/868417141 conn(0x7fb0940ff650 msgr2=0x7fb094101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:28.454 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb09a8f9700 1 -- 172.21.15.69:0/868417141 shutdown_connections 2023-12-14T14:03:28.454 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.009+0000 7fb09a8f9700 1 -- 172.21.15.69:0/868417141 wait complete. 2023-12-14T14:03:28.455 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.010+0000 7fb09a8f9700 1 Processor -- start 2023-12-14T14:03:28.455 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.010+0000 7fb09a8f9700 1 -- start start 2023-12-14T14:03:28.455 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.010+0000 7fb09a8f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb09419b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:28.455 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.010+0000 7fb09a8f9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09419b640 con 0x7fb094105fa0 2023-12-14T14:03:28.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.010+0000 7fb093fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb09419b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:28.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.010+0000 7fb093fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb09419b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57626/0 (socket says 172.21.15.69:57626) 2023-12-14T14:03:28.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.010+0000 7fb093fff700 1 -- 172.21.15.69:0/2295534131 learned_addr learned my addr 172.21.15.69:0/2295534131 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:28.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.011+0000 7fb093fff700 1 -- 172.21.15.69:0/2295534131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb084009550 con 0x7fb094105fa0 2023-12-14T14:03:28.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.011+0000 7fb093fff700 1 --2- 172.21.15.69:0/2295534131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb09419b100 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb0940666c0 tx=0x7fb084004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:28.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.011+0000 7fb0917fa700 1 -- 172.21.15.69:0/2295534131 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb084011630 con 0x7fb094105fa0 2023-12-14T14:03:28.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.011+0000 7fb0917fa700 1 -- 172.21.15.69:0/2295534131 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb084011790 con 0x7fb094105fa0 2023-12-14T14:03:28.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.011+0000 7fb0917fa700 1 -- 172.21.15.69:0/2295534131 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb084011a30 con 0x7fb094105fa0 2023-12-14T14:03:28.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.011+0000 7fb09a8f9700 1 -- 172.21.15.69:0/2295534131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb094103d50 con 0x7fb094105fa0 2023-12-14T14:03:28.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.011+0000 7fb09a8f9700 1 -- 172.21.15.69:0/2295534131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb094103bc0 con 0x7fb094105fa0 2023-12-14T14:03:28.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.011+0000 7fb0917fa700 1 -- 172.21.15.69:0/2295534131 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb084022070 con 0x7fb094105fa0 2023-12-14T14:03:28.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.011+0000 7fb0917fa700 1 -- 172.21.15.69:0/2295534131 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb08401c450 con 0x7fb094105fa0 2023-12-14T14:03:28.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.012+0000 7fb09a8f9700 1 -- 172.21.15.69:0/2295534131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb094194a80 con 0x7fb094105fa0 2023-12-14T14:03:28.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.014+0000 7fb0917fa700 1 -- 172.21.15.69:0/2295534131 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb08401b450 con 0x7fb094105fa0 2023-12-14T14:03:28.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.083+0000 7fb09a8f9700 1 -- 172.21.15.69:0/2295534131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb094062120 con 0x7fb094105fa0 2023-12-14T14:03:28.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.084+0000 7fb0917fa700 1 -- 172.21.15.69:0/2295534131 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fb094062120 con 0x7fb094105fa0 2023-12-14T14:03:28.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.084+0000 7fb09a8f9700 1 -- 172.21.15.69:0/2295534131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 msgr2=0x7fb09419b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:28.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.084+0000 7fb09a8f9700 1 --2- 172.21.15.69:0/2295534131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb09419b100 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb0940666c0 tx=0x7fb084004750 comp rx=0 tx=0).stop 2023-12-14T14:03:28.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.084+0000 7fb09a8f9700 1 -- 172.21.15.69:0/2295534131 shutdown_connections 2023-12-14T14:03:28.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.084+0000 7fb09a8f9700 1 --2- 172.21.15.69:0/2295534131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb094105fa0 0x7fb09419b100 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:28.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.084+0000 7fb09a8f9700 1 -- 172.21.15.69:0/2295534131 >> 172.21.15.69:0/2295534131 conn(0x7fb0940ff650 msgr2=0x7fb094101930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:28.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.085+0000 7fb09a8f9700 1 -- 172.21.15.69:0/2295534131 shutdown_connections 2023-12-14T14:03:28.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.085+0000 7fb09a8f9700 1 -- 172.21.15.69:0/2295534131 wait complete. 2023-12-14T14:03:28.458 INFO:teuthology.orchestra.run.smithi069.stdout:mon is available 2023-12-14T14:03:28.458 INFO:teuthology.orchestra.run.smithi069.stdout:Assimilating anything we can from ceph.conf... 2023-12-14T14:03:28.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:28 smithi069 ceph-mon[41554]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-14T14:03:28.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:28 smithi069 ceph-mon[41554]: monmap e1: 1 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0]} removed_ranks: {} 2023-12-14T14:03:28.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:28 smithi069 ceph-mon[41554]: fsmap 2023-12-14T14:03:28.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:28 smithi069 ceph-mon[41554]: osdmap e1: 0 total, 0 up, 0 in 2023-12-14T14:03:28.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:28 smithi069 ceph-mon[41554]: mgrmap e1: no daemons active 2023-12-14T14:03:28.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:28 smithi069 ceph-mon[41554]: from='client.? 172.21.15.69:0/2295534131' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-14T14:03:29.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:29.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [global] 2023-12-14T14:03:29.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout fsid = 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:29.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.69:3300,v1:172.21.15.69:6789] 2023-12-14T14:03:29.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-14T14:03:29.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-14T14:03:29.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-14T14:03:29.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [osd] 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-14T14:03:29.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-14T14:03:29.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.873+0000 7fd553281700 1 Processor -- start 2023-12-14T14:03:29.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.873+0000 7fd553281700 1 -- start start 2023-12-14T14:03:29.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.873+0000 7fd553281700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c105230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:29.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.873+0000 7fd553281700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c105800 con 0x7fd54c104e20 2023-12-14T14:03:29.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.874+0000 7fd55101d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c105230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:29.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.874+0000 7fd55101d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c105230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57636/0 (socket says 172.21.15.69:57636) 2023-12-14T14:03:29.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.874+0000 7fd55101d700 1 -- 172.21.15.69:0/2782553320 learned_addr learned my addr 172.21.15.69:0/2782553320 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:29.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.874+0000 7fd55101d700 1 -- 172.21.15.69:0/2782553320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c105b40 con 0x7fd54c104e20 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.874+0000 7fd55101d700 1 --2- 172.21.15.69:0/2782553320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c105230 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00bb40 tx=0x7fd53c00b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0fa6c2e8de6a04 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd543fff700 1 -- 172.21.15.69:0/2782553320 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd53c004160 con 0x7fd54c104e20 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd543fff700 1 -- 172.21.15.69:0/2782553320 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c0042c0 con 0x7fd54c104e20 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd543fff700 1 -- 172.21.15.69:0/2782553320 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd53c004580 con 0x7fd54c104e20 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd553281700 1 -- 172.21.15.69:0/2782553320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 msgr2=0x7fd54c105230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd553281700 1 --2- 172.21.15.69:0/2782553320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c105230 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00bb40 tx=0x7fd53c00b4d0 comp rx=0 tx=0).stop 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd553281700 1 -- 172.21.15.69:0/2782553320 shutdown_connections 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd553281700 1 --2- 172.21.15.69:0/2782553320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c105230 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd553281700 1 -- 172.21.15.69:0/2782553320 >> 172.21.15.69:0/2782553320 conn(0x7fd54c0ff650 msgr2=0x7fd54c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:29.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd553281700 1 -- 172.21.15.69:0/2782553320 shutdown_connections 2023-12-14T14:03:29.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.875+0000 7fd553281700 1 -- 172.21.15.69:0/2782553320 wait complete. 2023-12-14T14:03:29.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.876+0000 7fd553281700 1 Processor -- start 2023-12-14T14:03:29.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.876+0000 7fd553281700 1 -- start start 2023-12-14T14:03:29.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.876+0000 7fd553281700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:29.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.876+0000 7fd553281700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1972a0 con 0x7fd54c104e20 2023-12-14T14:03:29.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.876+0000 7fd55101d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:29.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.876+0000 7fd55101d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57642/0 (socket says 172.21.15.69:57642) 2023-12-14T14:03:29.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.876+0000 7fd55101d700 1 -- 172.21.15.69:0/1276082332 learned_addr learned my addr 172.21.15.69:0/1276082332 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:29.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.876+0000 7fd55101d700 1 -- 172.21.15.69:0/1276082332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c00b7f0 con 0x7fd54c104e20 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.877+0000 7fd55101d700 1 --2- 172.21.15.69:0/1276082332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c196d60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd54c073560 tx=0x7fd53c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.877+0000 7fd5427fc700 1 -- 172.21.15.69:0/1276082332 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd53c004560 con 0x7fd54c104e20 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.877+0000 7fd5427fc700 1 -- 172.21.15.69:0/1276082332 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c0036a0 con 0x7fd54c104e20 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.877+0000 7fd5427fc700 1 -- 172.21.15.69:0/1276082332 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd53c003980 con 0x7fd54c104e20 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.877+0000 7fd553281700 1 -- 172.21.15.69:0/1276082332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c105f20 con 0x7fd54c104e20 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.877+0000 7fd553281700 1 -- 172.21.15.69:0/1276082332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c105d90 con 0x7fd54c104e20 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.877+0000 7fd5427fc700 1 -- 172.21.15.69:0/1276082332 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd53c003ae0 con 0x7fd54c104e20 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.877+0000 7fd5427fc700 1 -- 172.21.15.69:0/1276082332 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd53c015070 con 0x7fd54c104e20 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.878+0000 7fd553281700 1 -- 172.21.15.69:0/1276082332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c190610 con 0x7fd54c104e20 2023-12-14T14:03:29.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.880+0000 7fd5427fc700 1 -- 172.21.15.69:0/1276082332 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd53c04bb10 con 0x7fd54c104e20 2023-12-14T14:03:29.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.947+0000 7fd553281700 1 -- 172.21.15.69:0/1276082332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd54c062120 con 0x7fd54c104e20 2023-12-14T14:03:29.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.951+0000 7fd5427fc700 1 -- 172.21.15.69:0/1276082332 <== mon.0 v2:172.21.15.69:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd53c007da0 con 0x7fd54c104e20 2023-12-14T14:03:29.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.951+0000 7fd5427fc700 1 -- 172.21.15.69:0/1276082332 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fd54c062120 con 0x7fd54c104e20 2023-12-14T14:03:29.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.952+0000 7fd553281700 1 -- 172.21.15.69:0/1276082332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 msgr2=0x7fd54c196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:29.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.952+0000 7fd553281700 1 --2- 172.21.15.69:0/1276082332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c196d60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd54c073560 tx=0x7fd53c004750 comp rx=0 tx=0).stop 2023-12-14T14:03:29.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.952+0000 7fd553281700 1 -- 172.21.15.69:0/1276082332 shutdown_connections 2023-12-14T14:03:29.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.952+0000 7fd553281700 1 --2- 172.21.15.69:0/1276082332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd54c104e20 0x7fd54c196d60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:29.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.952+0000 7fd553281700 1 -- 172.21.15.69:0/1276082332 >> 172.21.15.69:0/1276082332 conn(0x7fd54c0ff650 msgr2=0x7fd54c101950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:29.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.952+0000 7fd553281700 1 -- 172.21.15.69:0/1276082332 shutdown_connections 2023-12-14T14:03:29.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:28.952+0000 7fd553281700 1 -- 172.21.15.69:0/1276082332 wait complete. 2023-12-14T14:03:29.340 INFO:teuthology.orchestra.run.smithi069.stdout:Generating new minimal ceph.conf... 2023-12-14T14:03:29.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:29 smithi069 ceph-mon[41554]: from='client.? 172.21.15.69:0/1276082332' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-14T14:03:29.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:29 smithi069 ceph-mon[41554]: from='client.? 172.21.15.69:0/1276082332' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-14T14:03:30.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.682+0000 7f367be43700 1 Processor -- start 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.682+0000 7f367be43700 1 -- start start 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.682+0000 7f367be43700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f36741063b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.682+0000 7f367be43700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3674106980 con 0x7f3674105fa0 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.682+0000 7f3679bdf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f36741063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.682+0000 7f3679bdf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f36741063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57656/0 (socket says 172.21.15.69:57656) 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.682+0000 7f3679bdf700 1 -- 172.21.15.69:0/876936796 learned_addr learned my addr 172.21.15.69:0/876936796 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.682+0000 7f3679bdf700 1 -- 172.21.15.69:0/876936796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674106ac0 con 0x7f3674105fa0 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f3679bdf700 1 --2- 172.21.15.69:0/876936796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f36741063b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f36700098a0 tx=0x7f3670009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751ee6532acccd5f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f3678bdd700 1 -- 172.21.15.69:0/876936796 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3670004160 con 0x7f3674105fa0 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f3678bdd700 1 -- 172.21.15.69:0/876936796 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36700042c0 con 0x7f3674105fa0 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f3678bdd700 1 -- 172.21.15.69:0/876936796 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3670011a00 con 0x7f3674105fa0 2023-12-14T14:03:30.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f367be43700 1 -- 172.21.15.69:0/876936796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 msgr2=0x7f36741063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f367be43700 1 --2- 172.21.15.69:0/876936796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f36741063b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f36700098a0 tx=0x7f3670009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f367be43700 1 -- 172.21.15.69:0/876936796 shutdown_connections 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f367be43700 1 --2- 172.21.15.69:0/876936796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f36741063b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f367be43700 1 -- 172.21.15.69:0/876936796 >> 172.21.15.69:0/876936796 conn(0x7f36740ff650 msgr2=0x7f3674101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f367be43700 1 -- 172.21.15.69:0/876936796 shutdown_connections 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.683+0000 7f367be43700 1 -- 172.21.15.69:0/876936796 wait complete. 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.684+0000 7f367be43700 1 Processor -- start 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.684+0000 7f367be43700 1 -- start start 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.684+0000 7f367be43700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f367419b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.684+0000 7f367be43700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367419be70 con 0x7f3674105fa0 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.684+0000 7f3679bdf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f367419b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.684+0000 7f3679bdf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f367419b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57666/0 (socket says 172.21.15.69:57666) 2023-12-14T14:03:30.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.684+0000 7f3679bdf700 1 -- 172.21.15.69:0/1664406101 learned_addr learned my addr 172.21.15.69:0/1664406101 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.685+0000 7f3679bdf700 1 -- 172.21.15.69:0/1664406101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009550 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.685+0000 7f3679bdf700 1 --2- 172.21.15.69:0/1664406101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f367419b930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3670006af0 tx=0x7f3670011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.685+0000 7f366affd700 1 -- 172.21.15.69:0/1664406101 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3670003a40 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.685+0000 7f366affd700 1 -- 172.21.15.69:0/1664406101 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3670003ba0 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.685+0000 7f367be43700 1 -- 172.21.15.69:0/1664406101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3674104830 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.685+0000 7f366affd700 1 -- 172.21.15.69:0/1664406101 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367001a6e0 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.685+0000 7f367be43700 1 -- 172.21.15.69:0/1664406101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36741046a0 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.685+0000 7f366affd700 1 -- 172.21.15.69:0/1664406101 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f367001ac50 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.685+0000 7f366affd700 1 -- 172.21.15.69:0/1664406101 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3670019700 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.686+0000 7f367be43700 1 -- 172.21.15.69:0/1664406101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3674195600 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.688+0000 7f366affd700 1 -- 172.21.15.69:0/1664406101 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f367002ddf0 con 0x7f3674105fa0 2023-12-14T14:03:30.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.756+0000 7f367be43700 1 -- 172.21.15.69:0/1664406101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f36741049c0 con 0x7f3674105fa0 2023-12-14T14:03:30.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.756+0000 7f366affd700 1 -- 172.21.15.69:0/1664406101 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f3670024a60 con 0x7f3674105fa0 2023-12-14T14:03:30.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.757+0000 7f367be43700 1 -- 172.21.15.69:0/1664406101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 msgr2=0x7f367419b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:30.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.757+0000 7f367be43700 1 --2- 172.21.15.69:0/1664406101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f367419b930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3670006af0 tx=0x7f3670011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:30.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.757+0000 7f367be43700 1 -- 172.21.15.69:0/1664406101 shutdown_connections 2023-12-14T14:03:30.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.757+0000 7f367be43700 1 --2- 172.21.15.69:0/1664406101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3674105fa0 0x7f367419b930 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:30.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.757+0000 7f367be43700 1 -- 172.21.15.69:0/1664406101 >> 172.21.15.69:0/1664406101 conn(0x7f36740ff650 msgr2=0x7f3674192740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:30.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.757+0000 7f367be43700 1 -- 172.21.15.69:0/1664406101 shutdown_connections 2023-12-14T14:03:30.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:29.757+0000 7f367be43700 1 -- 172.21.15.69:0/1664406101 wait complete. 2023-12-14T14:03:30.149 INFO:teuthology.orchestra.run.smithi069.stdout:Restarting the monitor... 2023-12-14T14:03:30.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:30 smithi069 systemd[1]: Stopping Ceph mon.a for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:03:30.672 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:30 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-a[41531]: 2023-12-14T14:03:30.345+0000 7fdd31010700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:03:30.672 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:30 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-a[41531]: 2023-12-14T14:03:30.345+0000 7fdd31010700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-14T14:03:30.672 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:30 smithi069 bash[41879]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-a 2023-12-14T14:03:31.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:30 smithi069 systemd[1]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.a.service: Succeeded. 2023-12-14T14:03:31.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:30 smithi069 systemd[1]: Stopped Ceph mon.a for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:03:31.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:30 smithi069 systemd[1]: Starting Ceph mon.a for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:03:31.142 INFO:teuthology.orchestra.run.smithi069.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-14T14:03:31.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 bash[41996]: e8cf8c1c20038917e478c1862295d89cea6932748bd9ffccb70a3a75927b752b 2023-12-14T14:03:31.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 systemd[1]: Started Ceph mon.a for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:03:31.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: set uid:gid to 167:167 (ceph:ceph) 2023-12-14T14:03:31.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev), process ceph-mon, pid 7 2023-12-14T14:03:31.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: pidfile_write: ignore empty --pid-file 2023-12-14T14:03:31.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: load: jerasure load: lrc 2023-12-14T14:03:31.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: RocksDB version: 7.9.2 2023-12-14T14:03:31.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Git sha 0 2023-12-14T14:03:31.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Compile date 2023-12-13 16:19:48 2023-12-14T14:03:31.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: DB SUMMARY 2023-12-14T14:03:31.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: DB Session ID: XT5YPD77FNCSYW76RUZW 2023-12-14T14:03:31.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: CURRENT file: CURRENT 2023-12-14T14:03:31.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: IDENTITY file: IDENTITY 2023-12-14T14:03:31.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-12-14T14:03:31.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-12-14T14:03:31.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 97324 ; 2023-12-14T14:03:31.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.error_if_exists: 0 2023-12-14T14:03:31.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.create_if_missing: 0 2023-12-14T14:03:31.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.paranoid_checks: 1 2023-12-14T14:03:31.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-14T14:03:31.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-14T14:03:31.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-14T14:03:31.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.env: 0x556c2dc20720 2023-12-14T14:03:31.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.fs: PosixFileSystem 2023-12-14T14:03:31.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.info_log: 0x556c3056b3c0 2023-12-14T14:03:31.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_file_opening_threads: 16 2023-12-14T14:03:31.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.statistics: (nil) 2023-12-14T14:03:31.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.use_fsync: 0 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_log_file_size: 0 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.keep_log_file_num: 1000 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.recycle_log_file_num: 0 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.allow_fallocate: 1 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.allow_mmap_reads: 0 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.allow_mmap_writes: 0 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.use_direct_reads: 0 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-14T14:03:31.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.create_missing_column_families: 0 2023-12-14T14:03:31.592 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.db_log_dir: 2023-12-14T14:03:31.592 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.wal_dir: 2023-12-14T14:03:31.592 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-14T14:03:31.592 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-14T14:03:31.592 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-14T14:03:31.592 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-14T14:03:31.592 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-14T14:03:31.592 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-14T14:03:31.592 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.advise_random_on_open: 1 2023-12-14T14:03:31.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.db_write_buffer_size: 0 2023-12-14T14:03:31.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.write_buffer_manager: 0x556c2f7dc3c0 2023-12-14T14:03:31.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-14T14:03:31.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-14T14:03:31.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-14T14:03:31.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.rate_limiter: (nil) 2023-12-14T14:03:31.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-14T14:03:31.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.wal_recovery_mode: 2 2023-12-14T14:03:31.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.enable_thread_tracking: 0 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.enable_pipelined_write: 0 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.unordered_write: 0 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.row_cache: None 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.wal_filter: None 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.allow_ingest_behind: 0 2023-12-14T14:03:31.594 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.two_write_queues: 0 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.manual_wal_flush: 0 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.wal_compression: 0 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.atomic_flush: 0 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.log_readahead_size: 0 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.best_efforts_recovery: 0 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-14T14:03:31.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.allow_data_in_errors: 0 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.db_host_id: __hostname__ 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_background_jobs: 2 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_background_compactions: -1 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_subcompactions: 1 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-14T14:03:31.596 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_total_wal_size: 0 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_open_files: -1 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bytes_per_sync: 0 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_readahead_size: 0 2023-12-14T14:03:31.597 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_background_flushes: -1 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Compression algorithms supported: 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: kZSTD supported: 0 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: kXpressCompression supported: 0 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: kLZ4HCCompression supported: 1 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: kZlibCompression supported: 1 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: kSnappyCompression supported: 1 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: kLZ4Compression supported: 1 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: kBZip2Compression supported: 0 2023-12-14T14:03:31.598 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.merge_operator: 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_filter: None 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_filter_factory: None 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.sst_partitioner_factory: None 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-14T14:03:31.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556c3056b4e0) 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: cache_index_and_filter_blocks: 1 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: pin_top_level_index_and_filter: 1 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_type: 0 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: data_block_index_type: 0 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_shortening: 1 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: checksum: 4 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: no_block_cache: 0 2023-12-14T14:03:31.600 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache: 0x556c2f87d1f0 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_name: BinnedLRUCache 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_options: 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: capacity : 536870912 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: num_shard_bits : 4 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: strict_capacity_limit : 0 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: high_pri_pool_ratio: 0.000 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_compressed: (nil) 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: persistent_cache: (nil) 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_size: 4096 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_size_deviation: 10 2023-12-14T14:03:31.601 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_restart_interval: 16 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_block_restart_interval: 1 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: metadata_block_size: 4096 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: partition_filters: 0 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: use_delta_encoding: 1 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: filter_policy: bloomfilter 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: whole_key_filtering: 1 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: verify_compression: 0 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: read_amp_bytes_per_bit: 0 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: format_version: 5 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: enable_index_compression: 1 2023-12-14T14:03:31.602 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_align: 0 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout: max_auto_readahead_size: 262144 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout: prepopulate_block_cache: 0 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout: initial_auto_readahead_size: 8192 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout: num_file_reads_for_auto_readahead: 2 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.write_buffer_size: 33554432 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_write_buffer_number: 2 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression: NoCompression 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression: Disabled 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.prefix_extractor: nullptr 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-14T14:03:31.603 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.num_levels: 7 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-14T14:03:31.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression_opts.level: 32767 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression_opts.strategy: 0 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression_opts.enabled: false 2023-12-14T14:03:31.605 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.target_file_size_base: 67108864 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-14T14:03:31.606 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.arena_block_size: 1048576 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-14T14:03:31.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.disable_auto_compactions: 0 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-14T14:03:31.608 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.table_properties_collectors: 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.inplace_update_support: 0 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.bloom_locality: 0 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.max_successive_merges: 0 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.paranoid_file_checks: 0 2023-12-14T14:03:31.609 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.force_consistency_checks: 1 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.report_bg_io_stats: 0 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.ttl: 2592000 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.enable_blob_files: false 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.min_blob_size: 0 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.blob_file_size: 268435456 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-14T14:03:31.610 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.blob_file_starting_level: 0 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 92e9a3ff-26f8-4900-b515-2d1ef59bfe49 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702562611150402, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702562611151345, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92741, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 307, "table_properties": {"data_size": 90740, "index_size": 283, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13602, "raw_average_key_size": 50, "raw_value_size": 83320, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 270, "num_filter_entries": 270, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702562611, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "92e9a3ff-26f8-4900-b515-2d1ef59bfe49", "db_session_id": "XT5YPD77FNCSYW76RUZW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-12-14T14:03:31.611 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702562611151415, "job": 1, "event": "recovery_finished"} 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556c2f91a000 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: DB pointer 0x556c2f906000 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** DB Stats ** 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-14T14:03:31.612 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** Compaction Stats [default] ** 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: L0 2/0 92.40 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 158.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: Sum 2/0 92.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 158.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 158.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T14:03:31.613 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** Compaction Stats [default] ** 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 158.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-14T14:03:31.614 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative compaction: 0.00 GB write, 27.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval compaction: 0.00 GB write, 27.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout: Block cache BinnedLRUCache@0x556c2f87d1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: starting mon.a rank 0 at public addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] at bind addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mon.a@-1(???) e1 preinit fsid 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:31.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mon.a@-1(???).mds e1 new map 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mon.a@-1(???).mds e1 print_map 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout: e1 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout: legacy client fscid: -1 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout: No filesystems configured 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T14:03:31.616 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T14:03:31.617 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-14T14:03:31.617 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-14T14:03:31.617 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: monmap e1: 1 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0]} removed_ranks: {} 2023-12-14T14:03:31.617 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: fsmap 2023-12-14T14:03:31.617 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: osdmap e1: 0 total, 0 up, 0 in 2023-12-14T14:03:31.617 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:31 smithi069 ceph-mon[42034]: mgrmap e1: no daemons active 2023-12-14T14:03:31.972 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.512+0000 7f2eeddc8700 1 Processor -- start 2023-12-14T14:03:31.972 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.512+0000 7f2eeddc8700 1 -- start start 2023-12-14T14:03:31.972 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.512+0000 7f2eeddc8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee81088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:31.973 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.512+0000 7f2eeddc8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8079de0 con 0x7f2ee8106510 2023-12-14T14:03:31.973 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.512+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee81088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:31.973 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.512+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee81088f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57678/0 (socket says 172.21.15.69:57678) 2023-12-14T14:03:31.973 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.512+0000 7f2ee77fe700 1 -- 172.21.15.69:0/3720679783 learned_addr learned my addr 172.21.15.69:0/3720679783 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:31.973 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.513+0000 7f2ee77fe700 1 -- 172.21.15.69:0/3720679783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8108e30 con 0x7f2ee8106510 2023-12-14T14:03:31.973 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.513+0000 7f2ee77fe700 1 --2- 172.21.15.69:0/3720679783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee81088f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80098a0 tx=0x7f2ed8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2c2a7332808236 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:31.973 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.513+0000 7f2ee67fc700 1 -- 172.21.15.69:0/3720679783 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ed8004160 con 0x7f2ee8106510 2023-12-14T14:03:31.973 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.513+0000 7f2ee67fc700 1 -- 172.21.15.69:0/3720679783 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ed80042c0 con 0x7f2ee8106510 2023-12-14T14:03:31.973 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.513+0000 7f2ee67fc700 1 -- 172.21.15.69:0/3720679783 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ed8011a00 con 0x7f2ee8106510 2023-12-14T14:03:31.974 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.514+0000 7f2eeddc8700 1 -- 172.21.15.69:0/3720679783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 msgr2=0x7f2ee81088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:31.974 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.514+0000 7f2eeddc8700 1 --2- 172.21.15.69:0/3720679783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee81088f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80098a0 tx=0x7f2ed8009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:31.974 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.514+0000 7f2eeddc8700 1 -- 172.21.15.69:0/3720679783 shutdown_connections 2023-12-14T14:03:31.974 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.514+0000 7f2eeddc8700 1 --2- 172.21.15.69:0/3720679783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee81088f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:31.974 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.514+0000 7f2eeddc8700 1 -- 172.21.15.69:0/3720679783 >> 172.21.15.69:0/3720679783 conn(0x7f2ee80ffed0 msgr2=0x7f2ee8102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:31.974 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.514+0000 7f2eeddc8700 1 -- 172.21.15.69:0/3720679783 shutdown_connections 2023-12-14T14:03:31.974 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.514+0000 7f2eeddc8700 1 -- 172.21.15.69:0/3720679783 wait complete. 2023-12-14T14:03:31.974 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.514+0000 7f2eeddc8700 1 Processor -- start 2023-12-14T14:03:31.974 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2eeddc8700 1 -- start start 2023-12-14T14:03:31.975 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2eeddc8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:31.975 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2eeddc8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8199cb0 con 0x7f2ee8106510 2023-12-14T14:03:31.975 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:31.975 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee8199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57686/0 (socket says 172.21.15.69:57686) 2023-12-14T14:03:31.975 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2ee77fe700 1 -- 172.21.15.69:0/4094398280 learned_addr learned my addr 172.21.15.69:0/4094398280 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:31.975 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2ee77fe700 1 -- 172.21.15.69:0/4094398280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8009550 con 0x7f2ee8106510 2023-12-14T14:03:31.975 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2ee77fe700 1 --2- 172.21.15.69:0/4094398280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee8199770 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009fb0 tx=0x7f2ed8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:31.975 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2ee4ff9700 1 -- 172.21.15.69:0/4094398280 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ed8003930 con 0x7f2ee8106510 2023-12-14T14:03:31.975 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2ee4ff9700 1 -- 172.21.15.69:0/4094398280 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ed8003a90 con 0x7f2ee8106510 2023-12-14T14:03:31.976 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2eeddc8700 1 -- 172.21.15.69:0/4094398280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee8109d10 con 0x7f2ee8106510 2023-12-14T14:03:31.976 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2ee4ff9700 1 -- 172.21.15.69:0/4094398280 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ed8019610 con 0x7f2ee8106510 2023-12-14T14:03:31.976 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.515+0000 7f2eeddc8700 1 -- 172.21.15.69:0/4094398280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee8109b80 con 0x7f2ee8106510 2023-12-14T14:03:31.976 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.516+0000 7f2ee4ff9700 1 -- 172.21.15.69:0/4094398280 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2ed8019bf0 con 0x7f2ee8106510 2023-12-14T14:03:31.976 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.516+0000 7f2ee4ff9700 1 -- 172.21.15.69:0/4094398280 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2ed80243f0 con 0x7f2ee8106510 2023-12-14T14:03:31.976 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.516+0000 7f2eeddc8700 1 -- 172.21.15.69:0/4094398280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee8062120 con 0x7f2ee8106510 2023-12-14T14:03:31.976 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.519+0000 7f2ee4ff9700 1 -- 172.21.15.69:0/4094398280 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f2ed8003c00 con 0x7f2ee8106510 2023-12-14T14:03:31.976 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.586+0000 7f2eeddc8700 1 -- 172.21.15.69:0/4094398280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f2ee819a3f0 con 0x7f2ee8106510 2023-12-14T14:03:31.976 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.592+0000 7f2ee4ff9700 1 -- 172.21.15.69:0/4094398280 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2ed801a9d0 con 0x7f2ee8106510 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.593+0000 7f2eeddc8700 1 -- 172.21.15.69:0/4094398280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 msgr2=0x7f2ee8199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.593+0000 7f2eeddc8700 1 --2- 172.21.15.69:0/4094398280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee8199770 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009fb0 tx=0x7f2ed8011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.593+0000 7f2eeddc8700 1 -- 172.21.15.69:0/4094398280 shutdown_connections 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.593+0000 7f2eeddc8700 1 --2- 172.21.15.69:0/4094398280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ee8106510 0x7f2ee8199770 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.593+0000 7f2eeddc8700 1 -- 172.21.15.69:0/4094398280 >> 172.21.15.69:0/4094398280 conn(0x7f2ee80ffed0 msgr2=0x7f2ee8101530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.593+0000 7f2eeddc8700 1 -- 172.21.15.69:0/4094398280 shutdown_connections 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:31.593+0000 7f2eeddc8700 1 -- 172.21.15.69:0/4094398280 wait complete. 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-14T14:03:31.977 INFO:teuthology.orchestra.run.smithi069.stdout:Creating mgr... 2023-12-14T14:03:31.978 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying port 9283 ... 2023-12-14T14:03:31.978 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying port 8765 ... 2023-12-14T14:03:32.101 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.x 2023-12-14T14:03:32.101 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.x.service: Unit ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.x.service not loaded. 2023-12-14T14:03:32.191 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5d58180a-9a89-11ee-95a3-87774f69a715.target.wants/ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-5d58180a-9a89-11ee-95a3-87774f69a715@.service. 2023-12-14T14:03:32.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:32 smithi069 systemd[1]: Starting Ceph mgr.x for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:03:32.619 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-14T14:03:32.620 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2023-12-14T14:03:32.628 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-14T14:03:32.628 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T14:03:32.628 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2023-12-14T14:03:32.628 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to enable service . firewalld.service is not available 2023-12-14T14:03:32.637 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-14T14:03:32.637 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2023-12-14T14:03:32.645 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-14T14:03:32.646 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T14:03:32.646 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2023-12-14T14:03:32.646 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-12-14T14:03:32.646 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr to start... 2023-12-14T14:03:32.646 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr... 2023-12-14T14:03:32.946 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:32 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4094398280' entity='client.admin' 2023-12-14T14:03:32.946 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:32 smithi069 bash[42268]: 471394603f0d5294fcd9b08d4f61397397a984efca397a58c6124e2ffe30b597 2023-12-14T14:03:32.947 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:32 smithi069 systemd[1]: Started Ceph mgr.x for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:03:33.234 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:32.945+0000 7f48bcaf1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T14:03:33.234 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:33.054+0000 7f48bcaf1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T14:03:33.234 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:33.146+0000 7f48bcaf1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T14:03:33.234 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:33.234+0000 7f48bcaf1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T14:03:33.532 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:33.535 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T14:03:33.535 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:03:33.535 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:33.536 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-14T14:03:33.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-14T14:03:33.546 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-14T14:03:33.546 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-14T14:03:33.546 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-14T14:03:33.546 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:33.546 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-14T14:03:33.546 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-14T14:03:33.546 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-14T14:03:33.547 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-14T14:03:33.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2023-12-14T14:03:27.638013+0000", 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.051+0000 7f15740fe700 1 Processor -- start 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.051+0000 7f15740fe700 1 -- start start 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.051+0000 7f15740fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c07a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.051+0000 7f15740fe700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c07a8a0 con 0x7f156c07be70 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.052+0000 7f1571e9a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c07a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.052+0000 7f1571e9a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c07a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57704/0 (socket says 172.21.15.69:57704) 2023-12-14T14:03:33.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.052+0000 7f1571e9a700 1 -- 172.21.15.69:0/4042057794 learned_addr learned my addr 172.21.15.69:0/4042057794 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.052+0000 7f1571e9a700 1 -- 172.21.15.69:0/4042057794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c07a9e0 con 0x7f156c07be70 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.052+0000 7f1571e9a700 1 --2- 172.21.15.69:0/4042057794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c07a2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f15680098a0 tx=0x7f1568009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb697ed30868659a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.052+0000 7f1570e98700 1 -- 172.21.15.69:0/4042057794 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1568004160 con 0x7f156c07be70 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.052+0000 7f1570e98700 1 -- 172.21.15.69:0/4042057794 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15680042c0 con 0x7f156c07be70 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.052+0000 7f1570e98700 1 -- 172.21.15.69:0/4042057794 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1568011a00 con 0x7f156c07be70 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.053+0000 7f15740fe700 1 -- 172.21.15.69:0/4042057794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 msgr2=0x7f156c07a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.053+0000 7f15740fe700 1 --2- 172.21.15.69:0/4042057794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c07a2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f15680098a0 tx=0x7f1568009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.053+0000 7f15740fe700 1 -- 172.21.15.69:0/4042057794 shutdown_connections 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.053+0000 7f15740fe700 1 --2- 172.21.15.69:0/4042057794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c07a2d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.053+0000 7f15740fe700 1 -- 172.21.15.69:0/4042057794 >> 172.21.15.69:0/4042057794 conn(0x7f156c100fd0 msgr2=0x7f156c103400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.053+0000 7f15740fe700 1 -- 172.21.15.69:0/4042057794 shutdown_connections 2023-12-14T14:03:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.053+0000 7f15740fe700 1 -- 172.21.15.69:0/4042057794 wait complete. 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.054+0000 7f15740fe700 1 Processor -- start 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.054+0000 7f15740fe700 1 -- start start 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.054+0000 7f15740fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.054+0000 7f15740fe700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c19bef0 con 0x7f156c07be70 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.054+0000 7f1571e9a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.054+0000 7f1571e9a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c19b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57718/0 (socket says 172.21.15.69:57718) 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.054+0000 7f1571e9a700 1 -- 172.21.15.69:0/1453052064 learned_addr learned my addr 172.21.15.69:0/1453052064 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.054+0000 7f1571e9a700 1 -- 172.21.15.69:0/1453052064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1568009550 con 0x7f156c07be70 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.054+0000 7f1571e9a700 1 --2- 172.21.15.69:0/1453052064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c19b9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1568009fb0 tx=0x7f1568011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.055+0000 7f1562ffd700 1 -- 172.21.15.69:0/1453052064 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1568003930 con 0x7f156c07be70 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.055+0000 7f1562ffd700 1 -- 172.21.15.69:0/1453052064 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1568003a90 con 0x7f156c07be70 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.055+0000 7f1562ffd700 1 -- 172.21.15.69:0/1453052064 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1568019610 con 0x7f156c07be70 2023-12-14T14:03:33.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.055+0000 7f15740fe700 1 -- 172.21.15.69:0/1453052064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c10bf60 con 0x7f156c07be70 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.055+0000 7f15740fe700 1 -- 172.21.15.69:0/1453052064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c10bdd0 con 0x7f156c07be70 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.055+0000 7f1562ffd700 1 -- 172.21.15.69:0/1453052064 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1568019b80 con 0x7f156c07be70 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.055+0000 7f1562ffd700 1 -- 172.21.15.69:0/1453052064 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f15680243f0 con 0x7f156c07be70 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.056+0000 7f15740fe700 1 -- 172.21.15.69:0/1453052064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c062120 con 0x7f156c07be70 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.058+0000 7f1562ffd700 1 -- 172.21.15.69:0/1453052064 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f156802de40 con 0x7f156c07be70 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.132+0000 7f15740fe700 1 -- 172.21.15.69:0/1453052064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f156c19c430 con 0x7f156c07be70 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.132+0000 7f1562ffd700 1 -- 172.21.15.69:0/1453052064 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f1568003cb0 con 0x7f156c07be70 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.133+0000 7f15740fe700 1 -- 172.21.15.69:0/1453052064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 msgr2=0x7f156c19b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.133+0000 7f15740fe700 1 --2- 172.21.15.69:0/1453052064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c19b9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1568009fb0 tx=0x7f1568011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.133+0000 7f15740fe700 1 -- 172.21.15.69:0/1453052064 shutdown_connections 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.133+0000 7f15740fe700 1 --2- 172.21.15.69:0/1453052064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f156c07be70 0x7f156c19b9b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:33.552 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.133+0000 7f15740fe700 1 -- 172.21.15.69:0/1453052064 >> 172.21.15.69:0/1453052064 conn(0x7f156c100fd0 msgr2=0x7f156c1026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:33.553 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.133+0000 7f15740fe700 1 -- 172.21.15.69:0/1453052064 shutdown_connections 2023-12-14T14:03:33.553 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:33.133+0000 7f15740fe700 1 -- 172.21.15.69:0/1453052064 wait complete. 2023-12-14T14:03:33.553 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (1/15)... 2023-12-14T14:03:33.858 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:33 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1453052064' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-14T14:03:34.173 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:33.858+0000 7f48bcaf1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:03:34.174 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:34.090+0000 7f48bcaf1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T14:03:34.563 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:34.173+0000 7f48bcaf1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T14:03:34.563 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:34.282+0000 7f48bcaf1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T14:03:34.563 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:34.371+0000 7f48bcaf1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T14:03:34.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:34.563+0000 7f48bcaf1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T14:03:34.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:34.648+0000 7f48bcaf1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T14:03:35.277 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:35.017+0000 7f48bcaf1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T14:03:35.563 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:35.277+0000 7f48bcaf1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T14:03:35.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:35.563+0000 7f48bcaf1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T14:03:35.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:35.660+0000 7f48bcaf1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T14:03:36.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:36 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2150846086' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-14T14:03:36.393 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:36.393 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T14:03:36.393 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:03:36.393 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2023-12-14T14:03:36.393 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-14T14:03:36.393 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-14T14:03:36.393 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-14T14:03:36.394 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:36.395 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-14T14:03:36.395 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-14T14:03:36.395 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:36.395 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-14T14:03:36.395 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:36.395 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-14T14:03:36.395 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-14T14:03:36.405 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-14T14:03:36.405 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-14T14:03:36.405 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-14T14:03:36.405 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-14T14:03:36.405 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:36.405 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-14T14:03:36.405 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:36.406 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:36.407 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2023-12-14T14:03:27.638013+0000", 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.951+0000 7f0d9df8b700 1 Processor -- start 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.951+0000 7f0d9df8b700 1 -- start start 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.951+0000 7f0d9df8b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d98104710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:36.408 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.951+0000 7f0d9df8b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98079de0 con 0x7f0d98104300 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.951+0000 7f0d977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d98104710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.951+0000 7f0d977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d98104710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57732/0 (socket says 172.21.15.69:57732) 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.951+0000 7f0d977fe700 1 -- 172.21.15.69:0/433429855 learned_addr learned my addr 172.21.15.69:0/433429855 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.951+0000 7f0d977fe700 1 -- 172.21.15.69:0/433429855 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d98104c50 con 0x7f0d98104300 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.952+0000 7f0d977fe700 1 --2- 172.21.15.69:0/433429855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d98104710 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d880098a0 tx=0x7f0d88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf1794584ddf9ae server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.952+0000 7f0d967fc700 1 -- 172.21.15.69:0/433429855 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d88004160 con 0x7f0d98104300 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.952+0000 7f0d967fc700 1 -- 172.21.15.69:0/433429855 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d880042c0 con 0x7f0d98104300 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.952+0000 7f0d967fc700 1 -- 172.21.15.69:0/433429855 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d88011a00 con 0x7f0d98104300 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.953+0000 7f0d9df8b700 1 -- 172.21.15.69:0/433429855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 msgr2=0x7f0d98104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:36.409 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.953+0000 7f0d9df8b700 1 --2- 172.21.15.69:0/433429855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d98104710 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d880098a0 tx=0x7f0d88009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.953+0000 7f0d9df8b700 1 -- 172.21.15.69:0/433429855 shutdown_connections 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.953+0000 7f0d9df8b700 1 --2- 172.21.15.69:0/433429855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d98104710 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.953+0000 7f0d9df8b700 1 -- 172.21.15.69:0/433429855 >> 172.21.15.69:0/433429855 conn(0x7f0d980ffed0 msgr2=0x7f0d98102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.953+0000 7f0d9df8b700 1 -- 172.21.15.69:0/433429855 shutdown_connections 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.953+0000 7f0d9df8b700 1 -- 172.21.15.69:0/433429855 wait complete. 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.954+0000 7f0d9df8b700 1 Processor -- start 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.954+0000 7f0d9df8b700 1 -- start start 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.954+0000 7f0d9df8b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d9819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.954+0000 7f0d9df8b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9819beb0 con 0x7f0d98104300 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.954+0000 7f0d977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d9819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:36.410 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.954+0000 7f0d977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d9819b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57744/0 (socket says 172.21.15.69:57744) 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.954+0000 7f0d977fe700 1 -- 172.21.15.69:0/2150846086 learned_addr learned my addr 172.21.15.69:0/2150846086 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.954+0000 7f0d977fe700 1 -- 172.21.15.69:0/2150846086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88009550 con 0x7f0d98104300 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.955+0000 7f0d977fe700 1 --2- 172.21.15.69:0/2150846086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d9819b970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009fb0 tx=0x7f0d88011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.955+0000 7f0d94ff9700 1 -- 172.21.15.69:0/2150846086 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d88003930 con 0x7f0d98104300 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.955+0000 7f0d94ff9700 1 -- 172.21.15.69:0/2150846086 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d88003a90 con 0x7f0d98104300 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.955+0000 7f0d9df8b700 1 -- 172.21.15.69:0/2150846086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d98105c50 con 0x7f0d98104300 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.955+0000 7f0d94ff9700 1 -- 172.21.15.69:0/2150846086 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d88019610 con 0x7f0d98104300 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.955+0000 7f0d9df8b700 1 -- 172.21.15.69:0/2150846086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d98105ac0 con 0x7f0d98104300 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.955+0000 7f0d94ff9700 1 -- 172.21.15.69:0/2150846086 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0d88019bf0 con 0x7f0d98104300 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.955+0000 7f0d94ff9700 1 -- 172.21.15.69:0/2150846086 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0d880243f0 con 0x7f0d98104300 2023-12-14T14:03:36.411 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.956+0000 7f0d9df8b700 1 -- 172.21.15.69:0/2150846086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98195240 con 0x7f0d98104300 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:35.958+0000 7f0d94ff9700 1 -- 172.21.15.69:0/2150846086 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f0d88003c00 con 0x7f0d98104300 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:36.029+0000 7f0d9df8b700 1 -- 172.21.15.69:0/2150846086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0d98062120 con 0x7f0d98104300 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:36.030+0000 7f0d94ff9700 1 -- 172.21.15.69:0/2150846086 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f0d98062120 con 0x7f0d98104300 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:36.031+0000 7f0d9df8b700 1 -- 172.21.15.69:0/2150846086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 msgr2=0x7f0d9819b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:36.031+0000 7f0d9df8b700 1 --2- 172.21.15.69:0/2150846086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d9819b970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009fb0 tx=0x7f0d88011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:36.031+0000 7f0d9df8b700 1 -- 172.21.15.69:0/2150846086 shutdown_connections 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:36.031+0000 7f0d9df8b700 1 --2- 172.21.15.69:0/2150846086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d98104300 0x7f0d9819b970 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:36.031+0000 7f0d9df8b700 1 -- 172.21.15.69:0/2150846086 >> 172.21.15.69:0/2150846086 conn(0x7f0d980ffed0 msgr2=0x7f0d9818fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:36.031+0000 7f0d9df8b700 1 -- 172.21.15.69:0/2150846086 shutdown_connections 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:36.031+0000 7f0d9df8b700 1 -- 172.21.15.69:0/2150846086 wait complete. 2023-12-14T14:03:36.412 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (2/15)... 2023-12-14T14:03:36.705 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:36.464+0000 7f48bcaf1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T14:03:36.706 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:36.559+0000 7f48bcaf1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T14:03:37.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:36.705+0000 7f48bcaf1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T14:03:37.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:37 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:37.326+0000 7f48bcaf1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T14:03:37.586 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:37 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:37.506+0000 7f48bcaf1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T14:03:38.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:37 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:37.698+0000 7f48bcaf1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T14:03:38.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:38.397+0000 7f48bcaf1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T14:03:39.133 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:38 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2206622337' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-14T14:03:39.134 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:38.893+0000 7f48bcaf1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:03:39.134 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:38.984+0000 7f48bcaf1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T14:03:39.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2023-12-14T14:03:39.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-14T14:03:39.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T14:03:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2023-12-14T14:03:27.638013+0000", 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.747+0000 7f5bd49c8700 1 Processor -- start 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.747+0000 7f5bd49c8700 1 -- start start 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.747+0000 7f5bd49c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd01088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.747+0000 7f5bd49c8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd0079de0 con 0x7f5bd0106510 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.748+0000 7f5bce59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd01088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.748+0000 7f5bce59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd01088f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52464/0 (socket says 172.21.15.69:52464) 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.748+0000 7f5bce59c700 1 -- 172.21.15.69:0/1297634390 learned_addr learned my addr 172.21.15.69:0/1297634390 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:39.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.748+0000 7f5bce59c700 1 -- 172.21.15.69:0/1297634390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0108e30 con 0x7f5bd0106510 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.748+0000 7f5bce59c700 1 --2- 172.21.15.69:0/1297634390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd01088f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00098a0 tx=0x7f5bc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdfbc3dcc01eb3b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.748+0000 7f5bcd59a700 1 -- 172.21.15.69:0/1297634390 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0004160 con 0x7f5bd0106510 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.748+0000 7f5bcd59a700 1 -- 172.21.15.69:0/1297634390 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5bc00042c0 con 0x7f5bd0106510 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.748+0000 7f5bcd59a700 1 -- 172.21.15.69:0/1297634390 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0011a00 con 0x7f5bd0106510 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.749+0000 7f5bd49c8700 1 -- 172.21.15.69:0/1297634390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 msgr2=0x7f5bd01088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.749+0000 7f5bd49c8700 1 --2- 172.21.15.69:0/1297634390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd01088f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00098a0 tx=0x7f5bc0009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.749+0000 7f5bd49c8700 1 -- 172.21.15.69:0/1297634390 shutdown_connections 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.749+0000 7f5bd49c8700 1 --2- 172.21.15.69:0/1297634390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd01088f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.749+0000 7f5bd49c8700 1 -- 172.21.15.69:0/1297634390 >> 172.21.15.69:0/1297634390 conn(0x7f5bd00ffed0 msgr2=0x7f5bd0102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.749+0000 7f5bd49c8700 1 -- 172.21.15.69:0/1297634390 shutdown_connections 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.749+0000 7f5bd49c8700 1 -- 172.21.15.69:0/1297634390 wait complete. 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.750+0000 7f5bd49c8700 1 Processor -- start 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.750+0000 7f5bd49c8700 1 -- start start 2023-12-14T14:03:39.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.750+0000 7f5bd49c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.750+0000 7f5bd49c8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd01063b0 con 0x7f5bd0106510 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.750+0000 7f5bce59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.750+0000 7f5bce59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd0105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52470/0 (socket says 172.21.15.69:52470) 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.750+0000 7f5bce59c700 1 -- 172.21.15.69:0/2206622337 learned_addr learned my addr 172.21.15.69:0/2206622337 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.750+0000 7f5bce59c700 1 -- 172.21.15.69:0/2206622337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc0009550 con 0x7f5bd0106510 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.750+0000 7f5bce59c700 1 --2- 172.21.15.69:0/2206622337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd0105e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009fb0 tx=0x7f5bc0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.751+0000 7f5bbf7fe700 1 -- 172.21.15.69:0/2206622337 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0003930 con 0x7f5bd0106510 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.751+0000 7f5bbf7fe700 1 -- 172.21.15.69:0/2206622337 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5bc0003a90 con 0x7f5bd0106510 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.751+0000 7f5bbf7fe700 1 -- 172.21.15.69:0/2206622337 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0019610 con 0x7f5bd0106510 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.751+0000 7f5bd49c8700 1 -- 172.21.15.69:0/2206622337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd0109d10 con 0x7f5bd0106510 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.751+0000 7f5bd49c8700 1 -- 172.21.15.69:0/2206622337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd0109b80 con 0x7f5bd0106510 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.751+0000 7f5bbf7fe700 1 -- 172.21.15.69:0/2206622337 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5bc0019bd0 con 0x7f5bd0106510 2023-12-14T14:03:39.197 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.751+0000 7f5bbf7fe700 1 -- 172.21.15.69:0/2206622337 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5bc00243f0 con 0x7f5bd0106510 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.752+0000 7f5bd49c8700 1 -- 172.21.15.69:0/2206622337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd0062120 con 0x7f5bd0106510 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.754+0000 7f5bbf7fe700 1 -- 172.21.15.69:0/2206622337 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f5bc0003c00 con 0x7f5bd0106510 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.827+0000 7f5bd49c8700 1 -- 172.21.15.69:0/2206622337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5bd01052e0 con 0x7f5bd0106510 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.828+0000 7f5bbf7fe700 1 -- 172.21.15.69:0/2206622337 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f5bc001a9d0 con 0x7f5bd0106510 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.829+0000 7f5bd49c8700 1 -- 172.21.15.69:0/2206622337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 msgr2=0x7f5bd0105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.829+0000 7f5bd49c8700 1 --2- 172.21.15.69:0/2206622337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd0105e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009fb0 tx=0x7f5bc0011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.829+0000 7f5bd49c8700 1 -- 172.21.15.69:0/2206622337 shutdown_connections 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.829+0000 7f5bd49c8700 1 --2- 172.21.15.69:0/2206622337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bd0106510 0x7f5bd0105e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.829+0000 7f5bd49c8700 1 -- 172.21.15.69:0/2206622337 >> 172.21.15.69:0/2206622337 conn(0x7f5bd00ffed0 msgr2=0x7f5bd0100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.829+0000 7f5bd49c8700 1 -- 172.21.15.69:0/2206622337 shutdown_connections 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:38.829+0000 7f5bd49c8700 1 -- 172.21.15.69:0/2206622337 wait complete. 2023-12-14T14:03:39.198 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (3/15)... 2023-12-14T14:03:39.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:39.180+0000 7f48bcaf1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T14:03:40.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: Activating manager daemon x 2023-12-14T14:03:40.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: mgrmap e2: x(active, starting, since 0.00299162s) 2023-12-14T14:03:40.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: Manager daemon x is now available 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' 2023-12-14T14:03:40.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:39 smithi069 ceph-mon[42034]: from='mgr.14100 172.21.15.69:0/1414380155' entity='mgr.x' 2023-12-14T14:03:41.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:41 smithi069 ceph-mon[42034]: mgrmap e3: x(active, since 1.00658s) 2023-12-14T14:03:42.201 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:42.201 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T14:03:42.201 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2023-12-14T14:03:42.202 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-14T14:03:42.203 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-14T14:03:42.204 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-14T14:03:42.205 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2023-12-14T14:03:27.638013+0000", 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T14:03:42.206 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.545+0000 7f54b5e3c700 1 Processor -- start 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.545+0000 7f54b5e3c700 1 -- start start 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.545+0000 7f54b5e3c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b01088b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.545+0000 7f54b5e3c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0079e20 con 0x7f54b01064d0 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.545+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b01088b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.545+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b01088b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52548/0 (socket says 172.21.15.69:52548) 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.545+0000 7f54af7fe700 1 -- 172.21.15.69:0/2836545694 learned_addr learned my addr 172.21.15.69:0/2836545694 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.545+0000 7f54af7fe700 1 -- 172.21.15.69:0/2836545694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b0108df0 con 0x7f54b01064d0 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54af7fe700 1 --2- 172.21.15.69:0/2836545694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b01088b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54a00098a0 tx=0x7f54a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cbe510412865d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54ae7fc700 1 -- 172.21.15.69:0/2836545694 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0004160 con 0x7f54b01064d0 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54ae7fc700 1 -- 172.21.15.69:0/2836545694 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54a00042c0 con 0x7f54b01064d0 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54ae7fc700 1 -- 172.21.15.69:0/2836545694 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0011a00 con 0x7f54b01064d0 2023-12-14T14:03:42.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54b5e3c700 1 -- 172.21.15.69:0/2836545694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 msgr2=0x7f54b01088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54b5e3c700 1 --2- 172.21.15.69:0/2836545694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b01088b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54a00098a0 tx=0x7f54a0009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54b5e3c700 1 -- 172.21.15.69:0/2836545694 shutdown_connections 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54b5e3c700 1 --2- 172.21.15.69:0/2836545694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b01088b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54b5e3c700 1 -- 172.21.15.69:0/2836545694 >> 172.21.15.69:0/2836545694 conn(0x7f54b00ffed0 msgr2=0x7f54b0102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54b5e3c700 1 -- 172.21.15.69:0/2836545694 shutdown_connections 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.546+0000 7f54b5e3c700 1 -- 172.21.15.69:0/2836545694 wait complete. 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.547+0000 7f54b5e3c700 1 Processor -- start 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.547+0000 7f54b5e3c700 1 -- start start 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.547+0000 7f54b5e3c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b0105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.547+0000 7f54b5e3c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0106370 con 0x7f54b01064d0 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.547+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b0105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:42.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.547+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b0105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52560/0 (socket says 172.21.15.69:52560) 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.547+0000 7f54af7fe700 1 -- 172.21.15.69:0/3798873153 learned_addr learned my addr 172.21.15.69:0/3798873153 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.548+0000 7f54af7fe700 1 -- 172.21.15.69:0/3798873153 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0009550 con 0x7f54b01064d0 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.548+0000 7f54af7fe700 1 --2- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b0105e30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009fb0 tx=0x7f54a0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.548+0000 7f54acff9700 1 -- 172.21.15.69:0/3798873153 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0003930 con 0x7f54b01064d0 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.548+0000 7f54acff9700 1 -- 172.21.15.69:0/3798873153 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54a0003a90 con 0x7f54b01064d0 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.548+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b0109d20 con 0x7f54b01064d0 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.548+0000 7f54acff9700 1 -- 172.21.15.69:0/3798873153 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0019610 con 0x7f54b01064d0 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.548+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b0109b90 con 0x7f54b01064d0 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.549+0000 7f54acff9700 1 -- 172.21.15.69:0/3798873153 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 3) v1 ==== 45366+0+0 (secure 0 0 0) 0x7f54a00198d0 con 0x7f54b01064d0 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.549+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b0062120 con 0x7f54b01064d0 2023-12-14T14:03:42.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.549+0000 7f54acff9700 1 --2- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f5498038550 0x7f549803aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.549+0000 7f54acff9700 1 -- 172.21.15.69:0/3798873153 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f54a004c2e0 con 0x7f54b01064d0 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.549+0000 7f54aeffd700 1 --2- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f5498038550 0x7f549803aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.549+0000 7f54aeffd700 1 --2- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f5498038550 0x7f549803aa00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f54a4006fd0 tx=0x7f54a4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.554+0000 7f54acff9700 1 -- 172.21.15.69:0/3798873153 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f54a0019b80 con 0x7f54b01064d0 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.825+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f54b0104c30 con 0x7f54b01064d0 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.825+0000 7f54acff9700 1 -- 172.21.15.69:0/3798873153 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f54a0018b40 con 0x7f54b01064d0 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f5498038550 msgr2=0x7f549803aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 --2- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f5498038550 0x7f549803aa00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f54a4006fd0 tx=0x7f54a4006e40 comp rx=0 tx=0).stop 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 msgr2=0x7f54b0105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 --2- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b0105e30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009fb0 tx=0x7f54a0011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 shutdown_connections 2023-12-14T14:03:42.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 --2- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f5498038550 0x7f549803aa00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:42.211 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 --2- 172.21.15.69:0/3798873153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b01064d0 0x7f54b0105e30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:42.211 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 >> 172.21.15.69:0/3798873153 conn(0x7f54b00ffed0 msgr2=0x7f54b0101530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:42.211 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 shutdown_connections 2023-12-14T14:03:42.211 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:41.827+0000 7f54b5e3c700 1 -- 172.21.15.69:0/3798873153 wait complete. 2023-12-14T14:03:42.211 INFO:teuthology.orchestra.run.smithi069.stdout:mgr is available 2023-12-14T14:03:42.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:42 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3798873153' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-14T14:03:43.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:43.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [global] 2023-12-14T14:03:43.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout fsid = 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:43.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-14T14:03:43.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-14T14:03:43.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-14T14:03:43.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [osd] 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-14T14:03:43.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-14T14:03:43.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.519+0000 7fdb5d51d700 1 Processor -- start 2023-12-14T14:03:43.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.519+0000 7fdb5d51d700 1 -- start start 2023-12-14T14:03:43.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.519+0000 7fdb5d51d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58108950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:43.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.519+0000 7fdb5d51d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58079d80 con 0x7fdb58106570 2023-12-14T14:03:43.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.519+0000 7fdb56ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58108950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:43.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.519+0000 7fdb56ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58108950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52564/0 (socket says 172.21.15.69:52564) 2023-12-14T14:03:43.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.519+0000 7fdb56ffd700 1 -- 172.21.15.69:0/422174330 learned_addr learned my addr 172.21.15.69:0/422174330 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:43.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.520+0000 7fdb56ffd700 1 -- 172.21.15.69:0/422174330 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb58079ec0 con 0x7fdb58106570 2023-12-14T14:03:43.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.520+0000 7fdb56ffd700 1 --2- 172.21.15.69:0/422174330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58108950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdb500098a0 tx=0x7fdb50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcad21fe2273ddcb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.520+0000 7fdb55ffb700 1 -- 172.21.15.69:0/422174330 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb50004160 con 0x7fdb58106570 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.520+0000 7fdb55ffb700 1 -- 172.21.15.69:0/422174330 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb500042c0 con 0x7fdb58106570 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.520+0000 7fdb55ffb700 1 -- 172.21.15.69:0/422174330 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb50011a00 con 0x7fdb58106570 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.521+0000 7fdb5d51d700 1 -- 172.21.15.69:0/422174330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 msgr2=0x7fdb58108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.521+0000 7fdb5d51d700 1 --2- 172.21.15.69:0/422174330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58108950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdb500098a0 tx=0x7fdb50009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.521+0000 7fdb5d51d700 1 -- 172.21.15.69:0/422174330 shutdown_connections 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.521+0000 7fdb5d51d700 1 --2- 172.21.15.69:0/422174330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58108950 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.521+0000 7fdb5d51d700 1 -- 172.21.15.69:0/422174330 >> 172.21.15.69:0/422174330 conn(0x7fdb580ffed0 msgr2=0x7fdb58102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.521+0000 7fdb5d51d700 1 -- 172.21.15.69:0/422174330 shutdown_connections 2023-12-14T14:03:43.076 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.521+0000 7fdb5d51d700 1 -- 172.21.15.69:0/422174330 wait complete. 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.521+0000 7fdb5d51d700 1 Processor -- start 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb5d51d700 1 -- start start 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb5d51d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb5d51d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58199ca0 con 0x7fdb58106570 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb56ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb56ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52566/0 (socket says 172.21.15.69:52566) 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb56ffd700 1 -- 172.21.15.69:0/184831908 learned_addr learned my addr 172.21.15.69:0/184831908 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb56ffd700 1 -- 172.21.15.69:0/184831908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009550 con 0x7fdb58106570 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb56ffd700 1 --2- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58199760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009fb0 tx=0x7fdb50011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:43.077 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb4ffff700 1 -- 172.21.15.69:0/184831908 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb50003930 con 0x7fdb58106570 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb4ffff700 1 -- 172.21.15.69:0/184831908 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb50003a90 con 0x7fdb58106570 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58109d50 con 0x7fdb58106570 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.522+0000 7fdb4ffff700 1 -- 172.21.15.69:0/184831908 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb50019610 con 0x7fdb58106570 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.523+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb58109bc0 con 0x7fdb58106570 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.523+0000 7fdb4ffff700 1 -- 172.21.15.69:0/184831908 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7fdb500198d0 con 0x7fdb58106570 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.523+0000 7fdb4ffff700 1 --2- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fdb44038670 0x7fdb4403ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.523+0000 7fdb4ffff700 1 -- 172.21.15.69:0/184831908 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdb5004c6a0 con 0x7fdb58106570 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.524+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb58062120 con 0x7fdb58106570 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.524+0000 7fdb567fc700 1 --2- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fdb44038670 0x7fdb4403ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:43.078 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.524+0000 7fdb567fc700 1 --2- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fdb44038670 0x7fdb4403ab20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdb40006fd0 tx=0x7fdb40006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.528+0000 7fdb4ffff700 1 -- 172.21.15.69:0/184831908 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdb50019b80 con 0x7fdb58106570 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.716+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdb5819a1e0 con 0x7fdb58106570 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.717+0000 7fdb4ffff700 1 -- 172.21.15.69:0/184831908 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fdb5819a1e0 con 0x7fdb58106570 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fdb44038670 msgr2=0x7fdb4403ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 --2- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fdb44038670 0x7fdb4403ab20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdb40006fd0 tx=0x7fdb40006e40 comp rx=0 tx=0).stop 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 msgr2=0x7fdb58199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 --2- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58199760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009fb0 tx=0x7fdb50011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 shutdown_connections 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 --2- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fdb44038670 0x7fdb4403ab20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:43.079 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 --2- 172.21.15.69:0/184831908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb58106570 0x7fdb58199760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:43.080 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 >> 172.21.15.69:0/184831908 conn(0x7fdb580ffed0 msgr2=0x7fdb58100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:43.080 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 shutdown_connections 2023-12-14T14:03:43.080 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:42.719+0000 7fdb5d51d700 1 -- 172.21.15.69:0/184831908 wait complete. 2023-12-14T14:03:43.080 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling cephadm module... 2023-12-14T14:03:43.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:43 smithi069 ceph-mon[42034]: mgrmap e4: x(active, since 3s) 2023-12-14T14:03:43.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:43 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/184831908' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-14T14:03:44.532 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:44 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/377384482' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-14T14:03:44.533 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:44 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: ignoring --setuser ceph since I am not root 2023-12-14T14:03:44.533 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:44 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: ignoring --setgroup ceph since I am not root 2023-12-14T14:03:44.619 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.446+0000 7f8115a69700 1 Processor -- start 2023-12-14T14:03:44.619 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.446+0000 7f8115a69700 1 -- start start 2023-12-14T14:03:44.619 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.446+0000 7f8115a69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f8110104d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:44.619 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.446+0000 7f8115a69700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110105300 con 0x7f8110104920 2023-12-14T14:03:44.619 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.446+0000 7f810f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f8110104d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:44.619 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.446+0000 7f810f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f8110104d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52572/0 (socket says 172.21.15.69:52572) 2023-12-14T14:03:44.619 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.446+0000 7f810f7fe700 1 -- 172.21.15.69:0/3379170831 learned_addr learned my addr 172.21.15.69:0/3379170831 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:44.619 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.446+0000 7f810f7fe700 1 -- 172.21.15.69:0/3379170831 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8110105b20 con 0x7f8110104920 2023-12-14T14:03:44.619 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f810f7fe700 1 --2- 172.21.15.69:0/3379170831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f8110104d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f81000098a0 tx=0x7f8100009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b7ed7b27b13d77 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f810e7fc700 1 -- 172.21.15.69:0/3379170831 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8100004160 con 0x7f8110104920 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f810e7fc700 1 -- 172.21.15.69:0/3379170831 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81000042c0 con 0x7f8110104920 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f810e7fc700 1 -- 172.21.15.69:0/3379170831 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8100011a00 con 0x7f8110104920 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f8115a69700 1 -- 172.21.15.69:0/3379170831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 msgr2=0x7f8110104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f8115a69700 1 --2- 172.21.15.69:0/3379170831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f8110104d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f81000098a0 tx=0x7f8100009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f8115a69700 1 -- 172.21.15.69:0/3379170831 shutdown_connections 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f8115a69700 1 --2- 172.21.15.69:0/3379170831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f8110104d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f8115a69700 1 -- 172.21.15.69:0/3379170831 >> 172.21.15.69:0/3379170831 conn(0x7f81100ffed0 msgr2=0x7f8110102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f8115a69700 1 -- 172.21.15.69:0/3379170831 shutdown_connections 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.447+0000 7f8115a69700 1 -- 172.21.15.69:0/3379170831 wait complete. 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.448+0000 7f8115a69700 1 Processor -- start 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.448+0000 7f8115a69700 1 -- start start 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.448+0000 7f8115a69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f811018fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.448+0000 7f8115a69700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110190260 con 0x7f8110104920 2023-12-14T14:03:44.620 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.448+0000 7f810f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f811018fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.448+0000 7f810f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f811018fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52576/0 (socket says 172.21.15.69:52576) 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.448+0000 7f810f7fe700 1 -- 172.21.15.69:0/377384482 learned_addr learned my addr 172.21.15.69:0/377384482 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.449+0000 7f810f7fe700 1 -- 172.21.15.69:0/377384482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100009550 con 0x7f8110104920 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.449+0000 7f810f7fe700 1 --2- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f811018fd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8100009fb0 tx=0x7f8100011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.449+0000 7f810cff9700 1 -- 172.21.15.69:0/377384482 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8100003930 con 0x7f8110104920 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.449+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8110108d50 con 0x7f8110104920 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.449+0000 7f810cff9700 1 -- 172.21.15.69:0/377384482 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8100003a90 con 0x7f8110104920 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.449+0000 7f810cff9700 1 -- 172.21.15.69:0/377384482 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81000195e0 con 0x7f8110104920 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.449+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8110108ee0 con 0x7f8110104920 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.450+0000 7f810cff9700 1 -- 172.21.15.69:0/377384482 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f81000198a0 con 0x7f8110104920 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.450+0000 7f810cff9700 1 --2- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f80f8038670 0x7f80f803ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.450+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8110106990 con 0x7f8110104920 2023-12-14T14:03:44.621 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.450+0000 7f810cff9700 1 -- 172.21.15.69:0/377384482 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f810004c450 con 0x7f8110104920 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.450+0000 7f810effd700 1 --2- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f80f8038670 0x7f80f803ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.450+0000 7f810effd700 1 --2- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f80f8038670 0x7f80f803ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8104006fd0 tx=0x7f8104006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.455+0000 7f810cff9700 1 -- 172.21.15.69:0/377384482 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8110106990 con 0x7f8110104920 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:43.693+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f8110106990 con 0x7f8110104920 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.211+0000 7f810cff9700 1 -- 172.21.15.69:0/377384482 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f8100019d30 con 0x7f8110104920 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.212+0000 7f810cff9700 1 -- 172.21.15.69:0/377384482 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f8100003c00 con 0x7f8110104920 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f80f8038670 msgr2=0x7f80f803ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 --2- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f80f8038670 0x7f80f803ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8104006fd0 tx=0x7f8104006e40 comp rx=0 tx=0).stop 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 msgr2=0x7f811018fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 --2- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f811018fd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8100009fb0 tx=0x7f8100011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 shutdown_connections 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 --2- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f80f8038670 0x7f80f803ab20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 --2- 172.21.15.69:0/377384482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8110104920 0x7f811018fd20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 >> 172.21.15.69:0/377384482 conn(0x7f81100ffed0 msgr2=0x7f81100798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 shutdown_connections 2023-12-14T14:03:44.622 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.216+0000 7f8115a69700 1 -- 172.21.15.69:0/377384482 wait complete. 2023-12-14T14:03:44.783 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:44 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:44.577+0000 7f6eed138200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T14:03:44.783 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:44 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:44.687+0000 7f6eed138200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T14:03:44.783 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:44 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:44.783+0000 7f6eed138200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T14:03:45.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:44 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:44.869+0000 7f6eed138200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T14:03:45.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:45 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/377384482' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-14T14:03:45.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:45 smithi069 ceph-mon[42034]: mgrmap e5: x(active, since 5s) 2023-12-14T14:03:45.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.981+0000 7fb498cbd700 1 Processor -- start 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.981+0000 7fb498cbd700 1 -- start start 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.981+0000 7fb498cbd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494108870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.981+0000 7fb498cbd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494079e60 con 0x7fb494106490 2023-12-14T14:03:45.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.981+0000 7fb49259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:45.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.981+0000 7fb49259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494108870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52582/0 (socket says 172.21.15.69:52582) 2023-12-14T14:03:45.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.981+0000 7fb49259c700 1 -- 172.21.15.69:0/3633068987 learned_addr learned my addr 172.21.15.69:0/3633068987 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:45.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.982+0000 7fb49259c700 1 -- 172.21.15.69:0/3633068987 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494108db0 con 0x7fb494106490 2023-12-14T14:03:45.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.982+0000 7fb49259c700 1 --2- 172.21.15.69:0/3633068987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494108870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb4840098a0 tx=0x7fb484009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbc3bbcbefcc6e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:45.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.982+0000 7fb49159a700 1 -- 172.21.15.69:0/3633068987 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb484004160 con 0x7fb494106490 2023-12-14T14:03:45.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.982+0000 7fb49159a700 1 -- 172.21.15.69:0/3633068987 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4840042c0 con 0x7fb494106490 2023-12-14T14:03:45.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.982+0000 7fb49159a700 1 -- 172.21.15.69:0/3633068987 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb484011a00 con 0x7fb494106490 2023-12-14T14:03:45.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.982+0000 7fb498cbd700 1 -- 172.21.15.69:0/3633068987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 msgr2=0x7fb494108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:45.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.982+0000 7fb498cbd700 1 --2- 172.21.15.69:0/3633068987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494108870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb4840098a0 tx=0x7fb484009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.983+0000 7fb498cbd700 1 -- 172.21.15.69:0/3633068987 shutdown_connections 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.983+0000 7fb498cbd700 1 --2- 172.21.15.69:0/3633068987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494108870 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.983+0000 7fb498cbd700 1 -- 172.21.15.69:0/3633068987 >> 172.21.15.69:0/3633068987 conn(0x7fb4940ffed0 msgr2=0x7fb494102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.983+0000 7fb498cbd700 1 -- 172.21.15.69:0/3633068987 shutdown_connections 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.983+0000 7fb498cbd700 1 -- 172.21.15.69:0/3633068987 wait complete. 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.983+0000 7fb498cbd700 1 Processor -- start 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.983+0000 7fb498cbd700 1 -- start start 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb498cbd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494105df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb498cbd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494106330 con 0x7fb494106490 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb49259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494105df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:45.614 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb49259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494105df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52592/0 (socket says 172.21.15.69:52592) 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb49259c700 1 -- 172.21.15.69:0/2121010052 learned_addr learned my addr 172.21.15.69:0/2121010052 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb49259c700 1 -- 172.21.15.69:0/2121010052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484009550 con 0x7fb494106490 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb49259c700 1 --2- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494105df0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb484006af0 tx=0x7fb484011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb4837fe700 1 -- 172.21.15.69:0/2121010052 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb484003a40 con 0x7fb494106490 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb494109d40 con 0x7fb494106490 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb4837fe700 1 -- 172.21.15.69:0/2121010052 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb484003ba0 con 0x7fb494106490 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb4837fe700 1 -- 172.21.15.69:0/2121010052 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb48401a6e0 con 0x7fb494106490 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.984+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb494109bb0 con 0x7fb494106490 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.985+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494062120 con 0x7fb494106490 2023-12-14T14:03:45.615 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.985+0000 7fb4837fe700 1 -- 172.21.15.69:0/2121010052 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fb48401a950 con 0x7fb494106490 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.985+0000 7fb4837fe700 1 --2- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fb47c038710 0x7fb47c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.985+0000 7fb4837fe700 1 -- 172.21.15.69:0/2121010052 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb48404c6c0 con 0x7fb494106490 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.985+0000 7fb491d9b700 1 -- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fb47c038710 msgr2=0x7fb47c03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3548022044 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.985+0000 7fb491d9b700 1 --2- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fb47c038710 0x7fb47c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:44.990+0000 7fb4837fe700 1 -- 172.21.15.69:0/2121010052 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb48401ac00 con 0x7fb494106490 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.186+0000 7fb491d9b700 1 -- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fb47c038710 msgr2=0x7fb47c03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3548022044 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.186+0000 7fb491d9b700 1 --2- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fb47c038710 0x7fb47c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.246+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb494104bf0 con 0x7fb494106490 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.246+0000 7fb4837fe700 1 -- 172.21.15.69:0/2121010052 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fb484018350 con 0x7fb494106490 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fb47c038710 msgr2=0x7fb47c03abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:03:45.616 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 --2- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fb47c038710 0x7fb47c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 msgr2=0x7fb494105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 --2- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494105df0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb484006af0 tx=0x7fb484011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 shutdown_connections 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 --2- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7fb47c038710 0x7fb47c03abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 --2- 172.21.15.69:0/2121010052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb494106490 0x7fb494105df0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 >> 172.21.15.69:0/2121010052 conn(0x7fb4940ffed0 msgr2=0x7fb494100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 shutdown_connections 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.248+0000 7fb498cbd700 1 -- 172.21.15.69:0/2121010052 wait complete. 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for the mgr to restart... 2023-12-14T14:03:45.617 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr epoch 5... 2023-12-14T14:03:45.764 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:45 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:45.494+0000 7f6eed138200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:03:45.764 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:45 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:45.737+0000 7f6eed138200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T14:03:46.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:45 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:45.826+0000 7f6eed138200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T14:03:46.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:45 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:45.939+0000 7f6eed138200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T14:03:46.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:46 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:46.033+0000 7f6eed138200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T14:03:46.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:46 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2121010052' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-14T14:03:46.586 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:46 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:46.225+0000 7f6eed138200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T14:03:46.586 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:46 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:46.310+0000 7f6eed138200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T14:03:46.939 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:46 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:46.677+0000 7f6eed138200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T14:03:47.216 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:46 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:46.939+0000 7f6eed138200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T14:03:47.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:47 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:47.216+0000 7f6eed138200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T14:03:47.586 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:47 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:47.309+0000 7f6eed138200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T14:03:48.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:48 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:48.046+0000 7f6eed138200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T14:03:48.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:48 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:48.140+0000 7f6eed138200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T14:03:48.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:48 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:48.285+0000 7f6eed138200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T14:03:49.270 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:48 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:48.900+0000 7f6eed138200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T14:03:49.271 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:49 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:49.080+0000 7f6eed138200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T14:03:49.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:49 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:49.270+0000 7f6eed138200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T14:03:50.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:49 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:49.970+0000 7f6eed138200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T14:03:50.711 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:50.435+0000 7f6eed138200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:03:50.711 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:50.522+0000 7f6eed138200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T14:03:51.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:03:50.711+0000 7f6eed138200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T14:03:51.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: Active manager daemon x restarted 2023-12-14T14:03:51.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: Activating manager daemon x 2023-12-14T14:03:51.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: osdmap e2: 0 total, 0 up, 0 in 2023-12-14T14:03:51.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: mgrmap e6: x(active, starting, since 0.00585529s) 2023-12-14T14:03:51.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:03:51.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-14T14:03:51.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-14T14:03:51.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-14T14:03:51.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-14T14:03:51.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: Manager daemon x is now available 2023-12-14T14:03:51.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:03:51.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:03:51.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:50 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:03:52.041 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T14:03:52.041 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-14T14:03:52.041 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-14T14:03:52.041 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T14:03:52.041 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.971+0000 7f2d2d716700 1 Processor -- start 2023-12-14T14:03:52.041 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.971+0000 7f2d2d716700 1 -- start start 2023-12-14T14:03:52.041 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.971+0000 7f2d2d716700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28108950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:52.041 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.971+0000 7f2d2d716700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28079d80 con 0x7f2d28106570 2023-12-14T14:03:52.041 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.971+0000 7f2d26ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28108950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.971+0000 7f2d26ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28108950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52602/0 (socket says 172.21.15.69:52602) 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.971+0000 7f2d26ffd700 1 -- 172.21.15.69:0/1347775475 learned_addr learned my addr 172.21.15.69:0/1347775475 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.971+0000 7f2d26ffd700 1 -- 172.21.15.69:0/1347775475 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28079ec0 con 0x7f2d28106570 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d26ffd700 1 --2- 172.21.15.69:0/1347775475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28108950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2d180098a0 tx=0x7f2d18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6477b3524d2dde server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d25ffb700 1 -- 172.21.15.69:0/1347775475 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d18004160 con 0x7f2d28106570 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d25ffb700 1 -- 172.21.15.69:0/1347775475 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d180042c0 con 0x7f2d28106570 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d25ffb700 1 -- 172.21.15.69:0/1347775475 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d18011a00 con 0x7f2d28106570 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d2d716700 1 -- 172.21.15.69:0/1347775475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 msgr2=0x7f2d28108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d2d716700 1 --2- 172.21.15.69:0/1347775475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28108950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2d180098a0 tx=0x7f2d18009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d2d716700 1 -- 172.21.15.69:0/1347775475 shutdown_connections 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d2d716700 1 --2- 172.21.15.69:0/1347775475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28108950 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d2d716700 1 -- 172.21.15.69:0/1347775475 >> 172.21.15.69:0/1347775475 conn(0x7f2d280ffed0 msgr2=0x7f2d28102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.972+0000 7f2d2d716700 1 -- 172.21.15.69:0/1347775475 shutdown_connections 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.973+0000 7f2d2d716700 1 -- 172.21.15.69:0/1347775475 wait complete. 2023-12-14T14:03:52.042 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.973+0000 7f2d2d716700 1 Processor -- start 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.973+0000 7f2d2d716700 1 -- start start 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d2d716700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d2d716700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28199cb0 con 0x7f2d28106570 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d26ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d26ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52608/0 (socket says 172.21.15.69:52608) 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d26ffd700 1 -- 172.21.15.69:0/1551085371 learned_addr learned my addr 172.21.15.69:0/1551085371 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d26ffd700 1 -- 172.21.15.69:0/1551085371 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d18009550 con 0x7f2d28106570 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d26ffd700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28199770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2d18006af0 tx=0x7f2d18011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d18003a40 con 0x7f2d28106570 2023-12-14T14:03:52.043 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d18003ba0 con 0x7f2d28106570 2023-12-14T14:03:52.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:51 smithi069 ceph-mon[42034]: Found migration_current of "None". Setting to last migration. 2023-12-14T14:03:52.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:51 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:03:52.044 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:51 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:03:52.044 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:51 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-14T14:03:52.044 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:51 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-14T14:03:52.044 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:51 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:03:52.044 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:51 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:03:52.044 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:51 smithi069 ceph-mon[42034]: mgrmap e7: x(active, since 1.00556s) 2023-12-14T14:03:52.047 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d2d716700 1 -- 172.21.15.69:0/1551085371 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d28109d50 con 0x7f2d28106570 2023-12-14T14:03:52.047 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1801a6e0 con 0x7f2d28106570 2023-12-14T14:03:52.047 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.974+0000 7f2d2d716700 1 -- 172.21.15.69:0/1551085371 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d28109bc0 con 0x7f2d28106570 2023-12-14T14:03:52.047 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.976+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f2d18024a60 con 0x7f2d28106570 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.976+0000 7f2d0ffff700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 0x7f2d1003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.976+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 --> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d1003b2d0 con 0x7f2d10038710 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.976+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2d1804c760 con 0x7f2d28106570 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.976+0000 7f2d267fc700 1 -- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 msgr2=0x7f2d1003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3548022044 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:45.976+0000 7f2d267fc700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 0x7f2d1003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:46.177+0000 7f2d267fc700 1 -- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 msgr2=0x7f2d1003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3548022044 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:46.177+0000 7f2d267fc700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 0x7f2d1003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:46.578+0000 7f2d267fc700 1 -- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 msgr2=0x7f2d1003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3548022044 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:46.578+0000 7f2d267fc700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 0x7f2d1003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:47.379+0000 7f2d267fc700 1 -- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 msgr2=0x7f2d1003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3548022044 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:47.379+0000 7f2d267fc700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 0x7f2d1003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:48.980+0000 7f2d267fc700 1 -- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 msgr2=0x7f2d1003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3548022044 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:48.980+0000 7f2d267fc700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 0x7f2d1003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:50.728+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 6) v1 ==== 45250+0+0 (secure 0 0 0) 0x7f2d18024610 con 0x7f2d28106570 2023-12-14T14:03:52.048 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:50.728+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 msgr2=0x7f2d1003abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:50.728+0000 7f2d0ffff700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 0x7f2d1003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.727+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f2d1802cc50 con 0x7f2d28106570 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.727+0000 7f2d0ffff700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2d1003bfe0 0x7f2d1003e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.727+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d1003b2d0 con 0x7f2d1003bfe0 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.727+0000 7f2d267fc700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2d1003bfe0 0x7f2d1003e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.728+0000 7f2d267fc700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2d1003bfe0 0x7f2d1003e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c003a10 tx=0x7f2d1c009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.729+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 <== mgr.14120 v2:172.21.15.69:6800/1599224275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f2d1003b2d0 con 0x7f2d1003bfe0 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.735+0000 7f2d2d716700 1 -- 172.21.15.69:0/1551085371 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2d2819aab0 con 0x7f2d1003bfe0 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.735+0000 7f2d0ffff700 1 -- 172.21.15.69:0/1551085371 <== mgr.14120 v2:172.21.15.69:6800/1599224275 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f2d2819aab0 con 0x7f2d1003bfe0 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 -- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2d1003bfe0 msgr2=0x7f2d1003e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2d1003bfe0 0x7f2d1003e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c003a10 tx=0x7f2d1c009290 comp rx=0 tx=0).stop 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 -- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 msgr2=0x7f2d28199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28199770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2d18006af0 tx=0x7f2d18011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 -- 172.21.15.69:0/1551085371 shutdown_connections 2023-12-14T14:03:52.049 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2d1003bfe0 0x7f2d1003e3c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.050 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d28106570 0x7f2d28199770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.050 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 --2- 172.21.15.69:0/1551085371 >> [v2:172.21.15.69:6800/3548022044,v1:172.21.15.69:6801/3548022044] conn(0x7f2d10038710 0x7f2d1003abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.050 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 -- 172.21.15.69:0/1551085371 >> 172.21.15.69:0/1551085371 conn(0x7f2d280ffed0 msgr2=0x7f2d28101570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:52.050 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 -- 172.21.15.69:0/1551085371 shutdown_connections 2023-12-14T14:03:52.050 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:51.736+0000 7f2d2d716700 1 -- 172.21.15.69:0/1551085371 wait complete. 2023-12-14T14:03:52.050 INFO:teuthology.orchestra.run.smithi069.stdout:mgr epoch 5 is available 2023-12-14T14:03:52.050 INFO:teuthology.orchestra.run.smithi069.stdout:Setting orchestrator backend to cephadm... 2023-12-14T14:03:52.856 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:52 smithi069 ceph-mon[42034]: [14/Dec/2023:14:03:51] ENGINE Bus STARTING 2023-12-14T14:03:52.856 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:52 smithi069 ceph-mon[42034]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-14T14:03:52.856 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:52 smithi069 ceph-mon[42034]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-14T14:03:52.857 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:52 smithi069 ceph-mon[42034]: [14/Dec/2023:14:03:51] ENGINE Serving on https://172.21.15.69:7150 2023-12-14T14:03:52.857 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:52 smithi069 ceph-mon[42034]: [14/Dec/2023:14:03:51] ENGINE Serving on http://172.21.15.69:8765 2023-12-14T14:03:52.857 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:52 smithi069 ceph-mon[42034]: [14/Dec/2023:14:03:51] ENGINE Bus STARTED 2023-12-14T14:03:52.857 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:52 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:03:52.857 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:52 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:03:52.857 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:52 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:03:52.934 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.363+0000 7f2580397700 1 Processor -- start 2023-12-14T14:03:52.934 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.363+0000 7f2580397700 1 -- start start 2023-12-14T14:03:52.934 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.363+0000 7f2580397700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:52.934 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.363+0000 7f2580397700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2578079e00 con 0x7f25781064f0 2023-12-14T14:03:52.934 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.363+0000 7f257e133700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.363+0000 7f257e133700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38720/0 (socket says 172.21.15.69:38720) 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.363+0000 7f257e133700 1 -- 172.21.15.69:0/4038265510 learned_addr learned my addr 172.21.15.69:0/4038265510 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.364+0000 7f257e133700 1 -- 172.21.15.69:0/4038265510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578108e10 con 0x7f25781064f0 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.364+0000 7f257e133700 1 --2- 172.21.15.69:0/4038265510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781088d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25740098a0 tx=0x7f2574009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b4a38681e76b05 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.364+0000 7f257d131700 1 -- 172.21.15.69:0/4038265510 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2574004160 con 0x7f25781064f0 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.364+0000 7f257d131700 1 -- 172.21.15.69:0/4038265510 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f25740042c0 con 0x7f25781064f0 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.364+0000 7f257d131700 1 -- 172.21.15.69:0/4038265510 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2574011a00 con 0x7f25781064f0 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.364+0000 7f2580397700 1 -- 172.21.15.69:0/4038265510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 msgr2=0x7f25781088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.364+0000 7f2580397700 1 --2- 172.21.15.69:0/4038265510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781088d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25740098a0 tx=0x7f2574009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.364+0000 7f2580397700 1 -- 172.21.15.69:0/4038265510 shutdown_connections 2023-12-14T14:03:52.935 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f2580397700 1 --2- 172.21.15.69:0/4038265510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781088d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f2580397700 1 -- 172.21.15.69:0/4038265510 >> 172.21.15.69:0/4038265510 conn(0x7f25780ffed0 msgr2=0x7f2578102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f2580397700 1 -- 172.21.15.69:0/4038265510 shutdown_connections 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f2580397700 1 -- 172.21.15.69:0/4038265510 wait complete. 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f2580397700 1 Processor -- start 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f2580397700 1 -- start start 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f2580397700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f2580397700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2578199cf0 con 0x7f25781064f0 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f257e133700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f257e133700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38728/0 (socket says 172.21.15.69:38728) 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.365+0000 7f257e133700 1 -- 172.21.15.69:0/4185471917 learned_addr learned my addr 172.21.15.69:0/4185471917 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.366+0000 7f257e133700 1 -- 172.21.15.69:0/4185471917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009550 con 0x7f25781064f0 2023-12-14T14:03:52.936 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.366+0000 7f257e133700 1 --2- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781997b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2574009fb0 tx=0x7f2574011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.366+0000 7f256f7fe700 1 -- 172.21.15.69:0/4185471917 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2574003930 con 0x7f25781064f0 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.366+0000 7f256f7fe700 1 -- 172.21.15.69:0/4185471917 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2574003a90 con 0x7f25781064f0 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.366+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2578109d40 con 0x7f25781064f0 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.366+0000 7f256f7fe700 1 -- 172.21.15.69:0/4185471917 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2574019610 con 0x7f25781064f0 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.366+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2578109bb0 con 0x7f25781064f0 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.367+0000 7f256f7fe700 1 -- 172.21.15.69:0/4185471917 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f25740198d0 con 0x7f25781064f0 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.367+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2578062120 con 0x7f25781064f0 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.367+0000 7f256f7fe700 1 --2- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f25640385a0 0x7f256403aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.367+0000 7f256f7fe700 1 -- 172.21.15.69:0/4185471917 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f257404c860 con 0x7f25781064f0 2023-12-14T14:03:52.937 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.367+0000 7f257d932700 1 --2- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f25640385a0 0x7f256403aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.367+0000 7f257d932700 1 --2- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f25640385a0 0x7f256403aa50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2568006fd0 tx=0x7f2568006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.372+0000 7f256f7fe700 1 -- 172.21.15.69:0/4185471917 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f25740188f0 con 0x7f25781064f0 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.570+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f257819a4a0 con 0x7f25640385a0 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.576+0000 7f256f7fe700 1 -- 172.21.15.69:0/4185471917 <== mgr.14120 v2:172.21.15.69:6800/1599224275 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f257819a4a0 con 0x7f25640385a0 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f25640385a0 msgr2=0x7f256403aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 --2- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f25640385a0 0x7f256403aa50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2568006fd0 tx=0x7f2568006e40 comp rx=0 tx=0).stop 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 msgr2=0x7f25781997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 --2- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781997b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2574009fb0 tx=0x7f2574011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 shutdown_connections 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 --2- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f25640385a0 0x7f256403aa50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 --2- 172.21.15.69:0/4185471917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25781064f0 0x7f25781997b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 >> 172.21.15.69:0/4185471917 conn(0x7f25780ffed0 msgr2=0x7f25781015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:52.938 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 shutdown_connections 2023-12-14T14:03:52.939 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:52.578+0000 7f2580397700 1 -- 172.21.15.69:0/4185471917 wait complete. 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.285+0000 7fde09303700 1 Processor -- start 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.285+0000 7fde09303700 1 -- start start 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.285+0000 7fde09303700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde041062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.285+0000 7fde09303700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde041068b0 con 0x7fde04105ed0 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.286+0000 7fde02ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde041062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.286+0000 7fde02ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde041062e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38732/0 (socket says 172.21.15.69:38732) 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.286+0000 7fde02ffd700 1 -- 172.21.15.69:0/1604119092 learned_addr learned my addr 172.21.15.69:0/1604119092 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.286+0000 7fde02ffd700 1 -- 172.21.15.69:0/1604119092 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde04104b30 con 0x7fde04105ed0 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.286+0000 7fde02ffd700 1 --2- 172.21.15.69:0/1604119092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde041062e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddf80098a0 tx=0x7fddf8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f28e0b06cccacba server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:53.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.286+0000 7fde01ffb700 1 -- 172.21.15.69:0/1604119092 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddf8004160 con 0x7fde04105ed0 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.286+0000 7fde01ffb700 1 -- 172.21.15.69:0/1604119092 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fddf80042c0 con 0x7fde04105ed0 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.286+0000 7fde01ffb700 1 -- 172.21.15.69:0/1604119092 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddf8011a00 con 0x7fde04105ed0 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.287+0000 7fde09303700 1 -- 172.21.15.69:0/1604119092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 msgr2=0x7fde041062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.287+0000 7fde09303700 1 --2- 172.21.15.69:0/1604119092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde041062e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddf80098a0 tx=0x7fddf8009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.287+0000 7fde09303700 1 -- 172.21.15.69:0/1604119092 shutdown_connections 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.287+0000 7fde09303700 1 --2- 172.21.15.69:0/1604119092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde041062e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.287+0000 7fde09303700 1 -- 172.21.15.69:0/1604119092 >> 172.21.15.69:0/1604119092 conn(0x7fde040ff650 msgr2=0x7fde04101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.287+0000 7fde09303700 1 -- 172.21.15.69:0/1604119092 shutdown_connections 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.287+0000 7fde09303700 1 -- 172.21.15.69:0/1604119092 wait complete. 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.287+0000 7fde09303700 1 Processor -- start 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.287+0000 7fde09303700 1 -- start start 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fde09303700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde04104580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fde09303700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0419a420 con 0x7fde04105ed0 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fde02ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde04104580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:53.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fde02ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde04104580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38748/0 (socket says 172.21.15.69:38748) 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fde02ffd700 1 -- 172.21.15.69:0/1656546633 learned_addr learned my addr 172.21.15.69:0/1656546633 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fde02ffd700 1 -- 172.21.15.69:0/1656546633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8009550 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fde02ffd700 1 --2- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde04104580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009fb0 tx=0x7fddf8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fddebfff700 1 -- 172.21.15.69:0/1656546633 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddf8003930 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fddebfff700 1 -- 172.21.15.69:0/1656546633 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fddf8003a90 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde04108d70 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fddebfff700 1 -- 172.21.15.69:0/1656546633 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddf8019610 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.288+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde04108f00 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.289+0000 7fddebfff700 1 -- 172.21.15.69:0/1656546633 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7fddf80198d0 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.289+0000 7fddebfff700 1 --2- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fddec0385a0 0x7fddec03aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.289+0000 7fddebfff700 1 -- 172.21.15.69:0/1656546633 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fddf804d6b0 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.289+0000 7fde027fc700 1 --2- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fddec0385a0 0x7fddec03aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.289+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde04109090 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.290+0000 7fde027fc700 1 --2- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fddec0385a0 0x7fddec03aa50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fddf4006fd0 tx=0x7fddf4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.294+0000 7fddebfff700 1 -- 172.21.15.69:0/1656546633 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fddf8019bd0 con 0x7fde04105ed0 2023-12-14T14:03:53.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.483+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fde04100b50 con 0x7fddec0385a0 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.484+0000 7fddebfff700 1 -- 172.21.15.69:0/1656546633 <== mgr.14120 v2:172.21.15.69:6800/1599224275 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fde04100b50 con 0x7fddec0385a0 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fddec0385a0 msgr2=0x7fddec03aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 --2- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fddec0385a0 0x7fddec03aa50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fddf4006fd0 tx=0x7fddf4006e40 comp rx=0 tx=0).stop 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 msgr2=0x7fde04104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 --2- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde04104580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009fb0 tx=0x7fddf8011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 shutdown_connections 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 --2- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fddec0385a0 0x7fddec03aa50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 --2- 172.21.15.69:0/1656546633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04105ed0 0x7fde04104580 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 >> 172.21.15.69:0/1656546633 conn(0x7fde040ff650 msgr2=0x7fde04100440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 shutdown_connections 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:53.486+0000 7fde09303700 1 -- 172.21.15.69:0/1656546633 wait complete. 2023-12-14T14:03:53.879 INFO:teuthology.orchestra.run.smithi069.stdout:Generating ssh key... 2023-12-14T14:03:54.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:53 smithi069 ceph-mon[42034]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:03:54.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:53 smithi069 ceph-mon[42034]: mgrmap e8: x(active, since 2s) 2023-12-14T14:03:55.055 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-mon[42034]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: Generating public/private rsa key pair. 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: Your identification has been saved in /tmp/tmpmrkk_xxq/key. 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: Your public key has been saved in /tmp/tmpmrkk_xxq/key.pub. 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: The key fingerprint is: 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: SHA256:j10ftoh+/I/uEzxnPH8JzEe32ZbO9TEXkMx/m5KRSUs ceph-5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: The key's randomart image is: 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: +---[RSA 3072]----+ 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: | o . | 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: | E | 2023-12-14T14:03:55.056 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: | o * | 2023-12-14T14:03:55.057 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: | = +o| 2023-12-14T14:03:55.057 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: | S +.*.@| 2023-12-14T14:03:55.057 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: | + o X+&O| 2023-12-14T14:03:55.057 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: | . +.. O*X| 2023-12-14T14:03:55.057 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: | . o .=+| 2023-12-14T14:03:55.057 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: | .. +=oo| 2023-12-14T14:03:55.057 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:03:54 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: +----[SHA256]-----+ 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.242+0000 7f1054feb700 1 Processor -- start 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.242+0000 7f1054feb700 1 -- start start 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.242+0000 7f1054feb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f10501088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.242+0000 7f1054feb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1050079e00 con 0x7f10501064f0 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.242+0000 7f104e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f10501088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.242+0000 7f104e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f10501088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38762/0 (socket says 172.21.15.69:38762) 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.242+0000 7f104e59c700 1 -- 172.21.15.69:0/2082221573 learned_addr learned my addr 172.21.15.69:0/2082221573 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.243+0000 7f104e59c700 1 -- 172.21.15.69:0/2082221573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1050108e10 con 0x7f10501064f0 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.243+0000 7f104e59c700 1 --2- 172.21.15.69:0/2082221573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f10501088d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10400098a0 tx=0x7f1040009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf7697810818eb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.243+0000 7f104d59a700 1 -- 172.21.15.69:0/2082221573 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1040004160 con 0x7f10501064f0 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.243+0000 7f104d59a700 1 -- 172.21.15.69:0/2082221573 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10400042c0 con 0x7f10501064f0 2023-12-14T14:03:55.124 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.243+0000 7f104d59a700 1 -- 172.21.15.69:0/2082221573 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1040011a00 con 0x7f10501064f0 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.243+0000 7f1054feb700 1 -- 172.21.15.69:0/2082221573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 msgr2=0x7f10501088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.243+0000 7f1054feb700 1 --2- 172.21.15.69:0/2082221573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f10501088d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10400098a0 tx=0x7f1040009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.244+0000 7f1054feb700 1 -- 172.21.15.69:0/2082221573 shutdown_connections 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.244+0000 7f1054feb700 1 --2- 172.21.15.69:0/2082221573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f10501088d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.244+0000 7f1054feb700 1 -- 172.21.15.69:0/2082221573 >> 172.21.15.69:0/2082221573 conn(0x7f10500ffed0 msgr2=0x7f1050102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.244+0000 7f1054feb700 1 -- 172.21.15.69:0/2082221573 shutdown_connections 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.244+0000 7f1054feb700 1 -- 172.21.15.69:0/2082221573 wait complete. 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.244+0000 7f1054feb700 1 Processor -- start 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.244+0000 7f1054feb700 1 -- start start 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.244+0000 7f1054feb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f1050199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f1054feb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1050199cb0 con 0x7f10501064f0 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f104e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f1050199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f104e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f1050199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38772/0 (socket says 172.21.15.69:38772) 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f104e59c700 1 -- 172.21.15.69:0/459634666 learned_addr learned my addr 172.21.15.69:0/459634666 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:55.125 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f104e59c700 1 -- 172.21.15.69:0/459634666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040009550 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f104e59c700 1 --2- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f1050199770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1040009fb0 tx=0x7f1040011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f103f7fe700 1 -- 172.21.15.69:0/459634666 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1040003930 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f103f7fe700 1 -- 172.21.15.69:0/459634666 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1040003a90 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1050109d40 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f103f7fe700 1 -- 172.21.15.69:0/459634666 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1040019610 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.245+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1050109bb0 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.246+0000 7f103f7fe700 1 -- 172.21.15.69:0/459634666 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f10400198d0 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.246+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1050062120 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.246+0000 7f103f7fe700 1 --2- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f10380386c0 0x7f103803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.246+0000 7f103f7fe700 1 -- 172.21.15.69:0/459634666 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f104004ca10 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.246+0000 7f104dd9b700 1 --2- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f10380386c0 0x7f103803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.247+0000 7f104dd9b700 1 --2- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f10380386c0 0x7f103803ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1044006fd0 tx=0x7f1044006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.251+0000 7f103f7fe700 1 -- 172.21.15.69:0/459634666 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f104002d9b0 con 0x7f10501064f0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.441+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1050102190 con 0x7f10380386c0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.776+0000 7f103f7fe700 1 -- 172.21.15.69:0/459634666 <== mgr.14120 v2:172.21.15.69:6800/1599224275 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1050102190 con 0x7f10380386c0 2023-12-14T14:03:55.126 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f10380386c0 msgr2=0x7f103803ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:55.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 --2- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f10380386c0 0x7f103803ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1044006fd0 tx=0x7f1044006e40 comp rx=0 tx=0).stop 2023-12-14T14:03:55.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 msgr2=0x7f1050199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:55.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 --2- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f1050199770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1040009fb0 tx=0x7f1040011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:55.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 shutdown_connections 2023-12-14T14:03:55.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 --2- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f10380386c0 0x7f103803ab70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:55.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 --2- 172.21.15.69:0/459634666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10501064f0 0x7f1050199770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:55.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 >> 172.21.15.69:0/459634666 conn(0x7f10500ffed0 msgr2=0x7f1050101530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:55.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 shutdown_connections 2023-12-14T14:03:55.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:54.778+0000 7f1054feb700 1 -- 172.21.15.69:0/459634666 wait complete. 2023-12-14T14:03:55.955 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:55 smithi069 ceph-mon[42034]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:03:55.955 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:55 smithi069 ceph-mon[42034]: Generating ssh key... 2023-12-14T14:03:56.033 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBmLD+7jPk8HAyt8chU48SnUTeeMoE5BlCDRAd5U+mM/us7Rqede2tIOFlwZMcGFabc7iXLxQAKecmol0BWiCGxVtK3KFaXRRIbIL0Z4LltnYLPn85T7GG0p1nT/drr/vz1x6qV35rb3KI930MBFwBpkX5qODJK4cjYLfYV3BTv/DhWSwQ87STFZsGVKWmzHnp8Y0qoROYDBNM6eWbOCwp4XY1RZndNK6TGkS2OAfC2Kia5/NTgTe5yK7HYe/oWrBGdG5LKt5kuPsDyM2UkJ9MBXxo3deioVXOhRjarZmfiJYUL7/yxKcU7oepAbOSRPeclB0kjRi1VvW0NEHsZvVvgpZkuuZNCXhp9wtfZpDf+96K9CQb4rGTnOcFuyy4RO8q0jHhG/3jwdHR+eVKgY+1WDSJ7CQEC7GmDeaWagqz9rhaoHPptEXyS3nHIzpl5h9UQZw5MMMXeWO0GjMRdLJE0mtoIMEpBzz7xBGEs8aKTdOpA61qsCyAKaEaRBBTJ0U= ceph-5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:03:56.033 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.475+0000 7feb19d2f700 1 Processor -- start 2023-12-14T14:03:56.033 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.475+0000 7feb19d2f700 1 -- start start 2023-12-14T14:03:56.033 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.475+0000 7feb19d2f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14108870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:56.033 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.475+0000 7feb19d2f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14079e60 con 0x7feb14106490 2023-12-14T14:03:56.033 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.475+0000 7feb137fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:56.033 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.475+0000 7feb137fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14108870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38780/0 (socket says 172.21.15.69:38780) 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.475+0000 7feb137fe700 1 -- 172.21.15.69:0/1548724321 learned_addr learned my addr 172.21.15.69:0/1548724321 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.475+0000 7feb137fe700 1 -- 172.21.15.69:0/1548724321 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14108db0 con 0x7feb14106490 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb137fe700 1 --2- 172.21.15.69:0/1548724321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14108870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feb040098a0 tx=0x7feb04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f858bb303173be66 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb127fc700 1 -- 172.21.15.69:0/1548724321 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb04004160 con 0x7feb14106490 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb127fc700 1 -- 172.21.15.69:0/1548724321 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb040042c0 con 0x7feb14106490 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb127fc700 1 -- 172.21.15.69:0/1548724321 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb04011a00 con 0x7feb14106490 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb19d2f700 1 -- 172.21.15.69:0/1548724321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 msgr2=0x7feb14108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb19d2f700 1 --2- 172.21.15.69:0/1548724321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14108870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feb040098a0 tx=0x7feb04009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb19d2f700 1 -- 172.21.15.69:0/1548724321 shutdown_connections 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb19d2f700 1 --2- 172.21.15.69:0/1548724321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14108870 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb19d2f700 1 -- 172.21.15.69:0/1548724321 >> 172.21.15.69:0/1548724321 conn(0x7feb140ffed0 msgr2=0x7feb14102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb19d2f700 1 -- 172.21.15.69:0/1548724321 shutdown_connections 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.476+0000 7feb19d2f700 1 -- 172.21.15.69:0/1548724321 wait complete. 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.477+0000 7feb19d2f700 1 Processor -- start 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.477+0000 7feb19d2f700 1 -- start start 2023-12-14T14:03:56.034 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.477+0000 7feb19d2f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.477+0000 7feb19d2f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14199ca0 con 0x7feb14106490 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.477+0000 7feb137fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.477+0000 7feb137fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38784/0 (socket says 172.21.15.69:38784) 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.477+0000 7feb137fe700 1 -- 172.21.15.69:0/3779659633 learned_addr learned my addr 172.21.15.69:0/3779659633 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.478+0000 7feb137fe700 1 -- 172.21.15.69:0/3779659633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04009550 con 0x7feb14106490 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.478+0000 7feb137fe700 1 --2- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14199760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feb04009fb0 tx=0x7feb04011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.478+0000 7feb10ff9700 1 -- 172.21.15.69:0/3779659633 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb04003930 con 0x7feb14106490 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.478+0000 7feb10ff9700 1 -- 172.21.15.69:0/3779659633 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb04003a90 con 0x7feb14106490 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.478+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb14109d40 con 0x7feb14106490 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.478+0000 7feb10ff9700 1 -- 172.21.15.69:0/3779659633 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb04019610 con 0x7feb14106490 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.478+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb14109bb0 con 0x7feb14106490 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.479+0000 7feb10ff9700 1 -- 172.21.15.69:0/3779659633 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7feb040198d0 con 0x7feb14106490 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.479+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb14062120 con 0x7feb14106490 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.479+0000 7feb10ff9700 1 --2- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7feafc0386c0 0x7feafc03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:56.035 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.479+0000 7feb10ff9700 1 -- 172.21.15.69:0/3779659633 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7feb0404c860 con 0x7feb14106490 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.479+0000 7feb12ffd700 1 --2- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7feafc0386c0 0x7feafc03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.479+0000 7feb12ffd700 1 --2- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7feafc0386c0 0x7feafc03ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feb08006fd0 tx=0x7feb08006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.484+0000 7feb10ff9700 1 -- 172.21.15.69:0/3779659633 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7feb0402b340 con 0x7feb14106490 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.672+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7feb141013d0 con 0x7feafc0386c0 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.673+0000 7feb10ff9700 1 -- 172.21.15.69:0/3779659633 <== mgr.14120 v2:172.21.15.69:6800/1599224275 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7feb141013d0 con 0x7feafc0386c0 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.674+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7feafc0386c0 msgr2=0x7feafc03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.674+0000 7feb19d2f700 1 --2- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7feafc0386c0 0x7feafc03ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feb08006fd0 tx=0x7feb08006e40 comp rx=0 tx=0).stop 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.674+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 msgr2=0x7feb14199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.675+0000 7feb19d2f700 1 --2- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14199760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feb04009fb0 tx=0x7feb04011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.675+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 shutdown_connections 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.675+0000 7feb19d2f700 1 --2- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7feafc0386c0 0x7feafc03ab70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.675+0000 7feb19d2f700 1 --2- 172.21.15.69:0/3779659633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb14106490 0x7feb14199760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.675+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 >> 172.21.15.69:0/3779659633 conn(0x7feb140ffed0 msgr2=0x7feb14100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.675+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 shutdown_connections 2023-12-14T14:03:56.036 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:55.675+0000 7feb19d2f700 1 -- 172.21.15.69:0/3779659633 wait complete. 2023-12-14T14:03:56.037 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-14T14:03:56.037 INFO:teuthology.orchestra.run.smithi069.stdout:Adding key to root@localhost authorized_keys... 2023-12-14T14:03:56.037 INFO:teuthology.orchestra.run.smithi069.stdout:Adding host smithi069... 2023-12-14T14:03:57.351 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:57 smithi069 ceph-mon[42034]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:58 smithi069 ceph-mon[42034]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi069", "addr": "172.21.15.69", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:58 smithi069 ceph-mon[42034]: Deploying cephadm binary to smithi069 2023-12-14T14:03:58.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Added host 'smithi069' with addr '172.21.15.69' 2023-12-14T14:03:58.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.355+0000 7f4c62003700 1 Processor -- start 2023-12-14T14:03:58.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.355+0000 7f4c62003700 1 -- start start 2023-12-14T14:03:58.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.355+0000 7f4c62003700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c104d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:58.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.355+0000 7f4c62003700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c105300 con 0x7f4c5c104920 2023-12-14T14:03:58.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.355+0000 7f4c5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c104d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:58.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.355+0000 7f4c5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c104d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46020/0 (socket says 172.21.15.69:46020) 2023-12-14T14:03:58.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.355+0000 7f4c5b7fe700 1 -- 172.21.15.69:0/337052285 learned_addr learned my addr 172.21.15.69:0/337052285 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:58.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.355+0000 7f4c5b7fe700 1 -- 172.21.15.69:0/337052285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c105b20 con 0x7f4c5c104920 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c5b7fe700 1 --2- 172.21.15.69:0/337052285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c104d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0098a0 tx=0x7f4c4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3fefa82c20ed0d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c5a7fc700 1 -- 172.21.15.69:0/337052285 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4c004160 con 0x7f4c5c104920 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c5a7fc700 1 -- 172.21.15.69:0/337052285 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c4c0042c0 con 0x7f4c5c104920 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c5a7fc700 1 -- 172.21.15.69:0/337052285 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4c011a00 con 0x7f4c5c104920 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c62003700 1 -- 172.21.15.69:0/337052285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 msgr2=0x7f4c5c104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c62003700 1 --2- 172.21.15.69:0/337052285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c104d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0098a0 tx=0x7f4c4c009bb0 comp rx=0 tx=0).stop 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c62003700 1 -- 172.21.15.69:0/337052285 shutdown_connections 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c62003700 1 --2- 172.21.15.69:0/337052285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c104d30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c62003700 1 -- 172.21.15.69:0/337052285 >> 172.21.15.69:0/337052285 conn(0x7f4c5c0ffed0 msgr2=0x7f4c5c102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c62003700 1 -- 172.21.15.69:0/337052285 shutdown_connections 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.356+0000 7f4c62003700 1 -- 172.21.15.69:0/337052285 wait complete. 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.357+0000 7f4c62003700 1 Processor -- start 2023-12-14T14:03:58.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.357+0000 7f4c62003700 1 -- start start 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.357+0000 7f4c62003700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c079b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.357+0000 7f4c62003700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c19c620 con 0x7f4c5c104920 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.357+0000 7f4c5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c079b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.357+0000 7f4c5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c079b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46032/0 (socket says 172.21.15.69:46032) 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.357+0000 7f4c5b7fe700 1 -- 172.21.15.69:0/1917244454 learned_addr learned my addr 172.21.15.69:0/1917244454 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.358+0000 7f4c5b7fe700 1 -- 172.21.15.69:0/1917244454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c009550 con 0x7f4c5c104920 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.358+0000 7f4c5b7fe700 1 --2- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c079b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006af0 tx=0x7f4c4c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.358+0000 7f4c58ff9700 1 -- 172.21.15.69:0/1917244454 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4c003a40 con 0x7f4c5c104920 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.358+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c108d50 con 0x7f4c5c104920 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.358+0000 7f4c58ff9700 1 -- 172.21.15.69:0/1917244454 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c4c003ba0 con 0x7f4c5c104920 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.358+0000 7f4c58ff9700 1 -- 172.21.15.69:0/1917244454 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4c01a700 con 0x7f4c5c104920 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.358+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c108ee0 con 0x7f4c5c104920 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.359+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c106990 con 0x7f4c5c104920 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.359+0000 7f4c58ff9700 1 -- 172.21.15.69:0/1917244454 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f4c4c024ad0 con 0x7f4c5c104920 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.359+0000 7f4c58ff9700 1 --2- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4c44038710 0x7f4c4403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:58.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.359+0000 7f4c58ff9700 1 -- 172.21.15.69:0/1917244454 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4c4c04c730 con 0x7f4c5c104920 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.359+0000 7f4c5affd700 1 --2- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4c44038710 0x7f4c4403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.360+0000 7f4c5affd700 1 --2- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4c44038710 0x7f4c4403abc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c50006fd0 tx=0x7f4c50006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.365+0000 7f4c58ff9700 1 -- 172.21.15.69:0/1917244454 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4c5c106990 con 0x7f4c5c104920 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:56.556+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi069", "addr": "172.21.15.69", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c5c106990 con 0x7f4c44038710 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.497+0000 7f4c58ff9700 1 -- 172.21.15.69:0/1917244454 <== mgr.14120 v2:172.21.15.69:6800/1599224275 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f4c5c106990 con 0x7f4c44038710 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.499+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4c44038710 msgr2=0x7f4c4403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.499+0000 7f4c62003700 1 --2- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4c44038710 0x7f4c4403abc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c50006fd0 tx=0x7f4c50006e40 comp rx=0 tx=0).stop 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.499+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 msgr2=0x7f4c5c079b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.499+0000 7f4c62003700 1 --2- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c079b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006af0 tx=0x7f4c4c011ad0 comp rx=0 tx=0).stop 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.499+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 shutdown_connections 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.499+0000 7f4c62003700 1 --2- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4c44038710 0x7f4c4403abc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.499+0000 7f4c62003700 1 --2- 172.21.15.69:0/1917244454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c5c104920 0x7f4c5c079b40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.499+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 >> 172.21.15.69:0/1917244454 conn(0x7f4c5c0ffed0 msgr2=0x7f4c5c101540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.500+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 shutdown_connections 2023-12-14T14:03:58.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:58.500+0000 7f4c62003700 1 -- 172.21.15.69:0/1917244454 wait complete. 2023-12-14T14:03:58.820 INFO:teuthology.orchestra.run.smithi069.stdout:Deploying unmanaged mon service... 2023-12-14T14:03:59.676 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:59 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:03:59.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:59 smithi069 ceph-mon[42034]: Added host smithi069 2023-12-14T14:03:59.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:59 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:03:59.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:03:59 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.159+0000 7f3d992a4700 1 Processor -- start 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.159+0000 7f3d992a4700 1 -- start start 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.159+0000 7f3d992a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94104d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.160+0000 7f3d992a4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94105300 con 0x7f3d94104920 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.160+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94104d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.160+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94104d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46044/0 (socket says 172.21.15.69:46044) 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.160+0000 7f3d92ffd700 1 -- 172.21.15.69:0/2114065341 learned_addr learned my addr 172.21.15.69:0/2114065341 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.160+0000 7f3d92ffd700 1 -- 172.21.15.69:0/2114065341 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94105b20 con 0x7f3d94104920 2023-12-14T14:03:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.160+0000 7f3d92ffd700 1 --2- 172.21.15.69:0/2114065341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94104d30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009e80 tx=0x7f3d8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71aca7fd35e0c2fa server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.160+0000 7f3d91ffb700 1 -- 172.21.15.69:0/2114065341 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d8400e070 con 0x7f3d94104920 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.160+0000 7f3d91ffb700 1 -- 172.21.15.69:0/2114065341 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d8400b8c0 con 0x7f3d94104920 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.161+0000 7f3d91ffb700 1 -- 172.21.15.69:0/2114065341 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d840044c0 con 0x7f3d94104920 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.161+0000 7f3d992a4700 1 -- 172.21.15.69:0/2114065341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 msgr2=0x7f3d94104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.161+0000 7f3d992a4700 1 --2- 172.21.15.69:0/2114065341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94104d30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009e80 tx=0x7f3d8400b330 comp rx=0 tx=0).stop 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.161+0000 7f3d992a4700 1 -- 172.21.15.69:0/2114065341 shutdown_connections 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.161+0000 7f3d992a4700 1 --2- 172.21.15.69:0/2114065341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94104d30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.161+0000 7f3d992a4700 1 -- 172.21.15.69:0/2114065341 >> 172.21.15.69:0/2114065341 conn(0x7f3d940ffed0 msgr2=0x7f3d94102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.161+0000 7f3d992a4700 1 -- 172.21.15.69:0/2114065341 shutdown_connections 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.161+0000 7f3d992a4700 1 -- 172.21.15.69:0/2114065341 wait complete. 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.162+0000 7f3d992a4700 1 Processor -- start 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.162+0000 7f3d992a4700 1 -- start start 2023-12-14T14:03:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.162+0000 7f3d992a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.162+0000 7f3d992a4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94199e40 con 0x7f3d94104920 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.162+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.162+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46050/0 (socket says 172.21.15.69:46050) 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.162+0000 7f3d92ffd700 1 -- 172.21.15.69:0/1323810173 learned_addr learned my addr 172.21.15.69:0/1323810173 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.162+0000 7f3d92ffd700 1 -- 172.21.15.69:0/1323810173 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84009b30 con 0x7f3d94104920 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.162+0000 7f3d92ffd700 1 --2- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94199900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009e50 tx=0x7f3d84004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.163+0000 7f3d8bfff700 1 -- 172.21.15.69:0/1323810173 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d8400e040 con 0x7f3d94104920 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.163+0000 7f3d8bfff700 1 -- 172.21.15.69:0/1323810173 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d8400bd70 con 0x7f3d94104920 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.163+0000 7f3d8bfff700 1 -- 172.21.15.69:0/1323810173 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d8401c780 con 0x7f3d94104920 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.163+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d94108d50 con 0x7f3d94104920 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.163+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d94108ee0 con 0x7f3d94104920 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.163+0000 7f3d8bfff700 1 -- 172.21.15.69:0/1323810173 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f3d8401c9b0 con 0x7f3d94104920 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.164+0000 7f3d8bfff700 1 --2- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3d80038710 0x7f3d8003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:03:59.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.164+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d94106990 con 0x7f3d94104920 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.164+0000 7f3d8bfff700 1 -- 172.21.15.69:0/1323810173 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3d8404c720 con 0x7f3d94104920 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.164+0000 7f3d927fc700 1 --2- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3d80038710 0x7f3d8003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.164+0000 7f3d927fc700 1 --2- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3d80038710 0x7f3d8003abc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c006fd0 tx=0x7f3d7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.168+0000 7f3d8bfff700 1 -- 172.21.15.69:0/1323810173 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3d94106990 con 0x7f3d94104920 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.369+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3d94106990 con 0x7f3d80038710 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.373+0000 7f3d8bfff700 1 -- 172.21.15.69:0/1323810173 <== mgr.14120 v2:172.21.15.69:6800/1599224275 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3d94106990 con 0x7f3d80038710 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3d80038710 msgr2=0x7f3d8003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 --2- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3d80038710 0x7f3d8003abc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c006fd0 tx=0x7f3d7c006e40 comp rx=0 tx=0).stop 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 msgr2=0x7f3d94199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 --2- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94199900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009e50 tx=0x7f3d84004610 comp rx=0 tx=0).stop 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 shutdown_connections 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 --2- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3d80038710 0x7f3d8003abc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 --2- 172.21.15.69:0/1323810173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d94104920 0x7f3d94199900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 >> 172.21.15.69:0/1323810173 conn(0x7f3d940ffed0 msgr2=0x7f3d94079890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:03:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 shutdown_connections 2023-12-14T14:03:59.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:03:59.376+0000 7f3d992a4700 1 -- 172.21.15.69:0/1323810173 wait complete. 2023-12-14T14:03:59.803 INFO:teuthology.orchestra.run.smithi069.stdout:Deploying unmanaged mgr service... 2023-12-14T14:04:00.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:00 smithi069 ceph-mon[42034]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:00.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:00 smithi069 ceph-mon[42034]: Saving service mon spec with placement count:5 2023-12-14T14:04:00.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:00 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:04:01.024 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-14T14:04:01.024 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.430+0000 7f4a71de3700 1 Processor -- start 2023-12-14T14:04:01.024 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.430+0000 7f4a71de3700 1 -- start start 2023-12-14T14:04:01.024 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.430+0000 7f4a71de3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.430+0000 7f4a71de3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c079e00 con 0x7f4a6c1064f0 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.430+0000 7f4a6b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.431+0000 7f4a6b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46066/0 (socket says 172.21.15.69:46066) 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.431+0000 7f4a6b7fe700 1 -- 172.21.15.69:0/333046899 learned_addr learned my addr 172.21.15.69:0/333046899 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.431+0000 7f4a6b7fe700 1 -- 172.21.15.69:0/333046899 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c108e10 con 0x7f4a6c1064f0 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.431+0000 7f4a6b7fe700 1 --2- 172.21.15.69:0/333046899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1088d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4a600098a0 tx=0x7f4a60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6aa7c2dead72e0a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.431+0000 7f4a6a7fc700 1 -- 172.21.15.69:0/333046899 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a60004160 con 0x7f4a6c1064f0 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.431+0000 7f4a6a7fc700 1 -- 172.21.15.69:0/333046899 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a600042c0 con 0x7f4a6c1064f0 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.431+0000 7f4a6a7fc700 1 -- 172.21.15.69:0/333046899 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a60011a00 con 0x7f4a6c1064f0 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.432+0000 7f4a71de3700 1 -- 172.21.15.69:0/333046899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 msgr2=0x7f4a6c1088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.432+0000 7f4a71de3700 1 --2- 172.21.15.69:0/333046899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1088d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4a600098a0 tx=0x7f4a60009bb0 comp rx=0 tx=0).stop 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.432+0000 7f4a71de3700 1 -- 172.21.15.69:0/333046899 shutdown_connections 2023-12-14T14:04:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.432+0000 7f4a71de3700 1 --2- 172.21.15.69:0/333046899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1088d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.432+0000 7f4a71de3700 1 -- 172.21.15.69:0/333046899 >> 172.21.15.69:0/333046899 conn(0x7f4a6c0ffed0 msgr2=0x7f4a6c102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.432+0000 7f4a71de3700 1 -- 172.21.15.69:0/333046899 shutdown_connections 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.432+0000 7f4a71de3700 1 -- 172.21.15.69:0/333046899 wait complete. 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.432+0000 7f4a71de3700 1 Processor -- start 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a71de3700 1 -- start start 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a71de3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a71de3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c199cf0 con 0x7f4a6c1064f0 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a6b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a6b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46072/0 (socket says 172.21.15.69:46072) 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a6b7fe700 1 -- 172.21.15.69:0/4061578259 learned_addr learned my addr 172.21.15.69:0/4061578259 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a6b7fe700 1 -- 172.21.15.69:0/4061578259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60009550 con 0x7f4a6c1064f0 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a6b7fe700 1 --2- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1997b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4a60006af0 tx=0x7f4a60011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a68ff9700 1 -- 172.21.15.69:0/4061578259 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a60003a40 con 0x7f4a6c1064f0 2023-12-14T14:04:01.026 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a68ff9700 1 -- 172.21.15.69:0/4061578259 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a60003ba0 con 0x7f4a6c1064f0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c109d40 con 0x7f4a6c1064f0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a68ff9700 1 -- 172.21.15.69:0/4061578259 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a6001a6e0 con 0x7f4a6c1064f0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.433+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c109bb0 con 0x7f4a6c1064f0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.434+0000 7f4a68ff9700 1 -- 172.21.15.69:0/4061578259 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f4a6001a860 con 0x7f4a6c1064f0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.435+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c062120 con 0x7f4a6c1064f0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.435+0000 7f4a68ff9700 1 --2- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4a54038760 0x7f4a5403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.435+0000 7f4a68ff9700 1 -- 172.21.15.69:0/4061578259 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4a6004c920 con 0x7f4a6c1064f0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.435+0000 7f4a6affd700 1 --2- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4a54038760 0x7f4a5403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.435+0000 7f4a6affd700 1 --2- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4a54038760 0x7f4a5403ac10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c006fd0 tx=0x7f4a5c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.439+0000 7f4a68ff9700 1 -- 172.21.15.69:0/4061578259 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4a60018db0 con 0x7f4a6c1064f0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.441+0000 7f4a68ff9700 1 -- 172.21.15.69:0/4061578259 <== mon.0 v2:172.21.15.69:3300/0 7 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a6004c330 con 0x7f4a6c1064f0 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.655+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4a6c19a4a0 con 0x7f4a54038760 2023-12-14T14:04:01.027 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.660+0000 7f4a68ff9700 1 -- 172.21.15.69:0/4061578259 <== mgr.14120 v2:172.21.15.69:6800/1599224275 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4a6c19a4a0 con 0x7f4a54038760 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.662+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4a54038760 msgr2=0x7f4a5403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.663+0000 7f4a71de3700 1 --2- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4a54038760 0x7f4a5403ac10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c006fd0 tx=0x7f4a5c006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.663+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 msgr2=0x7f4a6c1997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.663+0000 7f4a71de3700 1 --2- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1997b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4a60006af0 tx=0x7f4a60011ad0 comp rx=0 tx=0).stop 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.663+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 shutdown_connections 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.663+0000 7f4a71de3700 1 --2- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f4a54038760 0x7f4a5403ac10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.663+0000 7f4a71de3700 1 --2- 172.21.15.69:0/4061578259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c1064f0 0x7f4a6c1997b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.663+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 >> 172.21.15.69:0/4061578259 conn(0x7f4a6c0ffed0 msgr2=0x7f4a6c1015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.663+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 shutdown_connections 2023-12-14T14:04:01.028 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:00.663+0000 7f4a71de3700 1 -- 172.21.15.69:0/4061578259 wait complete. 2023-12-14T14:04:01.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:01 smithi069 ceph-mon[42034]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:01.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:01 smithi069 ceph-mon[42034]: Saving service mgr spec with placement count:2 2023-12-14T14:04:01.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:01 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:04:01.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:01 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:04:01.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:01 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1652404240' entity='client.admin' 2023-12-14T14:04:02.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.419+0000 7fb5602a3700 1 Processor -- start 2023-12-14T14:04:02.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.419+0000 7fb5602a3700 1 -- start start 2023-12-14T14:04:02.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.420+0000 7fb5602a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581044b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:02.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.420+0000 7fb5602a3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558104a80 con 0x7fb5581040a0 2023-12-14T14:04:02.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.420+0000 7fb55e03f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:02.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.420+0000 7fb55e03f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581044b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46080/0 (socket says 172.21.15.69:46080) 2023-12-14T14:04:02.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.420+0000 7fb55e03f700 1 -- 172.21.15.69:0/1231601228 learned_addr learned my addr 172.21.15.69:0/1231601228 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.420+0000 7fb55e03f700 1 -- 172.21.15.69:0/1231601228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5581052a0 con 0x7fb5581040a0 2023-12-14T14:04:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.421+0000 7fb55e03f700 1 --2- 172.21.15.69:0/1231601228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581044b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb55400bb40 tx=0x7fb55400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c194878f7650b363 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.421+0000 7fb55d03d700 1 -- 172.21.15.69:0/1231601228 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb55400dad0 con 0x7fb5581040a0 2023-12-14T14:04:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.421+0000 7fb55d03d700 1 -- 172.21.15.69:0/1231601228 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5540044f0 con 0x7fb5581040a0 2023-12-14T14:04:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.421+0000 7fb55d03d700 1 -- 172.21.15.69:0/1231601228 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb554003dd0 con 0x7fb5581040a0 2023-12-14T14:04:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.422+0000 7fb5602a3700 1 -- 172.21.15.69:0/1231601228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 msgr2=0x7fb5581044b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.422+0000 7fb5602a3700 1 --2- 172.21.15.69:0/1231601228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581044b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb55400bb40 tx=0x7fb55400be50 comp rx=0 tx=0).stop 2023-12-14T14:04:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.422+0000 7fb5602a3700 1 -- 172.21.15.69:0/1231601228 shutdown_connections 2023-12-14T14:04:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.422+0000 7fb5602a3700 1 --2- 172.21.15.69:0/1231601228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581044b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.422+0000 7fb5602a3700 1 -- 172.21.15.69:0/1231601228 >> 172.21.15.69:0/1231601228 conn(0x7fb5580ff650 msgr2=0x7fb558101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.422+0000 7fb5602a3700 1 -- 172.21.15.69:0/1231601228 shutdown_connections 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.422+0000 7fb5602a3700 1 -- 172.21.15.69:0/1231601228 wait complete. 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb5602a3700 1 Processor -- start 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb5602a3700 1 -- start start 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb5602a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb5602a3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558197c10 con 0x7fb5581040a0 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb55e03f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb55e03f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46082/0 (socket says 172.21.15.69:46082) 2023-12-14T14:04:02.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb55e03f700 1 -- 172.21.15.69:0/1652404240 learned_addr learned my addr 172.21.15.69:0/1652404240 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb55e03f700 1 -- 172.21.15.69:0/1652404240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55400b7f0 con 0x7fb5581040a0 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb55e03f700 1 --2- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581976d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb5540046e0 tx=0x7fb55400dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb54f7fe700 1 -- 172.21.15.69:0/1652404240 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb554003710 con 0x7fb5581040a0 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb54f7fe700 1 -- 172.21.15.69:0/1652404240 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb554017b80 con 0x7fb5581040a0 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.423+0000 7fb54f7fe700 1 -- 172.21.15.69:0/1652404240 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb554021a60 con 0x7fb5581040a0 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.424+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5581059e0 con 0x7fb5581040a0 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.424+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb558105850 con 0x7fb5581040a0 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.425+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb558062120 con 0x7fb5581040a0 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.425+0000 7fb54f7fe700 1 -- 172.21.15.69:0/1652404240 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fb554015070 con 0x7fb5581040a0 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.425+0000 7fb54f7fe700 1 --2- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fb544038760 0x7fb54403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:02.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.426+0000 7fb54f7fe700 1 -- 172.21.15.69:0/1652404240 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb55404e540 con 0x7fb5581040a0 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.426+0000 7fb55d83e700 1 --2- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fb544038760 0x7fb54403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.426+0000 7fb55d83e700 1 --2- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fb544038760 0x7fb54403ac10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb548006fd0 tx=0x7fb548006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.430+0000 7fb54f7fe700 1 -- 172.21.15.69:0/1652404240 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb554017cf0 con 0x7fb5581040a0 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.628+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fb558106090 con 0x7fb5581040a0 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.631+0000 7fb54f7fe700 1 -- 172.21.15.69:0/1652404240 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fb554028350 con 0x7fb5581040a0 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.633+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fb544038760 msgr2=0x7fb54403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.633+0000 7fb5602a3700 1 --2- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fb544038760 0x7fb54403ac10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb548006fd0 tx=0x7fb548006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.633+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 msgr2=0x7fb5581976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.633+0000 7fb5602a3700 1 --2- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581976d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb5540046e0 tx=0x7fb55400dc80 comp rx=0 tx=0).stop 2023-12-14T14:04:02.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.633+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 shutdown_connections 2023-12-14T14:04:02.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.633+0000 7fb5602a3700 1 --2- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7fb544038760 0x7fb54403ac10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:02.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.633+0000 7fb5602a3700 1 --2- 172.21.15.69:0/1652404240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5581040a0 0x7fb5581976d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:02.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.633+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 >> 172.21.15.69:0/1652404240 conn(0x7fb5580ff650 msgr2=0x7fb55818ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:02.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.634+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 shutdown_connections 2023-12-14T14:04:02.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:01.634+0000 7fb5602a3700 1 -- 172.21.15.69:0/1652404240 wait complete. 2023-12-14T14:04:03.047 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:02 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:04:03.047 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:02 smithi069 ceph-mon[42034]: from='mgr.14120 172.21.15.69:0/1779424158' entity='mgr.x' 2023-12-14T14:04:03.047 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:02 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1268969327' entity='client.admin' 2023-12-14T14:04:03.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.535+0000 7f86ec089700 1 Processor -- start 2023-12-14T14:04:03.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.535+0000 7f86ec089700 1 -- start start 2023-12-14T14:04:03.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.535+0000 7f86ec089700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e4104710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:03.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.535+0000 7f86ec089700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4079de0 con 0x7f86e4104300 2023-12-14T14:04:03.127 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.535+0000 7f86e9e25700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e4104710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:03.128 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.535+0000 7f86e9e25700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e4104710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46086/0 (socket says 172.21.15.69:46086) 2023-12-14T14:04:03.128 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.535+0000 7f86e9e25700 1 -- 172.21.15.69:0/2419429590 learned_addr learned my addr 172.21.15.69:0/2419429590 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:03.128 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.536+0000 7f86e9e25700 1 -- 172.21.15.69:0/2419429590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4104c50 con 0x7f86e4104300 2023-12-14T14:04:03.128 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.536+0000 7f86e9e25700 1 --2- 172.21.15.69:0/2419429590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e4104710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86e00098a0 tx=0x7f86e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dec168fd5cc92bf server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:03.128 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.536+0000 7f86e8e23700 1 -- 172.21.15.69:0/2419429590 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86e0004160 con 0x7f86e4104300 2023-12-14T14:04:03.128 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.536+0000 7f86e8e23700 1 -- 172.21.15.69:0/2419429590 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86e00042c0 con 0x7f86e4104300 2023-12-14T14:04:03.128 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.536+0000 7f86e8e23700 1 -- 172.21.15.69:0/2419429590 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86e00119b0 con 0x7f86e4104300 2023-12-14T14:04:03.128 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.537+0000 7f86ec089700 1 -- 172.21.15.69:0/2419429590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 msgr2=0x7f86e4104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:03.128 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.537+0000 7f86ec089700 1 --2- 172.21.15.69:0/2419429590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e4104710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86e00098a0 tx=0x7f86e0009bb0 comp rx=0 tx=0).stop 2023-12-14T14:04:03.129 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.537+0000 7f86ec089700 1 -- 172.21.15.69:0/2419429590 shutdown_connections 2023-12-14T14:04:03.129 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.537+0000 7f86ec089700 1 --2- 172.21.15.69:0/2419429590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e4104710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:03.129 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.537+0000 7f86ec089700 1 -- 172.21.15.69:0/2419429590 >> 172.21.15.69:0/2419429590 conn(0x7f86e40ffed0 msgr2=0x7f86e4102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:03.129 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.537+0000 7f86ec089700 1 -- 172.21.15.69:0/2419429590 shutdown_connections 2023-12-14T14:04:03.129 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.537+0000 7f86ec089700 1 -- 172.21.15.69:0/2419429590 wait complete. 2023-12-14T14:04:03.129 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86ec089700 1 Processor -- start 2023-12-14T14:04:03.129 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86ec089700 1 -- start start 2023-12-14T14:04:03.129 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86ec089700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:03.129 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86ec089700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e419bf00 con 0x7f86e4104300 2023-12-14T14:04:03.130 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86e9e25700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:03.130 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86e9e25700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e419b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46100/0 (socket says 172.21.15.69:46100) 2023-12-14T14:04:03.130 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86e9e25700 1 -- 172.21.15.69:0/1268969327 learned_addr learned my addr 172.21.15.69:0/1268969327 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:03.130 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86e9e25700 1 -- 172.21.15.69:0/1268969327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0009550 con 0x7f86e4104300 2023-12-14T14:04:03.130 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86e9e25700 1 --2- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e419b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86e0003e60 tx=0x7f86e0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:03.130 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.538+0000 7f86daffd700 1 -- 172.21.15.69:0/1268969327 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86e0003970 con 0x7f86e4104300 2023-12-14T14:04:03.130 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.539+0000 7f86daffd700 1 -- 172.21.15.69:0/1268969327 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86e0003ad0 con 0x7f86e4104300 2023-12-14T14:04:03.130 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.539+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e4105c90 con 0x7f86e4104300 2023-12-14T14:04:03.130 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.539+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e4105b00 con 0x7f86e4104300 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.539+0000 7f86daffd700 1 -- 172.21.15.69:0/1268969327 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86e00195e0 con 0x7f86e4104300 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.540+0000 7f86daffd700 1 -- 172.21.15.69:0/1268969327 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f86e0019920 con 0x7f86e4104300 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.540+0000 7f86daffd700 1 --2- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f86d00386c0 0x7f86d003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.540+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c8005320 con 0x7f86e4104300 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.540+0000 7f86daffd700 1 -- 172.21.15.69:0/1268969327 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f86e004d840 con 0x7f86e4104300 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.540+0000 7f86e9624700 1 --2- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f86d00386c0 0x7f86d003ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.540+0000 7f86e9624700 1 --2- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f86d00386c0 0x7f86d003ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006fd0 tx=0x7f86d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.545+0000 7f86daffd700 1 -- 172.21.15.69:0/1268969327 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f86e002b340 con 0x7f86e4104300 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.761+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f86c8005f70 con 0x7f86e4104300 2023-12-14T14:04:03.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.764+0000 7f86daffd700 1 -- 172.21.15.69:0/1268969327 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f86e0018b40 con 0x7f86e4104300 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f86d00386c0 msgr2=0x7f86d003ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 --2- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f86d00386c0 0x7f86d003ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006fd0 tx=0x7f86d4006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 msgr2=0x7f86e419b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 --2- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e419b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86e0003e60 tx=0x7f86e0011aa0 comp rx=0 tx=0).stop 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 shutdown_connections 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 --2- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f86d00386c0 0x7f86d003ab70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 --2- 172.21.15.69:0/1268969327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e4104300 0x7f86e419b9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 >> 172.21.15.69:0/1268969327 conn(0x7f86e40ffed0 msgr2=0x7f86e418fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 shutdown_connections 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:02.767+0000 7f86ec089700 1 -- 172.21.15.69:0/1268969327 wait complete. 2023-12-14T14:04:03.132 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling the dashboard module... 2023-12-14T14:04:04.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:03 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/364535033' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-14T14:04:04.086 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:03 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: ignoring --setuser ceph since I am not root 2023-12-14T14:04:04.086 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:03 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: ignoring --setgroup ceph since I am not root 2023-12-14T14:04:04.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.620+0000 7f2b9a3f5700 1 Processor -- start 2023-12-14T14:04:04.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.620+0000 7f2b9a3f5700 1 -- start start 2023-12-14T14:04:04.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.620+0000 7f2b9a3f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94108930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:04.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.620+0000 7f2b9a3f5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94079da0 con 0x7f2b94106550 2023-12-14T14:04:04.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.620+0000 7f2b93fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94108930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:04.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.620+0000 7f2b93fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94108930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46104/0 (socket says 172.21.15.69:46104) 2023-12-14T14:04:04.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.620+0000 7f2b93fff700 1 -- 172.21.15.69:0/1006955082 learned_addr learned my addr 172.21.15.69:0/1006955082 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:04.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.621+0000 7f2b93fff700 1 -- 172.21.15.69:0/1006955082 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94079ee0 con 0x7f2b94106550 2023-12-14T14:04:04.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.621+0000 7f2b93fff700 1 --2- 172.21.15.69:0/1006955082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94108930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098a0 tx=0x7f2b88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a3dfc5bee15602 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:04.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.621+0000 7f2b92ffd700 1 -- 172.21.15.69:0/1006955082 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b88004160 con 0x7f2b94106550 2023-12-14T14:04:04.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.621+0000 7f2b92ffd700 1 -- 172.21.15.69:0/1006955082 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b880042c0 con 0x7f2b94106550 2023-12-14T14:04:04.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.621+0000 7f2b92ffd700 1 -- 172.21.15.69:0/1006955082 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b880119b0 con 0x7f2b94106550 2023-12-14T14:04:04.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.621+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/1006955082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 msgr2=0x7f2b94108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:04.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.621+0000 7f2b9a3f5700 1 --2- 172.21.15.69:0/1006955082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94108930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098a0 tx=0x7f2b88009bb0 comp rx=0 tx=0).stop 2023-12-14T14:04:04.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.621+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/1006955082 shutdown_connections 2023-12-14T14:04:04.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.622+0000 7f2b9a3f5700 1 --2- 172.21.15.69:0/1006955082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94108930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:04.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.622+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/1006955082 >> 172.21.15.69:0/1006955082 conn(0x7f2b940ffed0 msgr2=0x7f2b94102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:04.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.622+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/1006955082 shutdown_connections 2023-12-14T14:04:04.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.622+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/1006955082 wait complete. 2023-12-14T14:04:04.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.622+0000 7f2b9a3f5700 1 Processor -- start 2023-12-14T14:04:04.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.622+0000 7f2b9a3f5700 1 -- start start 2023-12-14T14:04:04.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.622+0000 7f2b9a3f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:04.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.622+0000 7f2b9a3f5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b941063f0 con 0x7f2b94106550 2023-12-14T14:04:04.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b93fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:04.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b93fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46108/0 (socket says 172.21.15.69:46108) 2023-12-14T14:04:04.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b93fff700 1 -- 172.21.15.69:0/364535033 learned_addr learned my addr 172.21.15.69:0/364535033 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:04.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b93fff700 1 -- 172.21.15.69:0/364535033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88009550 con 0x7f2b94106550 2023-12-14T14:04:04.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b93fff700 1 --2- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94105eb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b88011980 tx=0x7f2b88011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:04.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b917fa700 1 -- 172.21.15.69:0/364535033 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b88003a60 con 0x7f2b94106550 2023-12-14T14:04:04.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b917fa700 1 -- 172.21.15.69:0/364535033 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b88003bc0 con 0x7f2b94106550 2023-12-14T14:04:04.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b94109d70 con 0x7f2b94106550 2023-12-14T14:04:04.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b917fa700 1 -- 172.21.15.69:0/364535033 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8801a670 con 0x7f2b94106550 2023-12-14T14:04:04.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.623+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b94109be0 con 0x7f2b94106550 2023-12-14T14:04:04.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.624+0000 7f2b917fa700 1 -- 172.21.15.69:0/364535033 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f2b8801a8e0 con 0x7f2b94106550 2023-12-14T14:04:04.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.624+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b94062120 con 0x7f2b94106550 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.624+0000 7f2b917fa700 1 --2- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2b7c038760 0x7f2b7c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.624+0000 7f2b917fa700 1 -- 172.21.15.69:0/364535033 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2b8804c980 con 0x7f2b94106550 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.624+0000 7f2b937fe700 1 --2- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2b7c038760 0x7f2b7c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.625+0000 7f2b937fe700 1 --2- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2b7c038760 0x7f2b7c03ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b84006fd0 tx=0x7f2b84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.629+0000 7f2b917fa700 1 -- 172.21.15.69:0/364535033 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2b8801ab90 con 0x7f2b94106550 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.883+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f2b94104c60 con 0x7f2b94106550 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.935+0000 7f2b917fa700 1 -- 172.21.15.69:0/364535033 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f2b8802d910 con 0x7f2b94106550 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.937+0000 7f2b917fa700 1 -- 172.21.15.69:0/364535033 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f2b8802c710 con 0x7f2b94106550 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2b7c038760 msgr2=0x7f2b7c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 --2- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2b7c038760 0x7f2b7c03ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b84006fd0 tx=0x7f2b84006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:04.280 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 msgr2=0x7f2b94105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:04.280 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 --2- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94105eb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b88011980 tx=0x7f2b88011a60 comp rx=0 tx=0).stop 2023-12-14T14:04:04.280 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 shutdown_connections 2023-12-14T14:04:04.280 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 --2- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f2b7c038760 0x7f2b7c03ac10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:04.280 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 --2- 172.21.15.69:0/364535033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b94106550 0x7f2b94105eb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:04.280 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 >> 172.21.15.69:0/364535033 conn(0x7f2b940ffed0 msgr2=0x7f2b94101570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:04.280 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 shutdown_connections 2023-12-14T14:04:04.280 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:03.940+0000 7f2b9a3f5700 1 -- 172.21.15.69:0/364535033 wait complete. 2023-12-14T14:04:04.383 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:04 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:04.323+0000 7fcccbd3b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T14:04:04.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:04 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:04.437+0000 7fcccbd3b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T14:04:04.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:04 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:04.537+0000 7fcccbd3b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T14:04:04.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:04 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:04.625+0000 7fcccbd3b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T14:04:05.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:04 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/364535033' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-14T14:04:05.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:04 smithi069 ceph-mon[42034]: mgrmap e9: x(active, since 13s) 2023-12-14T14:04:05.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:04 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1476681790' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.663+0000 7f358fead700 1 Processor -- start 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.663+0000 7f358fead700 1 -- start start 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.663+0000 7f358fead700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f3588106300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.663+0000 7f358fead700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35881068d0 con 0x7f3588105ef0 2023-12-14T14:04:05.308 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.664+0000 7f358dc49700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f3588106300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.664+0000 7f358dc49700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f3588106300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46122/0 (socket says 172.21.15.69:46122) 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.664+0000 7f358dc49700 1 -- 172.21.15.69:0/3868417813 learned_addr learned my addr 172.21.15.69:0/3868417813 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.664+0000 7f358dc49700 1 -- 172.21.15.69:0/3868417813 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3588104b50 con 0x7f3588105ef0 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.664+0000 7f358dc49700 1 --2- 172.21.15.69:0/3868417813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f3588106300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35840098a0 tx=0x7f3584009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c72cf87998dd7e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.664+0000 7f358cc47700 1 -- 172.21.15.69:0/3868417813 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3584004160 con 0x7f3588105ef0 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.664+0000 7f358cc47700 1 -- 172.21.15.69:0/3868417813 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35840042c0 con 0x7f3588105ef0 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.664+0000 7f358cc47700 1 -- 172.21.15.69:0/3868417813 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35840119b0 con 0x7f3588105ef0 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.665+0000 7f358fead700 1 -- 172.21.15.69:0/3868417813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 msgr2=0x7f3588106300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.665+0000 7f358fead700 1 --2- 172.21.15.69:0/3868417813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f3588106300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35840098a0 tx=0x7f3584009bb0 comp rx=0 tx=0).stop 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.665+0000 7f358fead700 1 -- 172.21.15.69:0/3868417813 shutdown_connections 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.665+0000 7f358fead700 1 --2- 172.21.15.69:0/3868417813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f3588106300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.665+0000 7f358fead700 1 -- 172.21.15.69:0/3868417813 >> 172.21.15.69:0/3868417813 conn(0x7f35880ff650 msgr2=0x7f3588101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.665+0000 7f358fead700 1 -- 172.21.15.69:0/3868417813 shutdown_connections 2023-12-14T14:04:05.309 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.665+0000 7f358fead700 1 -- 172.21.15.69:0/3868417813 wait complete. 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.666+0000 7f358fead700 1 Processor -- start 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.666+0000 7f358fead700 1 -- start start 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.666+0000 7f358fead700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f358818fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.666+0000 7f358fead700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35881900d0 con 0x7f3588105ef0 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.666+0000 7f358dc49700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f358818fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.666+0000 7f358dc49700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f358818fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46138/0 (socket says 172.21.15.69:46138) 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.666+0000 7f358dc49700 1 -- 172.21.15.69:0/1476681790 learned_addr learned my addr 172.21.15.69:0/1476681790 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.666+0000 7f358dc49700 1 -- 172.21.15.69:0/1476681790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3584009550 con 0x7f3588105ef0 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.666+0000 7f358dc49700 1 --2- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f358818fb90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3584003e60 tx=0x7f3584011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.667+0000 7f357effd700 1 -- 172.21.15.69:0/1476681790 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3584003970 con 0x7f3588105ef0 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.667+0000 7f357effd700 1 -- 172.21.15.69:0/1476681790 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3584003ad0 con 0x7f3588105ef0 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.667+0000 7f357effd700 1 -- 172.21.15.69:0/1476681790 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35840195e0 con 0x7f3588105ef0 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.667+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3588108f20 con 0x7f3588105ef0 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.667+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3588108d90 con 0x7f3588105ef0 2023-12-14T14:04:05.310 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.668+0000 7f357effd700 1 -- 172.21.15.69:0/1476681790 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f3584019850 con 0x7f3588105ef0 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.668+0000 7f357effd700 1 --2- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3574038760 0x7f357403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.668+0000 7f357effd700 1 -- 172.21.15.69:0/1476681790 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f358404c880 con 0x7f3588105ef0 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.668+0000 7f358d448700 1 -- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3574038760 msgr2=0x7f357403ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/1599224275 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.668+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35881090b0 con 0x7f3588105ef0 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.668+0000 7f358d448700 1 --2- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3574038760 0x7f357403ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.675+0000 7f357effd700 1 -- 172.21.15.69:0/1476681790 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f358402b340 con 0x7f3588105ef0 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.869+0000 7f358d448700 1 -- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3574038760 msgr2=0x7f357403ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/1599224275 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.869+0000 7f358d448700 1 --2- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3574038760 0x7f357403ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.927+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f358818eff0 con 0x7f3588105ef0 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.927+0000 7f357effd700 1 -- 172.21.15.69:0/1476681790 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f3584018b40 con 0x7f3588105ef0 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3574038760 msgr2=0x7f357403ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 --2- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3574038760 0x7f357403ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 msgr2=0x7f358818fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 --2- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f358818fb90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3584003e60 tx=0x7f3584011aa0 comp rx=0 tx=0).stop 2023-12-14T14:04:05.311 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 shutdown_connections 2023-12-14T14:04:05.312 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 --2- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f3574038760 0x7f357403ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:05.312 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 --2- 172.21.15.69:0/1476681790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3588105ef0 0x7f358818fb90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:05.312 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 >> 172.21.15.69:0/1476681790 conn(0x7f35880ff650 msgr2=0x7f3588104390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:05.312 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 shutdown_connections 2023-12-14T14:04:05.312 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:04.929+0000 7f358fead700 1 -- 172.21.15.69:0/1476681790 wait complete. 2023-12-14T14:04:05.312 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for the mgr to restart... 2023-12-14T14:04:05.312 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr epoch 9... 2023-12-14T14:04:05.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:05 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:05.259+0000 7fcccbd3b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:04:05.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:05 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:05.503+0000 7fcccbd3b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T14:04:05.993 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:05 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:05.593+0000 7fcccbd3b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T14:04:05.993 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:05 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:05.708+0000 7fcccbd3b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T14:04:05.993 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:05 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:05.800+0000 7fcccbd3b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T14:04:06.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:05 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:05.994+0000 7fcccbd3b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T14:04:06.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:06 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:06.079+0000 7fcccbd3b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T14:04:06.712 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:06 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:06.450+0000 7fcccbd3b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T14:04:06.993 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:06 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:06.713+0000 7fcccbd3b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T14:04:07.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:06 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:06.994+0000 7fcccbd3b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T14:04:07.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:07 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:07.089+0000 7fcccbd3b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T14:04:08.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:07 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:07.835+0000 7fcccbd3b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T14:04:08.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:07 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:07.931+0000 7fcccbd3b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T14:04:08.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:08 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:08.077+0000 7fcccbd3b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T14:04:09.073 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:08 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:08.699+0000 7fcccbd3b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T14:04:09.073 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:08 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:08.881+0000 7fcccbd3b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T14:04:09.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:09 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:09.074+0000 7fcccbd3b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T14:04:10.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:09 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:09.780+0000 7fcccbd3b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T14:04:10.530 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:10.253+0000 7fcccbd3b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:04:10.530 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:10.341+0000 7fcccbd3b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T14:04:10.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:04:10.531+0000 7fcccbd3b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T14:04:10.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: Active manager daemon x restarted 2023-12-14T14:04:10.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: Activating manager daemon x 2023-12-14T14:04:10.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: osdmap e3: 0 total, 0 up, 0 in 2023-12-14T14:04:10.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: mgrmap e10: x(active, starting, since 0.00309978s) 2023-12-14T14:04:10.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:04:10.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-14T14:04:10.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-14T14:04:10.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-14T14:04:10.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-14T14:04:10.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: Manager daemon x is now available 2023-12-14T14:04:10.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:10.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-14T14:04:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-14T14:04:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:11 smithi069 ceph-mon[42034]: mgrmap e11: x(active, since 1.00767s) 2023-12-14T14:04:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:11.916 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T14:04:11.916 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-14T14:04:11.916 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.679+0000 7f6eb9b64700 1 Processor -- start 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.679+0000 7f6eb9b64700 1 -- start start 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.679+0000 7f6eb9b64700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4108930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.679+0000 7f6eb9b64700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4079da0 con 0x7f6eb4106550 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.680+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4108930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.680+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4108930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46154/0 (socket says 172.21.15.69:46154) 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.680+0000 7f6eb37fe700 1 -- 172.21.15.69:0/786392240 learned_addr learned my addr 172.21.15.69:0/786392240 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.680+0000 7f6eb37fe700 1 -- 172.21.15.69:0/786392240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb4079ee0 con 0x7f6eb4106550 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.680+0000 7f6eb37fe700 1 --2- 172.21.15.69:0/786392240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4108930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009e80 tx=0x7f6ea400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6af8e9324b73812 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.680+0000 7f6eb27fc700 1 -- 172.21.15.69:0/786392240 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea400e070 con 0x7f6eb4106550 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.680+0000 7f6eb27fc700 1 -- 172.21.15.69:0/786392240 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ea400b8c0 con 0x7f6eb4106550 2023-12-14T14:04:11.917 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.680+0000 7f6eb27fc700 1 -- 172.21.15.69:0/786392240 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea40043e0 con 0x7f6eb4106550 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.681+0000 7f6eb9b64700 1 -- 172.21.15.69:0/786392240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 msgr2=0x7f6eb4108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.681+0000 7f6eb9b64700 1 --2- 172.21.15.69:0/786392240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4108930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009e80 tx=0x7f6ea400b330 comp rx=0 tx=0).stop 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.681+0000 7f6eb9b64700 1 -- 172.21.15.69:0/786392240 shutdown_connections 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.681+0000 7f6eb9b64700 1 --2- 172.21.15.69:0/786392240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4108930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.681+0000 7f6eb9b64700 1 -- 172.21.15.69:0/786392240 >> 172.21.15.69:0/786392240 conn(0x7f6eb40ffed0 msgr2=0x7f6eb4102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.681+0000 7f6eb9b64700 1 -- 172.21.15.69:0/786392240 shutdown_connections 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.681+0000 7f6eb9b64700 1 -- 172.21.15.69:0/786392240 wait complete. 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.682+0000 7f6eb9b64700 1 Processor -- start 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.682+0000 7f6eb9b64700 1 -- start start 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.682+0000 7f6eb9b64700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.682+0000 7f6eb9b64700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb41063f0 con 0x7f6eb4106550 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.682+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.682+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46164/0 (socket says 172.21.15.69:46164) 2023-12-14T14:04:11.918 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.682+0000 7f6eb37fe700 1 -- 172.21.15.69:0/2407905938 learned_addr learned my addr 172.21.15.69:0/2407905938 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.682+0000 7f6eb37fe700 1 -- 172.21.15.69:0/2407905938 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4009b30 con 0x7f6eb4106550 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.683+0000 7f6eb37fe700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4105eb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009e50 tx=0x7f6ea4003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.683+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea400e040 con 0x7f6eb4106550 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.683+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ea400be30 con 0x7f6eb4106550 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.683+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb4109d70 con 0x7f6eb4106550 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.683+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea401c750 con 0x7f6eb4106550 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.683+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4109be0 con 0x7f6eb4106550 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.684+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f6ea401c940 con 0x7f6eb4106550 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.684+0000 7f6eb0ff9700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 0x7f6ea003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.684+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6ea404d620 con 0x7f6eb4106550 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.684+0000 7f6eb2ffd700 1 -- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 msgr2=0x7f6ea003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/1599224275 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.684+0000 7f6eb2ffd700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 0x7f6ea003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:04:11.919 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.684+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 --> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6eb4062120 con 0x7f6ea0038760 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.885+0000 7f6eb2ffd700 1 -- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 msgr2=0x7f6ea003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/1599224275 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:05.885+0000 7f6eb2ffd700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 0x7f6ea003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:06.286+0000 7f6eb2ffd700 1 -- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 msgr2=0x7f6ea003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/1599224275 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:06.286+0000 7f6eb2ffd700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 0x7f6ea003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:07.087+0000 7f6eb2ffd700 1 -- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 msgr2=0x7f6ea003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/1599224275 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:07.087+0000 7f6eb2ffd700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 0x7f6ea003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:08.688+0000 7f6eb2ffd700 1 -- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 msgr2=0x7f6ea003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/1599224275 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:08.688+0000 7f6eb2ffd700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 0x7f6ea003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:10.547+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 10) v1 ==== 45263+0+0 (secure 0 0 0) 0x7f6ea401b4e0 con 0x7f6eb4106550 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:10.547+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 msgr2=0x7f6ea003ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:10.547+0000 7f6eb0ff9700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 0x7f6ea003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.550+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7f6ea404c050 con 0x7f6eb4106550 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.550+0000 7f6eb0ff9700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ea003bfc0 0x7f6ea003e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.550+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6eb4062120 con 0x7f6ea003bfc0 2023-12-14T14:04:11.920 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.550+0000 7f6eb2ffd700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ea003bfc0 0x7f6ea003e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.551+0000 7f6eb2ffd700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ea003bfc0 0x7f6ea003e3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c003a10 tx=0x7f6e9c009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.552+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f6eb4062120 con 0x7f6ea003bfc0 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.562+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6eb4105a50 con 0x7f6ea003bfc0 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb0ff9700 1 -- 172.21.15.69:0/2407905938 <== mgr.14152 v2:172.21.15.69:6800/933503151 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f6eb4105a50 con 0x7f6ea003bfc0 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ea003bfc0 msgr2=0x7f6ea003e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ea003bfc0 0x7f6ea003e3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c003a10 tx=0x7f6e9c009270 comp rx=0 tx=0).stop 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 msgr2=0x7f6eb4105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4105eb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009e50 tx=0x7f6ea4003d00 comp rx=0 tx=0).stop 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 shutdown_connections 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ea003bfc0 0x7f6ea003e3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb4106550 0x7f6eb4105eb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 --2- 172.21.15.69:0/2407905938 >> [v2:172.21.15.69:6800/1599224275,v1:172.21.15.69:6801/1599224275] conn(0x7f6ea0038760 0x7f6ea003ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:11.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 >> 172.21.15.69:0/2407905938 conn(0x7f6eb40ffed0 msgr2=0x7f6eb4100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:11.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 shutdown_connections 2023-12-14T14:04:11.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:11.563+0000 7f6eb9b64700 1 -- 172.21.15.69:0/2407905938 wait complete. 2023-12-14T14:04:11.922 INFO:teuthology.orchestra.run.smithi069.stdout:mgr epoch 9 is available 2023-12-14T14:04:11.922 INFO:teuthology.orchestra.run.smithi069.stdout:Generating a dashboard self-signed certificate... 2023-12-14T14:04:12.888 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:12 smithi069 ceph-mon[42034]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-14T14:04:12.888 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:12 smithi069 ceph-mon[42034]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-14T14:04:12.888 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:12 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.349+0000 7fbe82cef700 1 Processor -- start 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.349+0000 7fbe82cef700 1 -- start start 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.349+0000 7fbe82cef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c104120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.349+0000 7fbe82cef700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c1046f0 con 0x7fbe7c103d10 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.350+0000 7fbe80a8b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c104120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.350+0000 7fbe80a8b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c104120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60462/0 (socket says 172.21.15.69:60462) 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.350+0000 7fbe80a8b700 1 -- 172.21.15.69:0/4141320086 learned_addr learned my addr 172.21.15.69:0/4141320086 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.350+0000 7fbe80a8b700 1 -- 172.21.15.69:0/4141320086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c106ca0 con 0x7fbe7c103d10 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.350+0000 7fbe80a8b700 1 --2- 172.21.15.69:0/4141320086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c104120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe700098a0 tx=0x7fbe70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550470e0d90d21d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.350+0000 7fbe7b7fe700 1 -- 172.21.15.69:0/4141320086 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe70004160 con 0x7fbe7c103d10 2023-12-14T14:04:13.072 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.350+0000 7fbe7b7fe700 1 -- 172.21.15.69:0/4141320086 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe700042c0 con 0x7fbe7c103d10 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.350+0000 7fbe7b7fe700 1 -- 172.21.15.69:0/4141320086 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe700119b0 con 0x7fbe7c103d10 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.351+0000 7fbe82cef700 1 -- 172.21.15.69:0/4141320086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 msgr2=0x7fbe7c104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.351+0000 7fbe82cef700 1 --2- 172.21.15.69:0/4141320086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c104120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe700098a0 tx=0x7fbe70009bb0 comp rx=0 tx=0).stop 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.351+0000 7fbe82cef700 1 -- 172.21.15.69:0/4141320086 shutdown_connections 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.351+0000 7fbe82cef700 1 --2- 172.21.15.69:0/4141320086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c104120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.351+0000 7fbe82cef700 1 -- 172.21.15.69:0/4141320086 >> 172.21.15.69:0/4141320086 conn(0x7fbe7c0ff650 msgr2=0x7fbe7c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.351+0000 7fbe82cef700 1 -- 172.21.15.69:0/4141320086 shutdown_connections 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.351+0000 7fbe82cef700 1 -- 172.21.15.69:0/4141320086 wait complete. 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.351+0000 7fbe82cef700 1 Processor -- start 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.351+0000 7fbe82cef700 1 -- start start 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe82cef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe82cef700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c199ce0 con 0x7fbe7c103d10 2023-12-14T14:04:13.073 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe80a8b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe80a8b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c1997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60478/0 (socket says 172.21.15.69:60478) 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe80a8b700 1 -- 172.21.15.69:0/3876438977 learned_addr learned my addr 172.21.15.69:0/3876438977 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe80a8b700 1 -- 172.21.15.69:0/3876438977 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70009550 con 0x7fbe7c103d10 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe80a8b700 1 --2- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c1997a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbe70003e60 tx=0x7fbe70011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe79ffb700 1 -- 172.21.15.69:0/3876438977 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe70003970 con 0x7fbe7c103d10 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe79ffb700 1 -- 172.21.15.69:0/3876438977 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe70003ad0 con 0x7fbe7c103d10 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c10a060 con 0x7fbe7c103d10 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.352+0000 7fbe79ffb700 1 -- 172.21.15.69:0/3876438977 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe700195e0 con 0x7fbe7c103d10 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.353+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c109ed0 con 0x7fbe7c103d10 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.353+0000 7fbe79ffb700 1 -- 172.21.15.69:0/3876438977 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7fbe70019850 con 0x7fbe7c103d10 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.353+0000 7fbe79ffb700 1 --2- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbe6c038640 0x7fbe6c03aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.353+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c10a1f0 con 0x7fbe7c103d10 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.354+0000 7fbe79ffb700 1 -- 172.21.15.69:0/3876438977 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbe7004c740 con 0x7fbe7c103d10 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.354+0000 7fbe7bfff700 1 --2- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbe6c038640 0x7fbe6c03aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:13.074 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.354+0000 7fbe7bfff700 1 --2- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbe6c038640 0x7fbe6c03aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbe68006fd0 tx=0x7fbe68006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.358+0000 7fbe79ffb700 1 -- 172.21.15.69:0/3876438977 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fbe70018740 con 0x7fbe7c103d10 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.564+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe7c101920 con 0x7fbe6c038640 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.691+0000 7fbe79ffb700 1 -- 172.21.15.69:0/3876438977 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fbe7c101920 con 0x7fbe6c038640 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbe6c038640 msgr2=0x7fbe6c03aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 --2- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbe6c038640 0x7fbe6c03aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbe68006fd0 tx=0x7fbe68006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 msgr2=0x7fbe7c1997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 --2- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c1997a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbe70003e60 tx=0x7fbe70011aa0 comp rx=0 tx=0).stop 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 shutdown_connections 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 --2- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbe6c038640 0x7fbe6c03aaf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 --2- 172.21.15.69:0/3876438977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe7c103d10 0x7fbe7c1997a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 >> 172.21.15.69:0/3876438977 conn(0x7fbe7c0ff650 msgr2=0x7fbe7c100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 shutdown_connections 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:12.693+0000 7fbe82cef700 1 -- 172.21.15.69:0/3876438977 wait complete. 2023-12-14T14:04:13.075 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial admin user... 2023-12-14T14:04:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:13 smithi069 ceph-mon[42034]: [14/Dec/2023:14:04:12] ENGINE Bus STARTING 2023-12-14T14:04:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:13 smithi069 ceph-mon[42034]: [14/Dec/2023:14:04:12] ENGINE Serving on https://172.21.15.69:7150 2023-12-14T14:04:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:13 smithi069 ceph-mon[42034]: [14/Dec/2023:14:04:12] ENGINE Serving on http://172.21.15.69:8765 2023-12-14T14:04:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:13 smithi069 ceph-mon[42034]: [14/Dec/2023:14:04:12] ENGINE Bus STARTED 2023-12-14T14:04:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:13 smithi069 ceph-mon[42034]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:13 smithi069 ceph-mon[42034]: mgrmap e12: x(active, since 2s) 2023-12-14T14:04:14.472 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$gQ65yqVxrnA1Rw9RIwkg.O.b9vbs8oq4TpD28HzoqIKhaGVQQTC..", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702562654, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-14T14:04:14.472 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.679+0000 7f72116d2700 1 Processor -- start 2023-12-14T14:04:14.472 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.679+0000 7f72116d2700 1 -- start start 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.679+0000 7f72116d2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c104710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.679+0000 7f72116d2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c079de0 con 0x7f720c104300 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.680+0000 7f720affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c104710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.680+0000 7f720affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c104710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60480/0 (socket says 172.21.15.69:60480) 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.680+0000 7f720affd700 1 -- 172.21.15.69:0/1016674569 learned_addr learned my addr 172.21.15.69:0/1016674569 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.680+0000 7f720affd700 1 -- 172.21.15.69:0/1016674569 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c104c50 con 0x7f720c104300 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.680+0000 7f720affd700 1 --2- 172.21.15.69:0/1016674569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c104710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f72000098a0 tx=0x7f7200009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee7a2a7f7336b1a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.680+0000 7f7209ffb700 1 -- 172.21.15.69:0/1016674569 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7200004160 con 0x7f720c104300 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.680+0000 7f7209ffb700 1 -- 172.21.15.69:0/1016674569 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72000042c0 con 0x7f720c104300 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.680+0000 7f7209ffb700 1 -- 172.21.15.69:0/1016674569 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72000119b0 con 0x7f720c104300 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.681+0000 7f72116d2700 1 -- 172.21.15.69:0/1016674569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 msgr2=0x7f720c104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:14.473 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.681+0000 7f72116d2700 1 --2- 172.21.15.69:0/1016674569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c104710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f72000098a0 tx=0x7f7200009bb0 comp rx=0 tx=0).stop 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.681+0000 7f72116d2700 1 -- 172.21.15.69:0/1016674569 shutdown_connections 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.681+0000 7f72116d2700 1 --2- 172.21.15.69:0/1016674569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c104710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.681+0000 7f72116d2700 1 -- 172.21.15.69:0/1016674569 >> 172.21.15.69:0/1016674569 conn(0x7f720c0ffed0 msgr2=0x7f720c102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.681+0000 7f72116d2700 1 -- 172.21.15.69:0/1016674569 shutdown_connections 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.681+0000 7f72116d2700 1 -- 172.21.15.69:0/1016674569 wait complete. 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.681+0000 7f72116d2700 1 Processor -- start 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.682+0000 7f72116d2700 1 -- start start 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.682+0000 7f72116d2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.682+0000 7f72116d2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c19bed0 con 0x7f720c104300 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.682+0000 7f720affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.682+0000 7f720affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c19b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60496/0 (socket says 172.21.15.69:60496) 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.682+0000 7f720affd700 1 -- 172.21.15.69:0/1597657303 learned_addr learned my addr 172.21.15.69:0/1597657303 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.682+0000 7f720affd700 1 -- 172.21.15.69:0/1597657303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200009550 con 0x7f720c104300 2023-12-14T14:04:14.474 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.682+0000 7f720affd700 1 --2- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c19b990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7200011980 tx=0x7f7200011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.683+0000 7f71f3fff700 1 -- 172.21.15.69:0/1597657303 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7200003a60 con 0x7f720c104300 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.683+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c105c90 con 0x7f720c104300 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.683+0000 7f71f3fff700 1 -- 172.21.15.69:0/1597657303 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7200003bc0 con 0x7f720c104300 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.683+0000 7f71f3fff700 1 -- 172.21.15.69:0/1597657303 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f720001a670 con 0x7f720c104300 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.683+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c105b00 con 0x7f720c104300 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.683+0000 7f71f3fff700 1 -- 172.21.15.69:0/1597657303 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f7200024a00 con 0x7f720c104300 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.684+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720c105e20 con 0x7f720c104300 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.684+0000 7f71f3fff700 1 --2- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f71f4038760 0x7f71f403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.684+0000 7f71f3fff700 1 -- 172.21.15.69:0/1597657303 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f720004ca50 con 0x7f720c104300 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.684+0000 7f720a7fc700 1 --2- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f71f4038760 0x7f71f403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.684+0000 7f720a7fc700 1 --2- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f71f4038760 0x7f71f403ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f71fc006fd0 tx=0x7f71fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.689+0000 7f71f3fff700 1 -- 172.21.15.69:0/1597657303 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f72000189a0 con 0x7f720c104300 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:13.894+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f720c19c410 con 0x7f71f4038760 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.112+0000 7f71f3fff700 1 -- 172.21.15.69:0/1597657303 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f720c19c410 con 0x7f71f4038760 2023-12-14T14:04:14.475 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.114+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f71f4038760 msgr2=0x7f71f403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.114+0000 7f72116d2700 1 --2- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f71f4038760 0x7f71f403ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f71fc006fd0 tx=0x7f71fc006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.114+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 msgr2=0x7f720c19b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.114+0000 7f72116d2700 1 --2- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c19b990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7200011980 tx=0x7f7200011a60 comp rx=0 tx=0).stop 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.115+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 shutdown_connections 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.115+0000 7f72116d2700 1 --2- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f71f4038760 0x7f71f403ac10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.115+0000 7f72116d2700 1 --2- 172.21.15.69:0/1597657303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f720c104300 0x7f720c19b990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.115+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 >> 172.21.15.69:0/1597657303 conn(0x7f720c0ffed0 msgr2=0x7f720c18fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.115+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 shutdown_connections 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.115+0000 7f72116d2700 1 -- 172.21.15.69:0/1597657303 wait complete. 2023-12-14T14:04:14.476 INFO:teuthology.orchestra.run.smithi069.stdout:Fetching dashboard port number... 2023-12-14T14:04:15.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:14 smithi069 ceph-mon[42034]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:15.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:14 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:15.347 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 8443 2023-12-14T14:04:15.347 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.835+0000 7f0348ffc700 1 Processor -- start 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.835+0000 7f0348ffc700 1 -- start start 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.835+0000 7f0348ffc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344104120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.835+0000 7f0348ffc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03441046f0 con 0x7f0344103d10 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.836+0000 7f034259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344104120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.836+0000 7f034259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344104120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60506/0 (socket says 172.21.15.69:60506) 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.836+0000 7f034259c700 1 -- 172.21.15.69:0/4216152113 learned_addr learned my addr 172.21.15.69:0/4216152113 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.836+0000 7f034259c700 1 -- 172.21.15.69:0/4216152113 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344106ca0 con 0x7f0344103d10 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.836+0000 7f034259c700 1 --2- 172.21.15.69:0/4216152113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344104120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03380098a0 tx=0x7f0338009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f26cc2ddbb3f77f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.836+0000 7f034159a700 1 -- 172.21.15.69:0/4216152113 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0338004160 con 0x7f0344103d10 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.836+0000 7f034159a700 1 -- 172.21.15.69:0/4216152113 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03380042c0 con 0x7f0344103d10 2023-12-14T14:04:15.348 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.836+0000 7f034159a700 1 -- 172.21.15.69:0/4216152113 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03380119b0 con 0x7f0344103d10 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.837+0000 7f0348ffc700 1 -- 172.21.15.69:0/4216152113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 msgr2=0x7f0344104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.837+0000 7f0348ffc700 1 --2- 172.21.15.69:0/4216152113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344104120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03380098a0 tx=0x7f0338009bb0 comp rx=0 tx=0).stop 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.837+0000 7f0348ffc700 1 -- 172.21.15.69:0/4216152113 shutdown_connections 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.837+0000 7f0348ffc700 1 --2- 172.21.15.69:0/4216152113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344104120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.837+0000 7f0348ffc700 1 -- 172.21.15.69:0/4216152113 >> 172.21.15.69:0/4216152113 conn(0x7f03440ff650 msgr2=0x7f0344101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.837+0000 7f0348ffc700 1 -- 172.21.15.69:0/4216152113 shutdown_connections 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.837+0000 7f0348ffc700 1 -- 172.21.15.69:0/4216152113 wait complete. 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.837+0000 7f0348ffc700 1 Processor -- start 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f0348ffc700 1 -- start start 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f0348ffc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344106600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:15.349 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f0348ffc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344106b40 con 0x7f0344103d10 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f034259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344106600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f034259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344106600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60522/0 (socket says 172.21.15.69:60522) 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f034259c700 1 -- 172.21.15.69:0/3745670735 learned_addr learned my addr 172.21.15.69:0/3745670735 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f034259c700 1 -- 172.21.15.69:0/3745670735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0338009550 con 0x7f0344103d10 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f034259c700 1 --2- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344106600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0338003e60 tx=0x7f0338011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f03337fe700 1 -- 172.21.15.69:0/3745670735 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0338003970 con 0x7f0344103d10 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f03337fe700 1 -- 172.21.15.69:0/3745670735 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0338003ad0 con 0x7f0344103d10 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034410a060 con 0x7f0344103d10 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f03337fe700 1 -- 172.21.15.69:0/3745670735 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03380195e0 con 0x7f0344103d10 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.838+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0344109ed0 con 0x7f0344103d10 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.839+0000 7f03337fe700 1 -- 172.21.15.69:0/3745670735 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f03380198a0 con 0x7f0344103d10 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.839+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0344062120 con 0x7f0344103d10 2023-12-14T14:04:15.350 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.839+0000 7f03337fe700 1 --2- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f032c038710 0x7f032c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.840+0000 7f03337fe700 1 -- 172.21.15.69:0/3745670735 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f033804cbf0 con 0x7f0344103d10 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.840+0000 7f0341d9b700 1 --2- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f032c038710 0x7f032c03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.840+0000 7f0341d9b700 1 --2- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f032c038710 0x7f032c03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0334006fd0 tx=0x7f0334006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:14.844+0000 7f03337fe700 1 -- 172.21.15.69:0/3745670735 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f033802b340 con 0x7f0344103d10 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.030+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f03441053b0 con 0x7f0344103d10 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.031+0000 7f03337fe700 1 -- 172.21.15.69:0/3745670735 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f0338018b40 con 0x7f0344103d10 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f032c038710 msgr2=0x7f032c03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 --2- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f032c038710 0x7f032c03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0334006fd0 tx=0x7f0334006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 msgr2=0x7f0344106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 --2- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344106600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0338003e60 tx=0x7f0338011aa0 comp rx=0 tx=0).stop 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 shutdown_connections 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 --2- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f032c038710 0x7f032c03abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:15.351 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 --2- 172.21.15.69:0/3745670735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0344103d10 0x7f0344106600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:15.352 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 >> 172.21.15.69:0/3745670735 conn(0x7f03440ff650 msgr2=0x7f0344100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:15.352 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 shutdown_connections 2023-12-14T14:04:15.352 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.033+0000 7f0348ffc700 1 -- 172.21.15.69:0/3745670735 wait complete. 2023-12-14T14:04:15.354 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-14T14:04:15.354 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2023-12-14T14:04:15.361 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-14T14:04:15.362 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T14:04:15.362 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2023-12-14T14:04:15.362 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-14T14:04:15.363 INFO:teuthology.orchestra.run.smithi069.stdout:Ceph Dashboard is now available at: 2023-12-14T14:04:15.363 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:15.363 INFO:teuthology.orchestra.run.smithi069.stdout: URL: https://smithi069:8443/ 2023-12-14T14:04:15.364 INFO:teuthology.orchestra.run.smithi069.stdout: User: admin 2023-12-14T14:04:15.364 INFO:teuthology.orchestra.run.smithi069.stdout: Password: 9fufzg571o 2023-12-14T14:04:15.364 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:15.364 INFO:teuthology.orchestra.run.smithi069.stdout:Saving cluster configuration to /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config directory 2023-12-14T14:04:15.364 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling autotune for osd_memory_target 2023-12-14T14:04:15.984 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:15 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3745670735' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-14T14:04:16.363 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.761+0000 7fde84b55700 1 Processor -- start 2023-12-14T14:04:16.363 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.761+0000 7fde84b55700 1 -- start start 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.762+0000 7fde84b55700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80108870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.762+0000 7fde84b55700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde80079e60 con 0x7fde80106490 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.762+0000 7fde7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.762+0000 7fde7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80108870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60534/0 (socket says 172.21.15.69:60534) 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.762+0000 7fde7e59c700 1 -- 172.21.15.69:0/4200565231 learned_addr learned my addr 172.21.15.69:0/4200565231 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.762+0000 7fde7e59c700 1 -- 172.21.15.69:0/4200565231 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde80108db0 con 0x7fde80106490 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.762+0000 7fde7e59c700 1 --2- 172.21.15.69:0/4200565231 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80108870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde700098a0 tx=0x7fde70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5b032b18eef056 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde7d59a700 1 -- 172.21.15.69:0/4200565231 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde70004160 con 0x7fde80106490 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde7d59a700 1 -- 172.21.15.69:0/4200565231 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde700042c0 con 0x7fde80106490 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde7d59a700 1 -- 172.21.15.69:0/4200565231 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde700119b0 con 0x7fde80106490 2023-12-14T14:04:16.364 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde84b55700 1 -- 172.21.15.69:0/4200565231 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 msgr2=0x7fde80108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde84b55700 1 --2- 172.21.15.69:0/4200565231 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80108870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde700098a0 tx=0x7fde70009bb0 comp rx=0 tx=0).stop 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde84b55700 1 -- 172.21.15.69:0/4200565231 shutdown_connections 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde84b55700 1 --2- 172.21.15.69:0/4200565231 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80108870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde84b55700 1 -- 172.21.15.69:0/4200565231 >> 172.21.15.69:0/4200565231 conn(0x7fde800ffed0 msgr2=0x7fde80102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde84b55700 1 -- 172.21.15.69:0/4200565231 shutdown_connections 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.763+0000 7fde84b55700 1 -- 172.21.15.69:0/4200565231 wait complete. 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.764+0000 7fde84b55700 1 Processor -- start 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.764+0000 7fde84b55700 1 -- start start 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.764+0000 7fde84b55700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.764+0000 7fde84b55700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde80199cc0 con 0x7fde80106490 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.764+0000 7fde7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.765+0000 7fde7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60536/0 (socket says 172.21.15.69:60536) 2023-12-14T14:04:16.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.765+0000 7fde7e59c700 1 -- 172.21.15.69:0/1034597324 learned_addr learned my addr 172.21.15.69:0/1034597324 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.765+0000 7fde7e59c700 1 -- 172.21.15.69:0/1034597324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009550 con 0x7fde80106490 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.765+0000 7fde7e59c700 1 --2- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80199780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde70003e60 tx=0x7fde70011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.765+0000 7fde6f7fe700 1 -- 172.21.15.69:0/1034597324 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde70003970 con 0x7fde80106490 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.765+0000 7fde6f7fe700 1 -- 172.21.15.69:0/1034597324 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde70003ad0 con 0x7fde80106490 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.765+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde80109d80 con 0x7fde80106490 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.765+0000 7fde6f7fe700 1 -- 172.21.15.69:0/1034597324 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde700195e0 con 0x7fde80106490 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.765+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde80109bf0 con 0x7fde80106490 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.766+0000 7fde6f7fe700 1 -- 172.21.15.69:0/1034597324 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fde700198a0 con 0x7fde80106490 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.766+0000 7fde6f7fe700 1 --2- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fde68038710 0x7fde6803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.766+0000 7fde6f7fe700 1 -- 172.21.15.69:0/1034597324 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fde7004c9e0 con 0x7fde80106490 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.766+0000 7fde7dd9b700 1 --2- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fde68038710 0x7fde6803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.766+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde80109f10 con 0x7fde80106490 2023-12-14T14:04:16.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.767+0000 7fde7dd9b700 1 --2- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fde68038710 0x7fde6803abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fde74006fd0 tx=0x7fde74006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.771+0000 7fde6f7fe700 1 -- 172.21.15.69:0/1034597324 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fde70019bf0 con 0x7fde80106490 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.960+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fde80062120 con 0x7fde80106490 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.960+0000 7fde6f7fe700 1 -- 172.21.15.69:0/1034597324 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fde70018b40 con 0x7fde80106490 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fde68038710 msgr2=0x7fde6803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 --2- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fde68038710 0x7fde6803abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fde74006fd0 tx=0x7fde74006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 msgr2=0x7fde80199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 --2- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80199780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde70003e60 tx=0x7fde70011aa0 comp rx=0 tx=0).stop 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 shutdown_connections 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 --2- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fde68038710 0x7fde6803abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 --2- 172.21.15.69:0/1034597324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde80106490 0x7fde80199780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 >> 172.21.15.69:0/1034597324 conn(0x7fde800ffed0 msgr2=0x7fde80100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 shutdown_connections 2023-12-14T14:04:16.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:15.962+0000 7fde84b55700 1 -- 172.21.15.69:0/1034597324 wait complete. 2023-12-14T14:04:17.399 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.724+0000 7f1763633700 1 Processor -- start 2023-12-14T14:04:17.399 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.724+0000 7f1763633700 1 -- start start 2023-12-14T14:04:17.399 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.724+0000 7f1763633700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c108870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:17.400 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.724+0000 7f1763633700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c079e60 con 0x7f175c106490 2023-12-14T14:04:17.400 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.724+0000 7f17613cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:17.400 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.724+0000 7f17613cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c108870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59634/0 (socket says 172.21.15.69:59634) 2023-12-14T14:04:17.400 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.724+0000 7f17613cf700 1 -- 172.21.15.69:0/1138965445 learned_addr learned my addr 172.21.15.69:0/1138965445 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:17.400 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.725+0000 7f17613cf700 1 -- 172.21.15.69:0/1138965445 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c108db0 con 0x7f175c106490 2023-12-14T14:04:17.400 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.725+0000 7f17613cf700 1 --2- 172.21.15.69:0/1138965445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c108870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17580098a0 tx=0x7f1758009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b19497325e8b6c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:17.400 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.725+0000 7f1753fff700 1 -- 172.21.15.69:0/1138965445 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1758004160 con 0x7f175c106490 2023-12-14T14:04:17.400 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.725+0000 7f1753fff700 1 -- 172.21.15.69:0/1138965445 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17580042c0 con 0x7f175c106490 2023-12-14T14:04:17.400 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.725+0000 7f1753fff700 1 -- 172.21.15.69:0/1138965445 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17580119b0 con 0x7f175c106490 2023-12-14T14:04:17.401 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.725+0000 7f1763633700 1 -- 172.21.15.69:0/1138965445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 msgr2=0x7f175c108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:17.401 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.725+0000 7f1763633700 1 --2- 172.21.15.69:0/1138965445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c108870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17580098a0 tx=0x7f1758009bb0 comp rx=0 tx=0).stop 2023-12-14T14:04:17.401 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f1763633700 1 -- 172.21.15.69:0/1138965445 shutdown_connections 2023-12-14T14:04:17.401 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f1763633700 1 --2- 172.21.15.69:0/1138965445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c108870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:17.401 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f1763633700 1 -- 172.21.15.69:0/1138965445 >> 172.21.15.69:0/1138965445 conn(0x7f175c0ffed0 msgr2=0x7f175c102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:17.401 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f1763633700 1 -- 172.21.15.69:0/1138965445 shutdown_connections 2023-12-14T14:04:17.401 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f1763633700 1 -- 172.21.15.69:0/1138965445 wait complete. 2023-12-14T14:04:17.401 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f1763633700 1 Processor -- start 2023-12-14T14:04:17.401 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f1763633700 1 -- start start 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f1763633700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c105df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f1763633700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c106330 con 0x7f175c106490 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f17613cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c105df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f17613cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c105df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59638/0 (socket says 172.21.15.69:59638) 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.726+0000 7f17613cf700 1 -- 172.21.15.69:0/3134810497 learned_addr learned my addr 172.21.15.69:0/3134810497 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.727+0000 7f17613cf700 1 -- 172.21.15.69:0/3134810497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758009550 con 0x7f175c106490 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.727+0000 7f17613cf700 1 --2- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c105df0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1758011980 tx=0x7f1758011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.727+0000 7f17527fc700 1 -- 172.21.15.69:0/3134810497 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1758003a60 con 0x7f175c106490 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.727+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175c109d80 con 0x7f175c106490 2023-12-14T14:04:17.402 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.727+0000 7f17527fc700 1 -- 172.21.15.69:0/3134810497 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1758003bc0 con 0x7f175c106490 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.727+0000 7f17527fc700 1 -- 172.21.15.69:0/3134810497 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f175801a670 con 0x7f175c106490 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.727+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c109bf0 con 0x7f175c106490 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.728+0000 7f17527fc700 1 -- 172.21.15.69:0/3134810497 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f1758024440 con 0x7f175c106490 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.728+0000 7f17527fc700 1 --2- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1748038760 0x7f174803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.728+0000 7f17527fc700 1 -- 172.21.15.69:0/3134810497 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f175804c990 con 0x7f175c106490 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.728+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c062120 con 0x7f175c106490 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.728+0000 7f1760bce700 1 --2- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1748038760 0x7f174803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.729+0000 7f1760bce700 1 --2- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1748038760 0x7f174803ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f174c006fd0 tx=0x7f174c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:16.733+0000 7f17527fc700 1 -- 172.21.15.69:0/3134810497 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1758018d90 con 0x7f175c106490 2023-12-14T14:04:17.403 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.026+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f175c104ba0 con 0x7f175c106490 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.028+0000 7f17527fc700 1 -- 172.21.15.69:0/3134810497 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f1758018350 con 0x7f175c106490 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1748038760 msgr2=0x7f174803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 --2- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1748038760 0x7f174803ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f174c006fd0 tx=0x7f174c006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 msgr2=0x7f175c105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 --2- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c105df0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1758011980 tx=0x7f1758011a60 comp rx=0 tx=0).stop 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 shutdown_connections 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 --2- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1748038760 0x7f174803ac10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 --2- 172.21.15.69:0/3134810497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f175c106490 0x7f175c105df0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 >> 172.21.15.69:0/3134810497 conn(0x7f175c0ffed0 msgr2=0x7f175c100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:17.404 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 shutdown_connections 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T14:04:17.030+0000 7f1763633700 1 -- 172.21.15.69:0/3134810497 wait complete. 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout:Or, if you are only running a single cluster on this host: 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:17.405 INFO:teuthology.orchestra.run.smithi069.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-14T14:04:17.406 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:17.406 INFO:teuthology.orchestra.run.smithi069.stdout: ceph telemetry on 2023-12-14T14:04:17.406 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:17.406 INFO:teuthology.orchestra.run.smithi069.stdout:For more information see: 2023-12-14T14:04:17.406 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:17.406 INFO:teuthology.orchestra.run.smithi069.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-12-14T14:04:17.406 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:17.406 INFO:teuthology.orchestra.run.smithi069.stdout:Bootstrap complete. 2023-12-14T14:04:17.429 INFO:tasks.cephadm:Fetching config... 2023-12-14T14:04:17.429 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:04:17.429 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-14T14:04:17.446 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-14T14:04:17.447 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:04:17.447 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-14T14:04:17.506 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-14T14:04:17.506 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:04:17.506 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/keyring of=/dev/stdout 2023-12-14T14:04:17.573 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-14T14:04:17.574 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:04:17.574 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-14T14:04:17.632 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-14T14:04:17.632 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBmLD+7jPk8HAyt8chU48SnUTeeMoE5BlCDRAd5U+mM/us7Rqede2tIOFlwZMcGFabc7iXLxQAKecmol0BWiCGxVtK3KFaXRRIbIL0Z4LltnYLPn85T7GG0p1nT/drr/vz1x6qV35rb3KI930MBFwBpkX5qODJK4cjYLfYV3BTv/DhWSwQ87STFZsGVKWmzHnp8Y0qoROYDBNM6eWbOCwp4XY1RZndNK6TGkS2OAfC2Kia5/NTgTe5yK7HYe/oWrBGdG5LKt5kuPsDyM2UkJ9MBXxo3deioVXOhRjarZmfiJYUL7/yxKcU7oepAbOSRPeclB0kjRi1VvW0NEHsZvVvgpZkuuZNCXhp9wtfZpDf+96K9CQb4rGTnOcFuyy4RO8q0jHhG/3jwdHR+eVKgY+1WDSJ7CQEC7GmDeaWagqz9rhaoHPptEXyS3nHIzpl5h9UQZw5MMMXeWO0GjMRdLJE0mtoIMEpBzz7xBGEs8aKTdOpA61qsCyAKaEaRBBTJ0U= ceph-5d58180a-9a89-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-14T14:04:17.710 INFO:teuthology.orchestra.run.smithi069.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBmLD+7jPk8HAyt8chU48SnUTeeMoE5BlCDRAd5U+mM/us7Rqede2tIOFlwZMcGFabc7iXLxQAKecmol0BWiCGxVtK3KFaXRRIbIL0Z4LltnYLPn85T7GG0p1nT/drr/vz1x6qV35rb3KI930MBFwBpkX5qODJK4cjYLfYV3BTv/DhWSwQ87STFZsGVKWmzHnp8Y0qoROYDBNM6eWbOCwp4XY1RZndNK6TGkS2OAfC2Kia5/NTgTe5yK7HYe/oWrBGdG5LKt5kuPsDyM2UkJ9MBXxo3deioVXOhRjarZmfiJYUL7/yxKcU7oepAbOSRPeclB0kjRi1VvW0NEHsZvVvgpZkuuZNCXhp9wtfZpDf+96K9CQb4rGTnOcFuyy4RO8q0jHhG/3jwdHR+eVKgY+1WDSJ7CQEC7GmDeaWagqz9rhaoHPptEXyS3nHIzpl5h9UQZw5MMMXeWO0GjMRdLJE0mtoIMEpBzz7xBGEs8aKTdOpA61qsCyAKaEaRBBTJ0U= ceph-5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:04:17.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBmLD+7jPk8HAyt8chU48SnUTeeMoE5BlCDRAd5U+mM/us7Rqede2tIOFlwZMcGFabc7iXLxQAKecmol0BWiCGxVtK3KFaXRRIbIL0Z4LltnYLPn85T7GG0p1nT/drr/vz1x6qV35rb3KI930MBFwBpkX5qODJK4cjYLfYV3BTv/DhWSwQ87STFZsGVKWmzHnp8Y0qoROYDBNM6eWbOCwp4XY1RZndNK6TGkS2OAfC2Kia5/NTgTe5yK7HYe/oWrBGdG5LKt5kuPsDyM2UkJ9MBXxo3deioVXOhRjarZmfiJYUL7/yxKcU7oepAbOSRPeclB0kjRi1VvW0NEHsZvVvgpZkuuZNCXhp9wtfZpDf+96K9CQb4rGTnOcFuyy4RO8q0jHhG/3jwdHR+eVKgY+1WDSJ7CQEC7GmDeaWagqz9rhaoHPptEXyS3nHIzpl5h9UQZw5MMMXeWO0GjMRdLJE0mtoIMEpBzz7xBGEs8aKTdOpA61qsCyAKaEaRBBTJ0U= ceph-5d58180a-9a89-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-14T14:04:17.768 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBmLD+7jPk8HAyt8chU48SnUTeeMoE5BlCDRAd5U+mM/us7Rqede2tIOFlwZMcGFabc7iXLxQAKecmol0BWiCGxVtK3KFaXRRIbIL0Z4LltnYLPn85T7GG0p1nT/drr/vz1x6qV35rb3KI930MBFwBpkX5qODJK4cjYLfYV3BTv/DhWSwQ87STFZsGVKWmzHnp8Y0qoROYDBNM6eWbOCwp4XY1RZndNK6TGkS2OAfC2Kia5/NTgTe5yK7HYe/oWrBGdG5LKt5kuPsDyM2UkJ9MBXxo3deioVXOhRjarZmfiJYUL7/yxKcU7oepAbOSRPeclB0kjRi1VvW0NEHsZvVvgpZkuuZNCXhp9wtfZpDf+96K9CQb4rGTnOcFuyy4RO8q0jHhG/3jwdHR+eVKgY+1WDSJ7CQEC7GmDeaWagqz9rhaoHPptEXyS3nHIzpl5h9UQZw5MMMXeWO0GjMRdLJE0mtoIMEpBzz7xBGEs8aKTdOpA61qsCyAKaEaRBBTJ0U= ceph-5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:04:17.781 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBmLD+7jPk8HAyt8chU48SnUTeeMoE5BlCDRAd5U+mM/us7Rqede2tIOFlwZMcGFabc7iXLxQAKecmol0BWiCGxVtK3KFaXRRIbIL0Z4LltnYLPn85T7GG0p1nT/drr/vz1x6qV35rb3KI930MBFwBpkX5qODJK4cjYLfYV3BTv/DhWSwQ87STFZsGVKWmzHnp8Y0qoROYDBNM6eWbOCwp4XY1RZndNK6TGkS2OAfC2Kia5/NTgTe5yK7HYe/oWrBGdG5LKt5kuPsDyM2UkJ9MBXxo3deioVXOhRjarZmfiJYUL7/yxKcU7oepAbOSRPeclB0kjRi1VvW0NEHsZvVvgpZkuuZNCXhp9wtfZpDf+96K9CQb4rGTnOcFuyy4RO8q0jHhG/3jwdHR+eVKgY+1WDSJ7CQEC7GmDeaWagqz9rhaoHPptEXyS3nHIzpl5h9UQZw5MMMXeWO0GjMRdLJE0mtoIMEpBzz7xBGEs8aKTdOpA61qsCyAKaEaRBBTJ0U= ceph-5d58180a-9a89-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-14T14:04:17.827 INFO:teuthology.orchestra.run.smithi119.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBmLD+7jPk8HAyt8chU48SnUTeeMoE5BlCDRAd5U+mM/us7Rqede2tIOFlwZMcGFabc7iXLxQAKecmol0BWiCGxVtK3KFaXRRIbIL0Z4LltnYLPn85T7GG0p1nT/drr/vz1x6qV35rb3KI930MBFwBpkX5qODJK4cjYLfYV3BTv/DhWSwQ87STFZsGVKWmzHnp8Y0qoROYDBNM6eWbOCwp4XY1RZndNK6TGkS2OAfC2Kia5/NTgTe5yK7HYe/oWrBGdG5LKt5kuPsDyM2UkJ9MBXxo3deioVXOhRjarZmfiJYUL7/yxKcU7oepAbOSRPeclB0kjRi1VvW0NEHsZvVvgpZkuuZNCXhp9wtfZpDf+96K9CQb4rGTnOcFuyy4RO8q0jHhG/3jwdHR+eVKgY+1WDSJ7CQEC7GmDeaWagqz9rhaoHPptEXyS3nHIzpl5h9UQZw5MMMXeWO0GjMRdLJE0mtoIMEpBzz7xBGEs8aKTdOpA61qsCyAKaEaRBBTJ0U= ceph-5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:04:17.840 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-14T14:04:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:04:18.207 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:18 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3134810497' entity='client.admin' 2023-12-14T14:04:18.207 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:18 smithi069 ceph-mon[42034]: mgrmap e13: x(active, since 6s) 2023-12-14T14:04:19.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.437+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/272808633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 msgr2=0x7f1a08104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:19.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.437+0000 7f1a0d2ad700 1 --2- 172.21.15.69:0/272808633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 0x7f1a08104cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009910 tx=0x7f19f8009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:19.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.437+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/272808633 shutdown_connections 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.437+0000 7f1a0d2ad700 1 --2- 172.21.15.69:0/272808633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 0x7f1a08104cb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.437+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/272808633 >> 172.21.15.69:0/272808633 conn(0x7f1a080fa240 msgr2=0x7f1a080fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.437+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/272808633 shutdown_connections 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.437+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/272808633 wait complete. 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.438+0000 7f1a0d2ad700 1 Processor -- start 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.438+0000 7f1a0d2ad700 1 -- start start 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.438+0000 7f1a0d2ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 0x7f1a08197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.438+0000 7f1a0d2ad700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a08197580 con 0x7f1a08068a00 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.438+0000 7f1a06ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 0x7f1a08197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.438+0000 7f1a06ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 0x7f1a08197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59664/0 (socket says 172.21.15.69:59664) 2023-12-14T14:04:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.438+0000 7f1a06ffd700 1 -- 172.21.15.69:0/2604539274 learned_addr learned my addr 172.21.15.69:0/2604539274 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.439+0000 7f1a06ffd700 1 -- 172.21.15.69:0/2604539274 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80095f0 con 0x7f1a08068a00 2023-12-14T14:04:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.439+0000 7f1a06ffd700 1 --2- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 0x7f1a08197040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f19f8004f40 tx=0x7f19f80057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.439+0000 7f19effff700 1 -- 172.21.15.69:0/2604539274 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19f801d070 con 0x7f1a08068a00 2023-12-14T14:04:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.439+0000 7f19effff700 1 -- 172.21.15.69:0/2604539274 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19f800be20 con 0x7f1a08068a00 2023-12-14T14:04:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.439+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a08107d40 con 0x7f1a08068a00 2023-12-14T14:04:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.439+0000 7f19effff700 1 -- 172.21.15.69:0/2604539274 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19f8022dd0 con 0x7f1a08068a00 2023-12-14T14:04:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.439+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a08107bb0 con 0x7f1a08068a00 2023-12-14T14:04:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.440+0000 7f19effff700 1 -- 172.21.15.69:0/2604539274 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f19f800f4b0 con 0x7f1a08068a00 2023-12-14T14:04:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.440+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a08107ed0 con 0x7f1a08068a00 2023-12-14T14:04:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.440+0000 7f19effff700 1 --2- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f19f0038870 0x7f19f003ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.440+0000 7f19effff700 1 -- 172.21.15.69:0/2604539274 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f19f804c870 con 0x7f1a08068a00 2023-12-14T14:04:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.440+0000 7f1a067fc700 1 --2- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f19f0038870 0x7f19f003ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.441+0000 7f1a067fc700 1 --2- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f19f0038870 0x7f19f003ad20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19fc006fd0 tx=0x7f19fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:19.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.449+0000 7f19effff700 1 -- 172.21.15.69:0/2604539274 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f19f8017440 con 0x7f1a08068a00 2023-12-14T14:04:19.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.647+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f1a08197b70 con 0x7f1a08068a00 2023-12-14T14:04:19.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.651+0000 7f19effff700 1 -- 172.21.15.69:0/2604539274 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f19f8027030 con 0x7f1a08068a00 2023-12-14T14:04:19.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.653+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f19f0038870 msgr2=0x7f19f003ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:19.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.653+0000 7f1a0d2ad700 1 --2- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f19f0038870 0x7f19f003ad20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19fc006fd0 tx=0x7f19fc006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:19.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.653+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 msgr2=0x7f1a08197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:19.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.653+0000 7f1a0d2ad700 1 --2- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 0x7f1a08197040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f19f8004f40 tx=0x7f19f80057e0 comp rx=0 tx=0).stop 2023-12-14T14:04:19.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.653+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 shutdown_connections 2023-12-14T14:04:19.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.653+0000 7f1a0d2ad700 1 --2- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f19f0038870 0x7f19f003ad20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:19.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.653+0000 7f1a0d2ad700 1 --2- 172.21.15.69:0/2604539274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a08068a00 0x7f1a08197040 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:19.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.653+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 >> 172.21.15.69:0/2604539274 conn(0x7f1a080fa240 msgr2=0x7f1a080faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:19.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.654+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 shutdown_connections 2023-12-14T14:04:19.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:19.654+0000 7f1a0d2ad700 1 -- 172.21.15.69:0/2604539274 wait complete. 2023-12-14T14:04:20.290 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-14T14:04:20.290 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-14T14:04:20.595 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:04:21.057 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:20 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2604539274' entity='client.admin' 2023-12-14T14:04:21.057 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:21.057 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:21.058 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi069", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:04:21.058 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:21.058 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:21.058 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:21.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.629+0000 7f6443636700 1 -- 172.21.15.69:0/103649961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 msgr2=0x7f643c0ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:21.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.629+0000 7f6443636700 1 --2- 172.21.15.69:0/103649961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 0x7f643c0ff010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6438009910 tx=0x7f6438009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:21.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.629+0000 7f6443636700 1 -- 172.21.15.69:0/103649961 shutdown_connections 2023-12-14T14:04:21.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.629+0000 7f6443636700 1 --2- 172.21.15.69:0/103649961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 0x7f643c0ff010 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:21.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.629+0000 7f6443636700 1 -- 172.21.15.69:0/103649961 >> 172.21.15.69:0/103649961 conn(0x7f643c0fa190 msgr2=0x7f643c0fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:21.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.630+0000 7f6443636700 1 -- 172.21.15.69:0/103649961 shutdown_connections 2023-12-14T14:04:21.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.630+0000 7f6443636700 1 -- 172.21.15.69:0/103649961 wait complete. 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.630+0000 7f6443636700 1 Processor -- start 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.630+0000 7f6443636700 1 -- start start 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.630+0000 7f6443636700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 0x7f643c194e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.630+0000 7f6443636700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c195350 con 0x7f643c0fec00 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.630+0000 7f64413d2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 0x7f643c194e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.630+0000 7f64413d2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 0x7f643c194e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59682/0 (socket says 172.21.15.69:59682) 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.630+0000 7f64413d2700 1 -- 172.21.15.69:0/1285125340 learned_addr learned my addr 172.21.15.69:0/1285125340 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.631+0000 7f64413d2700 1 -- 172.21.15.69:0/1285125340 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64380095f0 con 0x7f643c0fec00 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.631+0000 7f64413d2700 1 --2- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 0x7f643c194e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6438006010 tx=0x7f64380057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:21.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.631+0000 7f64327fc700 1 -- 172.21.15.69:0/1285125340 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f643801d070 con 0x7f643c0fec00 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.631+0000 7f64327fc700 1 -- 172.21.15.69:0/1285125340 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64380044e0 con 0x7f643c0fec00 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.631+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c104ad0 con 0x7f643c0fec00 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.631+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c104940 con 0x7f643c0fec00 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.631+0000 7f64327fc700 1 -- 172.21.15.69:0/1285125340 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64380039b0 con 0x7f643c0fec00 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.632+0000 7f64327fc700 1 -- 172.21.15.69:0/1285125340 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f6438003ca0 con 0x7f643c0fec00 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.632+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6420005320 con 0x7f643c0fec00 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.632+0000 7f64327fc700 1 --2- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64280388c0 0x7f642803ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.632+0000 7f64327fc700 1 -- 172.21.15.69:0/1285125340 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f643804c940 con 0x7f643c0fec00 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.632+0000 7f6440bd1700 1 --2- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64280388c0 0x7f642803ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:21.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.633+0000 7f6440bd1700 1 --2- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64280388c0 0x7f642803ad70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f642c006fd0 tx=0x7f642c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:21.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.637+0000 7f64327fc700 1 -- 172.21.15.69:0/1285125340 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f643802a950 con 0x7f643c0fec00 2023-12-14T14:04:21.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.829+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f6420000bf0 con 0x7f64280388c0 2023-12-14T14:04:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.832+0000 7f64327fc700 1 -- 172.21.15.69:0/1285125340 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6420000bf0 con 0x7f64280388c0 2023-12-14T14:04:21.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64280388c0 msgr2=0x7f642803ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:21.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 --2- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64280388c0 0x7f642803ad70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f642c006fd0 tx=0x7f642c006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:21.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 msgr2=0x7f643c194e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:21.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 --2- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 0x7f643c194e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6438006010 tx=0x7f64380057c0 comp rx=0 tx=0).stop 2023-12-14T14:04:21.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 shutdown_connections 2023-12-14T14:04:21.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 --2- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64280388c0 0x7f642803ad70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:21.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 --2- 172.21.15.69:0/1285125340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f643c0fec00 0x7f643c194e10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:21.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 >> 172.21.15.69:0/1285125340 conn(0x7f643c0fa190 msgr2=0x7f643c0fae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:21.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 shutdown_connections 2023-12-14T14:04:21.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:21.834+0000 7f6443636700 1 -- 172.21.15.69:0/1285125340 wait complete. 2023-12-14T14:04:22.257 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi081 2023-12-14T14:04:22.258 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T14:04:22.258 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.conf 2023-12-14T14:04:22.279 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T14:04:22.279 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:04:22.339 INFO:tasks.cephadm:Adding host smithi081 to orchestrator... 2023-12-14T14:04:22.339 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch host add smithi081 2023-12-14T14:04:22.661 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:04:23.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:23.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:04:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:04:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: Updating smithi069:/etc/ceph/ceph.conf 2023-12-14T14:04:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:23.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.667+0000 7f7ede093700 1 -- 172.21.15.69:0/1106215892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 msgr2=0x7f7ed81013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:23.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.667+0000 7f7ede093700 1 --2- 172.21.15.69:0/1106215892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 0x7f7ed81013b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009910 tx=0x7f7ecc009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:23.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.667+0000 7f7ede093700 1 -- 172.21.15.69:0/1106215892 shutdown_connections 2023-12-14T14:04:23.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.667+0000 7f7ede093700 1 --2- 172.21.15.69:0/1106215892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 0x7f7ed81013b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:23.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.667+0000 7f7ede093700 1 -- 172.21.15.69:0/1106215892 >> 172.21.15.69:0/1106215892 conn(0x7f7ed80fa880 msgr2=0x7f7ed80fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:23.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.667+0000 7f7ede093700 1 -- 172.21.15.69:0/1106215892 shutdown_connections 2023-12-14T14:04:23.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.667+0000 7f7ede093700 1 -- 172.21.15.69:0/1106215892 wait complete. 2023-12-14T14:04:23.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.667+0000 7f7ede093700 1 Processor -- start 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.668+0000 7f7ede093700 1 -- start start 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.668+0000 7f7ede093700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 0x7f7ed8195180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.668+0000 7f7ede093700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed81956c0 con 0x7f7ed8100fe0 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.668+0000 7f7ed77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 0x7f7ed8195180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.668+0000 7f7ed77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 0x7f7ed8195180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59694/0 (socket says 172.21.15.69:59694) 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.668+0000 7f7ed77fe700 1 -- 172.21.15.69:0/1795950165 learned_addr learned my addr 172.21.15.69:0/1795950165 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.668+0000 7f7ed77fe700 1 -- 172.21.15.69:0/1795950165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc0095f0 con 0x7f7ed8100fe0 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.668+0000 7f7ed77fe700 1 --2- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 0x7f7ed8195180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc004f40 tx=0x7f7ecc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.668+0000 7f7ed4ff9700 1 -- 172.21.15.69:0/1795950165 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ecc01d070 con 0x7f7ed8100fe0 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.669+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed810a2e0 con 0x7f7ed8100fe0 2023-12-14T14:04:23.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.669+0000 7f7ed4ff9700 1 -- 172.21.15.69:0/1795950165 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ecc004370 con 0x7f7ed8100fe0 2023-12-14T14:04:23.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.669+0000 7f7ed4ff9700 1 -- 172.21.15.69:0/1795950165 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ecc0039b0 con 0x7f7ed8100fe0 2023-12-14T14:04:23.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.669+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed810a150 con 0x7f7ed8100fe0 2023-12-14T14:04:23.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.669+0000 7f7ed4ff9700 1 -- 172.21.15.69:0/1795950165 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f7ecc003c70 con 0x7f7ed8100fe0 2023-12-14T14:04:23.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.669+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed810a470 con 0x7f7ed8100fe0 2023-12-14T14:04:23.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.670+0000 7f7ed4ff9700 1 --2- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ec0038870 0x7f7ec003ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:23.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.670+0000 7f7ed4ff9700 1 -- 172.21.15.69:0/1795950165 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7ecc04c7a0 con 0x7f7ed8100fe0 2023-12-14T14:04:23.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.670+0000 7f7ed6ffd700 1 --2- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ec0038870 0x7f7ec003ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:23.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.670+0000 7f7ed6ffd700 1 --2- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ec0038870 0x7f7ec003ad20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8006fd0 tx=0x7f7ec8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:23.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.674+0000 7f7ed4ff9700 1 -- 172.21.15.69:0/1795950165 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7ecc029770 con 0x7f7ed8100fe0 2023-12-14T14:04:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:23.868+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ed8107390 con 0x7f7ec0038870 2023-12-14T14:04:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:23 smithi069 ceph-mon[42034]: Updating smithi069:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:04:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:23 smithi069 ceph-mon[42034]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:04:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:23 smithi069 ceph-mon[42034]: Updating smithi069:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:04:25.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:24 smithi069 ceph-mon[42034]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:25.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.814+0000 7f7ed4ff9700 1 -- 172.21.15.69:0/1795950165 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f7ed8107390 con 0x7f7ec0038870 2023-12-14T14:04:25.814 INFO:teuthology.orchestra.run.smithi069.stdout:Added host 'smithi081' with addr '172.21.15.81' 2023-12-14T14:04:25.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.816+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ec0038870 msgr2=0x7f7ec003ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:25.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.816+0000 7f7ede093700 1 --2- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ec0038870 0x7f7ec003ad20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8006fd0 tx=0x7f7ec8006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:25.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.816+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 msgr2=0x7f7ed8195180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:25.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.816+0000 7f7ede093700 1 --2- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 0x7f7ed8195180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc004f40 tx=0x7f7ecc005020 comp rx=0 tx=0).stop 2023-12-14T14:04:25.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.816+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 shutdown_connections 2023-12-14T14:04:25.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.816+0000 7f7ede093700 1 --2- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ec0038870 0x7f7ec003ad20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:25.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.816+0000 7f7ede093700 1 --2- 172.21.15.69:0/1795950165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ed8100fe0 0x7f7ed8195180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:25.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.817+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 >> 172.21.15.69:0/1795950165 conn(0x7f7ed80fa880 msgr2=0x7f7ed8104630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:25.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.817+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 shutdown_connections 2023-12-14T14:04:25.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:25.817+0000 7f7ede093700 1 -- 172.21.15.69:0/1795950165 wait complete. 2023-12-14T14:04:26.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:25 smithi069 ceph-mon[42034]: Deploying cephadm binary to smithi081 2023-12-14T14:04:26.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:25 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:26.185 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch host ls --format=json 2023-12-14T14:04:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:04:26.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:26 smithi069 ceph-mon[42034]: Added host smithi081 2023-12-14T14:04:26.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:26 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:26.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:26 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:26.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:26 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:27.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.749+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/4029314954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 msgr2=0x7f4eb80ff2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:27.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.749+0000 7f4ebf3f5700 1 --2- 172.21.15.69:0/4029314954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 0x7f4eb80ff2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009910 tx=0x7f4ea8009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:27.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.749+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/4029314954 shutdown_connections 2023-12-14T14:04:27.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.749+0000 7f4ebf3f5700 1 --2- 172.21.15.69:0/4029314954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 0x7f4eb80ff2d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:27.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.749+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/4029314954 >> 172.21.15.69:0/4029314954 conn(0x7f4eb8074930 msgr2=0x7f4eb8074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:27.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.749+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/4029314954 shutdown_connections 2023-12-14T14:04:27.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.749+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/4029314954 wait complete. 2023-12-14T14:04:27.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.750+0000 7f4ebf3f5700 1 Processor -- start 2023-12-14T14:04:27.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.750+0000 7f4ebf3f5700 1 -- start start 2023-12-14T14:04:27.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.750+0000 7f4ebf3f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 0x7f4eb81008c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:27.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.750+0000 7f4ebf3f5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8102840 con 0x7f4eb80fef00 2023-12-14T14:04:27.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.750+0000 7f4ebd191700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 0x7f4eb81008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:27.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.750+0000 7f4ebd191700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 0x7f4eb81008c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42158/0 (socket says 172.21.15.69:42158) 2023-12-14T14:04:27.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.750+0000 7f4ebd191700 1 -- 172.21.15.69:0/3100931609 learned_addr learned my addr 172.21.15.69:0/3100931609 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:27.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.750+0000 7f4ebd191700 1 -- 172.21.15.69:0/3100931609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80095f0 con 0x7f4eb80fef00 2023-12-14T14:04:27.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.750+0000 7f4ebd191700 1 --2- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 0x7f4eb81008c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8004f40 tx=0x7f4ea8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:27.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.751+0000 7f4eae7fc700 1 -- 172.21.15.69:0/3100931609 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea801d070 con 0x7f4eb80fef00 2023-12-14T14:04:27.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.751+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb8109090 con 0x7f4eb80fef00 2023-12-14T14:04:27.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.751+0000 7f4eae7fc700 1 -- 172.21.15.69:0/3100931609 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ea8004370 con 0x7f4eb80fef00 2023-12-14T14:04:27.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.751+0000 7f4eae7fc700 1 -- 172.21.15.69:0/3100931609 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80039b0 con 0x7f4eb80fef00 2023-12-14T14:04:27.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.751+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb8108f00 con 0x7f4eb80fef00 2023-12-14T14:04:27.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.752+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb8109220 con 0x7f4eb80fef00 2023-12-14T14:04:27.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.752+0000 7f4eae7fc700 1 -- 172.21.15.69:0/3100931609 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f4ea8003c70 con 0x7f4eb80fef00 2023-12-14T14:04:27.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.752+0000 7f4eae7fc700 1 --2- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4ea4038870 0x7f4ea403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:27.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.752+0000 7f4eae7fc700 1 -- 172.21.15.69:0/3100931609 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4ea804c930 con 0x7f4eb80fef00 2023-12-14T14:04:27.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.752+0000 7f4ebc990700 1 --2- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4ea4038870 0x7f4ea403ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:27.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.753+0000 7f4ebc990700 1 --2- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4ea4038870 0x7f4ea403ad20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4006fd0 tx=0x7f4eb4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:27.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.757+0000 7f4eae7fc700 1 -- 172.21.15.69:0/3100931609 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4ea802a980 con 0x7f4eb80fef00 2023-12-14T14:04:27.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.948+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4eb8101630 con 0x7f4ea4038870 2023-12-14T14:04:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.950+0000 7f4eae7fc700 1 -- 172.21.15.69:0/3100931609 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f4eb8101630 con 0x7f4ea4038870 2023-12-14T14:04:27.950 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:27.950 INFO:teuthology.orchestra.run.smithi069.stdout:[{"addr": "172.21.15.69", "hostname": "smithi069", "labels": [], "status": ""}, {"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}] 2023-12-14T14:04:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4ea4038870 msgr2=0x7f4ea403ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 --2- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4ea4038870 0x7f4ea403ad20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4006fd0 tx=0x7f4eb4006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 msgr2=0x7f4eb81008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 --2- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 0x7f4eb81008c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8004f40 tx=0x7f4ea8005020 comp rx=0 tx=0).stop 2023-12-14T14:04:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 shutdown_connections 2023-12-14T14:04:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 --2- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4ea4038870 0x7f4ea403ad20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:27.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 --2- 172.21.15.69:0/3100931609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4eb80fef00 0x7f4eb81008c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:27.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 >> 172.21.15.69:0/3100931609 conn(0x7f4eb8074930 msgr2=0x7f4eb8067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:27.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 shutdown_connections 2023-12-14T14:04:27.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:27.952+0000 7f4ebf3f5700 1 -- 172.21.15.69:0/3100931609 wait complete. 2023-12-14T14:04:28.335 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi119 2023-12-14T14:04:28.335 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T14:04:28.336 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.conf 2023-12-14T14:04:28.357 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T14:04:28.357 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:04:28.416 INFO:tasks.cephadm:Adding host smithi119 to orchestrator... 2023-12-14T14:04:28.417 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch host add smithi119 2023-12-14T14:04:28.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:28 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:28.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:28 smithi069 ceph-mon[42034]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:04:28.723 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:04:29.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.705+0000 7f40a8fb5700 1 -- 172.21.15.69:0/4270451374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 msgr2=0x7f40a40ff2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:29.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.705+0000 7f40a8fb5700 1 --2- 172.21.15.69:0/4270451374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 0x7f40a40ff2d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4094009910 tx=0x7f4094009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:29.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.705+0000 7f40a8fb5700 1 -- 172.21.15.69:0/4270451374 shutdown_connections 2023-12-14T14:04:29.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.705+0000 7f40a8fb5700 1 --2- 172.21.15.69:0/4270451374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 0x7f40a40ff2d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:29.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.705+0000 7f40a8fb5700 1 -- 172.21.15.69:0/4270451374 >> 172.21.15.69:0/4270451374 conn(0x7f40a4074930 msgr2=0x7f40a4074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:29.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.705+0000 7f40a8fb5700 1 -- 172.21.15.69:0/4270451374 shutdown_connections 2023-12-14T14:04:29.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.705+0000 7f40a8fb5700 1 -- 172.21.15.69:0/4270451374 wait complete. 2023-12-14T14:04:29.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a8fb5700 1 Processor -- start 2023-12-14T14:04:29.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a8fb5700 1 -- start start 2023-12-14T14:04:29.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a8fb5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 0x7f40a41008c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:29.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a8fb5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a4102840 con 0x7f40a40fef00 2023-12-14T14:04:29.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 0x7f40a41008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:29.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 0x7f40a41008c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42176/0 (socket says 172.21.15.69:42176) 2023-12-14T14:04:29.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a259c700 1 -- 172.21.15.69:0/2748365005 learned_addr learned my addr 172.21.15.69:0/2748365005 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:29.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a259c700 1 -- 172.21.15.69:0/2748365005 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940095f0 con 0x7f40a40fef00 2023-12-14T14:04:29.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a259c700 1 --2- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 0x7f40a41008c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4094004f40 tx=0x7f4094005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:29.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40937fe700 1 -- 172.21.15.69:0/2748365005 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f409401d070 con 0x7f40a40fef00 2023-12-14T14:04:29.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a4109090 con 0x7f40a40fef00 2023-12-14T14:04:29.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40937fe700 1 -- 172.21.15.69:0/2748365005 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4094004370 con 0x7f40a40fef00 2023-12-14T14:04:29.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40937fe700 1 -- 172.21.15.69:0/2748365005 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40940039b0 con 0x7f40a40fef00 2023-12-14T14:04:29.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.706+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a4108f00 con 0x7f40a40fef00 2023-12-14T14:04:29.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.707+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a4109220 con 0x7f40a40fef00 2023-12-14T14:04:29.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.708+0000 7f40937fe700 1 -- 172.21.15.69:0/2748365005 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f4094003c70 con 0x7f40a40fef00 2023-12-14T14:04:29.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.708+0000 7f40937fe700 1 --2- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f408c038870 0x7f408c03ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:29.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.708+0000 7f40937fe700 1 -- 172.21.15.69:0/2748365005 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f409404c930 con 0x7f40a40fef00 2023-12-14T14:04:29.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.708+0000 7f40a1d9b700 1 --2- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f408c038870 0x7f408c03ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:29.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.708+0000 7f40a1d9b700 1 --2- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f408c038870 0x7f408c03ad20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4098006fd0 tx=0x7f4098006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:29.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.712+0000 7f40937fe700 1 -- 172.21.15.69:0/2748365005 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f409402a980 con 0x7f40a40fef00 2023-12-14T14:04:29.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:29.910+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a4101630 con 0x7f408c038870 2023-12-14T14:04:31.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:31.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:31.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:31.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:31.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:04:31.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:31.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:04:31.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:04:31.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: Updating smithi081:/etc/ceph/ceph.conf 2023-12-14T14:04:31.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: Updating smithi081:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:04:31.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:31.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:31.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:31.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:31.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.818+0000 7f40937fe700 1 -- 172.21.15.69:0/2748365005 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f40a4101630 con 0x7f408c038870 2023-12-14T14:04:31.818 INFO:teuthology.orchestra.run.smithi069.stdout:Added host 'smithi119' with addr '172.21.15.119' 2023-12-14T14:04:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f408c038870 msgr2=0x7f408c03ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 --2- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f408c038870 0x7f408c03ad20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4098006fd0 tx=0x7f4098006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 msgr2=0x7f40a41008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 --2- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 0x7f40a41008c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4094004f40 tx=0x7f4094005020 comp rx=0 tx=0).stop 2023-12-14T14:04:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 shutdown_connections 2023-12-14T14:04:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 --2- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f408c038870 0x7f408c03ad20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 --2- 172.21.15.69:0/2748365005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a40fef00 0x7f40a41008c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 >> 172.21.15.69:0/2748365005 conn(0x7f40a4074930 msgr2=0x7f40a4067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 shutdown_connections 2023-12-14T14:04:31.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:31.821+0000 7f40a8fb5700 1 -- 172.21.15.69:0/2748365005 wait complete. 2023-12-14T14:04:32.006 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:31 smithi069 ceph-mon[42034]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:04:32.006 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:31 smithi069 ceph-mon[42034]: Updating smithi081:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:04:32.006 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:31 smithi069 ceph-mon[42034]: Deploying cephadm binary to smithi119 2023-12-14T14:04:32.007 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:31 smithi069 ceph-mon[42034]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:32.146 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch host ls --format=json 2023-12-14T14:04:32.453 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:04:33.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:32 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:33.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:32 smithi069 ceph-mon[42034]: Added host smithi119 2023-12-14T14:04:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:32 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:32 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:32 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:33.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.515+0000 7fe8f3e25700 1 -- 172.21.15.69:0/3725862322 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 msgr2=0x7fe8ec100360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.515+0000 7fe8f3e25700 1 --2- 172.21.15.69:0/3725862322 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 0x7fe8ec100360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009910 tx=0x7fe8e0009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.515+0000 7fe8f3e25700 1 -- 172.21.15.69:0/3725862322 shutdown_connections 2023-12-14T14:04:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.515+0000 7fe8f3e25700 1 --2- 172.21.15.69:0/3725862322 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 0x7fe8ec100360 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.515+0000 7fe8f3e25700 1 -- 172.21.15.69:0/3725862322 >> 172.21.15.69:0/3725862322 conn(0x7fe8ec0fb850 msgr2=0x7fe8ec0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.515+0000 7fe8f3e25700 1 -- 172.21.15.69:0/3725862322 shutdown_connections 2023-12-14T14:04:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.515+0000 7fe8f3e25700 1 -- 172.21.15.69:0/3725862322 wait complete. 2023-12-14T14:04:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.515+0000 7fe8f3e25700 1 Processor -- start 2023-12-14T14:04:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.515+0000 7fe8f3e25700 1 -- start start 2023-12-14T14:04:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8f3e25700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 0x7fe8ec072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8f3e25700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec074d70 con 0x7fe8ec0fff90 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8f1bc1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 0x7fe8ec072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8f1bc1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 0x7fe8ec072df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42196/0 (socket says 172.21.15.69:42196) 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8f1bc1700 1 -- 172.21.15.69:0/2629168653 learned_addr learned my addr 172.21.15.69:0/2629168653 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8f1bc1700 1 -- 172.21.15.69:0/2629168653 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e00095f0 con 0x7fe8ec0fff90 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8f1bc1700 1 --2- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 0x7fe8ec072df0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0004f40 tx=0x7fe8e0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8deffd700 1 -- 172.21.15.69:0/2629168653 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e001d070 con 0x7fe8ec0fff90 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8deffd700 1 -- 172.21.15.69:0/2629168653 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8e0004370 con 0x7fe8ec0fff90 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec10a170 con 0x7fe8ec0fff90 2023-12-14T14:04:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8deffd700 1 -- 172.21.15.69:0/2629168653 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e00039b0 con 0x7fe8ec0fff90 2023-12-14T14:04:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.516+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec109fe0 con 0x7fe8ec0fff90 2023-12-14T14:04:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.517+0000 7fe8deffd700 1 -- 172.21.15.69:0/2629168653 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fe8e0003c20 con 0x7fe8ec0fff90 2023-12-14T14:04:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.517+0000 7fe8deffd700 1 --2- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe8d80388c0 0x7fe8d803ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.517+0000 7fe8deffd700 1 -- 172.21.15.69:0/2629168653 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe8e004c690 con 0x7fe8ec0fff90 2023-12-14T14:04:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.517+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec10a300 con 0x7fe8ec0fff90 2023-12-14T14:04:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.517+0000 7fe8f13c0700 1 --2- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe8d80388c0 0x7fe8d803ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.518+0000 7fe8f13c0700 1 --2- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe8d80388c0 0x7fe8d803ad70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8006fd0 tx=0x7fe8e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:33.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.522+0000 7fe8deffd700 1 -- 172.21.15.69:0/2629168653 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe8e0026070 con 0x7fe8ec0fff90 2023-12-14T14:04:33.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.718+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8ec074320 con 0x7fe8d80388c0 2023-12-14T14:04:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.719+0000 7fe8deffd700 1 -- 172.21.15.69:0/2629168653 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7fe8ec074320 con 0x7fe8d80388c0 2023-12-14T14:04:33.719 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:04:33.719 INFO:teuthology.orchestra.run.smithi069.stdout:[{"addr": "172.21.15.69", "hostname": "smithi069", "labels": [], "status": ""}, {"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}] 2023-12-14T14:04:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe8d80388c0 msgr2=0x7fe8d803ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 --2- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe8d80388c0 0x7fe8d803ad70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8006fd0 tx=0x7fe8e8006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 msgr2=0x7fe8ec072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 --2- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 0x7fe8ec072df0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0004f40 tx=0x7fe8e0005020 comp rx=0 tx=0).stop 2023-12-14T14:04:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 shutdown_connections 2023-12-14T14:04:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 --2- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe8d80388c0 0x7fe8d803ad70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 --2- 172.21.15.69:0/2629168653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8ec0fff90 0x7fe8ec072df0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 >> 172.21.15.69:0/2629168653 conn(0x7fe8ec0fb850 msgr2=0x7fe8ec104170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 shutdown_connections 2023-12-14T14:04:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:33.721+0000 7fe8f3e25700 1 -- 172.21.15.69:0/2629168653 wait complete. 2023-12-14T14:04:34.041 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:33 smithi069 ceph-mon[42034]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:34.041 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:34.101 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-14T14:04:34.101 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd crush tunables default 2023-12-14T14:04:34.405 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:04:35.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:34 smithi069 ceph-mon[42034]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:04:35.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.418+0000 7f51f2136700 1 -- 172.21.15.69:0/1447036665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 msgr2=0x7f51ec0ff260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:35.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.418+0000 7f51f2136700 1 --2- 172.21.15.69:0/1447036665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 0x7f51ec0ff260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009910 tx=0x7f51dc009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:35.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.418+0000 7f51f2136700 1 -- 172.21.15.69:0/1447036665 shutdown_connections 2023-12-14T14:04:35.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.418+0000 7f51f2136700 1 --2- 172.21.15.69:0/1447036665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 0x7f51ec0ff260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:35.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.418+0000 7f51f2136700 1 -- 172.21.15.69:0/1447036665 >> 172.21.15.69:0/1447036665 conn(0x7f51ec0fa750 msgr2=0x7f51ec0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:35.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.418+0000 7f51f2136700 1 -- 172.21.15.69:0/1447036665 shutdown_connections 2023-12-14T14:04:35.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.418+0000 7f51f2136700 1 -- 172.21.15.69:0/1447036665 wait complete. 2023-12-14T14:04:35.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.418+0000 7f51f2136700 1 Processor -- start 2023-12-14T14:04:35.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.419+0000 7f51f2136700 1 -- start start 2023-12-14T14:04:35.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.419+0000 7f51f2136700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 0x7f51ec195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:35.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.419+0000 7f51f2136700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec196510 con 0x7f51ec0fee90 2023-12-14T14:04:35.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.419+0000 7f51eb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 0x7f51ec195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:35.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.419+0000 7f51eb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 0x7f51ec195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42212/0 (socket says 172.21.15.69:42212) 2023-12-14T14:04:35.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.419+0000 7f51eb7fe700 1 -- 172.21.15.69:0/1947503208 learned_addr learned my addr 172.21.15.69:0/1947503208 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:35.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.419+0000 7f51eb7fe700 1 -- 172.21.15.69:0/1947503208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc0095f0 con 0x7f51ec0fee90 2023-12-14T14:04:35.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.420+0000 7f51eb7fe700 1 --2- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 0x7f51ec195fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f51dc004f40 tx=0x7f51dc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:35.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.420+0000 7f51e8ff9700 1 -- 172.21.15.69:0/1947503208 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51dc01d070 con 0x7f51ec0fee90 2023-12-14T14:04:35.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.420+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec109070 con 0x7f51ec0fee90 2023-12-14T14:04:35.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.420+0000 7f51e8ff9700 1 -- 172.21.15.69:0/1947503208 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51dc004370 con 0x7f51ec0fee90 2023-12-14T14:04:35.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.420+0000 7f51e8ff9700 1 -- 172.21.15.69:0/1947503208 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51dc0039b0 con 0x7f51ec0fee90 2023-12-14T14:04:35.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.420+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec108ee0 con 0x7f51ec0fee90 2023-12-14T14:04:35.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.420+0000 7f51e8ff9700 1 -- 172.21.15.69:0/1947503208 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f51dc003c70 con 0x7f51ec0fee90 2023-12-14T14:04:35.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.421+0000 7f51e8ff9700 1 --2- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f51d4038870 0x7f51d403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:35.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.421+0000 7f51e8ff9700 1 -- 172.21.15.69:0/1947503208 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f51dc04c6a0 con 0x7f51ec0fee90 2023-12-14T14:04:35.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.421+0000 7f51eaffd700 1 --2- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f51d4038870 0x7f51d403ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:35.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.421+0000 7f51eaffd700 1 --2- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f51d4038870 0x7f51d403ad20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f51e0006fd0 tx=0x7f51e0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:35.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.421+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec109200 con 0x7f51ec0fee90 2023-12-14T14:04:35.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.426+0000 7f51e8ff9700 1 -- 172.21.15.69:0/1947503208 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f51dc026020 con 0x7f51ec0fee90 2023-12-14T14:04:35.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:35.627+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f51ec062120 con 0x7f51ec0fee90 2023-12-14T14:04:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:35 smithi069 ceph-mon[42034]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:04:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:04:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:35 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1947503208' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-14T14:04:36.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.418+0000 7f51e8ff9700 1 -- 172.21.15.69:0/1947503208 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f51dc04a090 con 0x7f51ec0fee90 2023-12-14T14:04:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f51d4038870 msgr2=0x7f51d403ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 --2- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f51d4038870 0x7f51d403ad20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f51e0006fd0 tx=0x7f51e0006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 msgr2=0x7f51ec195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 --2- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 0x7f51ec195fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f51dc004f40 tx=0x7f51dc005020 comp rx=0 tx=0).stop 2023-12-14T14:04:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 shutdown_connections 2023-12-14T14:04:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 --2- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f51d4038870 0x7f51d403ad20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 --2- 172.21.15.69:0/1947503208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ec0fee90 0x7f51ec195fd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 >> 172.21.15.69:0/1947503208 conn(0x7f51ec0fa750 msgr2=0x7f51ec103070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 shutdown_connections 2023-12-14T14:04:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:36.420+0000 7f51f2136700 1 -- 172.21.15.69:0/1947503208 wait complete. 2023-12-14T14:04:36.422 INFO:teuthology.orchestra.run.smithi069.stderr:adjusted tunables profile to default 2023-12-14T14:04:36.808 INFO:tasks.cephadm:Adding mon.a on smithi069 2023-12-14T14:04:36.808 INFO:tasks.cephadm:Adding mon.b on smithi081 2023-12-14T14:04:36.808 INFO:tasks.cephadm:Adding mon.c on smithi119 2023-12-14T14:04:36.808 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch apply mon '3;smithi069:172.21.15.69=a;smithi081:172.21.15.81=b;smithi119:172.21.15.119=c' 2023-12-14T14:04:37.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:36 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:04:37.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:36 smithi069 ceph-mon[42034]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-14T14:04:37.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:36 smithi069 ceph-mon[42034]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:04:37.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:36 smithi069 ceph-mon[42034]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:04:37.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:36 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:37.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:36 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:37.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:36 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:37.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:36 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1947503208' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-14T14:04:37.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:36 smithi069 ceph-mon[42034]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:37.141 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:04:38.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:37 smithi069 ceph-mon[42034]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:04:38.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:37 smithi069 ceph-mon[42034]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:38.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.129+0000 7f6be1719700 1 -- 172.21.15.119:0/3520775330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 msgr2=0x7f6bdc100360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.129+0000 7f6be1719700 1 --2- 172.21.15.119:0/3520775330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 0x7f6bdc100360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009910 tx=0x7f6bcc009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.129+0000 7f6be1719700 1 -- 172.21.15.119:0/3520775330 shutdown_connections 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.129+0000 7f6be1719700 1 --2- 172.21.15.119:0/3520775330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 0x7f6bdc100360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.129+0000 7f6be1719700 1 -- 172.21.15.119:0/3520775330 >> 172.21.15.119:0/3520775330 conn(0x7f6bdc0fb870 msgr2=0x7f6bdc0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.129+0000 7f6be1719700 1 -- 172.21.15.119:0/3520775330 shutdown_connections 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.129+0000 7f6be1719700 1 -- 172.21.15.119:0/3520775330 wait complete. 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.130+0000 7f6be1719700 1 Processor -- start 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.130+0000 7f6be1719700 1 -- start start 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.130+0000 7f6be1719700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 0x7f6bdc195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:38.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.130+0000 7f6be1719700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc195790 con 0x7f6bdc0fff90 2023-12-14T14:04:38.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.130+0000 7f6bdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 0x7f6bdc195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:38.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.130+0000 7f6bdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 0x7f6bdc195250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.119:44094/0 (socket says 172.21.15.119:44094) 2023-12-14T14:04:38.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.130+0000 7f6bdaffd700 1 -- 172.21.15.119:0/2720635455 learned_addr learned my addr 172.21.15.119:0/2720635455 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:04:38.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.131+0000 7f6bdaffd700 1 -- 172.21.15.119:0/2720635455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc0095f0 con 0x7f6bdc0fff90 2023-12-14T14:04:38.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.131+0000 7f6bdaffd700 1 --2- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 0x7f6bdc195250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc004f40 tx=0x7f6bcc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:38.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.131+0000 7f6bc3fff700 1 -- 172.21.15.119:0/2720635455 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bcc01d070 con 0x7f6bdc0fff90 2023-12-14T14:04:38.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.131+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc10a170 con 0x7f6bdc0fff90 2023-12-14T14:04:38.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.131+0000 7f6bc3fff700 1 -- 172.21.15.119:0/2720635455 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bcc004370 con 0x7f6bdc0fff90 2023-12-14T14:04:38.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.131+0000 7f6bc3fff700 1 -- 172.21.15.119:0/2720635455 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bcc0039b0 con 0x7f6bdc0fff90 2023-12-14T14:04:38.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.131+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc109fe0 con 0x7f6bdc0fff90 2023-12-14T14:04:38.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.132+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc10a300 con 0x7f6bdc0fff90 2023-12-14T14:04:38.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.132+0000 7f6bc3fff700 1 -- 172.21.15.119:0/2720635455 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f6bcc003c70 con 0x7f6bdc0fff90 2023-12-14T14:04:38.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.132+0000 7f6bc3fff700 1 --2- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6bc40388c0 0x7f6bc403ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:38.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.132+0000 7f6bc3fff700 1 -- 172.21.15.119:0/2720635455 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6bcc04c5b0 con 0x7f6bdc0fff90 2023-12-14T14:04:38.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.133+0000 7f6bda7fc700 1 --2- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6bc40388c0 0x7f6bc403ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:38.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.133+0000 7f6bda7fc700 1 --2- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6bc40388c0 0x7f6bc403ad70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0006fd0 tx=0x7f6bd0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:38.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.138+0000 7f6bc3fff700 1 -- 172.21.15.119:0/2720635455 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6bcc005c00 con 0x7f6bdc0fff90 2023-12-14T14:04:38.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.333+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi081:172.21.15.81=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bdc195d90 con 0x7f6bc40388c0 2023-12-14T14:04:38.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.340+0000 7f6bc3fff700 1 -- 172.21.15.119:0/2720635455 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6bdc195d90 con 0x7f6bc40388c0 2023-12-14T14:04:38.340 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mon update... 2023-12-14T14:04:38.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6bc40388c0 msgr2=0x7f6bc403ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:38.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 --2- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6bc40388c0 0x7f6bc403ad70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0006fd0 tx=0x7f6bd0006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:38.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 msgr2=0x7f6bdc195250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:38.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 --2- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 0x7f6bdc195250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc004f40 tx=0x7f6bcc005020 comp rx=0 tx=0).stop 2023-12-14T14:04:38.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 shutdown_connections 2023-12-14T14:04:38.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 --2- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6bc40388c0 0x7f6bc403ad70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:38.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 --2- 172.21.15.119:0/2720635455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc0fff90 0x7f6bdc195250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:38.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 >> 172.21.15.119:0/2720635455 conn(0x7f6bdc0fb870 msgr2=0x7f6bdc104170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:38.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 shutdown_connections 2023-12-14T14:04:38.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:38.342+0000 7f6be1719700 1 -- 172.21.15.119:0/2720635455 wait complete. 2023-12-14T14:04:38.746 DEBUG:teuthology.orchestra.run.smithi081:mon.b> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.b.service 2023-12-14T14:04:38.749 DEBUG:teuthology.orchestra.run.smithi119:mon.c> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.c.service 2023-12-14T14:04:38.752 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-14T14:04:38.752 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-14T14:04:38.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:04:38.785 INFO:journalctl@ceph.mon.b.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:04:39.357 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:04:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi081:172.21.15.81=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: Saving service mon spec with placement smithi069:172.21.15.69=a;smithi081:172.21.15.81=b;smithi119:172.21.15.119=c;count:3 2023-12-14T14:04:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:04:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:04:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:04:39.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:39.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:39.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: Deploying daemon mon.c on smithi119 2023-12-14T14:04:39.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:39 smithi069 ceph-mon[42034]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:40.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.292+0000 7f5f455d4700 1 -- 172.21.15.119:0/119813190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 msgr2=0x7f5f400ff260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:40.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.292+0000 7f5f455d4700 1 --2- 172.21.15.119:0/119813190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 0x7f5f400ff260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009910 tx=0x7f5f38009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:40.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.293+0000 7f5f455d4700 1 -- 172.21.15.119:0/119813190 shutdown_connections 2023-12-14T14:04:40.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.293+0000 7f5f455d4700 1 --2- 172.21.15.119:0/119813190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 0x7f5f400ff260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:40.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.293+0000 7f5f455d4700 1 -- 172.21.15.119:0/119813190 >> 172.21.15.119:0/119813190 conn(0x7f5f400fa750 msgr2=0x7f5f400fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:40.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.293+0000 7f5f455d4700 1 -- 172.21.15.119:0/119813190 shutdown_connections 2023-12-14T14:04:40.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.293+0000 7f5f455d4700 1 -- 172.21.15.119:0/119813190 wait complete. 2023-12-14T14:04:40.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.293+0000 7f5f455d4700 1 Processor -- start 2023-12-14T14:04:40.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.294+0000 7f5f455d4700 1 -- start start 2023-12-14T14:04:40.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.294+0000 7f5f455d4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 0x7f5f40196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.294+0000 7f5f455d4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40196540 con 0x7f5f400fee90 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.294+0000 7f5f3effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 0x7f5f40196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.294+0000 7f5f3effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 0x7f5f40196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.119:36918/0 (socket says 172.21.15.119:36918) 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.294+0000 7f5f3effd700 1 -- 172.21.15.119:0/499755600 learned_addr learned my addr 172.21.15.119:0/499755600 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.294+0000 7f5f3effd700 1 -- 172.21.15.119:0/499755600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380095f0 con 0x7f5f400fee90 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.295+0000 7f5f3effd700 1 --2- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 0x7f5f40196000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f38004f40 tx=0x7f5f38005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.295+0000 7f5f37fff700 1 -- 172.21.15.119:0/499755600 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f3801d070 con 0x7f5f400fee90 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.295+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f40109070 con 0x7f5f400fee90 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.295+0000 7f5f37fff700 1 -- 172.21.15.119:0/499755600 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f38004370 con 0x7f5f400fee90 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.295+0000 7f5f37fff700 1 -- 172.21.15.119:0/499755600 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f380039b0 con 0x7f5f400fee90 2023-12-14T14:04:40.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.295+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f40108ee0 con 0x7f5f400fee90 2023-12-14T14:04:40.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.296+0000 7f5f37fff700 1 -- 172.21.15.119:0/499755600 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f5f38003c70 con 0x7f5f400fee90 2023-12-14T14:04:40.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.296+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f40109200 con 0x7f5f400fee90 2023-12-14T14:04:40.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.296+0000 7f5f37fff700 1 --2- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f2c038870 0x7f5f2c03ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:40.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.296+0000 7f5f37fff700 1 -- 172.21.15.119:0/499755600 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5f3804c6c0 con 0x7f5f400fee90 2023-12-14T14:04:40.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.296+0000 7f5f3e7fc700 1 --2- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f2c038870 0x7f5f2c03ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:40.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.297+0000 7f5f3e7fc700 1 --2- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f2c038870 0x7f5f2c03ad20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5f28006fd0 tx=0x7f5f28006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:40.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.301+0000 7f5f37fff700 1 -- 172.21.15.119:0/499755600 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5f3802a9c0 con 0x7f5f400fee90 2023-12-14T14:04:40.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.578+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5f40068db0 con 0x7f5f400fee90 2023-12-14T14:04:40.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.579+0000 7f5f37fff700 1 -- 172.21.15.119:0/499755600 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f5f38026030 con 0x7f5f400fee90 2023-12-14T14:04:40.579 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T14:04:40.579 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","modified":"2023-12-14T14:03:25.682019Z","created":"2023-12-14T14:03:25.682019Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-14T14:04:40.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f2c038870 msgr2=0x7f5f2c03ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:40.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 --2- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f2c038870 0x7f5f2c03ad20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5f28006fd0 tx=0x7f5f28006e40 comp rx=0 tx=0).stop 2023-12-14T14:04:40.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 msgr2=0x7f5f40196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:40.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 --2- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 0x7f5f40196000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f38004f40 tx=0x7f5f38005020 comp rx=0 tx=0).stop 2023-12-14T14:04:40.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 shutdown_connections 2023-12-14T14:04:40.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 --2- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f2c038870 0x7f5f2c03ad20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:40.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 --2- 172.21.15.119:0/499755600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400fee90 0x7f5f40196000 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:40.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 >> 172.21.15.119:0/499755600 conn(0x7f5f400fa750 msgr2=0x7f5f40103070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:40.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 shutdown_connections 2023-12-14T14:04:40.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:40.581+0000 7f5f455d4700 1 -- 172.21.15.119:0/499755600 wait complete. 2023-12-14T14:04:40.582 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-14T14:04:41.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:40 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/499755600' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T14:04:41.099 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 systemd[1]: Starting Ceph mon.c for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:04:41.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: set uid:gid to 167:167 (ceph:ceph) 2023-12-14T14:04:41.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev), process ceph-mon, pid 7 2023-12-14T14:04:41.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: pidfile_write: ignore empty --pid-file 2023-12-14T14:04:41.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: load: jerasure load: lrc 2023-12-14T14:04:41.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 bash[43796]: 5d4eba530f533fb9495dda5e42f62bab0a7a348f6832b615b040050f601e1fdc 2023-12-14T14:04:41.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: RocksDB version: 7.9.2 2023-12-14T14:04:41.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Git sha 0 2023-12-14T14:04:41.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Compile date 2023-12-13 16:19:48 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: DB SUMMARY 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: DB Session ID: KLL1E91CS85OWCFL2VB0 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: CURRENT file: CURRENT 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: IDENTITY file: IDENTITY 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.error_if_exists: 0 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.create_if_missing: 0 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.paranoid_checks: 1 2023-12-14T14:04:41.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.env: 0x5634587c4720 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.fs: PosixFileSystem 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.info_log: 0x56345af1d3c0 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_file_opening_threads: 16 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.statistics: (nil) 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.use_fsync: 0 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_log_file_size: 0 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.keep_log_file_num: 1000 2023-12-14T14:04:41.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.recycle_log_file_num: 0 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.allow_fallocate: 1 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.allow_mmap_reads: 0 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.allow_mmap_writes: 0 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.use_direct_reads: 0 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.create_missing_column_families: 0 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.db_log_dir: 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.wal_dir: 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-14T14:04:41.779 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.advise_random_on_open: 1 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.db_write_buffer_size: 0 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.write_buffer_manager: 0x56345a18e3c0 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.rate_limiter: (nil) 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.wal_recovery_mode: 2 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.enable_thread_tracking: 0 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.enable_pipelined_write: 0 2023-12-14T14:04:41.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.unordered_write: 0 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.row_cache: None 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.wal_filter: None 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.allow_ingest_behind: 0 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.two_write_queues: 0 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.manual_wal_flush: 0 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.wal_compression: 0 2023-12-14T14:04:41.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.atomic_flush: 0 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.log_readahead_size: 0 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.best_efforts_recovery: 0 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.allow_data_in_errors: 0 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.db_host_id: __hostname__ 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_background_jobs: 2 2023-12-14T14:04:41.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_background_compactions: -1 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_subcompactions: 1 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_total_wal_size: 0 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_open_files: -1 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bytes_per_sync: 0 2023-12-14T14:04:41.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_readahead_size: 0 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_background_flushes: -1 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Compression algorithms supported: 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: kZSTD supported: 0 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: kXpressCompression supported: 0 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: kLZ4HCCompression supported: 1 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: kZlibCompression supported: 1 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: kSnappyCompression supported: 1 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: kLZ4Compression supported: 1 2023-12-14T14:04:41.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: kBZip2Compression supported: 0 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.merge_operator: 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_filter: None 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_filter_factory: None 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.sst_partitioner_factory: None 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-14T14:04:41.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56345af1d4e0) 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: cache_index_and_filter_blocks: 1 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: pin_top_level_index_and_filter: 1 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: index_type: 0 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: data_block_index_type: 0 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: index_shortening: 1 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: checksum: 4 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: no_block_cache: 0 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_cache: 0x56345a22f1f0 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_cache_name: BinnedLRUCache 2023-12-14T14:04:41.786 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_cache_options: 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: capacity : 536870912 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: num_shard_bits : 4 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: strict_capacity_limit : 0 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: high_pri_pool_ratio: 0.000 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_cache_compressed: (nil) 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: persistent_cache: (nil) 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_size: 4096 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_size_deviation: 10 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_restart_interval: 16 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: index_block_restart_interval: 1 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: metadata_block_size: 4096 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: partition_filters: 0 2023-12-14T14:04:41.787 INFO:journalctl@ceph.mon.c.smithi119.stdout: use_delta_encoding: 1 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: filter_policy: bloomfilter 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: whole_key_filtering: 1 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: verify_compression: 0 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: read_amp_bytes_per_bit: 0 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: format_version: 5 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: enable_index_compression: 1 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_align: 0 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: max_auto_readahead_size: 262144 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: prepopulate_block_cache: 0 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: initial_auto_readahead_size: 8192 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout: num_file_reads_for_auto_readahead: 2 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.write_buffer_size: 33554432 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_write_buffer_number: 2 2023-12-14T14:04:41.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression: NoCompression 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression: Disabled 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.prefix_extractor: nullptr 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.num_levels: 7 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-14T14:04:41.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression_opts.level: 32767 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression_opts.strategy: 0 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression_opts.enabled: false 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-14T14:04:41.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.target_file_size_base: 67108864 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-14T14:04:41.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.arena_block_size: 1048576 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.disable_auto_compactions: 0 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-14T14:04:41.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.table_properties_collectors: 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.inplace_update_support: 0 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-14T14:04:41.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.bloom_locality: 0 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.max_successive_merges: 0 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.paranoid_file_checks: 0 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.force_consistency_checks: 1 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.report_bg_io_stats: 0 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.ttl: 2592000 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.enable_blob_files: false 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.min_blob_size: 0 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.blob_file_size: 268435456 2023-12-14T14:04:41.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.blob_file_starting_level: 0 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f0236e00-c85e-4337-b05e-292d0cde825b 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702562681419788, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 systemd[1]: Started Ceph mon.c for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:04:41.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702562681420385, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702562681, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f0236e00-c85e-4337-b05e-292d0cde825b", "db_session_id": "KLL1E91CS85OWCFL2VB0", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702562681420485, "job": 1, "event": "recovery_finished"} 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56345a2cc000 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: DB pointer 0x56345a2b8000 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout: ** DB Stats ** 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-14T14:04:41.796 INFO:journalctl@ceph.mon.c.smithi119.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: ** Compaction Stats [default] ** 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: ** Compaction Stats [default] ** 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-14T14:04:41.797 INFO:journalctl@ceph.mon.c.smithi119.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: Cumulative compaction: 0.00 GB write, 0.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: Interval compaction: 0.00 GB write, 0.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-14T14:04:41.798 INFO:journalctl@ceph.mon.c.smithi119.stdout: Block cache BinnedLRUCache@0x56345a22f1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-14T14:04:41.799 INFO:journalctl@ceph.mon.c.smithi119.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-12-14T14:04:41.799 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2023-12-14T14:04:41.799 INFO:journalctl@ceph.mon.c.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-14T14:04:41.799 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-12-14T14:04:41.799 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: using public_addr v2:172.21.15.119:0/0 -> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2023-12-14T14:04:41.799 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: starting mon.c rank -1 at public addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] at bind addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:04:41.799 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(???) e0 preinit fsid 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).mds e1 new map 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).mds e1 print_map 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout: e1 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout: legacy client fscid: -1 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout: No filesystems configured 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-14T14:04:41.800 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi081:172.21.15.81=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: Saving service mon spec with placement smithi069:172.21.15.69=a;smithi081:172.21.15.81=b;smithi119:172.21.15.119=c;count:3 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:04:41.801 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:04:41.802 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:41.802 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:04:41.802 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:41.802 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:41.802 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: Deploying daemon mon.c on smithi119 2023-12-14T14:04:41.802 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:41.802 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/499755600' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T14:04:41.802 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-12-14T14:04:41.802 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:41 smithi119 ceph-mon[43834]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-14T14:04:42.011 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-14T14:04:42.011 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-14T14:04:42.316 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:04:46.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:04:46.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: mon.a calling monitor election 2023-12-14T14:04:46.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:46.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:46.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:46.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:46.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: mon.c calling monitor election 2023-12-14T14:04:46.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:46.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: monmap e2: 2 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: fsmap 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: mgrmap e13: x(active, since 35s) 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: overall HEALTH_OK 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:46.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:46.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:46.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:46.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:46.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.854+0000 7f36b0b5a700 1 -- 172.21.15.119:0/1859039960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36940035c0 msgr2=0x7f3694005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:46.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.854+0000 7f36b0b5a700 1 --2- 172.21.15.119:0/1859039960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36940035c0 0x7f3694005a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0fec70 tx=0x7f369c014ec0 comp rx=0 tx=0).stop 2023-12-14T14:04:46.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.854+0000 7f36b0b5a700 1 -- 172.21.15.119:0/1859039960 shutdown_connections 2023-12-14T14:04:46.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.854+0000 7f36b0b5a700 1 --2- 172.21.15.119:0/1859039960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36940035c0 0x7f3694005a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:46.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.854+0000 7f36b0b5a700 1 -- 172.21.15.119:0/1859039960 >> 172.21.15.119:0/1859039960 conn(0x7f36ac0fa860 msgr2=0x7f36ac0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:46.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.854+0000 7f36b0b5a700 1 -- 172.21.15.119:0/1859039960 shutdown_connections 2023-12-14T14:04:46.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.854+0000 7f36b0b5a700 1 -- 172.21.15.119:0/1859039960 wait complete. 2023-12-14T14:04:46.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.855+0000 7f36b0b5a700 1 Processor -- start 2023-12-14T14:04:46.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.855+0000 7f36b0b5a700 1 -- start start 2023-12-14T14:04:46.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36b0b5a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 0x7f36ac1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:46.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36b0b5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36ac197a10 0x7f36ac19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:46.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36b0b5a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac197f90 con 0x7f36ac197a10 2023-12-14T14:04:46.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36b0b5a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac198100 con 0x7f36940035c0 2023-12-14T14:04:46.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36aa59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 0x7f36ac1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:46.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36aa59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 0x7f36ac1974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34388/0 (socket says 172.21.15.119:34388) 2023-12-14T14:04:46.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36aa59c700 1 -- 172.21.15.119:0/2991849447 learned_addr learned my addr 172.21.15.119:0/2991849447 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:04:46.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36a9d9b700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36ac197a10 0x7f36ac19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:46.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36aa59c700 1 -- 172.21.15.119:0/2991849447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 msgr2=0x7f36ac1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-14T14:04:46.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36aa59c700 1 -- 172.21.15.119:0/2991849447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 msgr2=0x7f36ac1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-14T14:04:46.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36aa59c700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 0x7f36ac1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36aa59c700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 0x7f36ac1974d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36a9d9b700 1 -- 172.21.15.119:0/2991849447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 msgr2=0x7f36ac1974d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36a9d9b700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 0x7f36ac1974d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.856+0000 7f36a9d9b700 1 -- 172.21.15.119:0/2991849447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c014910 con 0x7f36ac197a10 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.857+0000 7f36a9d9b700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36ac197a10 0x7f36ac19be80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f36a000b4d0 tx=0x7f36a000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.857+0000 7f369b7fe700 1 -- 172.21.15.119:0/2991849447 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f36a0011630 con 0x7f36ac197a10 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.857+0000 7f369b7fe700 1 -- 172.21.15.119:0/2991849447 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36a0011c50 con 0x7f36ac197a10 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.857+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac106b90 con 0x7f36ac197a10 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.857+0000 7f369b7fe700 1 -- 172.21.15.119:0/2991849447 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f36a0010d90 con 0x7f36ac197a10 2023-12-14T14:04:46.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.857+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac106a00 con 0x7f36ac197a10 2023-12-14T14:04:46.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.858+0000 7f369b7fe700 1 -- 172.21.15.119:0/2991849447 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f36a001a400 con 0x7f36ac197a10 2023-12-14T14:04:46.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.858+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac106d20 con 0x7f36ac197a10 2023-12-14T14:04:46.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.858+0000 7f369b7fe700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f368c0386b0 0x7f368c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:46.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.858+0000 7f369b7fe700 1 -- 172.21.15.119:0/2991849447 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f36a004ae80 con 0x7f36ac197a10 2023-12-14T14:04:46.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.858+0000 7f36aa59c700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f368c0386b0 0x7f368c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:46.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.859+0000 7f36aa59c700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f368c0386b0 0x7f368c03ab60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f369c00f470 tx=0x7f369c00f3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:46.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:46.864+0000 7f369b7fe700 1 -- 172.21.15.119:0/2991849447 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f36a00193b0 con 0x7f36ac197a10 2023-12-14T14:04:47.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:04:47.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: mon.a calling monitor election 2023-12-14T14:04:47.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: mon.c calling monitor election 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T14:04:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: monmap e2: 2 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T14:04:47.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: fsmap 2023-12-14T14:04:47.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:47.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: mgrmap e13: x(active, since 35s) 2023-12-14T14:04:47.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: overall HEALTH_OK 2023-12-14T14:04:47.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:47.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:47.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:47.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:47.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:47.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.130+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f36ac1a2120 con 0x7f36ac197a10 2023-12-14T14:04:47.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.131+0000 7f369b7fe700 1 -- 172.21.15.119:0/2991849447 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f36a00172c0 con 0x7f36ac197a10 2023-12-14T14:04:47.130 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T14:04:47.130 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","modified":"2023-12-14T14:04:41.447624Z","created":"2023-12-14T14:03:25.682019Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-14T14:04:47.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f368c0386b0 msgr2=0x7f368c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:47.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f368c0386b0 0x7f368c03ab60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f369c00f470 tx=0x7f369c00f3c0 comp rx=0 tx=0).stop 2023-12-14T14:04:47.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36ac197a10 msgr2=0x7f36ac19be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:47.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36ac197a10 0x7f36ac19be80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f36a000b4d0 tx=0x7f36a000b890 comp rx=0 tx=0).stop 2023-12-14T14:04:47.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 shutdown_connections 2023-12-14T14:04:47.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f368c0386b0 0x7f368c03ab60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:47.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36940035c0 0x7f36ac1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:47.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 --2- 172.21.15.119:0/2991849447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36ac197a10 0x7f36ac19be80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:47.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 >> 172.21.15.119:0/2991849447 conn(0x7f36ac0fa860 msgr2=0x7f36ac1028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:47.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 shutdown_connections 2023-12-14T14:04:47.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:47.133+0000 7f36b0b5a700 1 -- 172.21.15.119:0/2991849447 wait complete. 2023-12-14T14:04:47.133 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 2 2023-12-14T14:04:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:47 smithi119 ceph-mon[43834]: Deploying daemon mon.b on smithi081 2023-12-14T14:04:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:47 smithi119 ceph-mon[43834]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:47 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/2991849447' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T14:04:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:47 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:47.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:47 smithi069 ceph-mon[42034]: Deploying daemon mon.b on smithi081 2023-12-14T14:04:47.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:47 smithi069 ceph-mon[42034]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:47.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:47 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/2991849447' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T14:04:47.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:47 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:48.495 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-14T14:04:48.496 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-14T14:04:48.809 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:04:48.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:48 smithi081 systemd[1]: Starting Ceph mon.b for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:04:49.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: set uid:gid to 167:167 (ceph:ceph) 2023-12-14T14:04:49.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev), process ceph-mon, pid 7 2023-12-14T14:04:49.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: pidfile_write: ignore empty --pid-file 2023-12-14T14:04:49.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: load: jerasure load: lrc 2023-12-14T14:04:49.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: RocksDB version: 7.9.2 2023-12-14T14:04:49.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Git sha 0 2023-12-14T14:04:49.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Compile date 2023-12-13 16:19:48 2023-12-14T14:04:49.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: DB SUMMARY 2023-12-14T14:04:49.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: DB Session ID: 3QDRVYHB1QGVQU1QCDNA 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: CURRENT file: CURRENT 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: IDENTITY file: IDENTITY 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.error_if_exists: 0 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.create_if_missing: 0 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.paranoid_checks: 1 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-14T14:04:49.400 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-14T14:04:49.401 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-14T14:04:49.401 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.env: 0x556e3298f720 2023-12-14T14:04:49.401 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.fs: PosixFileSystem 2023-12-14T14:04:49.401 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.info_log: 0x556e34acb3c0 2023-12-14T14:04:49.401 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_file_opening_threads: 16 2023-12-14T14:04:49.401 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.statistics: (nil) 2023-12-14T14:04:49.401 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.use_fsync: 0 2023-12-14T14:04:49.401 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_log_file_size: 0 2023-12-14T14:04:49.401 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.keep_log_file_num: 1000 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.recycle_log_file_num: 0 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.allow_fallocate: 1 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.allow_mmap_reads: 0 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.allow_mmap_writes: 0 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.use_direct_reads: 0 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.create_missing_column_families: 0 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.db_log_dir: 2023-12-14T14:04:49.402 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.wal_dir: 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.advise_random_on_open: 1 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.db_write_buffer_size: 0 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.write_buffer_manager: 0x556e33d3c3c0 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-14T14:04:49.403 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.rate_limiter: (nil) 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.wal_recovery_mode: 2 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.enable_thread_tracking: 0 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.enable_pipelined_write: 0 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.unordered_write: 0 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-14T14:04:49.404 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.row_cache: None 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.wal_filter: None 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.allow_ingest_behind: 0 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.two_write_queues: 0 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.manual_wal_flush: 0 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.wal_compression: 0 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.atomic_flush: 0 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-14T14:04:49.405 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-14T14:04:49.406 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-14T14:04:49.406 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.log_readahead_size: 0 2023-12-14T14:04:49.406 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-14T14:04:49.406 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.best_efforts_recovery: 0 2023-12-14T14:04:49.406 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-14T14:04:49.406 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-14T14:04:49.406 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.allow_data_in_errors: 0 2023-12-14T14:04:49.406 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.db_host_id: __hostname__ 2023-12-14T14:04:49.406 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-14T14:04:49.408 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_background_jobs: 2 2023-12-14T14:04:49.408 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_background_compactions: -1 2023-12-14T14:04:49.408 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_subcompactions: 1 2023-12-14T14:04:49.408 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-14T14:04:49.408 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-14T14:04:49.408 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-14T14:04:49.408 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_total_wal_size: 0 2023-12-14T14:04:49.409 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-14T14:04:49.409 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-14T14:04:49.409 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-14T14:04:49.409 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-14T14:04:49.409 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_open_files: -1 2023-12-14T14:04:49.409 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bytes_per_sync: 0 2023-12-14T14:04:49.409 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-14T14:04:49.409 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-14T14:04:49.409 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_readahead_size: 0 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_background_flushes: -1 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Compression algorithms supported: 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: kZSTD supported: 0 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: kXpressCompression supported: 0 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: kLZ4HCCompression supported: 1 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: kZlibCompression supported: 1 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: kSnappyCompression supported: 1 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: kLZ4Compression supported: 1 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: kBZip2Compression supported: 0 2023-12-14T14:04:49.410 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.merge_operator: 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_filter: None 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_filter_factory: None 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.sst_partitioner_factory: None 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556e34acb4e0) 2023-12-14T14:04:49.411 INFO:journalctl@ceph.mon.b.smithi081.stdout: cache_index_and_filter_blocks: 1 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: pin_top_level_index_and_filter: 1 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: index_type: 0 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: data_block_index_type: 0 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: index_shortening: 1 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: checksum: 4 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: no_block_cache: 0 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: block_cache: 0x556e33ddd1f0 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: block_cache_name: BinnedLRUCache 2023-12-14T14:04:49.412 INFO:journalctl@ceph.mon.b.smithi081.stdout: block_cache_options: 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: capacity : 536870912 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: num_shard_bits : 4 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: strict_capacity_limit : 0 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: high_pri_pool_ratio: 0.000 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: block_cache_compressed: (nil) 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: persistent_cache: (nil) 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: block_size: 4096 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: block_size_deviation: 10 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: block_restart_interval: 16 2023-12-14T14:04:49.413 INFO:journalctl@ceph.mon.b.smithi081.stdout: index_block_restart_interval: 1 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: metadata_block_size: 4096 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: partition_filters: 0 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: use_delta_encoding: 1 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: filter_policy: bloomfilter 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: whole_key_filtering: 1 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: verify_compression: 0 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: read_amp_bytes_per_bit: 0 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: format_version: 5 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: enable_index_compression: 1 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: block_align: 0 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: max_auto_readahead_size: 262144 2023-12-14T14:04:49.414 INFO:journalctl@ceph.mon.b.smithi081.stdout: prepopulate_block_cache: 0 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout: initial_auto_readahead_size: 8192 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.write_buffer_size: 33554432 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_write_buffer_number: 2 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression: NoCompression 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression: Disabled 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.prefix_extractor: nullptr 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.num_levels: 7 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-14T14:04:49.415 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-14T14:04:49.416 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression_opts.level: 32767 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression_opts.strategy: 0 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression_opts.enabled: false 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-14T14:04:49.417 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.target_file_size_base: 67108864 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-14T14:04:49.418 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.arena_block_size: 1048576 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.disable_auto_compactions: 0 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-14T14:04:49.419 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.table_properties_collectors: 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.inplace_update_support: 0 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-14T14:04:49.420 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.bloom_locality: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.max_successive_merges: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.paranoid_file_checks: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.force_consistency_checks: 1 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.report_bg_io_stats: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.ttl: 2592000 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-14T14:04:49.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.enable_blob_files: false 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.min_blob_size: 0 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.blob_file_size: 268435456 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.blob_file_starting_level: 0 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-12-14T14:04:49.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f1e011a8-1f0c-4703-96ed-5b6c536fd0fe 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702562689011814, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702562689012213, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702562689, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f1e011a8-1f0c-4703-96ed-5b6c536fd0fe", "db_session_id": "3QDRVYHB1QGVQU1QCDNA", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702562689012278, "job": 1, "event": "recovery_finished"} 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556e33e7a000 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: DB pointer 0x556e33e66000 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-14T14:04:49.423 INFO:journalctl@ceph.mon.b.smithi081.stdout: ** DB Stats ** 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: ** Compaction Stats [default] ** 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-14T14:04:49.424 INFO:journalctl@ceph.mon.b.smithi081.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: ** Compaction Stats [default] ** 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: 2023-12-14T14:04:49.425 INFO:journalctl@ceph.mon.b.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: Cumulative compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: Interval compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: Block cache BinnedLRUCache@0x556e33ddd1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: 2023-12-14T14:04:49.426 INFO:journalctl@ceph.mon.b.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: using public_addr v2:172.21.15.81:0/0 -> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: starting mon.b rank -1 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(???) e0 preinit fsid 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 bash[43333]: 21e9b1054273de7a80584b0aaec85ef00d84cca006903b16cfacde2ba79e25e4 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 systemd[1]: Started Ceph mon.b for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).mds e1 new map 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).mds e1 print_map 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout: e1 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-14T14:04:49.427 INFO:journalctl@ceph.mon.b.smithi081.stdout: legacy client fscid: -1 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout: 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout: No filesystems configured 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T14:04:49.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi081:172.21.15.81=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: Saving service mon spec with placement smithi069:172.21.15.69=a;smithi081:172.21.15.81=b;smithi119:172.21.15.119=c;count:3 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:49.429 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: Deploying daemon mon.c on smithi119 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/499755600' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.a calling monitor election 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:49.430 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.c calling monitor election 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: monmap e2: 2 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: fsmap 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mgrmap e13: x(active, since 35s) 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: overall HEALTH_OK 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:49.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: Deploying daemon mon.b on smithi081 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/2991849447' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta expand map: {default=false} 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta from 'false' to 'false' 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta expanded map: {default=false} 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta expand map: {default=info} 2023-12-14T14:04:49.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta from 'info' to 'info' 2023-12-14T14:04:49.433 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta expanded map: {default=info} 2023-12-14T14:04:49.433 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta expand map: {default=daemon} 2023-12-14T14:04:49.433 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta from 'daemon' to 'daemon' 2023-12-14T14:04:49.433 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta expanded map: {default=daemon} 2023-12-14T14:04:49.433 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta expand map: {default=debug} 2023-12-14T14:04:49.433 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta from 'debug' to 'debug' 2023-12-14T14:04:49.433 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:49 smithi081 ceph-mon[43371]: expand_channel_meta expanded map: {default=debug} 2023-12-14T14:04:54.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.112+0000 7ff946100700 1 -- 172.21.15.119:0/1172963443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9280035c0 msgr2=0x7ff928005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:54.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.112+0000 7ff946100700 1 --2- 172.21.15.119:0/1172963443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9280035c0 0x7ff928005a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9400787c0 tx=0x7ff93000fe60 comp rx=0 tx=0).stop 2023-12-14T14:04:54.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.112+0000 7ff946100700 1 -- 172.21.15.119:0/1172963443 shutdown_connections 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.112+0000 7ff946100700 1 --2- 172.21.15.119:0/1172963443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9280035c0 0x7ff928005a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.112+0000 7ff946100700 1 -- 172.21.15.119:0/1172963443 >> 172.21.15.119:0/1172963443 conn(0x7ff940074c40 msgr2=0x7ff940075040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.112+0000 7ff946100700 1 -- 172.21.15.119:0/1172963443 shutdown_connections 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.112+0000 7ff946100700 1 -- 172.21.15.119:0/1172963443 wait complete. 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.113+0000 7ff946100700 1 Processor -- start 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.113+0000 7ff946100700 1 -- start start 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff946100700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 0x7ff9400ff880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff946100700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9400ffdc0 0x7ff940100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff946100700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9401a14d0 0x7ff9401a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff946100700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401a3f00 con 0x7ff9400ffdc0 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff946100700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401a4070 con 0x7ff9401a14d0 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff946100700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401a4230 con 0x7ff9280035c0 2023-12-14T14:04:54.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 0x7ff9400ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9400ffdc0 0x7ff940100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 0x7ff9400ff880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43568/0 (socket says 172.21.15.119:43568) 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93f7fe700 1 -- 172.21.15.119:0/9007676 learned_addr learned my addr 172.21.15.119:0/9007676 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93f7fe700 1 -- 172.21.15.119:0/9007676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 msgr2=0x7ff9400ff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93f7fe700 1 -- 172.21.15.119:0/9007676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 msgr2=0x7ff9400ff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93f7fe700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 0x7ff9400ff880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93f7fe700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 0x7ff9400ff880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93ffff700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9401a14d0 0x7ff9401a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93effd700 1 -- 172.21.15.119:0/9007676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 msgr2=0x7ff9400ff880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93effd700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 0x7ff9400ff880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93effd700 1 -- 172.21.15.119:0/9007676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9401a14d0 msgr2=0x7ff9401a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93effd700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9401a14d0 0x7ff9401a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93effd700 1 -- 172.21.15.119:0/9007676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93000f8b0 con 0x7ff9400ffdc0 2023-12-14T14:04:54.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.114+0000 7ff93ffff700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9401a14d0 0x7ff9401a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:04:54.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.115+0000 7ff93effd700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9400ffdc0 0x7ff940100230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff93400b550 tx=0x7ff93400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:54.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.115+0000 7ff93cff9700 1 -- 172.21.15.119:0/9007676 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934004230 con 0x7ff9400ffdc0 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.115+0000 7ff93cff9700 1 -- 172.21.15.119:0/9007676 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff934004390 con 0x7ff9400ffdc0 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.115+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff940107d10 con 0x7ff9400ffdc0 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.115+0000 7ff93cff9700 1 -- 172.21.15.119:0/9007676 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934011af0 con 0x7ff9400ffdc0 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.115+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff940107b80 con 0x7ff9400ffdc0 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.116+0000 7ff93cff9700 1 -- 172.21.15.119:0/9007676 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7ff934011c50 con 0x7ff9400ffdc0 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.116+0000 7ff93cff9700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff92c038d40 0x7ff92c03b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.116+0000 7ff93cff9700 1 -- 172.21.15.119:0/9007676 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff93404bd10 con 0x7ff9400ffdc0 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.116+0000 7ff93f7fe700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff92c038d40 0x7ff92c03b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.116+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff940107ea0 con 0x7ff9400ffdc0 2023-12-14T14:04:54.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.117+0000 7ff93f7fe700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff92c038d40 0x7ff92c03b1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff930015040 tx=0x7ff930001e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:54.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.122+0000 7ff93cff9700 1 -- 172.21.15.119:0/9007676 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff93401a400 con 0x7ff9400ffdc0 2023-12-14T14:04:54.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.416+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff9401a4e60 con 0x7ff9400ffdc0 2023-12-14T14:04:54.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.417+0000 7ff93cff9700 1 -- 172.21.15.119:0/9007676 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1270 (secure 0 0 0) 0x7ff934049020 con 0x7ff9400ffdc0 2023-12-14T14:04:54.416 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T14:04:54.416 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":3,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","modified":"2023-12-14T14:04:49.036364Z","created":"2023-12-14T14:03:25.682019Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-14T14:04:54.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff92c038d40 msgr2=0x7ff92c03b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:54.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff92c038d40 0x7ff92c03b1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff930015040 tx=0x7ff930001e50 comp rx=0 tx=0).stop 2023-12-14T14:04:54.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9400ffdc0 msgr2=0x7ff940100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:54.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9400ffdc0 0x7ff940100230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff93400b550 tx=0x7ff93400b910 comp rx=0 tx=0).stop 2023-12-14T14:04:54.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 shutdown_connections 2023-12-14T14:04:54.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff92c038d40 0x7ff92c03b1f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:54.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9401a14d0 0x7ff9401a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:54.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280035c0 0x7ff9400ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:54.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 --2- 172.21.15.119:0/9007676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9400ffdc0 0x7ff940100230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:54.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 >> 172.21.15.119:0/9007676 conn(0x7ff940074c40 msgr2=0x7ff940104300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:54.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 shutdown_connections 2023-12-14T14:04:54.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:54.419+0000 7ff946100700 1 -- 172.21.15.119:0/9007676 wait complete. 2023-12-14T14:04:54.419 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 3 2023-12-14T14:04:54.443 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:04:54.443 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: mon.a calling monitor election 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: mon.c calling monitor election 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: fsmap 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: mgrmap e13: x(active, since 43s) 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-14T14:04:54.444 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-14T14:04:54.445 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-14T14:04:54.445 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: mon.b (rank 2) addr [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] is down (out of quorum) 2023-12-14T14:04:54.445 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:54.445 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:54.445 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:54.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:04:54.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: mon.a calling monitor election 2023-12-14T14:04:54.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: mon.c calling monitor election 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: fsmap 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: mgrmap e13: x(active, since 43s) 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-14T14:04:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-14T14:04:54.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: mon.b (rank 2) addr [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] is down (out of quorum) 2023-12-14T14:04:54.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:54.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:54.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:54.789 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-14T14:04:54.790 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph config generate-minimal-conf 2023-12-14T14:04:55.107 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:04:55.401 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:55.401 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:55.401 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:55 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/9007676' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T14:04:55.401 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:55 smithi069 ceph-mon[42034]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:55.401 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:55.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:55.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:55.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:55 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/9007676' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T14:04:55.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:55 smithi119 ceph-mon[43834]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:55.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:56.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.157+0000 7f6c973e0700 1 -- 172.21.15.69:0/2418205661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 msgr2=0x7f6c900fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:56.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.157+0000 7f6c973e0700 1 --2- 172.21.15.69:0/2418205661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 0x7f6c900fef40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009910 tx=0x7f6c8c009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:56.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.157+0000 7f6c973e0700 1 -- 172.21.15.69:0/2418205661 shutdown_connections 2023-12-14T14:04:56.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.157+0000 7f6c973e0700 1 --2- 172.21.15.69:0/2418205661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 0x7f6c900fef40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:56.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.157+0000 7f6c973e0700 1 -- 172.21.15.69:0/2418205661 >> 172.21.15.69:0/2418205661 conn(0x7f6c90074930 msgr2=0x7f6c90074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:56.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 -- 172.21.15.69:0/2418205661 shutdown_connections 2023-12-14T14:04:56.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 -- 172.21.15.69:0/2418205661 wait complete. 2023-12-14T14:04:56.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 Processor -- start 2023-12-14T14:04:56.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 -- start start 2023-12-14T14:04:56.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 0x7f6c901975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:56.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c90197af0 0x7f6c9019bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:56.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c9019c4a0 0x7f6c9019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:56.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c901981c0 con 0x7f6c900feb70 2023-12-14T14:04:56.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c901a4210 con 0x7f6c90197af0 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c973e0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c901a4350 con 0x7f6c9019c4a0 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.158+0000 7f6c9517c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 0x7f6c901975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9517c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 0x7f6c901975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59834/0 (socket says 172.21.15.69:59834) 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9517c700 1 -- 172.21.15.69:0/2367703066 learned_addr learned my addr 172.21.15.69:0/2367703066 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9497b700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c90197af0 0x7f6c9019bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9597d700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c9019c4a0 0x7f6c9019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9497b700 1 -- 172.21.15.69:0/2367703066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c90197af0 msgr2=0x7f6c9019bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9497b700 1 -- 172.21.15.69:0/2367703066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c90197af0 msgr2=0x7f6c9019bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9497b700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c90197af0 0x7f6c9019bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9497b700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c90197af0 0x7f6c9019bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9597d700 1 -- 172.21.15.69:0/2367703066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c9019c4a0 msgr2=0x7f6c9019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9597d700 1 -- 172.21.15.69:0/2367703066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c9019c4a0 msgr2=0x7f6c9019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9597d700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c9019c4a0 0x7f6c9019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9597d700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c9019c4a0 0x7f6c9019c940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:04:56.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9517c700 1 -- 172.21.15.69:0/2367703066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c9019c4a0 msgr2=0x7f6c9019c940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9517c700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c9019c4a0 0x7f6c9019c940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9517c700 1 -- 172.21.15.69:0/2367703066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c90197af0 msgr2=0x7f6c9019bf60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9517c700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c90197af0 0x7f6c9019bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9517c700 1 -- 172.21.15.69:0/2367703066 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0095f0 con 0x7f6c900feb70 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c9517c700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 0x7f6c901975b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c004ca0 tx=0x7f6c8c004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c867fc700 1 -- 172.21.15.69:0/2367703066 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c01d070 con 0x7f6c900feb70 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c867fc700 1 -- 172.21.15.69:0/2367703066 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c8c00be20 con 0x7f6c900feb70 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9010c390 con 0x7f6c900feb70 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c867fc700 1 -- 172.21.15.69:0/2367703066 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c022e10 con 0x7f6c900feb70 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.159+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9010c200 con 0x7f6c900feb70 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.160+0000 7f6c867fc700 1 -- 172.21.15.69:0/2367703066 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f6c8c00f460 con 0x7f6c900feb70 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.160+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9010c520 con 0x7f6c900feb70 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.160+0000 7f6c867fc700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6c7c038d40 0x7f6c7c03b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.160+0000 7f6c867fc700 1 -- 172.21.15.69:0/2367703066 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6c8c04c9e0 con 0x7f6c900feb70 2023-12-14T14:04:56.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.160+0000 7f6c9497b700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6c7c038d40 0x7f6c7c03b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:56.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.161+0000 7f6c9497b700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6c7c038d40 0x7f6c7c03b1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009850 tx=0x7f6c80008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:56.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.165+0000 7f6c867fc700 1 -- 172.21.15.69:0/2367703066 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6c8c00fb30 con 0x7f6c900feb70 2023-12-14T14:04:56.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.385+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f6c901a4d60 con 0x7f6c900feb70 2023-12-14T14:04:56.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.385+0000 7f6c867fc700 1 -- 172.21.15.69:0/2367703066 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f6c8c027020 con 0x7f6c900feb70 2023-12-14T14:04:56.384 INFO:teuthology.orchestra.run.smithi069.stdout:# minimal ceph.conf for 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:04:56.384 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2023-12-14T14:04:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:04:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: mon_host = [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2023-12-14T14:04:56.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.387+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6c7c038d40 msgr2=0x7f6c7c03b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:56.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.387+0000 7f6c973e0700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6c7c038d40 0x7f6c7c03b1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009850 tx=0x7f6c80008040 comp rx=0 tx=0).stop 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.387+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 msgr2=0x7f6c901975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.387+0000 7f6c973e0700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 0x7f6c901975b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c004ca0 tx=0x7f6c8c004d80 comp rx=0 tx=0).stop 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.387+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 shutdown_connections 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.388+0000 7f6c973e0700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6c7c038d40 0x7f6c7c03b1f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.388+0000 7f6c973e0700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c9019c4a0 0x7f6c9019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.388+0000 7f6c973e0700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c900feb70 0x7f6c901975b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.388+0000 7f6c973e0700 1 --2- 172.21.15.69:0/2367703066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c90197af0 0x7f6c9019bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.388+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 >> 172.21.15.69:0/2367703066 conn(0x7f6c90074930 msgr2=0x7f6c901071a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.388+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 shutdown_connections 2023-12-14T14:04:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:04:56.388+0000 7f6c973e0700 1 -- 172.21.15.69:0/2367703066 wait complete. 2023-12-14T14:04:56.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:04:56.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mon.a calling monitor election 2023-12-14T14:04:56.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mon.c calling monitor election 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: fsmap 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:56.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mgrmap e13: x(active, since 43s) 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mon.b (rank 2) addr [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] is down (out of quorum) 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/9007676' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:56.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:57.013 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: mon.b calling monitor election 2023-12-14T14:04:57.013 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: mon.b calling monitor election 2023-12-14T14:04:57.013 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: mon.c calling monitor election 2023-12-14T14:04:57.013 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: mon.a calling monitor election 2023-12-14T14:04:57.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-14T14:04:57.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T14:04:57.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: fsmap 2023-12-14T14:04:57.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:57.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: mgrmap e13: x(active, since 45s) 2023-12-14T14:04:57.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-14T14:04:57.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: Cluster is now healthy 2023-12-14T14:04:57.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: overall HEALTH_OK 2023-12-14T14:04:57.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:56 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2367703066' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:57.015 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-14T14:04:57.015 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:04:57.015 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.conf 2023-12-14T14:04:57.044 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:04:57.044 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:04:57.111 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T14:04:57.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2023-12-14T14:04:57.143 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mon.b calling monitor election 2023-12-14T14:04:57.143 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mon.b calling monitor election 2023-12-14T14:04:57.143 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mon.c calling monitor election 2023-12-14T14:04:57.143 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mon.a calling monitor election 2023-12-14T14:04:57.143 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-14T14:04:57.143 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T14:04:57.143 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: fsmap 2023-12-14T14:04:57.144 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:57.144 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: mgrmap e13: x(active, since 45s) 2023-12-14T14:04:57.144 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-14T14:04:57.144 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: Cluster is now healthy 2023-12-14T14:04:57.144 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: overall HEALTH_OK 2023-12-14T14:04:57.144 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:56 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2367703066' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:57.148 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T14:04:57.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:04:57.220 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T14:04:57.220 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.conf 2023-12-14T14:04:57.250 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: mon.b calling monitor election 2023-12-14T14:04:57.250 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: mon.b calling monitor election 2023-12-14T14:04:57.250 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: mon.c calling monitor election 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: mon.a calling monitor election 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: fsmap 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: mgrmap e13: x(active, since 45s) 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: Cluster is now healthy 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: overall HEALTH_OK 2023-12-14T14:04:57.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:56 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2367703066' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:57.255 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T14:04:57.255 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:04:57.326 INFO:tasks.cephadm:Adding mgr.x on smithi069 2023-12-14T14:04:57.326 INFO:tasks.cephadm:Adding mgr.y on smithi081 2023-12-14T14:04:57.326 INFO:tasks.cephadm:Adding mgr.z on smithi119 2023-12-14T14:04:57.326 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch apply mgr '3;smithi069=x;smithi081=y;smithi119=z' 2023-12-14T14:04:57.669 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:04:58.059 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:57 smithi081 ceph-mon[43371]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:58.059 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:58.059 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:58.059 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:58.059 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:58.059 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T14:04:58.059 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:58.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:57 smithi069 ceph-mon[42034]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:58.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:58.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:58.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:58.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:58.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T14:04:58.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:58.217 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:57 smithi119 ceph-mon[43834]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:04:58.218 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:04:58.218 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:58.218 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:58.218 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:58.218 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T14:04:58.218 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:58.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.718+0000 7f2b824af700 1 -- 172.21.15.119:0/1744696498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b7c0ffe40 msgr2=0x7f2b7c100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:58.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.718+0000 7f2b824af700 1 --2- 172.21.15.119:0/1744696498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b7c0ffe40 0x7f2b7c100250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009910 tx=0x7f2b70009c20 comp rx=0 tx=0).stop 2023-12-14T14:04:58.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.718+0000 7f2b824af700 1 -- 172.21.15.119:0/1744696498 shutdown_connections 2023-12-14T14:04:58.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.718+0000 7f2b824af700 1 --2- 172.21.15.119:0/1744696498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b7c0ffe40 0x7f2b7c100250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:58.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.718+0000 7f2b824af700 1 -- 172.21.15.119:0/1744696498 >> 172.21.15.119:0/1744696498 conn(0x7f2b7c0fb3f0 msgr2=0x7f2b7c0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:58.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.718+0000 7f2b824af700 1 -- 172.21.15.119:0/1744696498 shutdown_connections 2023-12-14T14:04:58.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.718+0000 7f2b824af700 1 -- 172.21.15.119:0/1744696498 wait complete. 2023-12-14T14:04:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.718+0000 7f2b824af700 1 Processor -- start 2023-12-14T14:04:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.718+0000 7f2b824af700 1 -- start start 2023-12-14T14:04:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b824af700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b7c0ffe40 0x7f2b7c195070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b824af700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b7c1955b0 0x7f2b7c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b824af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b7c195a20 0x7f2b7c19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b824af700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c19d330 con 0x7f2b7c0ffe40 2023-12-14T14:04:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b824af700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c19d4a0 con 0x7f2b7c195a20 2023-12-14T14:04:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b824af700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c19d660 con 0x7f2b7c1955b0 2023-12-14T14:04:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b7c1955b0 0x7f2b7c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b7c1955b0 0x7f2b7c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47924/0 (socket says 172.21.15.119:47924) 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b7c0ffe40 0x7f2b7c195070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7b7fe700 1 -- 172.21.15.119:0/2512032560 learned_addr learned my addr 172.21.15.119:0/2512032560 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7b7fe700 1 -- 172.21.15.119:0/2512032560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b7c195a20 msgr2=0x7f2b7c19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7b7fe700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b7c195a20 0x7f2b7c19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7b7fe700 1 -- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b7c0ffe40 msgr2=0x7f2b7c195070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7b7fe700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b7c0ffe40 0x7f2b7c195070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7b7fe700 1 -- 172.21.15.119:0/2512032560 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700095f0 con 0x7f2b7c1955b0 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7bfff700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b7c0ffe40 0x7f2b7c195070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b7b7fe700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b7c1955b0 0x7f2b7c19a620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00b780 tx=0x7f2b6c00ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b797fa700 1 -- 172.21.15.119:0/2512032560 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c004230 con 0x7f2b7c1955b0 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c105c40 con 0x7f2b7c1955b0 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b797fa700 1 -- 172.21.15.119:0/2512032560 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b6c004390 con 0x7f2b7c1955b0 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.719+0000 7f2b797fa700 1 -- 172.21.15.119:0/2512032560 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c011ad0 con 0x7f2b7c1955b0 2023-12-14T14:04:58.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.720+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c105ab0 con 0x7f2b7c1955b0 2023-12-14T14:04:58.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.720+0000 7f2b797fa700 1 -- 172.21.15.119:0/2512032560 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f2b6c011c30 con 0x7f2b7c1955b0 2023-12-14T14:04:58.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.720+0000 7f2b797fa700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2b64038cf0 0x7f2b6403b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:04:58.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.720+0000 7f2b797fa700 1 -- 172.21.15.119:0/2512032560 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2b6c04acf0 con 0x7f2b7c1955b0 2023-12-14T14:04:58.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.721+0000 7f2b7bfff700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2b64038cf0 0x7f2b6403b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:04:58.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.721+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c18e970 con 0x7f2b7c1955b0 2023-12-14T14:04:58.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.721+0000 7f2b7bfff700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2b64038cf0 0x7f2b6403b1a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b70000c00 tx=0x7f2b70005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:04:58.725 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.726+0000 7f2b797fa700 1 -- 172.21.15.119:0/2512032560 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2b6c01a400 con 0x7f2b7c1955b0 2023-12-14T14:04:58.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.946+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi081=y;smithi119=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b7c061c30 con 0x7f2b64038cf0 2023-12-14T14:04:58.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.953+0000 7f2b797fa700 1 -- 172.21.15.119:0/2512032560 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f2b7c061c30 con 0x7f2b64038cf0 2023-12-14T14:04:58.953 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mgr update... 2023-12-14T14:04:58.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2b64038cf0 msgr2=0x7f2b6403b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:58.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2b64038cf0 0x7f2b6403b1a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b70000c00 tx=0x7f2b70005fd0 comp rx=0 tx=0).stop 2023-12-14T14:04:58.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b7c1955b0 msgr2=0x7f2b7c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:04:58.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b7c1955b0 0x7f2b7c19a620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00b780 tx=0x7f2b6c00ba90 comp rx=0 tx=0).stop 2023-12-14T14:04:58.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 shutdown_connections 2023-12-14T14:04:58.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2b64038cf0 0x7f2b6403b1a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:58.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b7c195a20 0x7f2b7c19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:58.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b7c0ffe40 0x7f2b7c195070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:58.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 --2- 172.21.15.119:0/2512032560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b7c1955b0 0x7f2b7c19a620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:04:58.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 >> 172.21.15.119:0/2512032560 conn(0x7f2b7c0fb3f0 msgr2=0x7f2b7c0fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:04:58.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 shutdown_connections 2023-12-14T14:04:58.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:04:58.955+0000 7f2b824af700 1 -- 172.21.15.119:0/2512032560 wait complete. 2023-12-14T14:04:59.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:58 smithi069 ceph-mon[42034]: Reconfiguring mon.b (monmap changed)... 2023-12-14T14:04:59.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:58 smithi069 ceph-mon[42034]: Reconfiguring daemon mon.b on smithi081 2023-12-14T14:04:59.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:59.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:59.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:59.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T14:04:59.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:59.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:58 smithi081 ceph-mon[43371]: Reconfiguring mon.b (monmap changed)... 2023-12-14T14:04:59.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:58 smithi081 ceph-mon[43371]: Reconfiguring daemon mon.b on smithi081 2023-12-14T14:04:59.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:59.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:59.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:59.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T14:04:59.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:59.231 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:58 smithi119 ceph-mon[43834]: Reconfiguring mon.b (monmap changed)... 2023-12-14T14:04:59.231 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:58 smithi119 ceph-mon[43834]: Reconfiguring daemon mon.b on smithi081 2023-12-14T14:04:59.231 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:59.231 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:04:59.231 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T14:04:59.231 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T14:04:59.231 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:04:59.712 DEBUG:teuthology.orchestra.run.smithi081:mgr.y> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.y.service 2023-12-14T14:04:59.714 DEBUG:teuthology.orchestra.run.smithi119:mgr.z> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.z.service 2023-12-14T14:04:59.716 INFO:tasks.cephadm:Deploying OSDs... 2023-12-14T14:04:59.716 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:04:59.716 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2023-12-14T14:04:59.738 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-14T14:04:59.738 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2023-12-14T14:04:59.747 INFO:journalctl@ceph.mgr.z.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:04:59.749 INFO:journalctl@ceph.mgr.y.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:04:59.798 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-14T14:04:59.798 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:04:59.798 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 123583 Links: 1 2023-12-14T14:04:59.798 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:04:59.798 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:04:59.798 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 14:04:19.556927601 +0000 2023-12-14T14:04:59.798 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 13:57:03.482204543 +0000 2023-12-14T14:04:59.799 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 13:57:03.482204543 +0000 2023-12-14T14:04:59.799 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-12-14T14:04:59.799 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-14T14:04:59.869 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-14T14:04:59.869 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-14T14:04:59.870 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000251497 s, 2.0 MB/s 2023-12-14T14:04:59.871 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-14T14:04:59.932 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2023-12-14T14:04:59.990 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-14T14:04:59.990 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:04:59.991 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 124260 Links: 1 2023-12-14T14:04:59.991 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:04:59.991 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:04:59.991 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 14:04:19.556927601 +0000 2023-12-14T14:04:59.991 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 13:57:03.975193099 +0000 2023-12-14T14:04:59.991 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 13:57:03.975193099 +0000 2023-12-14T14:04:59.991 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-12-14T14:04:59.991 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-14T14:05:00.057 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-14T14:05:00.057 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-14T14:05:00.058 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000210434 s, 2.4 MB/s 2023-12-14T14:05:00.059 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-14T14:05:00.117 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2023-12-14T14:05:00.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: Reconfiguring mon.c (monmap changed)... 2023-12-14T14:05:00.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: Reconfiguring daemon mon.c on smithi119 2023-12-14T14:05:00.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi081=y;smithi119=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: Saving service mgr spec with placement smithi069=x;smithi081=y;smithi119=z;count:3 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T14:05:00.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:04:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:00.175 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-14T14:05:00.175 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:00.175 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 129139 Links: 1 2023-12-14T14:05:00.175 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:00.176 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:00.176 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 14:04:19.556927601 +0000 2023-12-14T14:05:00.176 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 13:57:04.472181562 +0000 2023-12-14T14:05:00.176 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 13:57:04.472181562 +0000 2023-12-14T14:05:00.176 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-12-14T14:05:00.176 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: Reconfiguring mon.c (monmap changed)... 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: Reconfiguring daemon mon.c on smithi119 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi081=y;smithi119=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: Saving service mgr spec with placement smithi069=x;smithi081=y;smithi119=z;count:3 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:00.240 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:00.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T14:05:00.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T14:05:00.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T14:05:00.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:04:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:00.242 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-14T14:05:00.242 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-14T14:05:00.242 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000223793 s, 2.3 MB/s 2023-12-14T14:05:00.243 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-14T14:05:00.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: Reconfiguring mon.c (monmap changed)... 2023-12-14T14:05:00.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: Reconfiguring daemon mon.c on smithi119 2023-12-14T14:05:00.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi081=y;smithi119=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: Saving service mgr spec with placement smithi069=x;smithi081=y;smithi119=z;count:3 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T14:05:00.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:04:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:00.302 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2023-12-14T14:05:00.359 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-14T14:05:00.359 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:00.359 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 121346 Links: 1 2023-12-14T14:05:00.359 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:00.359 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:00.359 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 14:04:19.556927601 +0000 2023-12-14T14:05:00.359 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 13:57:04.979169793 +0000 2023-12-14T14:05:00.359 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 13:57:04.979169793 +0000 2023-12-14T14:05:00.360 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-12-14T14:05:00.360 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-14T14:05:00.425 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-14T14:05:00.425 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-14T14:05:00.425 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000242856 s, 2.1 MB/s 2023-12-14T14:05:00.426 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-14T14:05:00.484 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-14T14:05:00.484 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2023-12-14T14:05:00.505 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-14T14:05:00.505 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2023-12-14T14:05:00.566 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-14T14:05:00.566 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:00.567 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 120410 Links: 1 2023-12-14T14:05:00.567 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:00.567 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:00.567 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-12-14 14:04:48.613878806 +0000 2023-12-14T14:05:00.567 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-12-14 13:57:15.133464646 +0000 2023-12-14T14:05:00.567 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-12-14 13:57:15.133464646 +0000 2023-12-14T14:05:00.567 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-12-14T14:05:00.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-14T14:05:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-12-14T14:05:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-12-14T14:05:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000249173 s, 2.1 MB/s 2023-12-14T14:05:00.638 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-14T14:05:00.697 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2023-12-14T14:05:00.756 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-14T14:05:00.756 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:00.757 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 127390 Links: 1 2023-12-14T14:05:00.757 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:00.757 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:00.757 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-12-14 14:04:48.613878806 +0000 2023-12-14T14:05:00.757 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-12-14 13:57:15.620455340 +0000 2023-12-14T14:05:00.757 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-12-14 13:57:15.620455340 +0000 2023-12-14T14:05:00.757 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-12-14T14:05:00.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-14T14:05:00.824 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-12-14T14:05:00.824 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-12-14T14:05:00.824 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00023455 s, 2.2 MB/s 2023-12-14T14:05:00.825 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-14T14:05:00.885 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2023-12-14T14:05:00.943 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-14T14:05:00.943 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:00.943 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 125381 Links: 1 2023-12-14T14:05:00.943 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:00.943 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:00.943 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-12-14 14:04:48.613878806 +0000 2023-12-14T14:05:00.944 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-12-14 13:57:16.108446016 +0000 2023-12-14T14:05:00.944 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-12-14 13:57:16.108446016 +0000 2023-12-14T14:05:00.944 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-12-14T14:05:00.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-14T14:05:00.957 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:00 smithi119 systemd[1]: Starting Ceph mgr.z for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:05:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-12-14T14:05:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-12-14T14:05:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000259729 s, 2.0 MB/s 2023-12-14T14:05:01.011 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-14T14:05:01.069 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2023-12-14T14:05:01.127 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-14T14:05:01.127 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:01.127 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 126758 Links: 1 2023-12-14T14:05:01.127 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:01.127 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:01.127 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-12-14 14:04:48.613878806 +0000 2023-12-14T14:05:01.127 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-12-14 13:57:16.604436539 +0000 2023-12-14T14:05:01.127 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-12-14 13:57:16.604436539 +0000 2023-12-14T14:05:01.128 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-12-14T14:05:01.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-14T14:05:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-12-14T14:05:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-12-14T14:05:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000242406 s, 2.1 MB/s 2023-12-14T14:05:01.194 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-14T14:05:01.252 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T14:05:01.252 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2023-12-14T14:05:01.271 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-14T14:05:01.271 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2023-12-14T14:05:01.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:00 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:01.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:00 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:05:01.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:00 smithi119 ceph-mon[43834]: Deploying daemon mgr.z on smithi119 2023-12-14T14:05:01.292 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-14T14:05:01.292 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:01.293 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 123570 Links: 1 2023-12-14T14:05:01.293 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:01.293 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:01.293 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-14 14:05:00.713913719 +0000 2023-12-14T14:05:01.293 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-14 13:57:29.528257878 +0000 2023-12-14T14:05:01.293 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-14 13:57:29.528257878 +0000 2023-12-14T14:05:01.293 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-12-14T14:05:01.293 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-14T14:05:01.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:00 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:01.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:00 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:05:01.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:00 smithi069 ceph-mon[42034]: Deploying daemon mgr.z on smithi119 2023-12-14T14:05:01.362 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-14T14:05:01.362 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-14T14:05:01.363 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000253063 s, 2.0 MB/s 2023-12-14T14:05:01.364 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-14T14:05:01.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:00 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:01.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:00 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:05:01.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:00 smithi081 ceph-mon[43371]: Deploying daemon mgr.z on smithi119 2023-12-14T14:05:01.422 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2023-12-14T14:05:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-14T14:05:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:01.480 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 130103 Links: 1 2023-12-14T14:05:01.480 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:01.480 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:01.480 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-14 14:05:00.713913719 +0000 2023-12-14T14:05:01.481 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-14 13:57:30.029245376 +0000 2023-12-14T14:05:01.481 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-14 13:57:30.029245376 +0000 2023-12-14T14:05:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-12-14T14:05:01.481 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-14T14:05:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-14T14:05:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-14T14:05:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000248285 s, 2.1 MB/s 2023-12-14T14:05:01.548 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-14T14:05:01.606 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2023-12-14T14:05:01.654 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-mgr[45730]: -- 172.21.15.119:0/3862580336 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5639dc3eb520 con 0x5639dc3c0800 2023-12-14T14:05:01.654 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:01 smithi119 bash[45661]: cb8df0c00c3ce261294077e5fca88a7f2a1f46e6c6724cb407fd6ce07c0fcccc 2023-12-14T14:05:01.654 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:01 smithi119 systemd[1]: Started Ceph mgr.z for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:05:01.664 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-14T14:05:01.664 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:01.664 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 130172 Links: 1 2023-12-14T14:05:01.664 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:01.664 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:01.664 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-14 14:05:00.713913719 +0000 2023-12-14T14:05:01.664 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-14 13:57:30.530232874 +0000 2023-12-14T14:05:01.664 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-14 13:57:30.530232874 +0000 2023-12-14T14:05:01.664 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-12-14T14:05:01.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-14T14:05:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-14T14:05:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-14T14:05:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000319961 s, 1.6 MB/s 2023-12-14T14:05:01.735 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-14T14:05:01.794 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2023-12-14T14:05:01.854 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-14T14:05:01.854 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T14:05:01.854 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 130308 Links: 1 2023-12-14T14:05:01.854 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:05:01.854 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T14:05:01.854 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-14 14:05:00.713913719 +0000 2023-12-14T14:05:01.854 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-14 13:57:31.010220896 +0000 2023-12-14T14:05:01.854 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-14 13:57:31.010220896 +0000 2023-12-14T14:05:01.854 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-12-14T14:05:01.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-14T14:05:01.921 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:01.654+0000 7ffaa89c8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T14:05:01.921 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:01.763+0000 7ffaa89c8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T14:05:01.921 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:01.858+0000 7ffaa89c8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T14:05:01.923 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-14T14:05:01.924 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-14T14:05:01.924 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000240142 s, 2.1 MB/s 2023-12-14T14:05:01.925 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-14T14:05:01.985 INFO:tasks.cephadm:Deploying osd.0 on smithi069 with /dev/vg_nvme/lv_4... 2023-12-14T14:05:01.985 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-14T14:05:02.267 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:01 smithi081 ceph-mon[43371]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:02.267 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:02.267 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:02.267 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:02.268 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T14:05:02.268 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T14:05:02.268 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T14:05:02.268 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:02.274 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:01.948+0000 7ffaa89c8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T14:05:02.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-mon[43834]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:02.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:02.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:02.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:02.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T14:05:02.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T14:05:02.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T14:05:02.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:05:02.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:01 smithi069 ceph-mon[42034]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:02.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:02.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:02.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:02.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T14:05:02.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T14:05:02.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T14:05:02.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:02.878 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:02 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:02.565+0000 7ffaa89c8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:05:02.878 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:02 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:02.795+0000 7ffaa89c8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T14:05:02.898 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:02 smithi081 systemd[1]: Starting Ceph mgr.y for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:05:03.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:02 smithi069 ceph-mon[42034]: Deploying daemon mgr.y on smithi081 2023-12-14T14:05:03.269 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:02 smithi119 ceph-mon[43834]: Deploying daemon mgr.y on smithi081 2023-12-14T14:05:03.270 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:02 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:02.878+0000 7ffaa89c8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T14:05:03.270 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:02 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:02.987+0000 7ffaa89c8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T14:05:03.270 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:03.076+0000 7ffaa89c8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T14:05:03.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:02 smithi081 ceph-mon[43371]: Deploying daemon mgr.y on smithi081 2023-12-14T14:05:03.398 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-mgr[44846]: -- 172.21.15.81:0/3094429919 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555bceb09520 con 0x555bceade800 2023-12-14T14:05:03.398 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:03 smithi081 bash[44808]: b0db393e08866d39fcfdee8259b600879aa1372f289376baaf2fdf02f328c2bf 2023-12-14T14:05:03.398 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:03 smithi081 systemd[1]: Started Ceph mgr.y for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:05:03.524 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:03.269+0000 7ffaa89c8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T14:05:03.524 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:03.357+0000 7ffaa89c8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T14:05:03.607 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-14T14:05:03.607 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-14T14:05:03.608 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2023-12-14T14:05:03.608 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2023-12-14T14:05:03.608 INFO:teuthology.orchestra.run.smithi069.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110249 s, 951 MB/s 2023-12-14T14:05:03.608 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2023-12-14T14:05:03.735 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:03.436+0000 7f44f7532200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T14:05:03.735 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:03.545+0000 7f44f7532200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T14:05:03.735 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:03.638+0000 7f44f7532200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T14:05:03.735 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:03.735+0000 7f44f7532200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T14:05:04.004 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi069:vg_nvme/lv_4 2023-12-14T14:05:04.024 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:03.770+0000 7ffaa89c8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T14:05:04.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-mon[43834]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:04.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-mon[43371]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:04.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:04.318 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:05:04.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:03 smithi069 ceph-mon[42034]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:04.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:04.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:04.341 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:04.050+0000 7ffaa89c8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T14:05:04.647 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:04.393+0000 7f44f7532200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:05:04.647 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:04.622+0000 7f44f7532200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T14:05:04.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:04.341+0000 7ffaa89c8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T14:05:04.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:04.438+0000 7ffaa89c8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T14:05:04.965 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:04.706+0000 7f44f7532200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T14:05:04.965 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:04.812+0000 7f44f7532200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T14:05:04.965 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:04.901+0000 7f44f7532200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T14:05:05.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:05.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.056 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:05.057 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:05.057 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.057 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T14:05:05.057 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T14:05:05.057 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:05.274 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:05.182+0000 7ffaa89c8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T14:05:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T14:05:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T14:05:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:05.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 -- 172.21.15.69:0/2601821237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380ffe60 msgr2=0x7f3f381002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:05.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/2601821237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380ffe60 0x7f3f381002d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000b0a0 tx=0x7f3f3000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:05:05.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 -- 172.21.15.69:0/2601821237 shutdown_connections 2023-12-14T14:05:05.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/2601821237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380ffe60 0x7f3f381002d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:05.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/2601821237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f380feb60 0x7f3f380fef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:05.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/2601821237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f380ff4b0 0x7f3f380ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:05.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 -- 172.21.15.69:0/2601821237 >> 172.21.15.69:0/2601821237 conn(0x7f3f380fa7f0 msgr2=0x7f3f380fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:05:05.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 -- 172.21.15.69:0/2601821237 shutdown_connections 2023-12-14T14:05:05.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 -- 172.21.15.69:0/2601821237 wait complete. 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 Processor -- start 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.373+0000 7f3f3fa13700 1 -- start start 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3fa13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380feb60 0x7f3f38198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3fa13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f380ff4b0 0x7f3f38198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3fa13700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f380ffe60 0x7f3f3819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3fa13700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3819fec0 con 0x7f3f380feb60 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3fa13700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f381a0000 con 0x7f3f380ff4b0 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3fa13700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f381a0190 con 0x7f3f380ffe60 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3d7af700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380feb60 0x7f3f38198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3d7af700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380feb60 0x7f3f38198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42448/0 (socket says 172.21.15.69:42448) 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3d7af700 1 -- 172.21.15.69:0/3460172384 learned_addr learned my addr 172.21.15.69:0/3460172384 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:05:05.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3cfae700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f380ff4b0 0x7f3f38198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3dfb0700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f380ffe60 0x7f3f3819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3d7af700 1 -- 172.21.15.69:0/3460172384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f380ffe60 msgr2=0x7f3f3819f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3d7af700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f380ffe60 0x7f3f3819f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3d7af700 1 -- 172.21.15.69:0/3460172384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f380ff4b0 msgr2=0x7f3f38198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3d7af700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f380ff4b0 0x7f3f38198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3d7af700 1 -- 172.21.15.69:0/3460172384 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30009d00 con 0x7f3f380feb60 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3d7af700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380feb60 0x7f3f38198330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400d9b0 tx=0x7f3f3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f2e7fc700 1 -- 172.21.15.69:0/3460172384 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34004220 con 0x7f3f380feb60 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f2e7fc700 1 -- 172.21.15.69:0/3460172384 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f34007640 con 0x7f3f380feb60 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f2e7fc700 1 -- 172.21.15.69:0/3460172384 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34005590 con 0x7f3f380feb60 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3810de20 con 0x7f3f380feb60 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.374+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3810dc90 con 0x7f3f380feb60 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.375+0000 7f3f2e7fc700 1 -- 172.21.15.69:0/3460172384 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f3f34004830 con 0x7f3f380feb60 2023-12-14T14:05:05.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.375+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f38109940 con 0x7f3f380feb60 2023-12-14T14:05:05.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.375+0000 7f3f2e7fc700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3f240389e0 0x7f3f2403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:05.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.375+0000 7f3f2e7fc700 1 -- 172.21.15.69:0/3460172384 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3f3404b000 con 0x7f3f380feb60 2023-12-14T14:05:05.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.375+0000 7f3f3cfae700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3f240389e0 0x7f3f2403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:05.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.376+0000 7f3f3cfae700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3f240389e0 0x7f3f2403ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f28005950 tx=0x7f3f2800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:05:05.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.380+0000 7f3f2e7fc700 1 -- 172.21.15.69:0/3460172384 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3f3407d730 con 0x7f3f380feb60 2023-12-14T14:05:05.397 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:05.092+0000 7f44f7532200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T14:05:05.397 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:05.176+0000 7f44f7532200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T14:05:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:05.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:05.580+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f38061c90 con 0x7f3f240389e0 2023-12-14T14:05:05.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:05.277+0000 7ffaa89c8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T14:05:05.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:05.424+0000 7ffaa89c8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T14:05:05.802 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:05.543+0000 7f44f7532200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T14:05:06.085 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:05.803+0000 7f44f7532200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T14:05:06.085 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:06.085 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:05:06.085 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:06.085 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: Reconfiguring mgr.x (unknown last config time)... 2023-12-14T14:05:06.085 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: Reconfiguring daemon mgr.x on smithi069 2023-12-14T14:05:06.085 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:06.086 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.233 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:06 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:06.052+0000 7ffaa89c8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T14:05:06.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:06.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:05:06.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:06.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: Reconfiguring mgr.x (unknown last config time)... 2023-12-14T14:05:06.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: Reconfiguring daemon mgr.x on smithi069 2023-12-14T14:05:06.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:06.234 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: Reconfiguring mgr.x (unknown last config time)... 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: Reconfiguring daemon mgr.x on smithi069 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:06.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:06.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:06.397 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:06 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:06.085+0000 7f44f7532200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T14:05:06.397 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:06 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:06.177+0000 7f44f7532200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T14:05:06.524 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:06 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:06.233+0000 7ffaa89c8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T14:05:06.524 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:06 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:06.425+0000 7ffaa89c8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T14:05:07.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:06 smithi069 ceph-mon[42034]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:07.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:06 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:07.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:06 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:05:07.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:06 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:07.274 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:07.124+0000 7ffaa89c8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T14:05:07.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:06 smithi119 ceph-mon[43834]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:07.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:06 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:07.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:06 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:05:07.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:06 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:07.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:06 smithi081 ceph-mon[43371]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:07.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:06 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:07.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:06 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:05:07.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:06 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:07.398 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:06 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:06.933+0000 7f44f7532200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T14:05:07.398 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:07.028+0000 7f44f7532200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T14:05:07.398 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:07.175+0000 7f44f7532200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T14:05:07.869 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:07.594+0000 7ffaa89c8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:05:07.870 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:07.682+0000 7ffaa89c8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T14:05:07.870 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:05:07.870+0000 7ffaa89c8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T14:05:08.147 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:07.793+0000 7f44f7532200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T14:05:08.147 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:07.974+0000 7f44f7532200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T14:05:08.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:08.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4217185025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "626f1f59-a1b9-4b5a-a8ad-3f2866697db1"}]: dispatch 2023-12-14T14:05:08.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4217185025' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "626f1f59-a1b9-4b5a-a8ad-3f2866697db1"}]': finished 2023-12-14T14:05:08.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: osdmap e5: 1 total, 0 up, 1 in 2023-12-14T14:05:08.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:08.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: Standby manager daemon z started 2023-12-14T14:05:08.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-14T14:05:08.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:05:08.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-14T14:05:08.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:07 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:05:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4217185025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "626f1f59-a1b9-4b5a-a8ad-3f2866697db1"}]: dispatch 2023-12-14T14:05:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4217185025' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "626f1f59-a1b9-4b5a-a8ad-3f2866697db1"}]': finished 2023-12-14T14:05:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: osdmap e5: 1 total, 0 up, 1 in 2023-12-14T14:05:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: Standby manager daemon z started 2023-12-14T14:05:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-14T14:05:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:05:08.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-14T14:05:08.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:07 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:05:08.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:08.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4217185025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "626f1f59-a1b9-4b5a-a8ad-3f2866697db1"}]: dispatch 2023-12-14T14:05:08.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4217185025' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "626f1f59-a1b9-4b5a-a8ad-3f2866697db1"}]': finished 2023-12-14T14:05:08.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: osdmap e5: 1 total, 0 up, 1 in 2023-12-14T14:05:08.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:08.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: Standby manager daemon z started 2023-12-14T14:05:08.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-14T14:05:08.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:05:08.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-14T14:05:08.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:07 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.119:0/633479009' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:05:08.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:08.535+0000 7f3f2e7fc700 1 -- 172.21.15.69:0/3460172384 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 14) v1 ==== 90599+0+0 (secure 0 0 0) 0x7f3f34003d00 con 0x7f3f380feb60 2023-12-14T14:05:08.647 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:08 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:08.166+0000 7f44f7532200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T14:05:09.147 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:08 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:08.869+0000 7f44f7532200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T14:05:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:08 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/795723221' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:05:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:08 smithi081 ceph-mon[43371]: mgrmap e14: x(active, since 57s), standbys: z 2023-12-14T14:05:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-14T14:05:09.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:08 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/795723221' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:05:09.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:08 smithi119 ceph-mon[43834]: mgrmap e14: x(active, since 57s), standbys: z 2023-12-14T14:05:09.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-14T14:05:09.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:08 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/795723221' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:05:09.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:08 smithi069 ceph-mon[42034]: mgrmap e14: x(active, since 57s), standbys: z 2023-12-14T14:05:09.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-14T14:05:09.610 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:09 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:09.335+0000 7f44f7532200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:05:09.610 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:09 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:09.421+0000 7f44f7532200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T14:05:09.897 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:05:09 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:05:09.610+0000 7f44f7532200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T14:05:10.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:09 smithi119 ceph-mon[43834]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:10.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:09 smithi119 ceph-mon[43834]: Standby manager daemon y started 2023-12-14T14:05:10.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:09 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-14T14:05:10.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:09 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:05:10.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:09 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-14T14:05:10.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:09 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:05:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:09 smithi069 ceph-mon[42034]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:09 smithi069 ceph-mon[42034]: Standby manager daemon y started 2023-12-14T14:05:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:09 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-14T14:05:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:09 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:05:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:09 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-14T14:05:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:09 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:05:10.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:09 smithi081 ceph-mon[43371]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:10.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:09 smithi081 ceph-mon[43371]: Standby manager daemon y started 2023-12-14T14:05:10.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:09 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-14T14:05:10.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:09 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:05:10.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:09 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-14T14:05:10.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:09 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.81:0/3054395282' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:05:10.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:10.541+0000 7f3f2e7fc700 1 -- 172.21.15.69:0/3460172384 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f3f3400b750 con 0x7f3f380feb60 2023-12-14T14:05:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:11 smithi069 ceph-mon[42034]: mgrmap e15: x(active, since 59s), standbys: z, y 2023-12-14T14:05:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-14T14:05:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:11 smithi069 ceph-mon[42034]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:11.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:11 smithi081 ceph-mon[43371]: mgrmap e15: x(active, since 59s), standbys: z, y 2023-12-14T14:05:11.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-14T14:05:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:11 smithi081 ceph-mon[43371]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:12.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:11 smithi119 ceph-mon[43834]: mgrmap e15: x(active, since 59s), standbys: z, y 2023-12-14T14:05:12.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-14T14:05:12.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:11 smithi119 ceph-mon[43834]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:13 smithi069 ceph-mon[42034]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-14T14:05:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:13 smithi081 ceph-mon[43371]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-14T14:05:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:13 smithi119 ceph-mon[43834]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-14T14:05:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:14.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:14 smithi081 ceph-mon[43371]: Deploying daemon osd.0 on smithi069 2023-12-14T14:05:14.924 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:14 smithi069 ceph-mon[42034]: Deploying daemon osd.0 on smithi069 2023-12-14T14:05:15.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:14 smithi119 ceph-mon[43834]: Deploying daemon osd.0 on smithi069 2023-12-14T14:05:15.785 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:15 smithi069 ceph-mon[42034]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:15.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:15 smithi081 ceph-mon[43371]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:16.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:15 smithi119 ceph-mon[43834]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:17.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:17 smithi069 ceph-mon[42034]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:17.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:17 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:17.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:17 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:17.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:17 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:17.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:17 smithi119 ceph-mon[43834]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:17.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:17 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:17.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:17 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:17.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:17 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:17 smithi081 ceph-mon[43371]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:17 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:17 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:17 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:19.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.329+0000 7f3f2e7fc700 1 -- 172.21.15.69:0/3460172384 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3f38061c90 con 0x7f3f240389e0 2023-12-14T14:05:19.329 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 0 on host 'smithi069' 2023-12-14T14:05:19.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3f240389e0 msgr2=0x7f3f2403ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3f240389e0 0x7f3f2403ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f28005950 tx=0x7f3f2800b410 comp rx=0 tx=0).stop 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380feb60 msgr2=0x7f3f38198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380feb60 0x7f3f38198330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400d9b0 tx=0x7f3f3400dcc0 comp rx=0 tx=0).stop 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 shutdown_connections 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3f240389e0 0x7f3f2403ae90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f380ffe60 0x7f3f3819f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380feb60 0x7f3f38198330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 --2- 172.21.15.69:0/3460172384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f380ff4b0 0x7f3f38198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 >> 172.21.15.69:0/3460172384 conn(0x7f3f380fa7f0 msgr2=0x7f3f380fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:05:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 shutdown_connections 2023-12-14T14:05:19.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:19.331+0000 7f3f3fa13700 1 -- 172.21.15.69:0/3460172384 wait complete. 2023-12-14T14:05:19.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:19.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:19.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:19.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:19.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:05:19.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:19.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:19.741 DEBUG:teuthology.orchestra.run.smithi069:osd.0> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.0.service 2023-12-14T14:05:19.743 INFO:tasks.cephadm:Deploying osd.1 on smithi081 with /dev/vg_nvme/lv_4... 2023-12-14T14:05:19.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-14T14:05:19.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:19.776 INFO:journalctl@ceph.osd.0.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:05:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:19.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:05:19.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:19.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:19.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:05:21.303 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-14T14:05:21.304 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-14T14:05:21.304 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2023-12-14T14:05:21.304 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2023-12-14T14:05:21.304 INFO:teuthology.orchestra.run.smithi081.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011172 s, 939 MB/s 2023-12-14T14:05:21.304 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2023-12-14T14:05:21.335 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:05:21 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-0[54901]: 2023-12-14T14:05:21.044+0000 7fb88f6d6640 -1 osd.0 0 log_to_monitors true 2023-12-14T14:05:21.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2023-12-14T14:05:21.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:21 smithi069 ceph-mon[42034]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:21 smithi069 ceph-mon[42034]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-14T14:05:21.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:21 smithi081 ceph-mon[43371]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:21.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:21 smithi081 ceph-mon[43371]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-14T14:05:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:05:22.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:21 smithi119 ceph-mon[43834]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:22.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:21 smithi119 ceph-mon[43834]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: osdmap e6: 1 total, 0 up, 1 in 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi069 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi069 to 17113M 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:22.816 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:22.817 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:22.817 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:22.817 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:22.817 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:05:22.817 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:22 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:22.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.992+0000 7f769b92d700 1 -- 172.21.15.81:0/1001635857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76940ffb60 msgr2=0x7f76940fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:22.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.992+0000 7f769b92d700 1 --2- 172.21.15.81:0/1001635857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76940ffb60 0x7f76940fffb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7690009990 tx=0x7f7690009ca0 comp rx=0 tx=0).stop 2023-12-14T14:05:22.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.992+0000 7f769b92d700 1 -- 172.21.15.81:0/1001635857 shutdown_connections 2023-12-14T14:05:22.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.992+0000 7f769b92d700 1 --2- 172.21.15.81:0/1001635857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76941004f0 0x7f7694106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:22.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.992+0000 7f769b92d700 1 --2- 172.21.15.81:0/1001635857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76940fe960 0x7f76940fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:22.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.992+0000 7f769b92d700 1 --2- 172.21.15.81:0/1001635857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76940ffb60 0x7f76940fffb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:22.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.992+0000 7f769b92d700 1 -- 172.21.15.81:0/1001635857 >> 172.21.15.81:0/1001635857 conn(0x7f76940f9f70 msgr2=0x7f76940fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:05:22.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.992+0000 7f769b92d700 1 -- 172.21.15.81:0/1001635857 shutdown_connections 2023-12-14T14:05:22.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.992+0000 7f769b92d700 1 -- 172.21.15.81:0/1001635857 wait complete. 2023-12-14T14:05:22.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f769b92d700 1 Processor -- start 2023-12-14T14:05:22.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f769b92d700 1 -- start start 2023-12-14T14:05:22.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f769b92d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76940fe960 0x7f769410b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:22.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f769b92d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76940ffb60 0x7f769419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:22.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f769b92d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76941004f0 0x7f769419d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:22.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f769b92d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769419dcd0 con 0x7f76940ffb60 2023-12-14T14:05:22.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f769b92d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769419de40 con 0x7f76941004f0 2023-12-14T14:05:22.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f769b92d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769419e000 con 0x7f76940fe960 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f7699eca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76941004f0 0x7f769419d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f7699eca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76941004f0 0x7f769419d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39650/0 (socket says 172.21.15.81:39650) 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f7699eca700 1 -- 172.21.15.81:0/1492453701 learned_addr learned my addr 172.21.15.81:0/1492453701 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f76996c9700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76940fe960 0x7f769410b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f7698ec8700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76940ffb60 0x7f769419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f7699eca700 1 -- 172.21.15.81:0/1492453701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76940fe960 msgr2=0x7f769410b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f7699eca700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76940fe960 0x7f769410b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f7699eca700 1 -- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76940ffb60 msgr2=0x7f769419aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f7699eca700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76940ffb60 0x7f769419aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.993+0000 7f7699eca700 1 -- 172.21.15.81:0/1492453701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76900095f0 con 0x7f76941004f0 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.994+0000 7f7699eca700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76941004f0 0x7f769419d530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f768c007d70 tx=0x7f768c00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:05:22.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.994+0000 7f768a7fc700 1 -- 172.21.15.81:0/1492453701 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c00ac90 con 0x7f76941004f0 2023-12-14T14:05:22.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.994+0000 7f768a7fc700 1 -- 172.21.15.81:0/1492453701 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f768c00adf0 con 0x7f76941004f0 2023-12-14T14:05:22.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.994+0000 7f768a7fc700 1 -- 172.21.15.81:0/1492453701 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c0115e0 con 0x7f76941004f0 2023-12-14T14:05:22.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.994+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769410a2b0 con 0x7f76941004f0 2023-12-14T14:05:22.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.994+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769410a120 con 0x7f76941004f0 2023-12-14T14:05:22.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.995+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7694105540 con 0x7f76941004f0 2023-12-14T14:05:22.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.996+0000 7f768a7fc700 1 -- 172.21.15.81:0/1492453701 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f768c012420 con 0x7f76941004f0 2023-12-14T14:05:22.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.996+0000 7f768a7fc700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76800a1140 0x7f76800a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:22.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.997+0000 7f768a7fc700 1 -- 172.21.15.81:0/1492453701 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7f768c0cb2c0 con 0x7f76941004f0 2023-12-14T14:05:22.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.997+0000 7f76996c9700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76800a1140 0x7f76800a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:22.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:22.997+0000 7f76996c9700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76800a1140 0x7f76800a35f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76940ff9c0 tx=0x7f768400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:05:22.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:23.000+0000 7f768a7fc700 1 -- 172.21.15.81:0/1492453701 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f768c0965a0 con 0x7f76941004f0 2023-12-14T14:05:23.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-14T14:05:23.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: osdmap e6: 1 total, 0 up, 1 in 2023-12-14T14:05:23.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:23.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:05:23.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi069 2023-12-14T14:05:23.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:23.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:23.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:05:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi069 to 17113M 2023-12-14T14:05:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:05:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:22 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:23.085 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-0[54901]: 2023-12-14T14:05:22.621+0000 7fb884d4d700 -1 osd.0 0 waiting for initial osdmap 2023-12-14T14:05:23.085 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-0[54901]: 2023-12-14T14:05:22.627+0000 7fb87eb3e700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:05:23.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-14T14:05:23.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: osdmap e6: 1 total, 0 up, 1 in 2023-12-14T14:05:23.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi069 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi069 to 17113M 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:05:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:22 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:23.196+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7694061b40 con 0x7f76800a1140 2023-12-14T14:05:23.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:23 smithi081 ceph-mon[43371]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:23.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:23 smithi081 ceph-mon[43371]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:05:23.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:23 smithi081 ceph-mon[43371]: osdmap e7: 1 total, 0 up, 1 in 2023-12-14T14:05:23.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:23 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:23 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:23 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:23 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:23 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:24.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:23 smithi119 ceph-mon[43834]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:24.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:23 smithi119 ceph-mon[43834]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:05:24.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:23 smithi119 ceph-mon[43834]: osdmap e7: 1 total, 0 up, 1 in 2023-12-14T14:05:24.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:23 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:24.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:23 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:24.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:23 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:24.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:23 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:24.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:23 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:23 smithi069 ceph-mon[42034]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:23 smithi069 ceph-mon[42034]: from='osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:05:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:23 smithi069 ceph-mon[42034]: osdmap e7: 1 total, 0 up, 1 in 2023-12-14T14:05:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:23 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:23 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:23 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:24.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:23 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:24.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:23 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:24.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:24 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:05:24.901 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:24 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:05:24.901 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:24 smithi081 ceph-mon[43371]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:24.901 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:24.902 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:24 smithi081 ceph-mon[43371]: osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] boot 2023-12-14T14:05:24.902 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:24 smithi081 ceph-mon[43371]: osdmap e8: 1 total, 1 up, 1 in 2023-12-14T14:05:24.902 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:25.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:24 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:05:25.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:24 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:05:25.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:24 smithi119 ceph-mon[43834]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:25.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:25.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:24 smithi119 ceph-mon[43834]: osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] boot 2023-12-14T14:05:25.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:24 smithi119 ceph-mon[43834]: osdmap e8: 1 total, 1 up, 1 in 2023-12-14T14:05:25.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:25.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:24 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:05:25.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:24 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:05:25.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:24 smithi069 ceph-mon[42034]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:25.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:25.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:24 smithi069 ceph-mon[42034]: osd.0 [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] boot 2023-12-14T14:05:25.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:24 smithi069 ceph-mon[42034]: osdmap e8: 1 total, 1 up, 1 in 2023-12-14T14:05:25.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:05:25.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:25 smithi081 ceph-mon[43371]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:25 smithi081 ceph-mon[43371]: osdmap e9: 1 total, 1 up, 1 in 2023-12-14T14:05:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:25 smithi081 ceph-mon[43371]: from='client.? 172.21.15.81:0/2089509815' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3f5476-3f7e-4f95-ba27-a01e51228939"}]: dispatch 2023-12-14T14:05:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:25 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3f5476-3f7e-4f95-ba27-a01e51228939"}]: dispatch 2023-12-14T14:05:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:25 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc3f5476-3f7e-4f95-ba27-a01e51228939"}]': finished 2023-12-14T14:05:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:25 smithi081 ceph-mon[43371]: osdmap e10: 2 total, 1 up, 2 in 2023-12-14T14:05:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:25 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:25 smithi119 ceph-mon[43834]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:25 smithi119 ceph-mon[43834]: osdmap e9: 1 total, 1 up, 1 in 2023-12-14T14:05:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:25 smithi119 ceph-mon[43834]: from='client.? 172.21.15.81:0/2089509815' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3f5476-3f7e-4f95-ba27-a01e51228939"}]: dispatch 2023-12-14T14:05:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:25 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3f5476-3f7e-4f95-ba27-a01e51228939"}]: dispatch 2023-12-14T14:05:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:25 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc3f5476-3f7e-4f95-ba27-a01e51228939"}]': finished 2023-12-14T14:05:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:25 smithi119 ceph-mon[43834]: osdmap e10: 2 total, 1 up, 2 in 2023-12-14T14:05:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:25 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:26.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:25 smithi069 ceph-mon[42034]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T14:05:26.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:25 smithi069 ceph-mon[42034]: osdmap e9: 1 total, 1 up, 1 in 2023-12-14T14:05:26.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:25 smithi069 ceph-mon[42034]: from='client.? 172.21.15.81:0/2089509815' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3f5476-3f7e-4f95-ba27-a01e51228939"}]: dispatch 2023-12-14T14:05:26.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:25 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3f5476-3f7e-4f95-ba27-a01e51228939"}]: dispatch 2023-12-14T14:05:26.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:25 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc3f5476-3f7e-4f95-ba27-a01e51228939"}]': finished 2023-12-14T14:05:26.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:25 smithi069 ceph-mon[42034]: osdmap e10: 2 total, 1 up, 2 in 2023-12-14T14:05:26.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:25 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:26.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:26 smithi081 ceph-mon[43371]: from='client.? 172.21.15.81:0/718558365' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:05:27.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:26 smithi119 ceph-mon[43834]: from='client.? 172.21.15.81:0/718558365' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:05:27.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:26 smithi069 ceph-mon[42034]: from='client.? 172.21.15.81:0/718558365' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:05:27.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:27 smithi081 ceph-mon[43371]: pgmap v38: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:28.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:27 smithi119 ceph-mon[43834]: pgmap v38: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:28.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:27 smithi069 ceph-mon[42034]: pgmap v38: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:29.830 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:29 smithi081 ceph-mon[43371]: pgmap v39: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:30.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:29 smithi119 ceph-mon[43834]: pgmap v39: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:30.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:29 smithi069 ceph-mon[42034]: pgmap v39: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:31.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:31 smithi081 ceph-mon[43371]: pgmap v40: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-14T14:05:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:31 smithi081 ceph-mon[43371]: Deploying daemon osd.1 on smithi081 2023-12-14T14:05:32.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:31 smithi119 ceph-mon[43834]: pgmap v40: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:32.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-14T14:05:32.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:32.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:31 smithi119 ceph-mon[43834]: Deploying daemon osd.1 on smithi081 2023-12-14T14:05:32.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:31 smithi069 ceph-mon[42034]: pgmap v40: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:32.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-14T14:05:32.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:32.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:31 smithi069 ceph-mon[42034]: Deploying daemon osd.1 on smithi081 2023-12-14T14:05:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:33 smithi081 ceph-mon[43371]: pgmap v41: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:34.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:33 smithi119 ceph-mon[43834]: pgmap v41: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:34.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:33 smithi069 ceph-mon[42034]: pgmap v41: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:35.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:35.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:35.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:35.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:35 smithi119 ceph-mon[43834]: pgmap v42: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:35.831 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:35.831 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:35.831 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:35.831 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:35 smithi081 ceph-mon[43371]: pgmap v42: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:35.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:35.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:35.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:35.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:35 smithi069 ceph-mon[42034]: pgmap v42: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:36.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.756+0000 7f768a7fc700 1 -- 172.21.15.81:0/1492453701 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7694061b40 con 0x7f76800a1140 2023-12-14T14:05:36.757 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 1 on host 'smithi081' 2023-12-14T14:05:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76800a1140 msgr2=0x7f76800a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76800a1140 0x7f76800a35f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76940ff9c0 tx=0x7f768400a380 comp rx=0 tx=0).stop 2023-12-14T14:05:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76941004f0 msgr2=0x7f769419d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76941004f0 0x7f769419d530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f768c007d70 tx=0x7f768c00a340 comp rx=0 tx=0).stop 2023-12-14T14:05:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 shutdown_connections 2023-12-14T14:05:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76800a1140 0x7f76800a35f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76941004f0 0x7f769419d530 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76940fe960 0x7f769410b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 --2- 172.21.15.81:0/1492453701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76940ffb60 0x7f769419aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 >> 172.21.15.81:0/1492453701 conn(0x7f76940f9f70 msgr2=0x7f76940fbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:05:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 shutdown_connections 2023-12-14T14:05:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:05:36.758+0000 7f769b92d700 1 -- 172.21.15.81:0/1492453701 wait complete. 2023-12-14T14:05:36.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:36 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:36.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:36 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:36.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:36 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:36.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:36 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:36.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:36 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:36 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:36 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:36 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:37.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:36 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:37.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:36 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:36 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:36 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:36 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:36 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:36 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.150 DEBUG:teuthology.orchestra.run.smithi081:osd.1> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.1.service 2023-12-14T14:05:37.152 INFO:tasks.cephadm:Deploying osd.2 on smithi119 with /dev/vg_nvme/lv_4... 2023-12-14T14:05:37.152 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-14T14:05:37.183 INFO:journalctl@ceph.osd.1.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:05:37.463 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:05:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:37 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:37 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:05:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:37 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:37 smithi081 ceph-mon[43371]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:37 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:37 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:37 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:37.932 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:37 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:37.932 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:37 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:05:37.932 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:37 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:37.933 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:37 smithi119 ceph-mon[43834]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:37.933 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:37 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.933 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:37 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:37.933 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:37 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:38.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:37 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:38.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:37 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:05:38.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:37 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:38.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:37 smithi069 ceph-mon[42034]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:38.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:37 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:38.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:37 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:38.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:37 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:38.699 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:05:38 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-1[48332]: 2023-12-14T14:05:38.417+0000 7fc49db48640 -1 osd.1 0 log_to_monitors true 2023-12-14T14:05:38.712 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-14T14:05:38.712 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-14T14:05:38.712 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-14T14:05:38.712 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-14T14:05:38.712 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111228 s, 943 MB/s 2023-12-14T14:05:38.712 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-14T14:05:38.985 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:38 smithi119 ceph-mon[43834]: from='osd.1 [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T14:05:38.985 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:38 smithi119 ceph-mon[43834]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T14:05:39.043 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_4 2023-12-14T14:05:39.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:38 smithi069 ceph-mon[42034]: from='osd.1 [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T14:05:39.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:38 smithi069 ceph-mon[42034]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T14:05:39.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:38 smithi081 ceph-mon[43371]: from='osd.1 [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T14:05:39.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:38 smithi081 ceph-mon[43371]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T14:05:39.343 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:05:40.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: pgmap v44: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:40.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-14T14:05:40.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: osdmap e11: 2 total, 1 up, 2 in 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='osd.1 [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi081 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi081 to 17114M 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:05:40.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:39 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:40.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: pgmap v44: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:40.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-14T14:05:40.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: osdmap e11: 2 total, 1 up, 2 in 2023-12-14T14:05:40.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:40.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='osd.1 [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:05:40.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi081 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi081 to 17114M 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:05:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:39 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:40.147 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-1[48332]: 2023-12-14T14:05:39.740+0000 7fc4931bf700 -1 osd.1 0 waiting for initial osdmap 2023-12-14T14:05:40.147 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-1[48332]: 2023-12-14T14:05:39.744+0000 7fc48d7b1700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: pgmap v44: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: osdmap e11: 2 total, 1 up, 2 in 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='osd.1 [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi081 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi081 to 17114M 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:40.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:40.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:05:40.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:39 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.268+0000 7ff87b13d700 1 -- 172.21.15.119:0/1672674339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff874100d70 msgr2=0x7ff874107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.268+0000 7ff87b13d700 1 --2- 172.21.15.119:0/1672674339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff874100d70 0x7ff874107630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00b0a0 tx=0x7ff86c00b3b0 comp rx=0 tx=0).stop 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.268+0000 7ff87b13d700 1 -- 172.21.15.119:0/1672674339 shutdown_connections 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.268+0000 7ff87b13d700 1 --2- 172.21.15.119:0/1672674339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff874100d70 0x7ff874107630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.268+0000 7ff87b13d700 1 --2- 172.21.15.119:0/1672674339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8740ff1e0 0x7ff8740ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.268+0000 7ff87b13d700 1 --2- 172.21.15.119:0/1672674339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8741003e0 0x7ff874100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.268+0000 7ff87b13d700 1 -- 172.21.15.119:0/1672674339 >> 172.21.15.119:0/1672674339 conn(0x7ff8740fa7f0 msgr2=0x7ff8740fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.268+0000 7ff87b13d700 1 -- 172.21.15.119:0/1672674339 shutdown_connections 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.268+0000 7ff87b13d700 1 -- 172.21.15.119:0/1672674339 wait complete. 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff87b13d700 1 Processor -- start 2023-12-14T14:05:40.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff87b13d700 1 -- start start 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff87b13d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8740ff1e0 0x7ff8740699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff87b13d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8741003e0 0x7ff87419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff87b13d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff874100d70 0x7ff87419d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff87b13d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87419dc20 con 0x7ff874100d70 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff87b13d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87419dd90 con 0x7ff8741003e0 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff87b13d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87419df50 con 0x7ff8740ff1e0 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff878ed9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8740ff1e0 0x7ff8740699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff878ed9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8740ff1e0 0x7ff8740699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48968/0 (socket says 172.21.15.119:48968) 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff878ed9700 1 -- 172.21.15.119:0/673939007 learned_addr learned my addr 172.21.15.119:0/673939007 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.269+0000 7ff873fff700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8741003e0 0x7ff87419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff878ed9700 1 -- 172.21.15.119:0/673939007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8741003e0 msgr2=0x7ff87419ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff878ed9700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8741003e0 0x7ff87419ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff878ed9700 1 -- 172.21.15.119:0/673939007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff874100d70 msgr2=0x7ff87419d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff878ed9700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff874100d70 0x7ff87419d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff878ed9700 1 -- 172.21.15.119:0/673939007 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c009d00 con 0x7ff8740ff1e0 2023-12-14T14:05:40.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff878ed9700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8740ff1e0 0x7ff8740699a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff86800b500 tx=0x7ff86800b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:05:40.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff871ffb700 1 -- 172.21.15.119:0/673939007 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868011830 con 0x7ff8740ff1e0 2023-12-14T14:05:40.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff871ffb700 1 -- 172.21.15.119:0/673939007 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff868011e50 con 0x7ff8740ff1e0 2023-12-14T14:05:40.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87410abd0 con 0x7ff8740ff1e0 2023-12-14T14:05:40.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff871ffb700 1 -- 172.21.15.119:0/673939007 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86800f2e0 con 0x7ff8740ff1e0 2023-12-14T14:05:40.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.270+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87410aa40 con 0x7ff8740ff1e0 2023-12-14T14:05:40.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.271+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8741066c0 con 0x7ff8740ff1e0 2023-12-14T14:05:40.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.272+0000 7ff871ffb700 1 -- 172.21.15.119:0/673939007 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7ff868010580 con 0x7ff8740ff1e0 2023-12-14T14:05:40.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.272+0000 7ff871ffb700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff8640a10c0 0x7ff8640a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:40.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.273+0000 7ff871ffb700 1 -- 172.21.15.119:0/673939007 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2029+0+0 (secure 0 0 0) 0x7ff8680ca9c0 con 0x7ff8740ff1e0 2023-12-14T14:05:40.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.273+0000 7ff873fff700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff8640a10c0 0x7ff8640a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:40.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.273+0000 7ff873fff700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff8640a10c0 0x7ff8640a3570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff874069f20 tx=0x7ff86000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:05:40.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.277+0000 7ff871ffb700 1 -- 172.21.15.119:0/673939007 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff868095a80 con 0x7ff8740ff1e0 2023-12-14T14:05:40.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:40.471+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff874061cd0 con 0x7ff8640a10c0 2023-12-14T14:05:41.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:40 smithi119 ceph-mon[43834]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:05:41.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:40 smithi119 ceph-mon[43834]: osdmap e12: 2 total, 1 up, 2 in 2023-12-14T14:05:41.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:41.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:41.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:41.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:41.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:41.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:40 smithi069 ceph-mon[42034]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:05:41.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:40 smithi069 ceph-mon[42034]: osdmap e12: 2 total, 1 up, 2 in 2023-12-14T14:05:41.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:41.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:41.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:41.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:40 smithi081 ceph-mon[43371]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:05:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:40 smithi081 ceph-mon[43371]: osdmap e12: 2 total, 1 up, 2 in 2023-12-14T14:05:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:41 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:05:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:41 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:05:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:41 smithi119 ceph-mon[43834]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:41 smithi119 ceph-mon[43834]: pgmap v47: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:41 smithi119 ceph-mon[43834]: osd.1 [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] boot 2023-12-14T14:05:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:41 smithi119 ceph-mon[43834]: osdmap e13: 2 total, 2 up, 2 in 2023-12-14T14:05:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:42.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:41 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:05:42.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:41 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:05:42.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:41 smithi069 ceph-mon[42034]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:42.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:41 smithi069 ceph-mon[42034]: pgmap v47: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:42.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:41 smithi069 ceph-mon[42034]: osd.1 [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] boot 2023-12-14T14:05:42.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:41 smithi069 ceph-mon[42034]: osdmap e13: 2 total, 2 up, 2 in 2023-12-14T14:05:42.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:41 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:42.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:41 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:05:42.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:41 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:05:42.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:41 smithi081 ceph-mon[43371]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:41 smithi081 ceph-mon[43371]: pgmap v47: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T14:05:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:41 smithi081 ceph-mon[43371]: osd.1 [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] boot 2023-12-14T14:05:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:41 smithi081 ceph-mon[43371]: osdmap e13: 2 total, 2 up, 2 in 2023-12-14T14:05:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:41 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:05:43.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:43 smithi119 ceph-mon[43834]: osdmap e14: 2 total, 2 up, 2 in 2023-12-14T14:05:43.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:43 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/182231691' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cec31ae4-c25e-460e-9522-7924fed2ec9d"}]: dispatch 2023-12-14T14:05:43.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:43 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cec31ae4-c25e-460e-9522-7924fed2ec9d"}]: dispatch 2023-12-14T14:05:43.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:43 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cec31ae4-c25e-460e-9522-7924fed2ec9d"}]': finished 2023-12-14T14:05:43.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:43 smithi119 ceph-mon[43834]: osdmap e15: 3 total, 2 up, 3 in 2023-12-14T14:05:43.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:43 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:43.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:43 smithi119 ceph-mon[43834]: pgmap v51: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:43.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:43 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/1379268580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:05:43.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:43 smithi069 ceph-mon[42034]: osdmap e14: 2 total, 2 up, 2 in 2023-12-14T14:05:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:43 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/182231691' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cec31ae4-c25e-460e-9522-7924fed2ec9d"}]: dispatch 2023-12-14T14:05:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:43 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cec31ae4-c25e-460e-9522-7924fed2ec9d"}]: dispatch 2023-12-14T14:05:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:43 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cec31ae4-c25e-460e-9522-7924fed2ec9d"}]': finished 2023-12-14T14:05:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:43 smithi069 ceph-mon[42034]: osdmap e15: 3 total, 2 up, 3 in 2023-12-14T14:05:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:43 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:43 smithi069 ceph-mon[42034]: pgmap v51: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:43 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/1379268580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:05:43.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:43 smithi081 ceph-mon[43371]: osdmap e14: 2 total, 2 up, 2 in 2023-12-14T14:05:43.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:43 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/182231691' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cec31ae4-c25e-460e-9522-7924fed2ec9d"}]: dispatch 2023-12-14T14:05:43.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:43 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cec31ae4-c25e-460e-9522-7924fed2ec9d"}]: dispatch 2023-12-14T14:05:43.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:43 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cec31ae4-c25e-460e-9522-7924fed2ec9d"}]': finished 2023-12-14T14:05:43.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:43 smithi081 ceph-mon[43371]: osdmap e15: 3 total, 2 up, 3 in 2023-12-14T14:05:43.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:43 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:43.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:43 smithi081 ceph-mon[43371]: pgmap v51: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:43.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:43 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/1379268580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:05:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:45 smithi081 ceph-mon[43371]: pgmap v52: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:45.938 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:45 smithi119 ceph-mon[43834]: pgmap v52: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:46.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:45 smithi069 ceph-mon[42034]: pgmap v52: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:47.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:47 smithi119 ceph-mon[43834]: pgmap v53: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:47.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:47 smithi069 ceph-mon[42034]: pgmap v53: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:47.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:47 smithi081 ceph-mon[43371]: pgmap v53: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:48.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:48 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-14T14:05:48.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:48 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:48.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:48 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-14T14:05:48.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:48 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:48.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:48 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-14T14:05:48.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:48 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:49.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:49 smithi119 ceph-mon[43834]: Deploying daemon osd.2 on smithi119 2023-12-14T14:05:49.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:49 smithi119 ceph-mon[43834]: pgmap v54: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:49.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:49 smithi069 ceph-mon[42034]: Deploying daemon osd.2 on smithi119 2023-12-14T14:05:49.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:49 smithi069 ceph-mon[42034]: pgmap v54: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:49.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:49 smithi081 ceph-mon[43371]: Deploying daemon osd.2 on smithi119 2023-12-14T14:05:49.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:49 smithi081 ceph-mon[43371]: pgmap v54: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:51 smithi081 ceph-mon[43371]: pgmap v55: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:52.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:51 smithi119 ceph-mon[43834]: pgmap v55: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:52.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:51 smithi069 ceph-mon[42034]: pgmap v55: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:52.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:52.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:52.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:53.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:53.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:53.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:53.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:53.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:53.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:53.933 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:53 smithi119 ceph-mon[43834]: pgmap v56: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:53.933 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:53.934 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:53.934 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:53.934 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:53.934 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.073+0000 7ff871ffb700 1 -- 172.21.15.119:0/673939007 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff874061cd0 con 0x7ff8640a10c0 2023-12-14T14:05:54.074 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 2 on host 'smithi119' 2023-12-14T14:05:54.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff8640a10c0 msgr2=0x7ff8640a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:54.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff8640a10c0 0x7ff8640a3570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff874069f20 tx=0x7ff86000a380 comp rx=0 tx=0).stop 2023-12-14T14:05:54.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8740ff1e0 msgr2=0x7ff8740699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:54.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8740ff1e0 0x7ff8740699a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff86800b500 tx=0x7ff86800b810 comp rx=0 tx=0).stop 2023-12-14T14:05:54.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 shutdown_connections 2023-12-14T14:05:54.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff8640a10c0 0x7ff8640a3570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:54.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff874100d70 0x7ff87419d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:54.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8740ff1e0 0x7ff8740699a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:54.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 --2- 172.21.15.119:0/673939007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8741003e0 0x7ff87419ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:54.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 >> 172.21.15.119:0/673939007 conn(0x7ff8740fa7f0 msgr2=0x7ff874103800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:05:54.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 shutdown_connections 2023-12-14T14:05:54.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:05:54.076+0000 7ff87b13d700 1 -- 172.21.15.119:0/673939007 wait complete. 2023-12-14T14:05:54.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:53 smithi069 ceph-mon[42034]: pgmap v56: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:54.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:54.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:54.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:53 smithi081 ceph-mon[43371]: pgmap v56: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:54.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:54.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:54.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.455 DEBUG:teuthology.orchestra.run.smithi119:osd.2> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.2.service 2023-12-14T14:05:54.458 INFO:tasks.cephadm:Deploying osd.3 on smithi069 with /dev/vg_nvme/lv_3... 2023-12-14T14:05:54.458 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-14T14:05:54.490 INFO:journalctl@ceph.osd.2.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:05:54.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:54 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:54 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:05:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:54 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.780 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:05:54.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:54 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:54.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:54 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:05:54.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:54 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:54.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:55.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:54 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:55.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:54 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:05:55.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:54 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:55.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:54 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:55.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:54 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:05:55.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:54 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:55.971 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:05:55 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-2[49597]: 2023-12-14T14:05:55.701+0000 7f386a18d640 -1 osd.2 0 log_to_monitors true 2023-12-14T14:05:55.972 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:55 smithi119 ceph-mon[43834]: pgmap v57: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:55.972 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:55 smithi119 ceph-mon[43834]: from='osd.2 [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T14:05:55.972 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:55 smithi119 ceph-mon[43834]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T14:05:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-14T14:05:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-14T14:05:56.073 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2023-12-14T14:05:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2023-12-14T14:05:56.073 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0129464 s, 810 MB/s 2023-12-14T14:05:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2023-12-14T14:05:56.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:55 smithi069 ceph-mon[42034]: pgmap v57: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:56.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:55 smithi069 ceph-mon[42034]: from='osd.2 [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T14:05:56.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:55 smithi069 ceph-mon[42034]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T14:05:56.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:55 smithi081 ceph-mon[43371]: pgmap v57: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:56.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:55 smithi081 ceph-mon[43371]: from='osd.2 [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T14:05:56.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:55 smithi081 ceph-mon[43371]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T14:05:56.439 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi069:vg_nvme/lv_3 2023-12-14T14:05:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:05:57.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-14T14:05:57.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: osdmap e16: 3 total, 2 up, 3 in 2023-12-14T14:05:57.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:57.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='osd.2 [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:05:57.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:05:57.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi119 2023-12-14T14:05:57.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:05:57.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi119 to 17113M 2023-12-14T14:05:57.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:57.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:57.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:57.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:05:57.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:05:57.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:57 smithi069 ceph-mon[42034]: pgmap v59: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: osdmap e16: 3 total, 2 up, 3 in 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='osd.2 [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi119 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi119 to 17113M 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:57.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:05:57.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:05:57.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:57 smithi081 ceph-mon[43371]: pgmap v59: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:57.524 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-2[49597]: 2023-12-14T14:05:57.054+0000 7f385f804700 -1 osd.2 0 waiting for initial osdmap 2023-12-14T14:05:57.524 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-2[49597]: 2023-12-14T14:05:57.059+0000 7f38585f3700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:05:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-14T14:05:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: osdmap e16: 3 total, 2 up, 3 in 2023-12-14T14:05:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='osd.2 [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:05:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi119 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi119 to 17113M 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:05:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:57 smithi119 ceph-mon[43834]: pgmap v59: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.737+0000 7f6a68baf700 1 -- 172.21.15.69:0/1563124807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 msgr2=0x7f6a64107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.737+0000 7f6a68baf700 1 --2- 172.21.15.69:0/1563124807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 0x7f6a64107630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00b0a0 tx=0x7f6a5c00b3b0 comp rx=0 tx=0).stop 2023-12-14T14:05:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.737+0000 7f6a68baf700 1 -- 172.21.15.69:0/1563124807 shutdown_connections 2023-12-14T14:05:57.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.737+0000 7f6a68baf700 1 --2- 172.21.15.69:0/1563124807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 0x7f6a64107630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:57.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.737+0000 7f6a68baf700 1 --2- 172.21.15.69:0/1563124807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a640ff1e0 0x7f6a640ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:57.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.737+0000 7f6a68baf700 1 --2- 172.21.15.69:0/1563124807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a641003e0 0x7f6a64100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:57.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.737+0000 7f6a68baf700 1 -- 172.21.15.69:0/1563124807 >> 172.21.15.69:0/1563124807 conn(0x7f6a640fa7f0 msgr2=0x7f6a640fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:05:57.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.737+0000 7f6a68baf700 1 -- 172.21.15.69:0/1563124807 shutdown_connections 2023-12-14T14:05:57.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.737+0000 7f6a68baf700 1 -- 172.21.15.69:0/1563124807 wait complete. 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a68baf700 1 Processor -- start 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a68baf700 1 -- start start 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a68baf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a640ff1e0 0x7f6a64194fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a68baf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a641003e0 0x7f6a64195520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a68baf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 0x7f6a6419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a68baf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6419cb70 con 0x7f6a64100d70 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a68baf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6419ccb0 con 0x7f6a641003e0 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a68baf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6419ce40 con 0x7f6a640ff1e0 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a62d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 0x7f6a6419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a62d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 0x7f6a6419c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59242/0 (socket says 172.21.15.69:59242) 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a62d9d700 1 -- 172.21.15.69:0/2500340190 learned_addr learned my addr 172.21.15.69:0/2500340190 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.738+0000 7f6a6259c700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a640ff1e0 0x7f6a64194fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a61d9b700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a641003e0 0x7f6a64195520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a62d9d700 1 -- 172.21.15.69:0/2500340190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a640ff1e0 msgr2=0x7f6a64194fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a62d9d700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a640ff1e0 0x7f6a64194fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a62d9d700 1 -- 172.21.15.69:0/2500340190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a641003e0 msgr2=0x7f6a64195520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a62d9d700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a641003e0 0x7f6a64195520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a62d9d700 1 -- 172.21.15.69:0/2500340190 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c009d00 con 0x7f6a64100d70 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a62d9d700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 0x7f6a6419c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00b070 tx=0x7f6a5c0094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a5b7fe700 1 -- 172.21.15.69:0/2500340190 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00e040 con 0x7f6a64100d70 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a5b7fe700 1 -- 172.21.15.69:0/2500340190 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a5c004d60 con 0x7f6a64100d70 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6410ab30 con 0x7f6a64100d70 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a5b7fe700 1 -- 172.21.15.69:0/2500340190 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c01d480 con 0x7f6a64100d70 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.739+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6410a9a0 con 0x7f6a64100d70 2023-12-14T14:05:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.740+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6419d480 con 0x7f6a64100d70 2023-12-14T14:05:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.741+0000 7f6a5b7fe700 1 -- 172.21.15.69:0/2500340190 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f6a5c003a00 con 0x7f6a64100d70 2023-12-14T14:05:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.741+0000 7f6a5b7fe700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a500a1140 0x7f6a500a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:05:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.742+0000 7f6a6259c700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a500a1140 0x7f6a500a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:05:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.742+0000 7f6a5b7fe700 1 -- 172.21.15.69:0/2500340190 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2571+0+0 (secure 0 0 0) 0x7f6a5c0cc7f0 con 0x7f6a64100d70 2023-12-14T14:05:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.742+0000 7f6a6259c700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a500a1140 0x7f6a500a35f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a64100240 tx=0x7f6a4c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:05:57.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.746+0000 7f6a5b7fe700 1 -- 172.21.15.69:0/2500340190 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6a5c097720 con 0x7f6a64100d70 2023-12-14T14:05:57.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:05:57.942+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a6419da30 con 0x7f6a500a1140 2023-12-14T14:05:58.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:58 smithi069 ceph-mon[42034]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:05:58.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:58 smithi069 ceph-mon[42034]: osdmap e17: 3 total, 2 up, 3 in 2023-12-14T14:05:58.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:58.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:58.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:58 smithi069 ceph-mon[42034]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:58.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:58.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:58.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:58.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:58 smithi081 ceph-mon[43371]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:05:58.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:58 smithi081 ceph-mon[43371]: osdmap e17: 3 total, 2 up, 3 in 2023-12-14T14:05:58.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:58.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:58.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:58 smithi081 ceph-mon[43371]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:58.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:58.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:58.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:58.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:58 smithi119 ceph-mon[43834]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:05:58.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:58 smithi119 ceph-mon[43834]: osdmap e17: 3 total, 2 up, 3 in 2023-12-14T14:05:58.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:58.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:58.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:58 smithi119 ceph-mon[43834]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:05:58.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:05:58.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:05:58.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:05:59.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:59 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:05:59.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:59 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:05:59.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:59 smithi069 ceph-mon[42034]: osd.2 [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] boot 2023-12-14T14:05:59.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:59 smithi069 ceph-mon[42034]: osdmap e18: 3 total, 3 up, 3 in 2023-12-14T14:05:59.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:59.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:59 smithi069 ceph-mon[42034]: pgmap v62: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:59.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:05:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-14T14:05:59.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:59 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:05:59.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:59 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:05:59.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:59 smithi081 ceph-mon[43371]: osd.2 [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] boot 2023-12-14T14:05:59.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:59 smithi081 ceph-mon[43371]: osdmap e18: 3 total, 3 up, 3 in 2023-12-14T14:05:59.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:59.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:59 smithi081 ceph-mon[43371]: pgmap v62: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:59.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:05:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-14T14:05:59.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:59 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:05:59.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:59 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:05:59.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:59 smithi119 ceph-mon[43834]: osd.2 [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] boot 2023-12-14T14:05:59.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:59 smithi119 ceph-mon[43834]: osdmap e18: 3 total, 3 up, 3 in 2023-12-14T14:05:59.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:05:59.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:59 smithi119 ceph-mon[43834]: pgmap v62: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T14:05:59.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:05:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-14T14:06:00.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-14T14:06:00.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:00 smithi069 ceph-mon[42034]: osdmap e19: 3 total, 3 up, 3 in 2023-12-14T14:06:00.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T14:06:00.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:00 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1926300033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcee4795-1084-4049-bae8-b982198f8b00"}]: dispatch 2023-12-14T14:06:00.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-14T14:06:00.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:00 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1926300033' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcee4795-1084-4049-bae8-b982198f8b00"}]': finished 2023-12-14T14:06:00.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:00 smithi069 ceph-mon[42034]: osdmap e20: 4 total, 3 up, 4 in 2023-12-14T14:06:00.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:00.337 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:06:00 smithi069 sudo[58023]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T14:06:00.337 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:06:00 smithi069 sudo[58023]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:00.337 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:06:00 smithi069 sudo[58023]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:00.337 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:06:00 smithi069 sudo[58023]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:00.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-14T14:06:00.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:00 smithi081 ceph-mon[43371]: osdmap e19: 3 total, 3 up, 3 in 2023-12-14T14:06:00.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T14:06:00.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:00 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1926300033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcee4795-1084-4049-bae8-b982198f8b00"}]: dispatch 2023-12-14T14:06:00.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-14T14:06:00.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:00 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1926300033' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcee4795-1084-4049-bae8-b982198f8b00"}]': finished 2023-12-14T14:06:00.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:00 smithi081 ceph-mon[43371]: osdmap e20: 4 total, 3 up, 4 in 2023-12-14T14:06:00.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:00.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-14T14:06:00.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:00 smithi119 ceph-mon[43834]: osdmap e19: 3 total, 3 up, 3 in 2023-12-14T14:06:00.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T14:06:00.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:00 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1926300033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcee4795-1084-4049-bae8-b982198f8b00"}]: dispatch 2023-12-14T14:06:00.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-14T14:06:00.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:00 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1926300033' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcee4795-1084-4049-bae8-b982198f8b00"}]': finished 2023-12-14T14:06:00.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:00 smithi119 ceph-mon[43834]: osdmap e20: 4 total, 3 up, 4 in 2023-12-14T14:06:00.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:00.835 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:06:00 smithi069 sudo[58046]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T14:06:00.836 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:06:00 smithi069 sudo[58046]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:00.836 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:06:00 smithi069 sudo[58046]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:00.836 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:06:00 smithi069 sudo[58046]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:01.147 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:06:00 smithi081 sudo[50603]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T14:06:01.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:06:00 smithi081 sudo[50603]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:01.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:06:00 smithi081 sudo[50603]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:01.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:06:00 smithi081 sudo[50603]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:01.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:06:00 smithi081 sudo[50606]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T14:06:01.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:06:00 smithi081 sudo[50606]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:01.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:06:00 smithi081 sudo[50606]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:01.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:06:00 smithi081 sudo[50606]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:01.476 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:06:01 smithi119 sudo[51822]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T14:06:01.476 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:06:01 smithi119 sudo[51822]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:01.476 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:06:01 smithi119 sudo[51822]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:01.476 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:06:01 smithi119 sudo[51822]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:01.476 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:06:01 smithi119 sudo[51825]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T14:06:01.476 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:06:01 smithi119 sudo[51825]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:01.477 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:06:01 smithi119 sudo[51825]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:01.477 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:06:01 smithi119 sudo[51825]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:01.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:01.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3720597378' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:01.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 ceph-mon[42034]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:01.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 ceph-mon[42034]: osdmap e21: 4 total, 3 up, 4 in 2023-12-14T14:06:01.727 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:01.727 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:01 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3720597378' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:01 smithi119 ceph-mon[43834]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:01 smithi119 ceph-mon[43834]: osdmap e21: 4 total, 3 up, 4 in 2023-12-14T14:06:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:01.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:01 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3720597378' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:01 smithi081 ceph-mon[43371]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:01 smithi081 ceph-mon[43371]: osdmap e21: 4 total, 3 up, 4 in 2023-12-14T14:06:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:01.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 sudo[58470]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T14:06:01.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 sudo[58470]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:01.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 sudo[58470]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:01.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 sudo[58470]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:02.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 sudo[58657]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T14:06:02.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 sudo[58657]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:02.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 sudo[58657]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:02.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:01 smithi069 sudo[58657]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:02.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:02.467+0000 7f6a5b7fe700 1 -- 172.21.15.69:0/2500340190 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f6a5c003cb0 con 0x7f6a64100d70 2023-12-14T14:06:02.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 sudo[51828]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T14:06:02.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 sudo[51828]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:02.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 sudo[51828]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:02.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 sudo[51828]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:02.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 sudo[51831]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T14:06:02.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 sudo[51831]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:02.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 sudo[51831]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:02.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 sudo[51831]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:02.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 sudo[50609]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T14:06:02.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 sudo[50609]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:02.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 sudo[50609]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:02.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 sudo[50609]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:02.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 sudo[50612]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T14:06:02.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 sudo[50612]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T14:06:02.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 sudo[50612]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T14:06:02.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 sudo[50612]: pam_unix(sudo:session): session closed for user root 2023-12-14T14:06:03.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:06:03.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T14:06:03.276 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: mgrmap e16: x(active, since 111s), standbys: z, y 2023-12-14T14:06:03.276 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:06:03.276 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:06:03.276 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:06:03.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:03.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T14:06:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: mgrmap e16: x(active, since 111s), standbys: z, y 2023-12-14T14:06:03.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:06:03.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:06:03.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:06:03.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:06:03.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T14:06:03.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: mgrmap e16: x(active, since 111s), standbys: z, y 2023-12-14T14:06:03.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:06:03.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:06:03.399 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:06:04.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:03 smithi119 ceph-mon[43834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T14:06:04.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:03 smithi119 ceph-mon[43834]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:04.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:03 smithi119 ceph-mon[43834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T14:06:04.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:03 smithi069 ceph-mon[42034]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T14:06:04.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:03 smithi069 ceph-mon[42034]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:04.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:03 smithi069 ceph-mon[42034]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T14:06:04.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:03 smithi081 ceph-mon[43371]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T14:06:04.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:03 smithi081 ceph-mon[43371]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:04.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:03 smithi081 ceph-mon[43371]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T14:06:06.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:05 smithi069 ceph-mon[42034]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:06.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-14T14:06:06.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:06.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:05 smithi119 ceph-mon[43834]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:06.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-14T14:06:06.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:06.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:05 smithi081 ceph-mon[43371]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:06.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-14T14:06:06.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:07.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:06 smithi069 ceph-mon[42034]: Deploying daemon osd.3 on smithi069 2023-12-14T14:06:07.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:06 smithi119 ceph-mon[43834]: Deploying daemon osd.3 on smithi069 2023-12-14T14:06:07.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:06 smithi081 ceph-mon[43371]: Deploying daemon osd.3 on smithi069 2023-12-14T14:06:08.057 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:07 smithi069 ceph-mon[42034]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:07 smithi119 ceph-mon[43834]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:08.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:07 smithi081 ceph-mon[43371]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-12-14T14:06:10.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:09 smithi119 ceph-mon[43834]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-12-14T14:06:10.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:10.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:10.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:09 smithi069 ceph-mon[42034]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-12-14T14:06:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:10.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:09 smithi081 ceph-mon[43371]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-12-14T14:06:10.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:10.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:10.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:11.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.739+0000 7f6a5b7fe700 1 -- 172.21.15.69:0/2500340190 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6a6419da30 con 0x7f6a500a1140 2023-12-14T14:06:11.738 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 3 on host 'smithi069' 2023-12-14T14:06:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.741+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a500a1140 msgr2=0x7f6a500a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.741+0000 7f6a68baf700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a500a1140 0x7f6a500a35f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a64100240 tx=0x7f6a4c00b410 comp rx=0 tx=0).stop 2023-12-14T14:06:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.741+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 msgr2=0x7f6a6419c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.741+0000 7f6a68baf700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 0x7f6a6419c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00b070 tx=0x7f6a5c0094e0 comp rx=0 tx=0).stop 2023-12-14T14:06:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.742+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 shutdown_connections 2023-12-14T14:06:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.742+0000 7f6a68baf700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a500a1140 0x7f6a500a35f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.742+0000 7f6a68baf700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a64100d70 0x7f6a6419c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:11.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.742+0000 7f6a68baf700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a640ff1e0 0x7f6a64194fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:11.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.742+0000 7f6a68baf700 1 --2- 172.21.15.69:0/2500340190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a641003e0 0x7f6a64195520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:11.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.742+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 >> 172.21.15.69:0/2500340190 conn(0x7f6a640fa7f0 msgr2=0x7f6a640fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:06:11.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.742+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 shutdown_connections 2023-12-14T14:06:11.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:11.742+0000 7f6a68baf700 1 -- 172.21.15.69:0/2500340190 wait complete. 2023-12-14T14:06:12.166 DEBUG:teuthology.orchestra.run.smithi069:osd.3> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.3.service 2023-12-14T14:06:12.168 INFO:tasks.cephadm:Deploying osd.4 on smithi081 with /dev/vg_nvme/lv_3... 2023-12-14T14:06:12.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-14T14:06:12.199 INFO:journalctl@ceph.osd.3.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:06:12.263 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:11 smithi069 ceph-mon[42034]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-12-14T14:06:12.263 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.263 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.263 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:12.263 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:12.263 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.264 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.264 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.264 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:11 smithi119 ceph-mon[43834]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-12-14T14:06:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:12.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:12.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:11 smithi081 ceph-mon[43371]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-12-14T14:06:12.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:12.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:12.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:12.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:06:13.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:12 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:13.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:12 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:06:13.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:12 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:13.293 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:12 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:13.293 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:12 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:06:13.293 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:12 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:13.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:12 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:13.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:12 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:06:13.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:12 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-14T14:06:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-14T14:06:13.756 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2023-12-14T14:06:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2023-12-14T14:06:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.015046 s, 697 MB/s 2023-12-14T14:06:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2023-12-14T14:06:13.793 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-3[60281]: 2023-12-14T14:06:13.479+0000 7f5fb2662640 -1 osd.3 0 log_to_monitors true 2023-12-14T14:06:14.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T14:06:14.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-14T14:06:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.103 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T14:06:14.103 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-14T14:06:14.103 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.104 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.104 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:14.104 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:14.104 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.104 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:14.104 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:14.104 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2023-12-14T14:06:14.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T14:06:14.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-14T14:06:14.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:14.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:14.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:14.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:14.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:06:15.250 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi069 2023-12-14T14:06:15.250 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi069 to 8556M 2023-12-14T14:06:15.250 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:15.250 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:06:15.251 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:15.251 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-14T14:06:15.251 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: osdmap e22: 4 total, 3 up, 4 in 2023-12-14T14:06:15.251 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:15.251 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:06:15.251 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:06:15.251 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: osdmap e23: 4 total, 3 up, 4 in 2023-12-14T14:06:15.251 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:14 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:15.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi069 2023-12-14T14:06:15.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi069 to 8556M 2023-12-14T14:06:15.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:15.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:06:15.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:15.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-14T14:06:15.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: osdmap e22: 4 total, 3 up, 4 in 2023-12-14T14:06:15.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:15.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:06:15.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:06:15.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: osdmap e23: 4 total, 3 up, 4 in 2023-12-14T14:06:15.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:14 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:15.335 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-3[60281]: 2023-12-14T14:06:14.981+0000 7f5fa7cd9700 -1 osd.3 0 waiting for initial osdmap 2023-12-14T14:06:15.336 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-3[60281]: 2023-12-14T14:06:14.988+0000 7f5f9fac6700 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:06:15.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi069 2023-12-14T14:06:15.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi069 to 8556M 2023-12-14T14:06:15.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:15.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:06:15.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:15.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-14T14:06:15.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: osdmap e22: 4 total, 3 up, 4 in 2023-12-14T14:06:15.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:15.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:06:15.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: from='osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:06:15.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: osdmap e23: 4 total, 3 up, 4 in 2023-12-14T14:06:15.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:14 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:15.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.428+0000 7f5f451e0700 1 -- 172.21.15.81:0/3243144379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400ff1e0 msgr2=0x7f5f400ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.428+0000 7f5f451e0700 1 --2- 172.21.15.81:0/3243144379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400ff1e0 0x7f5f400ff5f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009990 tx=0x7f5f34009ca0 comp rx=0 tx=0).stop 2023-12-14T14:06:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.428+0000 7f5f451e0700 1 -- 172.21.15.81:0/3243144379 shutdown_connections 2023-12-14T14:06:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.428+0000 7f5f451e0700 1 --2- 172.21.15.81:0/3243144379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f40100d70 0x7f5f40107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.428+0000 7f5f451e0700 1 --2- 172.21.15.81:0/3243144379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400ff1e0 0x7f5f400ff5f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.428+0000 7f5f451e0700 1 --2- 172.21.15.81:0/3243144379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f401003e0 0x7f5f40100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.428+0000 7f5f451e0700 1 -- 172.21.15.81:0/3243144379 >> 172.21.15.81:0/3243144379 conn(0x7f5f400fa7f0 msgr2=0x7f5f400fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:06:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.428+0000 7f5f451e0700 1 -- 172.21.15.81:0/3243144379 shutdown_connections 2023-12-14T14:06:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.428+0000 7f5f451e0700 1 -- 172.21.15.81:0/3243144379 wait complete. 2023-12-14T14:06:15.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f451e0700 1 Processor -- start 2023-12-14T14:06:15.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f451e0700 1 -- start start 2023-12-14T14:06:15.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f451e0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400ff1e0 0x7f5f401982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:15.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f451e0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f401003e0 0x7f5f401987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:15.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f451e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f40100d70 0x7f5f4019f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f451e0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4019fe40 con 0x7f5f400ff1e0 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f451e0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4019ff80 con 0x7f5f40100d70 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f451e0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f401a0110 con 0x7f5f401003e0 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f3f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f40100d70 0x7f5f4019f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.429+0000 7f5f3ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400ff1e0 0x7f5f401982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f40100d70 0x7f5f4019f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35380/0 (socket says 172.21.15.81:35380) 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400ff1e0 0x7f5f401982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.81:39128/0 (socket says 172.21.15.81:39128) 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3f59e700 1 -- 172.21.15.81:0/756004629 learned_addr learned my addr 172.21.15.81:0/756004629 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3e59c700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f401003e0 0x7f5f401987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3f59e700 1 -- 172.21.15.81:0/756004629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f401003e0 msgr2=0x7f5f401987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3f59e700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f401003e0 0x7f5f401987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3f59e700 1 -- 172.21.15.81:0/756004629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400ff1e0 msgr2=0x7f5f401982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3f59e700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400ff1e0 0x7f5f401982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3f59e700 1 -- 172.21.15.81:0/756004629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340095f0 con 0x7f5f40100d70 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3e59c700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f401003e0 0x7f5f401987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f3f59e700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f40100d70 0x7f5f4019f870 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800ef30 tx=0x7f5f3800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f27fff700 1 -- 172.21.15.81:0/756004629 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38018070 con 0x7f5f40100d70 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4010ab30 con 0x7f5f40100d70 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f27fff700 1 -- 172.21.15.81:0/756004629 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f3800f040 con 0x7f5f40100d70 2023-12-14T14:06:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f27fff700 1 -- 172.21.15.81:0/756004629 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3800cdb0 con 0x7f5f40100d70 2023-12-14T14:06:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.430+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4010a9a0 con 0x7f5f40100d70 2023-12-14T14:06:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.432+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f40066ea0 con 0x7f5f40100d70 2023-12-14T14:06:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.432+0000 7f5f27fff700 1 -- 172.21.15.81:0/756004629 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f5f38003a00 con 0x7f5f40100d70 2023-12-14T14:06:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.433+0000 7f5f27fff700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f280a11d0 0x7f5f280a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.433+0000 7f5f27fff700 1 -- 172.21.15.81:0/756004629 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3389+0+0 (secure 0 0 0) 0x7f5f380cb270 con 0x7f5f40100d70 2023-12-14T14:06:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.433+0000 7f5f3ed9d700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f280a11d0 0x7f5f280a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.434+0000 7f5f3ed9d700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f280a11d0 0x7f5f280a3680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400b2e0 tx=0x7f5f34005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:06:15.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.437+0000 7f5f27fff700 1 -- 172.21.15.81:0/756004629 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5f38095cf0 con 0x7f5f40100d70 2023-12-14T14:06:15.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:15.633+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f40068d60 con 0x7f5f280a11d0 2023-12-14T14:06:16.237 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:15 smithi081 ceph-mon[43371]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T14:06:16.237 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:16.237 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:06:16.237 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:06:16.238 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:16.238 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:15 smithi081 ceph-mon[43371]: osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] boot 2023-12-14T14:06:16.238 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:15 smithi081 ceph-mon[43371]: osdmap e24: 4 total, 4 up, 4 in 2023-12-14T14:06:16.238 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:16.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:15 smithi119 ceph-mon[43834]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T14:06:16.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:16.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:06:16.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:06:16.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:16.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:15 smithi119 ceph-mon[43834]: osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] boot 2023-12-14T14:06:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:15 smithi119 ceph-mon[43834]: osdmap e24: 4 total, 4 up, 4 in 2023-12-14T14:06:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:16.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:15 smithi069 ceph-mon[42034]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T14:06:16.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:16.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:06:16.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:06:16.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:16.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:15 smithi069 ceph-mon[42034]: osd.3 [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] boot 2023-12-14T14:06:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:15 smithi069 ceph-mon[42034]: osdmap e24: 4 total, 4 up, 4 in 2023-12-14T14:06:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:06:17.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:16 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:06:17.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:16 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:06:17.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:16 smithi119 ceph-mon[43834]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:06:17.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:16 smithi119 ceph-mon[43834]: osdmap e25: 4 total, 4 up, 4 in 2023-12-14T14:06:17.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:16 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:06:17.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:16 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:06:17.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:16 smithi069 ceph-mon[42034]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:06:17.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:16 smithi069 ceph-mon[42034]: osdmap e25: 4 total, 4 up, 4 in 2023-12-14T14:06:17.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:16 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:06:17.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:16 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:06:17.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:16 smithi081 ceph-mon[43371]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:06:17.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:16 smithi081 ceph-mon[43371]: osdmap e25: 4 total, 4 up, 4 in 2023-12-14T14:06:18.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:17 smithi119 ceph-mon[43834]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:18.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:17 smithi119 ceph-mon[43834]: osdmap e26: 4 total, 4 up, 4 in 2023-12-14T14:06:18.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:17 smithi119 ceph-mon[43834]: from='client.? 172.21.15.81:0/3921818353' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f27f286d-c5ed-4fed-8624-0ec67bc590fa"}]: dispatch 2023-12-14T14:06:18.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:17 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f27f286d-c5ed-4fed-8624-0ec67bc590fa"}]: dispatch 2023-12-14T14:06:18.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:17 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f27f286d-c5ed-4fed-8624-0ec67bc590fa"}]': finished 2023-12-14T14:06:18.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:17 smithi119 ceph-mon[43834]: osdmap e27: 5 total, 4 up, 5 in 2023-12-14T14:06:18.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:17 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:18.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:17 smithi069 ceph-mon[42034]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:18.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:17 smithi069 ceph-mon[42034]: osdmap e26: 4 total, 4 up, 4 in 2023-12-14T14:06:18.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:17 smithi069 ceph-mon[42034]: from='client.? 172.21.15.81:0/3921818353' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f27f286d-c5ed-4fed-8624-0ec67bc590fa"}]: dispatch 2023-12-14T14:06:18.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:17 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f27f286d-c5ed-4fed-8624-0ec67bc590fa"}]: dispatch 2023-12-14T14:06:18.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:17 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f27f286d-c5ed-4fed-8624-0ec67bc590fa"}]': finished 2023-12-14T14:06:18.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:17 smithi069 ceph-mon[42034]: osdmap e27: 5 total, 4 up, 5 in 2023-12-14T14:06:18.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:17 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:18.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:17 smithi081 ceph-mon[43371]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:18.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:17 smithi081 ceph-mon[43371]: osdmap e26: 4 total, 4 up, 4 in 2023-12-14T14:06:18.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:17 smithi081 ceph-mon[43371]: from='client.? 172.21.15.81:0/3921818353' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f27f286d-c5ed-4fed-8624-0ec67bc590fa"}]: dispatch 2023-12-14T14:06:18.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:17 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f27f286d-c5ed-4fed-8624-0ec67bc590fa"}]: dispatch 2023-12-14T14:06:18.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:17 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f27f286d-c5ed-4fed-8624-0ec67bc590fa"}]': finished 2023-12-14T14:06:18.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:17 smithi081 ceph-mon[43371]: osdmap e27: 5 total, 4 up, 5 in 2023-12-14T14:06:18.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:17 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:19.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:18 smithi119 ceph-mon[43834]: from='client.? 172.21.15.81:0/3779046391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:19.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:18 smithi119 ceph-mon[43834]: osdmap e28: 5 total, 4 up, 5 in 2023-12-14T14:06:19.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:19.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:18 smithi069 ceph-mon[42034]: from='client.? 172.21.15.81:0/3779046391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:19.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:18 smithi069 ceph-mon[42034]: osdmap e28: 5 total, 4 up, 5 in 2023-12-14T14:06:19.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:19.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:18 smithi081 ceph-mon[43371]: from='client.? 172.21.15.81:0/3779046391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:19.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:18 smithi081 ceph-mon[43371]: osdmap e28: 5 total, 4 up, 5 in 2023-12-14T14:06:19.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:20.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:19 smithi119 ceph-mon[43834]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:20.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:19 smithi119 ceph-mon[43834]: osdmap e29: 5 total, 4 up, 5 in 2023-12-14T14:06:20.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:20.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:19 smithi069 ceph-mon[42034]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:20.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:19 smithi069 ceph-mon[42034]: osdmap e29: 5 total, 4 up, 5 in 2023-12-14T14:06:20.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:20.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:19 smithi081 ceph-mon[43371]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:20.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:19 smithi081 ceph-mon[43371]: osdmap e29: 5 total, 4 up, 5 in 2023-12-14T14:06:20.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:22.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:21 smithi081 ceph-mon[43371]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:22.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:21 smithi119 ceph-mon[43834]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:22.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:21 smithi069 ceph-mon[42034]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:24.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:23 smithi119 ceph-mon[43834]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2023-12-14T14:06:24.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:23 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-14T14:06:24.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:23 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:24.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:23 smithi069 ceph-mon[42034]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2023-12-14T14:06:24.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:23 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-14T14:06:24.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:23 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:24.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:23 smithi081 ceph-mon[43371]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2023-12-14T14:06:24.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:23 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-14T14:06:24.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:23 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:25.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:25 smithi081 ceph-mon[43371]: Deploying daemon osd.4 on smithi081 2023-12-14T14:06:25.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:25 smithi119 ceph-mon[43834]: Deploying daemon osd.4 on smithi081 2023-12-14T14:06:25.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:25 smithi069 ceph-mon[42034]: Deploying daemon osd.4 on smithi081 2023-12-14T14:06:26.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:26 smithi119 ceph-mon[43834]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-12-14T14:06:26.315 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:26 smithi081 ceph-mon[43371]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-12-14T14:06:26.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:26 smithi069 ceph-mon[42034]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-12-14T14:06:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:27 smithi081 ceph-mon[43371]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-12-14T14:06:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:27 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:27 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:27 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:28.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:27 smithi119 ceph-mon[43834]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-12-14T14:06:28.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:27 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:28.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:27 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:28.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:27 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:28.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:27 smithi069 ceph-mon[42034]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-12-14T14:06:28.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:27 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:28.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:27 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:28.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:27 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:29.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.133+0000 7f5f27fff700 1 -- 172.21.15.81:0/756004629 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5f40068d60 con 0x7f5f280a11d0 2023-12-14T14:06:29.134 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 4 on host 'smithi081' 2023-12-14T14:06:29.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.135+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f280a11d0 msgr2=0x7f5f280a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:29.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.135+0000 7f5f451e0700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f280a11d0 0x7f5f280a3680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400b2e0 tx=0x7f5f34005fd0 comp rx=0 tx=0).stop 2023-12-14T14:06:29.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.135+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f40100d70 msgr2=0x7f5f4019f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:29.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.135+0000 7f5f451e0700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f40100d70 0x7f5f4019f870 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800ef30 tx=0x7f5f3800c3a0 comp rx=0 tx=0).stop 2023-12-14T14:06:29.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.136+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 shutdown_connections 2023-12-14T14:06:29.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.136+0000 7f5f451e0700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5f280a11d0 0x7f5f280a3680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:29.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.136+0000 7f5f451e0700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f40100d70 0x7f5f4019f870 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:29.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.136+0000 7f5f451e0700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f400ff1e0 0x7f5f401982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:29.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.136+0000 7f5f451e0700 1 --2- 172.21.15.81:0/756004629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f401003e0 0x7f5f401987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:29.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.136+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 >> 172.21.15.81:0/756004629 conn(0x7f5f400fa7f0 msgr2=0x7f5f40068650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:06:29.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.136+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 shutdown_connections 2023-12-14T14:06:29.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:06:29.136+0000 7f5f451e0700 1 -- 172.21.15.81:0/756004629 wait complete. 2023-12-14T14:06:29.431 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.432 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.433 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:29 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:29.523 DEBUG:teuthology.orchestra.run.smithi081:osd.4> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.4.service 2023-12-14T14:06:29.526 INFO:tasks.cephadm:Deploying osd.5 on smithi119 with /dev/vg_nvme/lv_3... 2023-12-14T14:06:29.526 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-14T14:06:29.554 INFO:journalctl@ceph.osd.4.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:06:29.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:29 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:29.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:06:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:06:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:29 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:29.845 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:06:31.086 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-14T14:06:31.086 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-14T14:06:31.087 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-14T14:06:31.087 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-14T14:06:31.087 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110823 s, 946 MB/s 2023-12-14T14:06:31.087 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-14T14:06:31.148 INFO:journalctl@ceph.osd.4.smithi081.stdout:Dec 14 14:06:30 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-4[53679]: 2023-12-14T14:06:30.833+0000 7f901f375640 -1 osd.4 0 log_to_monitors true 2023-12-14T14:06:31.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_3 2023-12-14T14:06:31.774 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:06:31.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='osd.4 [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:31.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='osd.4 [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:32.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='osd.4 [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:32.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.711+0000 7f29ffc3f700 1 -- 172.21.15.119:0/1408233443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 msgr2=0x7f29f8107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:32.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.711+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/1408233443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 0x7f29f8107840 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f29f000b0a0 tx=0x7f29f000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:06:32.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.711+0000 7f29ffc3f700 1 -- 172.21.15.119:0/1408233443 shutdown_connections 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.711+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/1408233443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 0x7f29f8107840 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.711+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/1408233443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29f80ff3f0 0x7f29f80ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/1408233443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f81005f0 0x7f29f8100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 -- 172.21.15.119:0/1408233443 >> 172.21.15.119:0/1408233443 conn(0x7f29f80faa20 msgr2=0x7f29f80fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 -- 172.21.15.119:0/1408233443 shutdown_connections 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 -- 172.21.15.119:0/1408233443 wait complete. 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 Processor -- start 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 -- start start 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f80ff3f0 0x7f29f81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29f81005f0 0x7f29f8196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 0x7f29f819d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f819de70 con 0x7f29f81005f0 2023-12-14T14:06:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f819dfb0 con 0x7f29f80ff3f0 2023-12-14T14:06:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29ffc3f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f819e140 con 0x7f29f8100f80 2023-12-14T14:06:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.712+0000 7f29fe1dc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 0x7f29f819d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fe1dc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 0x7f29f819d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48654/0 (socket says 172.21.15.119:48654) 2023-12-14T14:06:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fe1dc700 1 -- 172.21.15.119:0/2132457710 learned_addr learned my addr 172.21.15.119:0/2132457710 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:06:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fd9db700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f80ff3f0 0x7f29f81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fd1da700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29f81005f0 0x7f29f8196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:32.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fe1dc700 1 -- 172.21.15.119:0/2132457710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f80ff3f0 msgr2=0x7f29f81962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:32.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fe1dc700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f80ff3f0 0x7f29f81962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:32.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fe1dc700 1 -- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29f81005f0 msgr2=0x7f29f8196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:32.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fe1dc700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29f81005f0 0x7f29f8196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:32.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fe1dc700 1 -- 172.21.15.119:0/2132457710 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f0009d00 con 0x7f29f8100f80 2023-12-14T14:06:32.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29fe1dc700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 0x7f29f819d8a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f29f0007ab0 tx=0x7f29f0004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:06:32.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29eeffd700 1 -- 172.21.15.119:0/2132457710 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f000e040 con 0x7f29f8100f80 2023-12-14T14:06:32.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29eeffd700 1 -- 172.21.15.119:0/2132457710 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29f000cec0 con 0x7f29f8100f80 2023-12-14T14:06:32.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f810ad40 con 0x7f29f8100f80 2023-12-14T14:06:32.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29eeffd700 1 -- 172.21.15.119:0/2132457710 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f001bb30 con 0x7f29f8100f80 2023-12-14T14:06:32.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.713+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f810abb0 con 0x7f29f8100f80 2023-12-14T14:06:32.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.714+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f8066ea0 con 0x7f29f8100f80 2023-12-14T14:06:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.715+0000 7f29eeffd700 1 -- 172.21.15.119:0/2132457710 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f29f001bc90 con 0x7f29f8100f80 2023-12-14T14:06:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.716+0000 7f29eeffd700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f29e40a1150 0x7f29e40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.716+0000 7f29eeffd700 1 -- 172.21.15.119:0/2132457710 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3821+0+0 (secure 0 0 0) 0x7f29f00cd1c0 con 0x7f29f8100f80 2023-12-14T14:06:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.716+0000 7f29fd9db700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f29e40a1150 0x7f29e40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.717+0000 7f29fd9db700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f29e40a1150 0x7f29e40a3600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f29f8100450 tx=0x7f29e800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:06:32.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.720+0000 7f29eeffd700 1 -- 172.21.15.119:0/2132457710 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f29f0097b30 con 0x7f29f8100f80 2023-12-14T14:06:32.898 INFO:journalctl@ceph.osd.4.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-4[53679]: 2023-12-14T14:06:32.638+0000 7f90149ec700 -1 osd.4 0 waiting for initial osdmap 2023-12-14T14:06:32.898 INFO:journalctl@ceph.osd.4.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-4[53679]: 2023-12-14T14:06:32.646+0000 7f900dfdc700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:06:32.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi081 2023-12-14T14:06:32.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi081 to 8557M 2023-12-14T14:06:32.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:32.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:06:32.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:32.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-14T14:06:32.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: osdmap e30: 5 total, 4 up, 5 in 2023-12-14T14:06:32.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:32.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: from='osd.4 [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:06:32.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:32 smithi081 ceph-mon[43371]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:06:32.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:32.915+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f29f80698d0 con 0x7f29e40a1150 2023-12-14T14:06:33.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi081 2023-12-14T14:06:33.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi081 to 8557M 2023-12-14T14:06:33.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:33.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:06:33.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:33.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-14T14:06:33.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: osdmap e30: 5 total, 4 up, 5 in 2023-12-14T14:06:33.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:33.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: from='osd.4 [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:06:33.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:32 smithi119 ceph-mon[43834]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:06:33.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi081 2023-12-14T14:06:33.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi081 to 8557M 2023-12-14T14:06:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:06:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-14T14:06:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: osdmap e30: 5 total, 4 up, 5 in 2023-12-14T14:06:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: from='osd.4 [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:06:33.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:32 smithi069 ceph-mon[42034]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:06:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:33 smithi081 ceph-mon[43371]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:33 smithi081 ceph-mon[43371]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:06:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:33 smithi081 ceph-mon[43371]: osdmap e31: 5 total, 4 up, 5 in 2023-12-14T14:06:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:33 smithi081 ceph-mon[43371]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:06:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:06:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:06:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:34.015 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:33 smithi119 ceph-mon[43834]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:34.015 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:33 smithi119 ceph-mon[43834]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:06:34.015 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:33 smithi119 ceph-mon[43834]: osdmap e31: 5 total, 4 up, 5 in 2023-12-14T14:06:34.015 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:34.016 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:34.016 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:33 smithi119 ceph-mon[43834]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:06:34.016 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:06:34.016 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:06:34.016 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:34.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:33 smithi069 ceph-mon[42034]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:34.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:33 smithi069 ceph-mon[42034]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:06:34.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:33 smithi069 ceph-mon[42034]: osdmap e31: 5 total, 4 up, 5 in 2023-12-14T14:06:34.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:34.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:34.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:33 smithi069 ceph-mon[42034]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:06:34.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:06:34.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:06:34.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:34.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:34 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:06:34.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:34 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:06:34.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:34 smithi081 ceph-mon[43371]: osd.4 [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] boot 2023-12-14T14:06:34.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:34 smithi081 ceph-mon[43371]: osdmap e32: 5 total, 5 up, 5 in 2023-12-14T14:06:34.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:34 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:35.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:34 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:06:35.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:34 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:06:35.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:34 smithi119 ceph-mon[43834]: osd.4 [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] boot 2023-12-14T14:06:35.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:34 smithi119 ceph-mon[43834]: osdmap e32: 5 total, 5 up, 5 in 2023-12-14T14:06:35.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:34 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:35.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:34 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:06:35.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:34 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:06:35.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:34 smithi069 ceph-mon[42034]: osd.4 [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] boot 2023-12-14T14:06:35.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:34 smithi069 ceph-mon[42034]: osdmap e32: 5 total, 5 up, 5 in 2023-12-14T14:06:35.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:34 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:06:36.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:35 smithi119 ceph-mon[43834]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:36.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:35 smithi119 ceph-mon[43834]: osdmap e33: 5 total, 5 up, 5 in 2023-12-14T14:06:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:35 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/836206237' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e65ea32-885b-41d1-a325-922ff4f66117"}]: dispatch 2023-12-14T14:06:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:35 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e65ea32-885b-41d1-a325-922ff4f66117"}]: dispatch 2023-12-14T14:06:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:35 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e65ea32-885b-41d1-a325-922ff4f66117"}]': finished 2023-12-14T14:06:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:35 smithi119 ceph-mon[43834]: osdmap e34: 6 total, 5 up, 6 in 2023-12-14T14:06:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:35 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/2182356541' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:35 smithi069 ceph-mon[42034]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:35 smithi069 ceph-mon[42034]: osdmap e33: 5 total, 5 up, 5 in 2023-12-14T14:06:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:35 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/836206237' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e65ea32-885b-41d1-a325-922ff4f66117"}]: dispatch 2023-12-14T14:06:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:35 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e65ea32-885b-41d1-a325-922ff4f66117"}]: dispatch 2023-12-14T14:06:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:35 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e65ea32-885b-41d1-a325-922ff4f66117"}]': finished 2023-12-14T14:06:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:35 smithi069 ceph-mon[42034]: osdmap e34: 6 total, 5 up, 6 in 2023-12-14T14:06:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:35 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/2182356541' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:36.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:35 smithi081 ceph-mon[43371]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-12-14T14:06:36.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:35 smithi081 ceph-mon[43371]: osdmap e33: 5 total, 5 up, 5 in 2023-12-14T14:06:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:35 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/836206237' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e65ea32-885b-41d1-a325-922ff4f66117"}]: dispatch 2023-12-14T14:06:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:35 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e65ea32-885b-41d1-a325-922ff4f66117"}]: dispatch 2023-12-14T14:06:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:35 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e65ea32-885b-41d1-a325-922ff4f66117"}]': finished 2023-12-14T14:06:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:35 smithi081 ceph-mon[43371]: osdmap e34: 6 total, 5 up, 6 in 2023-12-14T14:06:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:35 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/2182356541' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:37.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:37 smithi119 ceph-mon[43834]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:37.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:37 smithi069 ceph-mon[42034]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:37.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:37 smithi081 ceph-mon[43371]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:39.898 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:39 smithi119 ceph-mon[43834]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:39 smithi081 ceph-mon[43371]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:40.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:39 smithi069 ceph-mon[42034]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:41 smithi081 ceph-mon[43371]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:41 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-14T14:06:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:41 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:41 smithi081 ceph-mon[43371]: Deploying daemon osd.5 on smithi119 2023-12-14T14:06:41.931 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:41 smithi119 ceph-mon[43834]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:41.931 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-14T14:06:41.931 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:41 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:41.931 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:41 smithi119 ceph-mon[43834]: Deploying daemon osd.5 on smithi119 2023-12-14T14:06:42.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:41 smithi069 ceph-mon[42034]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:42.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:41 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-14T14:06:42.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:41 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:42.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:41 smithi069 ceph-mon[42034]: Deploying daemon osd.5 on smithi119 2023-12-14T14:06:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:43 smithi081 ceph-mon[43371]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:43 smithi119 ceph-mon[43834]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:44.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:43 smithi069 ceph-mon[42034]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:45.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:45 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:45.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:45 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:45.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:45 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:45.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:45 smithi119 ceph-mon[43834]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:45.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:45 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:45.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:45 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:45.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:45 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:45 smithi069 ceph-mon[42034]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:45 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:45 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:45 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:45 smithi081 ceph-mon[43371]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:46.823 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 5 on host 'smithi119' 2023-12-14T14:06:46.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.824+0000 7f29eeffd700 1 -- 172.21.15.119:0/2132457710 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f29f80698d0 con 0x7f29e40a1150 2023-12-14T14:06:46.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f29e40a1150 msgr2=0x7f29e40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f29e40a1150 0x7f29e40a3600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f29f8100450 tx=0x7f29e800b410 comp rx=0 tx=0).stop 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 msgr2=0x7f29f819d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 0x7f29f819d8a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f29f0007ab0 tx=0x7f29f0004d00 comp rx=0 tx=0).stop 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 shutdown_connections 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f29e40a1150 0x7f29e40a3600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f8100f80 0x7f29f819d8a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f80ff3f0 0x7f29f81962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 --2- 172.21.15.119:0/2132457710 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29f81005f0 0x7f29f8196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 >> 172.21.15.119:0/2132457710 conn(0x7f29f80faa20 msgr2=0x7f29f80691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 shutdown_connections 2023-12-14T14:06:46.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:06:46.825+0000 7f29ffc3f700 1 -- 172.21.15.119:0/2132457710 wait complete. 2023-12-14T14:06:47.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:47.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:47.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:47.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:47.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.184 DEBUG:teuthology.orchestra.run.smithi119:osd.5> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.5.service 2023-12-14T14:06:47.187 INFO:tasks.cephadm:Deploying osd.6 on smithi069 with /dev/vg_nvme/lv_2... 2023-12-14T14:06:47.187 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-14T14:06:47.218 INFO:journalctl@ceph.osd.5.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:06:47.506 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:06:47.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:47 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:47.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:47 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:06:47.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:47 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:47.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:47 smithi069 ceph-mon[42034]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:47.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:47 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:47.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:47 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:48.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:47 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:48.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:47 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:06:48.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:47 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:48.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:47 smithi119 ceph-mon[43834]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:48.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:47 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:48.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:47 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:48.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:47 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:48.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:47 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:06:48.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:47 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:47 smithi081 ceph-mon[43371]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:47 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:47 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:06:48.697 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:06:48 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:06:48.422+0000 7fd4e294d640 -1 osd.5 0 log_to_monitors true 2023-12-14T14:06:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-14T14:06:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-14T14:06:48.793 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2023-12-14T14:06:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2023-12-14T14:06:48.793 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111277 s, 942 MB/s 2023-12-14T14:06:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2023-12-14T14:06:49.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:48 smithi119 ceph-mon[43834]: from='osd.5 [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T14:06:49.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:48 smithi119 ceph-mon[43834]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T14:06:49.062 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:48 smithi069 ceph-mon[42034]: from='osd.5 [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T14:06:49.062 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:48 smithi069 ceph-mon[42034]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T14:06:49.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:48 smithi081 ceph-mon[43371]: from='osd.5 [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T14:06:49.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:48 smithi081 ceph-mon[43371]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T14:06:49.197 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi069:vg_nvme/lv_2 2023-12-14T14:06:49.504 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: osdmap e35: 6 total, 5 up, 6 in 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='osd.5 [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi119 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi119 to 8556M 2023-12-14T14:06:49.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:49.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:49.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:49.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:49.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:49.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:06:49.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:49 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:06:50.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:50.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-14T14:06:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: osdmap e35: 6 total, 5 up, 6 in 2023-12-14T14:06:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='osd.5 [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:06:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:06:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi119 2023-12-14T14:06:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi119 to 8556M 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:06:50.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:49 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:06:50.274 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:06:49.819+0000 7fd4d7fc4700 -1 osd.5 0 waiting for initial osdmap 2023-12-14T14:06:50.274 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:06:49.828+0000 7fd4d15b4700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:06:50.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:50.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-14T14:06:50.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: osdmap e35: 6 total, 5 up, 6 in 2023-12-14T14:06:50.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='osd.5 [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi119 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi119 to 8556M 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:06:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:49 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:06:50.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.469+0000 7fd4d4d33700 1 -- 172.21.15.69:0/2838375121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 msgr2=0x7fd4d0100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:50.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.469+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/2838375121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 0x7fd4d0100720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009990 tx=0x7fd4c4009ca0 comp rx=0 tx=0).stop 2023-12-14T14:06:50.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.469+0000 7fd4d4d33700 1 -- 172.21.15.69:0/2838375121 shutdown_connections 2023-12-14T14:06:50.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.469+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/2838375121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d0101ea0 0x7fd4d0108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:50.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.469+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/2838375121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 0x7fd4d0100720 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:50.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.469+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/2838375121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d0101510 0x7fd4d0101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:50.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.469+0000 7fd4d4d33700 1 -- 172.21.15.69:0/2838375121 >> 172.21.15.69:0/2838375121 conn(0x7fd4d00fb960 msgr2=0x7fd4d00fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:06:50.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.469+0000 7fd4d4d33700 1 -- 172.21.15.69:0/2838375121 shutdown_connections 2023-12-14T14:06:50.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.469+0000 7fd4d4d33700 1 -- 172.21.15.69:0/2838375121 wait complete. 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4d4d33700 1 Processor -- start 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4d4d33700 1 -- start start 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4d4d33700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 0x7fd4d0196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4d4d33700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d0101510 0x7fd4d01965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4d4d33700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d0101ea0 0x7fd4d019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4d4d33700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d019dc10 con 0x7fd4d0100310 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4d4d33700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d019dd50 con 0x7fd4d0101ea0 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4d4d33700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d019dee0 con 0x7fd4d0101510 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ce59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 0x7fd4d0196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:50.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ce59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 0x7fd4d0196080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58054/0 (socket says 172.21.15.69:58054) 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ce59c700 1 -- 172.21.15.69:0/3225333346 learned_addr learned my addr 172.21.15.69:0/3225333346 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4cdd9b700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d0101510 0x7fd4d01965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ced9d700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d0101ea0 0x7fd4d019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ce59c700 1 -- 172.21.15.69:0/3225333346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d0101510 msgr2=0x7fd4d01965c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ce59c700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d0101510 0x7fd4d01965c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ce59c700 1 -- 172.21.15.69:0/3225333346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d0101ea0 msgr2=0x7fd4d019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ce59c700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d0101ea0 0x7fd4d019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ce59c700 1 -- 172.21.15.69:0/3225333346 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40095f0 con 0x7fd4d0100310 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.470+0000 7fd4ced9d700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d0101ea0 0x7fd4d019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.471+0000 7fd4ce59c700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 0x7fd4d0196080 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4004730 tx=0x7fd4c4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.471+0000 7fd4bf7fe700 1 -- 172.21.15.69:0/3225333346 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c401d070 con 0x7fd4d0100310 2023-12-14T14:06:50.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.471+0000 7fd4bf7fe700 1 -- 172.21.15.69:0/3225333346 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4c4004cd0 con 0x7fd4d0100310 2023-12-14T14:06:50.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.471+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d010bcd0 con 0x7fd4d0100310 2023-12-14T14:06:50.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.471+0000 7fd4bf7fe700 1 -- 172.21.15.69:0/3225333346 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4005590 con 0x7fd4d0100310 2023-12-14T14:06:50.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.471+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d010bb40 con 0x7fd4d0100310 2023-12-14T14:06:50.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.472+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d01078e0 con 0x7fd4d0100310 2023-12-14T14:06:50.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.473+0000 7fd4bf7fe700 1 -- 172.21.15.69:0/3225333346 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fd4c400fbb0 con 0x7fd4d0100310 2023-12-14T14:06:50.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.473+0000 7fd4bf7fe700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4b80a1150 0x7fd4b80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:06:50.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.473+0000 7fd4cdd9b700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4b80a1150 0x7fd4b80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:06:50.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.473+0000 7fd4bf7fe700 1 -- 172.21.15.69:0/3225333346 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4253+0+0 (secure 0 0 0) 0x7fd4c40ccc70 con 0x7fd4d0100310 2023-12-14T14:06:50.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.474+0000 7fd4cdd9b700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4b80a1150 0x7fd4b80a3600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005fd0 tx=0x7fd4c000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:06:50.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.478+0000 7fd4bf7fe700 1 -- 172.21.15.69:0/3225333346 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd4c405a730 con 0x7fd4d0100310 2023-12-14T14:06:50.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:06:50.678+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4d0061a80 con 0x7fd4b80a1150 2023-12-14T14:06:50.824 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:06:50.824 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: osdmap e36: 6 total, 5 up, 6 in 2023-12-14T14:06:50.824 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:50.824 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:50.824 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:06:50.824 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:06:50.824 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:50.824 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: osd.5 [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] boot 2023-12-14T14:06:50.825 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: osdmap e37: 6 total, 6 up, 6 in 2023-12-14T14:06:50.825 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:50 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: osdmap e36: 6 total, 5 up, 6 in 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: osd.5 [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] boot 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: osdmap e37: 6 total, 6 up, 6 in 2023-12-14T14:06:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:50 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:51.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:06:51.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: osdmap e36: 6 total, 5 up, 6 in 2023-12-14T14:06:51.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:51.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:51.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:06:51.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:06:51.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:51.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: osd.5 [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] boot 2023-12-14T14:06:51.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: osdmap e37: 6 total, 6 up, 6 in 2023-12-14T14:06:51.276 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:50 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:06:52.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:51 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:06:52.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:51 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:06:52.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:51 smithi069 ceph-mon[42034]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:52.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:51 smithi069 ceph-mon[42034]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:06:52.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:51 smithi069 ceph-mon[42034]: osdmap e38: 6 total, 6 up, 6 in 2023-12-14T14:06:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:51 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:06:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:51 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:06:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:51 smithi081 ceph-mon[43371]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:51 smithi081 ceph-mon[43371]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:06:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:51 smithi081 ceph-mon[43371]: osdmap e38: 6 total, 6 up, 6 in 2023-12-14T14:06:52.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:51 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:06:52.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:51 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:06:52.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:51 smithi119 ceph-mon[43834]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-12-14T14:06:52.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:51 smithi119 ceph-mon[43834]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:06:52.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:51 smithi119 ceph-mon[43834]: osdmap e38: 6 total, 6 up, 6 in 2023-12-14T14:06:53.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:53 smithi119 ceph-mon[43834]: osdmap e39: 6 total, 6 up, 6 in 2023-12-14T14:06:53.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:53 smithi119 ceph-mon[43834]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:06:53.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:53 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2585942578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edda790d-463a-4082-b2ca-c569272907ea"}]: dispatch 2023-12-14T14:06:53.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:53 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2585942578' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edda790d-463a-4082-b2ca-c569272907ea"}]': finished 2023-12-14T14:06:53.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:53 smithi119 ceph-mon[43834]: osdmap e40: 7 total, 6 up, 7 in 2023-12-14T14:06:53.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:06:53.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:53 smithi069 ceph-mon[42034]: osdmap e39: 6 total, 6 up, 6 in 2023-12-14T14:06:53.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:53 smithi069 ceph-mon[42034]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:06:53.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:53 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2585942578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edda790d-463a-4082-b2ca-c569272907ea"}]: dispatch 2023-12-14T14:06:53.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:53 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2585942578' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edda790d-463a-4082-b2ca-c569272907ea"}]': finished 2023-12-14T14:06:53.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:53 smithi069 ceph-mon[42034]: osdmap e40: 7 total, 6 up, 7 in 2023-12-14T14:06:53.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:06:53.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:53 smithi081 ceph-mon[43371]: osdmap e39: 6 total, 6 up, 6 in 2023-12-14T14:06:53.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:53 smithi081 ceph-mon[43371]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:06:53.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:53 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2585942578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edda790d-463a-4082-b2ca-c569272907ea"}]: dispatch 2023-12-14T14:06:53.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:53 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2585942578' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edda790d-463a-4082-b2ca-c569272907ea"}]': finished 2023-12-14T14:06:53.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:53 smithi081 ceph-mon[43371]: osdmap e40: 7 total, 6 up, 7 in 2023-12-14T14:06:53.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:06:54.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:54 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2550169420' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:54.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:54 smithi119 ceph-mon[43834]: osdmap e41: 7 total, 6 up, 7 in 2023-12-14T14:06:54.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:06:54.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:54 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2550169420' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:54.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:54 smithi069 ceph-mon[42034]: osdmap e41: 7 total, 6 up, 7 in 2023-12-14T14:06:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:06:54.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:54 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2550169420' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:06:54.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:54 smithi081 ceph-mon[43371]: osdmap e41: 7 total, 6 up, 7 in 2023-12-14T14:06:54.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:54 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:06:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:55 smithi081 ceph-mon[43371]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:06:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:55 smithi081 ceph-mon[43371]: osdmap e42: 7 total, 6 up, 7 in 2023-12-14T14:06:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:55 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:06:56.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:55 smithi119 ceph-mon[43834]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:06:56.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:55 smithi119 ceph-mon[43834]: osdmap e42: 7 total, 6 up, 7 in 2023-12-14T14:06:56.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:06:56.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:55 smithi069 ceph-mon[42034]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:06:56.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:55 smithi069 ceph-mon[42034]: osdmap e42: 7 total, 6 up, 7 in 2023-12-14T14:06:56.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:06:57.399 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:57 smithi069 ceph-mon[42034]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:06:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:57 smithi119 ceph-mon[43834]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:06:57.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:57 smithi081 ceph-mon[43371]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:06:58.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-14T14:06:58.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:58.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-14T14:06:58.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:59.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-14T14:06:59.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:06:59.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:59 smithi069 ceph-mon[42034]: Deploying daemon osd.6 on smithi069 2023-12-14T14:06:59.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:06:59 smithi069 ceph-mon[42034]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-14T14:06:59.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:59 smithi081 ceph-mon[43371]: Deploying daemon osd.6 on smithi069 2023-12-14T14:06:59.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:06:59 smithi081 ceph-mon[43371]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-14T14:07:00.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:59 smithi119 ceph-mon[43834]: Deploying daemon osd.6 on smithi069 2023-12-14T14:07:00.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:06:59 smithi119 ceph-mon[43834]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-14T14:07:01.699 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:01 smithi069 ceph-mon[42034]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T14:07:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:01 smithi081 ceph-mon[43371]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T14:07:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:01 smithi119 ceph-mon[43834]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T14:07:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:03.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:03 smithi069 ceph-mon[42034]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-12-14T14:07:03.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:03.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:03.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:03.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:03 smithi119 ceph-mon[43834]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-12-14T14:07:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:03 smithi081 ceph-mon[43371]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-12-14T14:07:04.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.723+0000 7fd4bf7fe700 1 -- 172.21.15.69:0/3225333346 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd4d0061a80 con 0x7fd4b80a1150 2023-12-14T14:07:04.723 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 6 on host 'smithi069' 2023-12-14T14:07:04.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4b80a1150 msgr2=0x7fd4b80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:04.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4b80a1150 0x7fd4b80a3600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005fd0 tx=0x7fd4c000a560 comp rx=0 tx=0).stop 2023-12-14T14:07:04.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 msgr2=0x7fd4d0196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:04.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 0x7fd4d0196080 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4004730 tx=0x7fd4c4005ef0 comp rx=0 tx=0).stop 2023-12-14T14:07:04.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 shutdown_connections 2023-12-14T14:07:04.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4b80a1150 0x7fd4b80a3600 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:04.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d0101ea0 0x7fd4d019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:04.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4d0100310 0x7fd4d0196080 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:04.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 --2- 172.21.15.69:0/3225333346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d0101510 0x7fd4d01965c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:04.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 >> 172.21.15.69:0/3225333346 conn(0x7fd4d00fb960 msgr2=0x7fd4d0104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:07:04.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 shutdown_connections 2023-12-14T14:07:04.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:04.725+0000 7fd4d4d33700 1 -- 172.21.15.69:0/3225333346 wait complete. 2023-12-14T14:07:05.120 DEBUG:teuthology.orchestra.run.smithi069:osd.6> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.6.service 2023-12-14T14:07:05.123 INFO:tasks.cephadm:Deploying osd.7 on smithi081 with /dev/vg_nvme/lv_2... 2023-12-14T14:07:05.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-14T14:07:05.168 INFO:journalctl@ceph.osd.6.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:07:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:07:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:05.296 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.296 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.296 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:05.296 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:05.296 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:05.296 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.296 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:07:05.296 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:05.297 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.297 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.297 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:05.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:05.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:07:06.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:06 smithi081 ceph-mon[43371]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:07:06.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:06 smithi119 ceph-mon[43834]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:07:06.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:06 smithi069 ceph-mon[42034]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:07:06.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:07:06 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:07:06.181+0000 7f3a14d89640 -1 osd.6 0 log_to_monitors true 2023-12-14T14:07:06.714 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-14T14:07:06.714 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-14T14:07:06.714 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2023-12-14T14:07:06.714 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2023-12-14T14:07:06.714 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125195 s, 838 MB/s 2023-12-14T14:07:06.715 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2023-12-14T14:07:07.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2023-12-14T14:07:07.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-14T14:07:07.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:07.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:07.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:07.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:07.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:07.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:07.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-14T14:07:07.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:07.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:07.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:07.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:07.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:07.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:07:08.255 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-14T14:07:08.255 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi069 2023-12-14T14:07:08.255 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi069 to 5704M 2023-12-14T14:07:08.256 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:08.256 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:07:08.256 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:08.256 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-14T14:07:08.256 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: osdmap e43: 7 total, 6 up, 7 in 2023-12-14T14:07:08.256 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:08.256 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:08 smithi081 ceph-mon[43371]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:07:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-14T14:07:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi069 2023-12-14T14:07:08.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi069 to 5704M 2023-12-14T14:07:08.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:08.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:07:08.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:08.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-14T14:07:08.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: osdmap e43: 7 total, 6 up, 7 in 2023-12-14T14:07:08.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:08.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:08 smithi119 ceph-mon[43834]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:07:08.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:07:08.033+0000 7f3a0a400700 -1 osd.6 0 waiting for initial osdmap 2023-12-14T14:07:08.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:07:08.044+0000 7f3a041f1700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:07:08.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-14T14:07:08.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi069 2023-12-14T14:07:08.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi069 to 5704M 2023-12-14T14:07:08.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:08.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:07:08.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:08.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-14T14:07:08.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: osdmap e43: 7 total, 6 up, 7 in 2023-12-14T14:07:08.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:08.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:08 smithi069 ceph-mon[42034]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:07:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.428+0000 7f544c25b700 1 -- 172.21.15.81:0/2436959122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 msgr2=0x7f5444108740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.428+0000 7f544c25b700 1 --2- 172.21.15.81:0/2436959122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 0x7f5444108740 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5434009990 tx=0x7f5434009ca0 comp rx=0 tx=0).stop 2023-12-14T14:07:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.428+0000 7f544c25b700 1 -- 172.21.15.81:0/2436959122 shutdown_connections 2023-12-14T14:07:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.428+0000 7f544c25b700 1 --2- 172.21.15.81:0/2436959122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 0x7f5444108740 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.428+0000 7f544c25b700 1 --2- 172.21.15.81:0/2436959122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54441002f0 0x7f5444100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.428+0000 7f544c25b700 1 --2- 172.21.15.81:0/2436959122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54441014f0 0x7f5444101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.428+0000 7f544c25b700 1 -- 172.21.15.81:0/2436959122 >> 172.21.15.81:0/2436959122 conn(0x7f54440fb900 msgr2=0x7f54440fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:07:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.428+0000 7f544c25b700 1 -- 172.21.15.81:0/2436959122 shutdown_connections 2023-12-14T14:07:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.428+0000 7f544c25b700 1 -- 172.21.15.81:0/2436959122 wait complete. 2023-12-14T14:07:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544c25b700 1 Processor -- start 2023-12-14T14:07:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544c25b700 1 -- start start 2023-12-14T14:07:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544c25b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54441002f0 0x7f5444196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544c25b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54441014f0 0x7f5444196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544c25b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 0x7f544419d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544c25b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419dba0 con 0x7f54441014f0 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544c25b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419dce0 con 0x7f5444101e80 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544c25b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419de70 con 0x7f54441002f0 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544a7f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 0x7f544419d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544a7f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 0x7f544419d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56346/0 (socket says 172.21.15.81:56346) 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f544a7f8700 1 -- 172.21.15.81:0/2145082908 learned_addr learned my addr 172.21.15.81:0/2145082908 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.429+0000 7f54497f6700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54441014f0 0x7f5444196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:08.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f5449ff7700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54441002f0 0x7f5444196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f544a7f8700 1 -- 172.21.15.81:0/2145082908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54441002f0 msgr2=0x7f5444196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f544a7f8700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54441002f0 0x7f5444196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f544a7f8700 1 -- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54441014f0 msgr2=0x7f5444196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f544a7f8700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54441014f0 0x7f5444196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f544a7f8700 1 -- 172.21.15.81:0/2145082908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54340095f0 con 0x7f5444101e80 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f544a7f8700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 0x7f544419d5d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5434005910 tx=0x7f543400f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f5442ffd700 1 -- 172.21.15.81:0/2145082908 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543401d070 con 0x7f5444101e80 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f5442ffd700 1 -- 172.21.15.81:0/2145082908 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54340047e0 con 0x7f5444101e80 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544410bcd0 con 0x7f5444101e80 2023-12-14T14:07:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f5442ffd700 1 -- 172.21.15.81:0/2145082908 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54340054b0 con 0x7f5444101e80 2023-12-14T14:07:08.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.430+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544410bb40 con 0x7f5444101e80 2023-12-14T14:07:08.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.431+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5444107850 con 0x7f5444101e80 2023-12-14T14:07:08.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.432+0000 7f5442ffd700 1 -- 172.21.15.81:0/2145082908 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f5434004950 con 0x7f5444101e80 2023-12-14T14:07:08.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.432+0000 7f5442ffd700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f542c0a1150 0x7f542c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:08.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.433+0000 7f5442ffd700 1 -- 172.21.15.81:0/2145082908 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4685+0+0 (secure 0 0 0) 0x7f54340ccb70 con 0x7f5444101e80 2023-12-14T14:07:08.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.433+0000 7f5449ff7700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f542c0a1150 0x7f542c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:08.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.433+0000 7f5449ff7700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f542c0a1150 0x7f542c0a3600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5444101350 tx=0x7f543c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:07:08.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.437+0000 7f5442ffd700 1 -- 172.21.15.81:0/2145082908 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5434097180 con 0x7f5444101e80 2023-12-14T14:07:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:08.634+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5444061c30 con 0x7f542c0a1150 2023-12-14T14:07:09.297 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:09 smithi081 ceph-mon[43371]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:07:09.297 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:09 smithi081 ceph-mon[43371]: osdmap e44: 7 total, 6 up, 7 in 2023-12-14T14:07:09.297 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:09.298 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:09.298 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:09 smithi081 ceph-mon[43371]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:07:09.298 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:09 smithi081 ceph-mon[43371]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:07:09.298 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:07:09.298 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:07:09.298 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:09.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:09 smithi069 ceph-mon[42034]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:07:09.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:09 smithi069 ceph-mon[42034]: osdmap e44: 7 total, 6 up, 7 in 2023-12-14T14:07:09.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:09.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:09.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:09 smithi069 ceph-mon[42034]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:07:09.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:09 smithi069 ceph-mon[42034]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:07:09.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:07:09.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:07:09.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:09.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:09 smithi119 ceph-mon[43834]: from='osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:07:09.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:09 smithi119 ceph-mon[43834]: osdmap e44: 7 total, 6 up, 7 in 2023-12-14T14:07:09.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:09.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:09.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:09 smithi119 ceph-mon[43834]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-12-14T14:07:09.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:09 smithi119 ceph-mon[43834]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:07:09.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:07:09.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:07:09.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:10 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:07:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:10 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:07:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:10 smithi081 ceph-mon[43371]: osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] boot 2023-12-14T14:07:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:10 smithi081 ceph-mon[43371]: osdmap e45: 7 total, 7 up, 7 in 2023-12-14T14:07:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:10 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:07:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:10 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:07:10.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:10 smithi069 ceph-mon[42034]: osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] boot 2023-12-14T14:07:10.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:10 smithi069 ceph-mon[42034]: osdmap e45: 7 total, 7 up, 7 in 2023-12-14T14:07:10.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:10.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:10 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:07:10.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:10 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:07:10.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:10 smithi119 ceph-mon[43834]: osd.6 [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] boot 2023-12-14T14:07:10.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:10 smithi119 ceph-mon[43834]: osdmap e45: 7 total, 7 up, 7 in 2023-12-14T14:07:10.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:07:11.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:11 smithi069 ceph-mon[42034]: osdmap e46: 7 total, 7 up, 7 in 2023-12-14T14:07:11.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:11 smithi069 ceph-mon[42034]: from='client.? 172.21.15.81:0/2518830515' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ef2f893-b375-4221-be5e-25e21d60006e"}]: dispatch 2023-12-14T14:07:11.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:11 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ef2f893-b375-4221-be5e-25e21d60006e"}]: dispatch 2023-12-14T14:07:11.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:11 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ef2f893-b375-4221-be5e-25e21d60006e"}]': finished 2023-12-14T14:07:11.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:11 smithi069 ceph-mon[42034]: osdmap e47: 8 total, 7 up, 8 in 2023-12-14T14:07:11.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:11.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:11 smithi069 ceph-mon[42034]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:11.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:11 smithi081 ceph-mon[43371]: osdmap e46: 7 total, 7 up, 7 in 2023-12-14T14:07:11.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:11 smithi081 ceph-mon[43371]: from='client.? 172.21.15.81:0/2518830515' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ef2f893-b375-4221-be5e-25e21d60006e"}]: dispatch 2023-12-14T14:07:11.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:11 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ef2f893-b375-4221-be5e-25e21d60006e"}]: dispatch 2023-12-14T14:07:11.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:11 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ef2f893-b375-4221-be5e-25e21d60006e"}]': finished 2023-12-14T14:07:11.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:11 smithi081 ceph-mon[43371]: osdmap e47: 8 total, 7 up, 8 in 2023-12-14T14:07:11.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:11.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:11 smithi081 ceph-mon[43371]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:11.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:11 smithi119 ceph-mon[43834]: osdmap e46: 7 total, 7 up, 7 in 2023-12-14T14:07:11.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:11 smithi119 ceph-mon[43834]: from='client.? 172.21.15.81:0/2518830515' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ef2f893-b375-4221-be5e-25e21d60006e"}]: dispatch 2023-12-14T14:07:11.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:11 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ef2f893-b375-4221-be5e-25e21d60006e"}]: dispatch 2023-12-14T14:07:11.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:11 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ef2f893-b375-4221-be5e-25e21d60006e"}]': finished 2023-12-14T14:07:11.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:11 smithi119 ceph-mon[43834]: osdmap e47: 8 total, 7 up, 8 in 2023-12-14T14:07:11.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:11.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:11 smithi119 ceph-mon[43834]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:12.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:12 smithi069 ceph-mon[42034]: from='client.? 172.21.15.81:0/2233698495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:07:12.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:12 smithi081 ceph-mon[43371]: from='client.? 172.21.15.81:0/2233698495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:07:12.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:12 smithi119 ceph-mon[43834]: from='client.? 172.21.15.81:0/2233698495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:07:13.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:13 smithi069 ceph-mon[42034]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:13.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:13 smithi081 ceph-mon[43371]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:13.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:13 smithi119 ceph-mon[43834]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:15 smithi081 ceph-mon[43371]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:16.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:15 smithi119 ceph-mon[43834]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:16.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:15 smithi069 ceph-mon[42034]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:17.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:17 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-14T14:07:17.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:17 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:17.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:17 smithi119 ceph-mon[43834]: Deploying daemon osd.7 on smithi081 2023-12-14T14:07:17.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:17 smithi119 ceph-mon[43834]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:17.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:17 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-14T14:07:17.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:17 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:17.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:17 smithi069 ceph-mon[42034]: Deploying daemon osd.7 on smithi081 2023-12-14T14:07:17.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:17 smithi069 ceph-mon[42034]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:17 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-14T14:07:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:17 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:17 smithi081 ceph-mon[43371]: Deploying daemon osd.7 on smithi081 2023-12-14T14:07:17.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:17 smithi081 ceph-mon[43371]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:19 smithi081 ceph-mon[43371]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:20.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:19 smithi119 ceph-mon[43834]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:20.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:19 smithi069 ceph-mon[42034]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:21 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:21 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:21 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:21 smithi069 ceph-mon[42034]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:21.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:21 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:21.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:21 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:21 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:21 smithi081 ceph-mon[43371]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:21.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:21 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:21.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:21 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:21.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:21 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:21.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:21 smithi119 ceph-mon[43834]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:22.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.685+0000 7f5442ffd700 1 -- 172.21.15.81:0/2145082908 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5444061c30 con 0x7f542c0a1150 2023-12-14T14:07:22.687 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 7 on host 'smithi081' 2023-12-14T14:07:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f542c0a1150 msgr2=0x7f542c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f542c0a1150 0x7f542c0a3600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5444101350 tx=0x7f543c009040 comp rx=0 tx=0).stop 2023-12-14T14:07:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 msgr2=0x7f544419d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 0x7f544419d5d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5434005910 tx=0x7f543400f690 comp rx=0 tx=0).stop 2023-12-14T14:07:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 shutdown_connections 2023-12-14T14:07:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f542c0a1150 0x7f542c0a3600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5444101e80 0x7f544419d5d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54441002f0 0x7f5444196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 --2- 172.21.15.81:0/2145082908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54441014f0 0x7f5444196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 >> 172.21.15.81:0/2145082908 conn(0x7f54440fb900 msgr2=0x7f5444104990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:07:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 shutdown_connections 2023-12-14T14:07:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:07:22.688+0000 7f544c25b700 1 -- 172.21.15.81:0/2145082908 wait complete. 2023-12-14T14:07:23.064 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.065 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.065 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:23.065 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:23.065 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:23.065 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.065 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:07:23.065 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:23.065 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.066 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.066 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:23.067 DEBUG:teuthology.orchestra.run.smithi081:osd.7> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.7.service 2023-12-14T14:07:23.070 INFO:tasks.cephadm:Deploying osd.8 on smithi119 with /dev/vg_nvme/lv_2... 2023-12-14T14:07:23.070 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-14T14:07:23.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:23.100 INFO:journalctl@ceph.osd.7.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:07:23.117 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.117 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.117 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:23.117 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:23.117 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:23.118 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.118 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:07:23.118 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:23.118 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.118 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:23.118 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:07:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:23 smithi081 ceph-mon[43371]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:24.199 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:23 smithi119 ceph-mon[43834]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:24.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:23 smithi069 ceph-mon[42034]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:24.607 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:07:24.300+0000 7f25021e2640 -1 osd.7 0 log_to_monitors true 2023-12-14T14:07:24.659 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-14T14:07:24.659 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-14T14:07:24.660 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-14T14:07:24.660 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-14T14:07:24.660 INFO:teuthology.orchestra.run.smithi119.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111361 s, 942 MB/s 2023-12-14T14:07:24.660 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-14T14:07:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='osd.7 [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T14:07:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T14:07:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:24.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:24.952 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='osd.7 [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T14:07:24.952 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T14:07:24.953 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:24.953 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:24.953 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:24.953 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:24.953 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:24.953 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:24.953 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:24.953 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:25.055 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_2 2023-12-14T14:07:25.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='osd.7 [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T14:07:25.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T14:07:25.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:25.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:25.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:25.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:25.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:25.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:25.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:25.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:25.360 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:07:26.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:26.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi081 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi081 to 5704M 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: osdmap e48: 8 total, 7 up, 8 in 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: from='osd.7 [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:26.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-mon[43371]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:07:26.150 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:07:25.868+0000 7f24f7859700 -1 osd.7 0 waiting for initial osdmap 2023-12-14T14:07:26.150 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:07:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:07:25.882+0000 7f24f1e4b700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:07:26.200 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:26.200 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi081 2023-12-14T14:07:26.200 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi081 to 5704M 2023-12-14T14:07:26.200 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:26.200 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-14T14:07:26.200 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: osdmap e48: 8 total, 7 up, 8 in 2023-12-14T14:07:26.200 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:26.200 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: from='osd.7 [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:07:26.201 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:26.201 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:07:26.201 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:26.201 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:25 smithi119 ceph-mon[43834]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:07:26.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:26.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi081 2023-12-14T14:07:26.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi081 to 5704M 2023-12-14T14:07:26.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:26.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-14T14:07:26.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: osdmap e48: 8 total, 7 up, 8 in 2023-12-14T14:07:26.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:26.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: from='osd.7 [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:07:26.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:26.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:07:26.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:26.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:25 smithi069 ceph-mon[42034]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:07:26.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.360+0000 7f8d7cb66700 1 -- 172.21.15.119:0/3594799865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 msgr2=0x7f8d780fea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:26.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.360+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/3594799865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 0x7f8d780fea00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0099c0 tx=0x7f8d6c009cd0 comp rx=0 tx=0).stop 2023-12-14T14:07:26.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.360+0000 7f8d7cb66700 1 -- 172.21.15.119:0/3594799865 shutdown_connections 2023-12-14T14:07:26.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.360+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/3594799865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d780fef40 0x7f8d78106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:26.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.360+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/3594799865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d78100070 0x7f8d78100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:26.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.360+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/3594799865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 0x7f8d780fea00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:26.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.360+0000 7f8d7cb66700 1 -- 172.21.15.119:0/3594799865 >> 172.21.15.119:0/3594799865 conn(0x7f8d780f9fe0 msgr2=0x7f8d780fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:07:26.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.360+0000 7f8d7cb66700 1 -- 172.21.15.119:0/3594799865 shutdown_connections 2023-12-14T14:07:26.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.360+0000 7f8d7cb66700 1 -- 172.21.15.119:0/3594799865 wait complete. 2023-12-14T14:07:26.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7cb66700 1 Processor -- start 2023-12-14T14:07:26.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7cb66700 1 -- start start 2023-12-14T14:07:26.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7cb66700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 0x7f8d78108340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:26.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7cb66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d780fef40 0x7f8d7819ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:26.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7cb66700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d78100070 0x7f8d7819d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:26.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7cb66700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819dc60 con 0x7f8d78100070 2023-12-14T14:07:26.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7cb66700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819ddd0 con 0x7f8d780fef40 2023-12-14T14:07:26.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7cb66700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819df90 con 0x7f8d780fe5b0 2023-12-14T14:07:26.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 0x7f8d78108340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:26.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 0x7f8d78108340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58598/0 (socket says 172.21.15.119:58598) 2023-12-14T14:07:26.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7659c700 1 -- 172.21.15.119:0/2571752677 learned_addr learned my addr 172.21.15.119:0/2571752677 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d75d9b700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d780fef40 0x7f8d7819ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d76d9d700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d78100070 0x7f8d7819d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7659c700 1 -- 172.21.15.119:0/2571752677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d780fef40 msgr2=0x7f8d7819ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7659c700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d780fef40 0x7f8d7819ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7659c700 1 -- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d78100070 msgr2=0x7f8d7819d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7659c700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d78100070 0x7f8d7819d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7659c700 1 -- 172.21.15.119:0/2571752677 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0095f0 con 0x7f8d780fe5b0 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d76d9d700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d78100070 0x7f8d7819d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.361+0000 7f8d7659c700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 0x7f8d78108340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800d980 tx=0x7f8d6800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:07:26.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.362+0000 7f8d677fe700 1 -- 172.21.15.119:0/2571752677 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68004020 con 0x7f8d780fe5b0 2023-12-14T14:07:26.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.362+0000 7f8d677fe700 1 -- 172.21.15.119:0/2571752677 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d68009730 con 0x7f8d780fe5b0 2023-12-14T14:07:26.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.362+0000 7f8d677fe700 1 -- 172.21.15.119:0/2571752677 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68003a80 con 0x7f8d780fe5b0 2023-12-14T14:07:26.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.362+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7810ac90 con 0x7f8d780fe5b0 2023-12-14T14:07:26.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.362+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7810ab00 con 0x7f8d780fe5b0 2023-12-14T14:07:26.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.363+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d78066ea0 con 0x7f8d780fe5b0 2023-12-14T14:07:26.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.364+0000 7f8d677fe700 1 -- 172.21.15.119:0/2571752677 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8d680098a0 con 0x7f8d780fe5b0 2023-12-14T14:07:26.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.364+0000 7f8d677fe700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8d600a1150 0x7f8d600a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:26.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.364+0000 7f8d677fe700 1 -- 172.21.15.119:0/2571752677 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5430+0+0 (secure 0 0 0) 0x7f8d680cbe10 con 0x7f8d780fe5b0 2023-12-14T14:07:26.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.365+0000 7f8d75d9b700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8d600a1150 0x7f8d600a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:26.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.365+0000 7f8d75d9b700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8d600a1150 0x7f8d600a3600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00b580 tx=0x7f8d6c005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:07:26.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.368+0000 7f8d677fe700 1 -- 172.21.15.119:0/2571752677 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8d680960a0 con 0x7f8d780fe5b0 2023-12-14T14:07:26.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:26.565+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d7819ea70 con 0x7f8d600a1150 2023-12-14T14:07:27.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:07:27.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: osdmap e49: 8 total, 7 up, 8 in 2023-12-14T14:07:27.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:27.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:27.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: osd.7 [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] boot 2023-12-14T14:07:27.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: osdmap e50: 8 total, 8 up, 8 in 2023-12-14T14:07:27.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:27.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:07:27.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:07:27.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:26 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:27.165 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:07:27.165 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: osdmap e49: 8 total, 7 up, 8 in 2023-12-14T14:07:27.166 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:27.166 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:27.166 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: osd.7 [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] boot 2023-12-14T14:07:27.166 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: osdmap e50: 8 total, 8 up, 8 in 2023-12-14T14:07:27.166 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:27.166 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:07:27.166 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:07:27.166 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:26 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:27.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:07:27.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: osdmap e49: 8 total, 7 up, 8 in 2023-12-14T14:07:27.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:27.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:27.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: osd.7 [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] boot 2023-12-14T14:07:27.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: osdmap e50: 8 total, 8 up, 8 in 2023-12-14T14:07:27.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:07:27.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:07:27.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:07:27.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:26 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:28.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:27 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:07:28.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:27 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:07:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:27 smithi119 ceph-mon[43834]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:07:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:27 smithi119 ceph-mon[43834]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:27 smithi119 ceph-mon[43834]: osdmap e51: 8 total, 8 up, 8 in 2023-12-14T14:07:28.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:27 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:07:28.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:27 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:07:28.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:27 smithi081 ceph-mon[43371]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:07:28.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:27 smithi081 ceph-mon[43371]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:28.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:27 smithi081 ceph-mon[43371]: osdmap e51: 8 total, 8 up, 8 in 2023-12-14T14:07:28.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:27 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:07:28.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:27 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:07:28.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:27 smithi069 ceph-mon[42034]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:07:28.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:27 smithi069 ceph-mon[42034]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-12-14T14:07:28.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:27 smithi069 ceph-mon[42034]: osdmap e51: 8 total, 8 up, 8 in 2023-12-14T14:07:29.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:29 smithi119 ceph-mon[43834]: osdmap e52: 8 total, 8 up, 8 in 2023-12-14T14:07:29.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:29 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/2140729463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d90c4bb-61c8-4b80-b910-afcc2a88230c"}]: dispatch 2023-12-14T14:07:29.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:29 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d90c4bb-61c8-4b80-b910-afcc2a88230c"}]: dispatch 2023-12-14T14:07:29.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:29 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d90c4bb-61c8-4b80-b910-afcc2a88230c"}]': finished 2023-12-14T14:07:29.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:29 smithi119 ceph-mon[43834]: osdmap e53: 9 total, 8 up, 9 in 2023-12-14T14:07:29.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:29 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:29.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:29 smithi119 ceph-mon[43834]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:29.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:29 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/420861297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:07:29.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:29 smithi069 ceph-mon[42034]: osdmap e52: 8 total, 8 up, 8 in 2023-12-14T14:07:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:29 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/2140729463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d90c4bb-61c8-4b80-b910-afcc2a88230c"}]: dispatch 2023-12-14T14:07:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:29 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d90c4bb-61c8-4b80-b910-afcc2a88230c"}]: dispatch 2023-12-14T14:07:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:29 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d90c4bb-61c8-4b80-b910-afcc2a88230c"}]': finished 2023-12-14T14:07:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:29 smithi069 ceph-mon[42034]: osdmap e53: 9 total, 8 up, 9 in 2023-12-14T14:07:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:29 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:29 smithi069 ceph-mon[42034]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:29.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:29 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/420861297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:07:29.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:29 smithi081 ceph-mon[43371]: osdmap e52: 8 total, 8 up, 8 in 2023-12-14T14:07:29.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:29 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/2140729463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d90c4bb-61c8-4b80-b910-afcc2a88230c"}]: dispatch 2023-12-14T14:07:29.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:29 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d90c4bb-61c8-4b80-b910-afcc2a88230c"}]: dispatch 2023-12-14T14:07:29.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:29 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d90c4bb-61c8-4b80-b910-afcc2a88230c"}]': finished 2023-12-14T14:07:29.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:29 smithi081 ceph-mon[43371]: osdmap e53: 9 total, 8 up, 9 in 2023-12-14T14:07:29.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:29 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:29.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:29 smithi081 ceph-mon[43371]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:29.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:29 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/420861297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:07:30.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:30 smithi119 ceph-mon[43834]: osdmap e54: 9 total, 8 up, 9 in 2023-12-14T14:07:30.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:30 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:30.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:30 smithi069 ceph-mon[42034]: osdmap e54: 9 total, 8 up, 9 in 2023-12-14T14:07:30.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:30 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:30.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:30 smithi081 ceph-mon[43371]: osdmap e54: 9 total, 8 up, 9 in 2023-12-14T14:07:30.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:30 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:31.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:31 smithi119 ceph-mon[43834]: osdmap e55: 9 total, 8 up, 9 in 2023-12-14T14:07:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:31 smithi119 ceph-mon[43834]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:31.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:31 smithi069 ceph-mon[42034]: osdmap e55: 9 total, 8 up, 9 in 2023-12-14T14:07:31.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:31 smithi069 ceph-mon[42034]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:31.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:31 smithi081 ceph-mon[43371]: osdmap e55: 9 total, 8 up, 9 in 2023-12-14T14:07:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:31 smithi081 ceph-mon[43371]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:33 smithi081 ceph-mon[43371]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:34.020 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:33 smithi119 ceph-mon[43834]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:34.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:33 smithi069 ceph-mon[42034]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:34.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:34 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-14T14:07:34.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:34 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:34.998 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:34 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-14T14:07:34.998 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:34 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:35.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:34 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-14T14:07:35.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:34 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:35 smithi081 ceph-mon[43371]: Deploying daemon osd.8 on smithi119 2023-12-14T14:07:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:35 smithi081 ceph-mon[43371]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:35.928 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:35 smithi119 ceph-mon[43834]: Deploying daemon osd.8 on smithi119 2023-12-14T14:07:35.928 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:35 smithi119 ceph-mon[43834]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:35 smithi069 ceph-mon[42034]: Deploying daemon osd.8 on smithi119 2023-12-14T14:07:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:35 smithi069 ceph-mon[42034]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:37.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:37 smithi119 ceph-mon[43834]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:37.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:37 smithi069 ceph-mon[42034]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:37.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:37 smithi081 ceph-mon[43371]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:39.147 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:39.147 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:39.147 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:39 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:39.147 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:39 smithi119 ceph-mon[43834]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:39.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:39.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:39.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:39 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:39.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:39 smithi069 ceph-mon[42034]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:39.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:39.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:39.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:39 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:39.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:39 smithi081 ceph-mon[43371]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:40.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.371+0000 7f8d677fe700 1 -- 172.21.15.119:0/2571752677 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8d7819ea70 con 0x7f8d600a1150 2023-12-14T14:07:40.371 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 8 on host 'smithi119' 2023-12-14T14:07:40.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8d600a1150 msgr2=0x7f8d600a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:40.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8d600a1150 0x7f8d600a3600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00b580 tx=0x7f8d6c005bc0 comp rx=0 tx=0).stop 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 msgr2=0x7f8d78108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 0x7f8d78108340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800d980 tx=0x7f8d6800dc90 comp rx=0 tx=0).stop 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 shutdown_connections 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8d600a1150 0x7f8d600a3600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d78100070 0x7f8d7819d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780fe5b0 0x7f8d78108340 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 --2- 172.21.15.119:0/2571752677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d780fef40 0x7f8d7819ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 >> 172.21.15.119:0/2571752677 conn(0x7f8d780f9fe0 msgr2=0x7f8d780fc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 shutdown_connections 2023-12-14T14:07:40.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:07:40.373+0000 7f8d7cb66700 1 -- 172.21.15.119:0/2571752677 wait complete. 2023-12-14T14:07:40.769 DEBUG:teuthology.orchestra.run.smithi119:osd.8> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.8.service 2023-12-14T14:07:40.771 INFO:tasks.cephadm:Deploying osd.9 on smithi069 with /dev/vg_nvme/lv_1... 2023-12-14T14:07:40.771 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-14T14:07:40.804 INFO:journalctl@ceph.osd.8.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:07:40.962 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:40.962 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:40.962 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:40.962 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:40.963 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:40.963 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:40.963 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:07:40.963 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:40.963 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:40.963 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:40.963 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:40 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:07:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:41.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:40 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:41.090 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:07:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:07:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:41.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:41.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:40 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:41.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:41 smithi069 ceph-mon[42034]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:42.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:41 smithi119 ceph-mon[43834]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:42.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:41 smithi081 ceph-mon[43371]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:42.379 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:07:42.075+0000 7f46b9cf7640 -1 osd.8 0 log_to_monitors true 2023-12-14T14:07:42.520 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-14T14:07:42.520 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-14T14:07:42.520 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2023-12-14T14:07:42.520 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2023-12-14T14:07:42.520 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110589 s, 948 MB/s 2023-12-14T14:07:42.520 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2023-12-14T14:07:42.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='osd.8 [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:42 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:42.938 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi069:vg_nvme/lv_1 2023-12-14T14:07:43.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='osd.8 [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T14:07:43.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T14:07:43.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:42 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:43.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='osd.8 [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:42 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:43.245 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:07:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi119 2023-12-14T14:07:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi119 to 5704M 2023-12-14T14:07:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:07:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:44.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-14T14:07:44.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: osdmap e56: 9 total, 8 up, 9 in 2023-12-14T14:07:44.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:44.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: from='osd.8 [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:07:44.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-mon[43834]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:07:44.026 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:07:43.755+0000 7f46af36e700 -1 osd.8 0 waiting for initial osdmap 2023-12-14T14:07:44.026 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:07:43 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:07:43.768+0000 7f46a915f700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:07:44.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi119 2023-12-14T14:07:44.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:44.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi119 to 5704M 2023-12-14T14:07:44.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:44.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:07:44.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:44.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-14T14:07:44.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: osdmap e56: 9 total, 8 up, 9 in 2023-12-14T14:07:44.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:44.036 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: from='osd.8 [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:07:44.036 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:43 smithi069 ceph-mon[42034]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:07:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi119 2023-12-14T14:07:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi119 to 5704M 2023-12-14T14:07:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:07:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:44.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-14T14:07:44.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: osdmap e56: 9 total, 8 up, 9 in 2023-12-14T14:07:44.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:44.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: from='osd.8 [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:07:44.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:43 smithi081 ceph-mon[43371]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:07:44.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 -- 172.21.15.69:0/2214524138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 msgr2=0x7f3840100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:44.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 --2- 172.21.15.69:0/2214524138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 0x7f3840100730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3834009990 tx=0x7f3834009ca0 comp rx=0 tx=0).stop 2023-12-14T14:07:44.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 -- 172.21.15.69:0/2214524138 shutdown_connections 2023-12-14T14:07:44.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 --2- 172.21.15.69:0/2214524138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3840101eb0 0x7f3840108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:44.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 --2- 172.21.15.69:0/2214524138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 0x7f3840100730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:44.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 --2- 172.21.15.69:0/2214524138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840101520 0x7f3840101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:44.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 -- 172.21.15.69:0/2214524138 >> 172.21.15.69:0/2214524138 conn(0x7f38400fb970 msgr2=0x7f38400fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:07:44.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 -- 172.21.15.69:0/2214524138 shutdown_connections 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 -- 172.21.15.69:0/2214524138 wait complete. 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 Processor -- start 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.205+0000 7f3846dbb700 1 -- start start 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3846dbb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 0x7f3840074890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3846dbb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3840101520 0x7f3840072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3846dbb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840101eb0 0x7f3840073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3846dbb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3840073ba0 con 0x7f3840100320 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3846dbb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3840073d10 con 0x7f3840101eb0 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3846dbb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38401a00a0 con 0x7f3840101520 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3844b57700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 0x7f3840074890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:44.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3844b57700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 0x7f3840074890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55948/0 (socket says 172.21.15.69:55948) 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3844b57700 1 -- 172.21.15.69:0/1559253673 learned_addr learned my addr 172.21.15.69:0/1559253673 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3845358700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840101eb0 0x7f3840073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f383ffff700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3840101520 0x7f3840072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3844b57700 1 -- 172.21.15.69:0/1559253673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3840101520 msgr2=0x7f3840072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3844b57700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3840101520 0x7f3840072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3844b57700 1 -- 172.21.15.69:0/1559253673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840101eb0 msgr2=0x7f3840073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3844b57700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840101eb0 0x7f3840073420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3844b57700 1 -- 172.21.15.69:0/1559253673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38340095f0 con 0x7f3840100320 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3845358700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840101eb0 0x7f3840073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:07:44.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3844b57700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 0x7f3840074890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f383400f730 tx=0x7f383400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:07:44.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f383dffb700 1 -- 172.21.15.69:0/1559253673 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383401d070 con 0x7f3840100320 2023-12-14T14:07:44.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384010bce0 con 0x7f3840100320 2023-12-14T14:07:44.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f383dffb700 1 -- 172.21.15.69:0/1559253673 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f383400fd30 con 0x7f3840100320 2023-12-14T14:07:44.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.206+0000 7f383dffb700 1 -- 172.21.15.69:0/1559253673 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834005710 con 0x7f3840100320 2023-12-14T14:07:44.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.207+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384010bb50 con 0x7f3840100320 2023-12-14T14:07:44.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.208+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38401a0690 con 0x7f3840100320 2023-12-14T14:07:44.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.208+0000 7f383dffb700 1 -- 172.21.15.69:0/1559253673 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f38340047e0 con 0x7f3840100320 2023-12-14T14:07:44.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.209+0000 7f383dffb700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38300a1150 0x7f38300a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:07:44.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.209+0000 7f383ffff700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38300a1150 0x7f38300a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:07:44.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.209+0000 7f383dffb700 1 -- 172.21.15.69:0/1559253673 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f38340cd100 con 0x7f3840100320 2023-12-14T14:07:44.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.209+0000 7f383ffff700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38300a1150 0x7f38300a3600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f382c005fd0 tx=0x7f382c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:07:44.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.213+0000 7f383dffb700 1 -- 172.21.15.69:0/1559253673 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f38340973b0 con 0x7f3840100320 2023-12-14T14:07:44.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:44.411+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3840060f30 con 0x7f38300a1150 2023-12-14T14:07:45.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:44 smithi119 ceph-mon[43834]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:07:45.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:44 smithi119 ceph-mon[43834]: osdmap e57: 9 total, 8 up, 9 in 2023-12-14T14:07:45.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:45.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:45.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:07:45.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:07:45.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:45.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:44 smithi069 ceph-mon[42034]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:07:45.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:44 smithi069 ceph-mon[42034]: osdmap e57: 9 total, 8 up, 9 in 2023-12-14T14:07:45.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:45.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:45.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:07:45.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:07:45.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:44 smithi081 ceph-mon[43371]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:07:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:44 smithi081 ceph-mon[43371]: osdmap e57: 9 total, 8 up, 9 in 2023-12-14T14:07:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:07:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:07:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:45.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:45 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:07:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:45 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:07:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:45 smithi069 ceph-mon[42034]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:07:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:45 smithi069 ceph-mon[42034]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:45 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:45 smithi069 ceph-mon[42034]: osd.8 [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] boot 2023-12-14T14:07:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:45 smithi069 ceph-mon[42034]: osdmap e58: 9 total, 9 up, 9 in 2023-12-14T14:07:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:45 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:46.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:45 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:07:46.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:45 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:07:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:45 smithi119 ceph-mon[43834]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:07:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:45 smithi119 ceph-mon[43834]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:45 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:45 smithi119 ceph-mon[43834]: osd.8 [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] boot 2023-12-14T14:07:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:45 smithi119 ceph-mon[43834]: osdmap e58: 9 total, 9 up, 9 in 2023-12-14T14:07:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:45 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:45 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:07:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:45 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:07:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:45 smithi081 ceph-mon[43371]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:07:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:45 smithi081 ceph-mon[43371]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T14:07:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:45 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:45 smithi081 ceph-mon[43371]: osd.8 [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] boot 2023-12-14T14:07:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:45 smithi081 ceph-mon[43371]: osdmap e58: 9 total, 9 up, 9 in 2023-12-14T14:07:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:45 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:07:47.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:46 smithi119 ceph-mon[43834]: osdmap e59: 9 total, 9 up, 9 in 2023-12-14T14:07:47.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:46 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3149314647' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0b1e8ff-4f3c-43b5-88eb-e6da09577292"}]: dispatch 2023-12-14T14:07:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:46 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3149314647' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0b1e8ff-4f3c-43b5-88eb-e6da09577292"}]': finished 2023-12-14T14:07:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:46 smithi119 ceph-mon[43834]: osdmap e60: 10 total, 9 up, 10 in 2023-12-14T14:07:47.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:07:47.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:46 smithi069 ceph-mon[42034]: osdmap e59: 9 total, 9 up, 9 in 2023-12-14T14:07:47.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:46 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3149314647' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0b1e8ff-4f3c-43b5-88eb-e6da09577292"}]: dispatch 2023-12-14T14:07:47.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:46 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3149314647' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0b1e8ff-4f3c-43b5-88eb-e6da09577292"}]': finished 2023-12-14T14:07:47.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:46 smithi069 ceph-mon[42034]: osdmap e60: 10 total, 9 up, 10 in 2023-12-14T14:07:47.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:07:47.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:46 smithi081 ceph-mon[43371]: osdmap e59: 9 total, 9 up, 9 in 2023-12-14T14:07:47.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:46 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3149314647' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0b1e8ff-4f3c-43b5-88eb-e6da09577292"}]: dispatch 2023-12-14T14:07:47.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:46 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3149314647' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0b1e8ff-4f3c-43b5-88eb-e6da09577292"}]': finished 2023-12-14T14:07:47.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:46 smithi081 ceph-mon[43371]: osdmap e60: 10 total, 9 up, 10 in 2023-12-14T14:07:47.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:07:48.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:47 smithi119 ceph-mon[43834]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail 2023-12-14T14:07:48.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:47 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1831742450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:07:48.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:47 smithi069 ceph-mon[42034]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail 2023-12-14T14:07:48.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:47 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1831742450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:07:48.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:47 smithi081 ceph-mon[43371]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail 2023-12-14T14:07:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:47 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1831742450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:07:49.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:49 smithi119 ceph-mon[43834]: osdmap e61: 10 total, 9 up, 10 in 2023-12-14T14:07:49.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:07:49.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:49 smithi119 ceph-mon[43834]: pgmap v160: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T14:07:49.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:49 smithi069 ceph-mon[42034]: osdmap e61: 10 total, 9 up, 10 in 2023-12-14T14:07:49.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:07:49.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:49 smithi069 ceph-mon[42034]: pgmap v160: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T14:07:49.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:49 smithi081 ceph-mon[43371]: osdmap e61: 10 total, 9 up, 10 in 2023-12-14T14:07:49.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:07:49.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:49 smithi081 ceph-mon[43371]: pgmap v160: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T14:07:50.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:50 smithi119 ceph-mon[43834]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-12-14T14:07:50.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:50 smithi119 ceph-mon[43834]: osdmap e62: 10 total, 9 up, 10 in 2023-12-14T14:07:50.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:50 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:07:50.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:50 smithi069 ceph-mon[42034]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-12-14T14:07:50.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:50 smithi069 ceph-mon[42034]: osdmap e62: 10 total, 9 up, 10 in 2023-12-14T14:07:50.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:50 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:07:50.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:50 smithi081 ceph-mon[43371]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-12-14T14:07:50.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:50 smithi081 ceph-mon[43371]: osdmap e62: 10 total, 9 up, 10 in 2023-12-14T14:07:50.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:50 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:07:51.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:51 smithi069 ceph-mon[42034]: pgmap v162: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T14:07:51.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:51 smithi119 ceph-mon[43834]: pgmap v162: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T14:07:51.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:51 smithi081 ceph-mon[43371]: pgmap v162: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T14:07:52.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-14T14:07:52.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:52.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-14T14:07:52.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:52.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-14T14:07:52.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:53.251 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:53 smithi069 ceph-mon[42034]: Deploying daemon osd.9 on smithi069 2023-12-14T14:07:53.251 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:53 smithi069 ceph-mon[42034]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-12-14T14:07:53.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:53 smithi119 ceph-mon[43834]: Deploying daemon osd.9 on smithi069 2023-12-14T14:07:53.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:53 smithi119 ceph-mon[43834]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-12-14T14:07:53.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:53 smithi081 ceph-mon[43371]: Deploying daemon osd.9 on smithi069 2023-12-14T14:07:53.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:53 smithi081 ceph-mon[43371]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-12-14T14:07:54.443 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:54 smithi069 ceph-mon[42034]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-12-14T14:07:54.443 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:54 smithi069 ceph-mon[42034]: Cluster is now healthy 2023-12-14T14:07:54.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:54 smithi119 ceph-mon[43834]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-12-14T14:07:54.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:54 smithi119 ceph-mon[43834]: Cluster is now healthy 2023-12-14T14:07:54.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:54 smithi081 ceph-mon[43371]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-12-14T14:07:54.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:54 smithi081 ceph-mon[43371]: Cluster is now healthy 2023-12-14T14:07:55.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:55 smithi119 ceph-mon[43834]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T14:07:55.577 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:55 smithi069 ceph-mon[42034]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T14:07:55.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:55 smithi081 ceph-mon[43371]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T14:07:56.431 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:56 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:56.431 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:56 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:56.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:56 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:56.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:56 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:56.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:56 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:56.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:56 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:56.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:56.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:56.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:56 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:57 smithi119 ceph-mon[43834]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-12-14T14:07:57.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:57 smithi069 ceph-mon[42034]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-12-14T14:07:57.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:57 smithi081 ceph-mon[43371]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-12-14T14:07:58.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.168+0000 7f383dffb700 1 -- 172.21.15.69:0/1559253673 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3840060f30 con 0x7f38300a1150 2023-12-14T14:07:58.170 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 9 on host 'smithi069' 2023-12-14T14:07:58.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.170+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38300a1150 msgr2=0x7f38300a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:58.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.170+0000 7f3846dbb700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38300a1150 0x7f38300a3600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f382c005fd0 tx=0x7f382c00a560 comp rx=0 tx=0).stop 2023-12-14T14:07:58.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 msgr2=0x7f3840074890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:07:58.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 0x7f3840074890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f383400f730 tx=0x7f383400f810 comp rx=0 tx=0).stop 2023-12-14T14:07:58.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 shutdown_connections 2023-12-14T14:07:58.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38300a1150 0x7f38300a3600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:58.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840101eb0 0x7f3840073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:58.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3840100320 0x7f3840074890 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:58.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 --2- 172.21.15.69:0/1559253673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3840101520 0x7f3840072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:07:58.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 >> 172.21.15.69:0/1559253673 conn(0x7f38400fb970 msgr2=0x7f38400fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:07:58.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 shutdown_connections 2023-12-14T14:07:58.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:07:58.171+0000 7f3846dbb700 1 -- 172.21.15.69:0/1559253673 wait complete. 2023-12-14T14:07:58.538 DEBUG:teuthology.orchestra.run.smithi069:osd.9> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.9.service 2023-12-14T14:07:58.540 INFO:tasks.cephadm:Deploying osd.10 on smithi081 with /dev/vg_nvme/lv_1... 2023-12-14T14:07:58.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-14T14:07:58.565 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.565 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.565 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:58.565 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:58.565 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:58.566 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.566 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:07:58.566 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:07:58.566 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.566 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.566 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:58.572 INFO:journalctl@ceph.osd.9.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:07:58.573 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.574 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:58.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:07:58.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:07:58.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:58.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:07:58.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:07:58.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:07:58.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:07:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:07:59.376 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:07:59 smithi069 ceph-mon[42034]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:07:59.628 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:07:59 smithi081 ceph-mon[43371]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:07:59.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:07:59 smithi119 ceph-mon[43834]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:07:59.944 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:07:59 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:07:59.655+0000 7fbd69fa9640 -1 osd.9 0 log_to_monitors true 2023-12-14T14:08:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-14T14:08:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-14T14:08:00.067 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2023-12-14T14:08:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2023-12-14T14:08:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113409 s, 925 MB/s 2023-12-14T14:08:00.067 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 2023-12-14T14:08:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2023-12-14T14:08:00.381 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:00 smithi081 ceph-mon[43371]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-14T14:08:00.381 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:00.381 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:00.381 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.382 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.382 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.382 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2023-12-14T14:08:00.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:00 smithi069 ceph-mon[42034]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-14T14:08:00.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:00.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:00.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:00 smithi119 ceph-mon[43834]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-14T14:08:00.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:00.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:00.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:08:01.561 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi069 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi069 to 4278M 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: osdmap e63: 10 total, 9 up, 10 in 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:01.562 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:01 smithi081 ceph-mon[43371]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:08:01.585 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:08:01.331+0000 7fbd5f620700 -1 osd.9 0 waiting for initial osdmap 2023-12-14T14:08:01.585 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:08:01.354+0000 7fbd59c12700 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi069 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi069 to 4278M 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: osdmap e63: 10 total, 9 up, 10 in 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:08:01.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:01.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:01 smithi069 ceph-mon[42034]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:08:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.739+0000 7f882239b700 1 -- 172.21.15.81:0/1879847013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c101ea0 msgr2=0x7f881c108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.739+0000 7f882239b700 1 --2- 172.21.15.81:0/1879847013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c101ea0 0x7f881c108760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f881400b0a0 tx=0x7f881400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:08:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.739+0000 7f882239b700 1 -- 172.21.15.81:0/1879847013 shutdown_connections 2023-12-14T14:08:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.739+0000 7f882239b700 1 --2- 172.21.15.81:0/1879847013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c101ea0 0x7f881c108760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.739+0000 7f882239b700 1 --2- 172.21.15.81:0/1879847013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f881c100310 0x7f881c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.739+0000 7f882239b700 1 --2- 172.21.15.81:0/1879847013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f881c101510 0x7f881c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.739+0000 7f882239b700 1 -- 172.21.15.81:0/1879847013 >> 172.21.15.81:0/1879847013 conn(0x7f881c0fb960 msgr2=0x7f881c0fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.739+0000 7f882239b700 1 -- 172.21.15.81:0/1879847013 shutdown_connections 2023-12-14T14:08:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f882239b700 1 -- 172.21.15.81:0/1879847013 wait complete. 2023-12-14T14:08:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f882239b700 1 Processor -- start 2023-12-14T14:08:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f882239b700 1 -- start start 2023-12-14T14:08:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f882239b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c100310 0x7f881c074890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f882239b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f881c101510 0x7f881c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f882239b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f881c101ea0 0x7f881c073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f882239b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c073ba0 con 0x7f881c101ea0 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f882239b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c073d10 con 0x7f881c100310 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f882239b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1a01f0 con 0x7f881c101510 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.740+0000 7f881bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c100310 0x7f881c074890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f881bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c100310 0x7f881c074890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37746/0 (socket says 172.21.15.81:37746) 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f881bfff700 1 -- 172.21.15.81:0/2533237196 learned_addr learned my addr 172.21.15.81:0/2533237196 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f8820938700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f881c101ea0 0x7f881c073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f881bfff700 1 -- 172.21.15.81:0/2533237196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f881c101510 msgr2=0x7f881c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f881b7fe700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f881c101510 0x7f881c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f881bfff700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f881c101510 0x7f881c072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f881bfff700 1 -- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f881c101ea0 msgr2=0x7f881c073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f881bfff700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f881c101ea0 0x7f881c073420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f881bfff700 1 -- 172.21.15.81:0/2533237196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8814009d00 con 0x7f881c100310 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f8820938700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f881c101ea0 0x7f881c073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f881bfff700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c100310 0x7f881c074890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f880c00b500 tx=0x7f880c00b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f88197fa700 1 -- 172.21.15.81:0/2533237196 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c011830 con 0x7f881c100310 2023-12-14T14:08:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f88197fa700 1 -- 172.21.15.81:0/2533237196 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f880c011e50 con 0x7f881c100310 2023-12-14T14:08:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c10bd00 con 0x7f881c100310 2023-12-14T14:08:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f88197fa700 1 -- 172.21.15.81:0/2533237196 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c00f2e0 con 0x7f881c100310 2023-12-14T14:08:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.741+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c10bb70 con 0x7f881c100310 2023-12-14T14:08:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.742+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c1a0a00 con 0x7f881c100310 2023-12-14T14:08:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.743+0000 7f88197fa700 1 -- 172.21.15.81:0/2533237196 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f880c010580 con 0x7f881c100310 2023-12-14T14:08:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.744+0000 7f88197fa700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f88040a1250 0x7f88040a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.744+0000 7f881b7fe700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f88040a1250 0x7f88040a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.744+0000 7f88197fa700 1 -- 172.21.15.81:0/2533237196 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f880c0cc0b0 con 0x7f881c100310 2023-12-14T14:08:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.744+0000 7f881b7fe700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f88040a1250 0x7f88040a3700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8810005950 tx=0x7f88100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:01.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.747+0000 7f88197fa700 1 -- 172.21.15.81:0/2533237196 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f880c096080 con 0x7f881c100310 2023-12-14T14:08:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi069 2023-12-14T14:08:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi069 to 4278M 2023-12-14T14:08:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-14T14:08:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: osdmap e63: 10 total, 9 up, 10 in 2023-12-14T14:08:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T14:08:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:08:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:01 smithi119 ceph-mon[43834]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:08:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:01.943+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f881c1a0fb0 con 0x7f88040a1250 2023-12-14T14:08:02.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:02 smithi069 ceph-mon[42034]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:08:02.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:02 smithi069 ceph-mon[42034]: osdmap e64: 10 total, 9 up, 10 in 2023-12-14T14:08:02.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:02.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:02.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:02 smithi069 ceph-mon[42034]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:08:02.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:08:02.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:08:02.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:02.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:02 smithi081 ceph-mon[43371]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:08:02.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:02 smithi081 ceph-mon[43371]: osdmap e64: 10 total, 9 up, 10 in 2023-12-14T14:08:02.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:02.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:02.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:02 smithi081 ceph-mon[43371]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:08:02.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:08:02.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:08:02.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:02.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:02 smithi119 ceph-mon[43834]: from='osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T14:08:02.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:02 smithi119 ceph-mon[43834]: osdmap e64: 10 total, 9 up, 10 in 2023-12-14T14:08:02.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:02.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:02.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:02 smithi119 ceph-mon[43834]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:08:02.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:08:02.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:08:02.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:03.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:03 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:08:03.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:03 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:08:03.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:03.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:03 smithi069 ceph-mon[42034]: osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] boot 2023-12-14T14:08:03.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:03 smithi069 ceph-mon[42034]: osdmap e65: 10 total, 10 up, 10 in 2023-12-14T14:08:03.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:03.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:03 smithi069 ceph-mon[42034]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-12-14T14:08:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:03 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:08:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:03 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:08:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:03 smithi081 ceph-mon[43371]: osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] boot 2023-12-14T14:08:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:03 smithi081 ceph-mon[43371]: osdmap e65: 10 total, 10 up, 10 in 2023-12-14T14:08:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:03.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:03 smithi081 ceph-mon[43371]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-12-14T14:08:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:03 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:08:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:03 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:08:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:03 smithi119 ceph-mon[43834]: osd.9 [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] boot 2023-12-14T14:08:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:03 smithi119 ceph-mon[43834]: osdmap e65: 10 total, 10 up, 10 in 2023-12-14T14:08:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:08:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:03 smithi119 ceph-mon[43834]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-12-14T14:08:04.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:04 smithi081 ceph-mon[43371]: osdmap e66: 10 total, 10 up, 10 in 2023-12-14T14:08:04.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:04 smithi081 ceph-mon[43371]: from='client.? 172.21.15.81:0/1715798974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3627e9bc-5957-42e7-866f-f085f0b28e59"}]: dispatch 2023-12-14T14:08:04.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:04 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3627e9bc-5957-42e7-866f-f085f0b28e59"}]: dispatch 2023-12-14T14:08:04.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:04 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3627e9bc-5957-42e7-866f-f085f0b28e59"}]': finished 2023-12-14T14:08:04.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:04 smithi081 ceph-mon[43371]: osdmap e67: 11 total, 10 up, 11 in 2023-12-14T14:08:04.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:04.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:04 smithi119 ceph-mon[43834]: osdmap e66: 10 total, 10 up, 10 in 2023-12-14T14:08:04.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:04 smithi119 ceph-mon[43834]: from='client.? 172.21.15.81:0/1715798974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3627e9bc-5957-42e7-866f-f085f0b28e59"}]: dispatch 2023-12-14T14:08:04.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:04 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3627e9bc-5957-42e7-866f-f085f0b28e59"}]: dispatch 2023-12-14T14:08:04.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:04 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3627e9bc-5957-42e7-866f-f085f0b28e59"}]': finished 2023-12-14T14:08:04.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:04 smithi119 ceph-mon[43834]: osdmap e67: 11 total, 10 up, 11 in 2023-12-14T14:08:04.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:04.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:04 smithi069 ceph-mon[42034]: osdmap e66: 10 total, 10 up, 10 in 2023-12-14T14:08:04.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:04 smithi069 ceph-mon[42034]: from='client.? 172.21.15.81:0/1715798974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3627e9bc-5957-42e7-866f-f085f0b28e59"}]: dispatch 2023-12-14T14:08:04.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:04 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3627e9bc-5957-42e7-866f-f085f0b28e59"}]: dispatch 2023-12-14T14:08:04.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:04 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3627e9bc-5957-42e7-866f-f085f0b28e59"}]': finished 2023-12-14T14:08:04.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:04 smithi069 ceph-mon[42034]: osdmap e67: 11 total, 10 up, 11 in 2023-12-14T14:08:04.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:05.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:05 smithi081 ceph-mon[43371]: from='client.? 172.21.15.81:0/3357411577' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:08:05.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:05 smithi081 ceph-mon[43371]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:05.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:05 smithi119 ceph-mon[43834]: from='client.? 172.21.15.81:0/3357411577' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:08:05.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:05 smithi119 ceph-mon[43834]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:05.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:05 smithi069 ceph-mon[42034]: from='client.? 172.21.15.81:0/3357411577' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:08:05.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:05 smithi069 ceph-mon[42034]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:07.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:07 smithi119 ceph-mon[43834]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:07.585 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:07 smithi081 ceph-mon[43371]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:07.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:07 smithi069 ceph-mon[42034]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:09 smithi081 ceph-mon[43371]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-14T14:08:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:10.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:09 smithi119 ceph-mon[43834]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:10.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-14T14:08:10.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:10.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:09 smithi069 ceph-mon[42034]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:10.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-14T14:08:10.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:10.827 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:10 smithi081 ceph-mon[43371]: Deploying daemon osd.10 on smithi081 2023-12-14T14:08:11.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:10 smithi119 ceph-mon[43834]: Deploying daemon osd.10 on smithi081 2023-12-14T14:08:11.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:10 smithi069 ceph-mon[42034]: Deploying daemon osd.10 on smithi081 2023-12-14T14:08:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:11 smithi081 ceph-mon[43371]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:12.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:11 smithi119 ceph-mon[43834]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:12.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:11 smithi069 ceph-mon[42034]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:13 smithi119 ceph-mon[43834]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:14.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:14.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:14.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:13 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:14.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:13 smithi069 ceph-mon[42034]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:14.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:14.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:13 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:14.092 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:13 smithi081 ceph-mon[43371]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:14.092 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:14.092 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:14.092 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:13 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.295+0000 7f88197fa700 1 -- 172.21.15.81:0/2533237196 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f881c1a0fb0 con 0x7f88040a1250 2023-12-14T14:08:15.296 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 10 on host 'smithi081' 2023-12-14T14:08:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f88040a1250 msgr2=0x7f88040a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f88040a1250 0x7f88040a3700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8810005950 tx=0x7f88100058e0 comp rx=0 tx=0).stop 2023-12-14T14:08:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c100310 msgr2=0x7f881c074890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c100310 0x7f881c074890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f880c00b500 tx=0x7f880c00b8c0 comp rx=0 tx=0).stop 2023-12-14T14:08:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 shutdown_connections 2023-12-14T14:08:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f88040a1250 0x7f88040a3700 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f881c101ea0 0x7f881c073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c100310 0x7f881c074890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 --2- 172.21.15.81:0/2533237196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f881c101510 0x7f881c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 >> 172.21.15.81:0/2533237196 conn(0x7f881c0fb960 msgr2=0x7f881c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 shutdown_connections 2023-12-14T14:08:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-14T14:08:15.297+0000 7f882239b700 1 -- 172.21.15.81:0/2533237196 wait complete. 2023-12-14T14:08:15.695 DEBUG:teuthology.orchestra.run.smithi081:osd.10> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.10.service 2023-12-14T14:08:15.698 INFO:tasks.cephadm:Deploying osd.11 on smithi119 with /dev/vg_nvme/lv_1... 2023-12-14T14:08:15.698 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-14T14:08:15.730 INFO:journalctl@ceph.osd.10.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:15.889 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:15.890 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:15.890 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:15 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:16.017 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:08:16.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:16.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:15 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:16.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:16.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:15 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:17.328 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:17 smithi081 ceph-mon[43371]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:17.328 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:08:17 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:08:17.226+0000 7fdc502eb640 -1 osd.10 0 log_to_monitors true 2023-12-14T14:08:17.329 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-14T14:08:17.329 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-14T14:08:17.330 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-14T14:08:17.330 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-14T14:08:17.330 INFO:teuthology.orchestra.run.smithi119.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112648 s, 931 MB/s 2023-12-14T14:08:17.330 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-14T14:08:17.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:17 smithi119 ceph-mon[43834]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:17.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:17 smithi069 ceph-mon[42034]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:17.753 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_1 2023-12-14T14:08:18.056 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:08:18.490 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='osd.10 [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T14:08:18.490 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T14:08:18.491 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi081 2023-12-14T14:08:18.491 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.491 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.491 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.491 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.491 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.491 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.491 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi081 to 4278M 2023-12-14T14:08:18.492 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.492 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:18.492 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:18.492 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:18.492 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.492 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:08:18.492 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:18 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:18.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='osd.10 [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T14:08:18.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T14:08:18.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi081 2023-12-14T14:08:18.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi081 to 4278M 2023-12-14T14:08:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:08:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:18 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:18.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='osd.10 [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T14:08:18.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T14:08:18.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi081 2023-12-14T14:08:18.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:18.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi081 to 4278M 2023-12-14T14:08:18.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:18.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:18.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:18.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:18.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:08:18.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:18 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:19.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.052+0000 7fdfac469700 1 -- 172.21.15.119:0/405521874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4100310 msgr2=0x7fdfa4100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:19.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.052+0000 7fdfac469700 1 --2- 172.21.15.119:0/405521874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4100310 0x7fdfa4100720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009990 tx=0x7fdf94009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:19.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.052+0000 7fdfac469700 1 -- 172.21.15.119:0/405521874 shutdown_connections 2023-12-14T14:08:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.052+0000 7fdfac469700 1 --2- 172.21.15.119:0/405521874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa4101ea0 0x7fdfa4108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.052+0000 7fdfac469700 1 --2- 172.21.15.119:0/405521874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4100310 0x7fdfa4100720 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.052+0000 7fdfac469700 1 --2- 172.21.15.119:0/405521874 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfa4101510 0x7fdfa4101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.052+0000 7fdfac469700 1 -- 172.21.15.119:0/405521874 >> 172.21.15.119:0/405521874 conn(0x7fdfa40fb960 msgr2=0x7fdfa40fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.052+0000 7fdfac469700 1 -- 172.21.15.119:0/405521874 shutdown_connections 2023-12-14T14:08:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfac469700 1 -- 172.21.15.119:0/405521874 wait complete. 2023-12-14T14:08:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfac469700 1 Processor -- start 2023-12-14T14:08:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfac469700 1 -- start start 2023-12-14T14:08:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfac469700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa4100310 0x7fdfa4074890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfac469700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4101510 0x7fdfa4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfac469700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfa4101ea0 0x7fdfa4073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfac469700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4073ba0 con 0x7fdfa4101ea0 2023-12-14T14:08:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfac469700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4073d10 con 0x7fdfa4100310 2023-12-14T14:08:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfac469700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa41a0170 con 0x7fdfa4101510 2023-12-14T14:08:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfa9a04700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4101510 0x7fdfa4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfa9a04700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4101510 0x7fdfa4072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49924/0 (socket says 172.21.15.119:49924) 2023-12-14T14:08:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfa9a04700 1 -- 172.21.15.119:0/2563050514 learned_addr learned my addr 172.21.15.119:0/2563050514 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:08:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.053+0000 7fdfaa205700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa4100310 0x7fdfa4074890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdfaaa06700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfa4101ea0 0x7fdfa4073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdfa9a04700 1 -- 172.21.15.119:0/2563050514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa4100310 msgr2=0x7fdfa4074890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdfa9a04700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa4100310 0x7fdfa4074890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdfa9a04700 1 -- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfa4101ea0 msgr2=0x7fdfa4073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdfa9a04700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfa4101ea0 0x7fdfa4073420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdfa9a04700 1 -- 172.21.15.119:0/2563050514 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940095f0 con 0x7fdfa4101510 2023-12-14T14:08:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdfa9a04700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4101510 0x7fdfa4072ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000b530 tx=0x7fdfa000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdf9b7fe700 1 -- 172.21.15.119:0/2563050514 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0011830 con 0x7fdfa4101510 2023-12-14T14:08:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdf9b7fe700 1 -- 172.21.15.119:0/2563050514 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfa0011e50 con 0x7fdfa4101510 2023-12-14T14:08:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdf9b7fe700 1 -- 172.21.15.119:0/2563050514 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000f2e0 con 0x7fdfa4101510 2023-12-14T14:08:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa410bd60 con 0x7fdfa4101510 2023-12-14T14:08:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.054+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa410bbd0 con 0x7fdfa4101510 2023-12-14T14:08:19.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.055+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa41a08e0 con 0x7fdfa4101510 2023-12-14T14:08:19.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.056+0000 7fdf9b7fe700 1 -- 172.21.15.119:0/2563050514 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fdfa00105a0 con 0x7fdfa4101510 2023-12-14T14:08:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.057+0000 7fdf9b7fe700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdf900a11d0 0x7fdf900a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.057+0000 7fdf9b7fe700 1 -- 172.21.15.119:0/2563050514 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6398+0+0 (secure 0 0 0) 0x7fdfa00cc0f0 con 0x7fdfa4101510 2023-12-14T14:08:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.057+0000 7fdfaa205700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdf900a11d0 0x7fdf900a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.058+0000 7fdfaa205700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdf900a11d0 0x7fdf900a3680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400b5c0 tx=0x7fdf94005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.061+0000 7fdf9b7fe700 1 -- 172.21.15.119:0/2563050514 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdfa0095f20 con 0x7fdfa4101510 2023-12-14T14:08:19.240 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:19 smithi119 ceph-mon[43834]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-14T14:08:19.240 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:19 smithi119 ceph-mon[43834]: osdmap e68: 11 total, 10 up, 11 in 2023-12-14T14:08:19.240 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:19 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:19.240 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:19 smithi119 ceph-mon[43834]: from='osd.10 [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:08:19.240 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:19 smithi119 ceph-mon[43834]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:08:19.240 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:19 smithi119 ceph-mon[43834]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:19.258+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfa41a0e90 con 0x7fdf900a11d0 2023-12-14T14:08:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:19 smithi069 ceph-mon[42034]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-14T14:08:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:19 smithi069 ceph-mon[42034]: osdmap e68: 11 total, 10 up, 11 in 2023-12-14T14:08:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:19 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:19 smithi069 ceph-mon[42034]: from='osd.10 [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:08:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:19 smithi069 ceph-mon[42034]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:08:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:19 smithi069 ceph-mon[42034]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:19.648 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:08:19 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:08:19.243+0000 7fdc45962700 -1 osd.10 0 waiting for initial osdmap 2023-12-14T14:08:19.648 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:08:19 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:08:19.263+0000 7fdc41757700 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:08:19.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:19 smithi081 ceph-mon[43371]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-14T14:08:19.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:19 smithi081 ceph-mon[43371]: osdmap e68: 11 total, 10 up, 11 in 2023-12-14T14:08:19.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:19 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:19.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:19 smithi081 ceph-mon[43371]: from='osd.10 [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:08:19.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:19 smithi081 ceph-mon[43371]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2023-12-14T14:08:19.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:19 smithi081 ceph-mon[43371]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:20.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:08:20.251 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:08:20.252 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:08:20.252 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: osdmap e69: 11 total, 10 up, 11 in 2023-12-14T14:08:20.252 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:20.252 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:20.252 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:08:20.252 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:08:20.252 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:08:20.252 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:20 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: osdmap e69: 11 total, 10 up, 11 in 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:08:20.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:20 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: osdmap e69: 11 total, 10 up, 11 in 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T14:08:20.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:20 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:21.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:21 smithi119 ceph-mon[43834]: osd.10 [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] boot 2023-12-14T14:08:21.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:21 smithi119 ceph-mon[43834]: osdmap e70: 11 total, 11 up, 11 in 2023-12-14T14:08:21.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:21 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:21.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:21 smithi119 ceph-mon[43834]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:21.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:21 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/3432415790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59f201a4-0834-4f62-9904-fc42f0fb70e1"}]: dispatch 2023-12-14T14:08:21.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:21 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59f201a4-0834-4f62-9904-fc42f0fb70e1"}]: dispatch 2023-12-14T14:08:21.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:21 smithi119 ceph-mon[43834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59f201a4-0834-4f62-9904-fc42f0fb70e1"}]': finished 2023-12-14T14:08:21.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:21 smithi119 ceph-mon[43834]: osdmap e71: 12 total, 11 up, 12 in 2023-12-14T14:08:21.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:21 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:21.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:21 smithi069 ceph-mon[42034]: osd.10 [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] boot 2023-12-14T14:08:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:21 smithi069 ceph-mon[42034]: osdmap e70: 11 total, 11 up, 11 in 2023-12-14T14:08:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:21 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:21 smithi069 ceph-mon[42034]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:21 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/3432415790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59f201a4-0834-4f62-9904-fc42f0fb70e1"}]: dispatch 2023-12-14T14:08:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:21 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59f201a4-0834-4f62-9904-fc42f0fb70e1"}]: dispatch 2023-12-14T14:08:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:21 smithi069 ceph-mon[42034]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59f201a4-0834-4f62-9904-fc42f0fb70e1"}]': finished 2023-12-14T14:08:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:21 smithi069 ceph-mon[42034]: osdmap e71: 12 total, 11 up, 12 in 2023-12-14T14:08:21.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:21 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:21 smithi081 ceph-mon[43371]: osd.10 [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] boot 2023-12-14T14:08:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:21 smithi081 ceph-mon[43371]: osdmap e70: 11 total, 11 up, 11 in 2023-12-14T14:08:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:21 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:08:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:21 smithi081 ceph-mon[43371]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-12-14T14:08:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:21 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/3432415790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59f201a4-0834-4f62-9904-fc42f0fb70e1"}]: dispatch 2023-12-14T14:08:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:21 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59f201a4-0834-4f62-9904-fc42f0fb70e1"}]: dispatch 2023-12-14T14:08:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:21 smithi081 ceph-mon[43371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59f201a4-0834-4f62-9904-fc42f0fb70e1"}]': finished 2023-12-14T14:08:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:21 smithi081 ceph-mon[43371]: osdmap e71: 12 total, 11 up, 12 in 2023-12-14T14:08:21.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:21 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:22.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:22 smithi119 ceph-mon[43834]: from='client.? 172.21.15.119:0/3897739364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:08:22.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:22 smithi119 ceph-mon[43834]: osdmap e72: 12 total, 11 up, 12 in 2023-12-14T14:08:22.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:22 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:22.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:22 smithi069 ceph-mon[42034]: from='client.? 172.21.15.119:0/3897739364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:08:22.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:22 smithi069 ceph-mon[42034]: osdmap e72: 12 total, 11 up, 12 in 2023-12-14T14:08:22.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:22 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:22.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:22 smithi081 ceph-mon[43371]: from='client.? 172.21.15.119:0/3897739364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T14:08:22.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:22 smithi081 ceph-mon[43371]: osdmap e72: 12 total, 11 up, 12 in 2023-12-14T14:08:22.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:22 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:23.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:23 smithi119 ceph-mon[43834]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:23.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:23 smithi069 ceph-mon[42034]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:23.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:23 smithi081 ceph-mon[43371]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:24.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:24 smithi119 ceph-mon[43834]: osdmap e73: 12 total, 11 up, 12 in 2023-12-14T14:08:24.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:24 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:24.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:24 smithi069 ceph-mon[42034]: osdmap e73: 12 total, 11 up, 12 in 2023-12-14T14:08:24.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:24 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:24.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:24 smithi081 ceph-mon[43371]: osdmap e73: 12 total, 11 up, 12 in 2023-12-14T14:08:24.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:24 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:25.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:25 smithi119 ceph-mon[43834]: osdmap e74: 12 total, 11 up, 12 in 2023-12-14T14:08:25.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:25 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:25.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:25 smithi119 ceph-mon[43834]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:25.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:25 smithi069 ceph-mon[42034]: osdmap e74: 12 total, 11 up, 12 in 2023-12-14T14:08:25.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:25 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:25.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:25 smithi069 ceph-mon[42034]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:25.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:25 smithi081 ceph-mon[43371]: osdmap e74: 12 total, 11 up, 12 in 2023-12-14T14:08:25.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:25 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:25.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:25 smithi081 ceph-mon[43371]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:27.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:27 smithi119 ceph-mon[43834]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:27.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:27 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-14T14:08:27.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:27 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:27.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:27 smithi069 ceph-mon[42034]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:27.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:27 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-14T14:08:27.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:27 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:27 smithi081 ceph-mon[43371]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:27 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-14T14:08:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:27 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:28.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:28 smithi119 ceph-mon[43834]: Deploying daemon osd.11 on smithi119 2023-12-14T14:08:28.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:28 smithi069 ceph-mon[42034]: Deploying daemon osd.11 on smithi119 2023-12-14T14:08:28.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:28 smithi081 ceph-mon[43371]: Deploying daemon osd.11 on smithi119 2023-12-14T14:08:29.369 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:29 smithi119 ceph-mon[43834]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-12-14T14:08:29.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:29 smithi069 ceph-mon[42034]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-12-14T14:08:29.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:29 smithi081 ceph-mon[43371]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-12-14T14:08:32.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:31 smithi069 ceph-mon[42034]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T14:08:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:32.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:31 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:32.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:31 smithi081 ceph-mon[43371]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T14:08:32.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:32.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:32.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:31 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:32.164 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:31 smithi119 ceph-mon[43834]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T14:08:32.164 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:32.165 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:32.165 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:31 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:33.110 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 11 on host 'smithi119' 2023-12-14T14:08:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.110+0000 7fdf9b7fe700 1 -- 172.21.15.119:0/2563050514 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fdfa41a0e90 con 0x7fdf900a11d0 2023-12-14T14:08:33.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdf900a11d0 msgr2=0x7fdf900a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:33.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdf900a11d0 0x7fdf900a3680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400b5c0 tx=0x7fdf94005fd0 comp rx=0 tx=0).stop 2023-12-14T14:08:33.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4101510 msgr2=0x7fdfa4072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:33.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4101510 0x7fdfa4072ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000b530 tx=0x7fdfa000b840 comp rx=0 tx=0).stop 2023-12-14T14:08:33.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 shutdown_connections 2023-12-14T14:08:33.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdf900a11d0 0x7fdf900a3680 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:33.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfa4101ea0 0x7fdfa4073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:33.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa4100310 0x7fdfa4074890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:33.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 --2- 172.21.15.119:0/2563050514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfa4101510 0x7fdfa4072ee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:33.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 >> 172.21.15.119:0/2563050514 conn(0x7fdfa40fb960 msgr2=0x7fdfa40fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:33.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 shutdown_connections 2023-12-14T14:08:33.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:33.112+0000 7fdfac469700 1 -- 172.21.15.119:0/2563050514 wait complete. 2023-12-14T14:08:33.503 DEBUG:teuthology.orchestra.run.smithi119:osd.11> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.11.service 2023-12-14T14:08:33.506 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-12-14T14:08:33.506 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-14T14:08:33.537 INFO:journalctl@ceph.osd.11.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:08:33.670 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.670 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.670 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:33.670 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:33.670 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:33.671 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.671 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:08:33.671 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:33.671 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-12-14T14:08:33.671 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.671 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.671 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:33 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:08:33.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:33 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:08:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:33.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-12-14T14:08:33.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:33.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:33 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 -- 172.21.15.69:0/1518462525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae40ff1e0 msgr2=0x7f7ae40ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/1518462525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae40ff1e0 0x7f7ae40ff5f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009990 tx=0x7f7ad8009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 -- 172.21.15.69:0/1518462525 shutdown_connections 2023-12-14T14:08:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/1518462525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ae4100d70 0x7f7ae4107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/1518462525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae40ff1e0 0x7f7ae40ff5f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/1518462525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae41003e0 0x7f7ae4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 -- 172.21.15.69:0/1518462525 >> 172.21.15.69:0/1518462525 conn(0x7f7ae40fa7f0 msgr2=0x7f7ae40fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 -- 172.21.15.69:0/1518462525 shutdown_connections 2023-12-14T14:08:34.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 -- 172.21.15.69:0/1518462525 wait complete. 2023-12-14T14:08:34.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.818+0000 7f7aeabcf700 1 Processor -- start 2023-12-14T14:08:34.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7aeabcf700 1 -- start start 2023-12-14T14:08:34.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7aeabcf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae40ff1e0 0x7f7ae4109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:34.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7aeabcf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ae41003e0 0x7f7ae41080e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:34.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7aeabcf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4100d70 0x7f7ae4108620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:34.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7aeabcf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4108da0 con 0x7f7ae4100d70 2023-12-14T14:08:34.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7aeabcf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4108f10 con 0x7f7ae41003e0 2023-12-14T14:08:34.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7aeabcf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae41a01e0 con 0x7f7ae40ff1e0 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae916c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4100d70 0x7f7ae4108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae916c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4100d70 0x7f7ae4108620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39766/0 (socket says 172.21.15.69:39766) 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae916c700 1 -- 172.21.15.69:0/283575545 learned_addr learned my addr 172.21.15.69:0/283575545 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae896b700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae40ff1e0 0x7f7ae4109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae3fff700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ae41003e0 0x7f7ae41080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae916c700 1 -- 172.21.15.69:0/283575545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae40ff1e0 msgr2=0x7f7ae4109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae916c700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae40ff1e0 0x7f7ae4109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae916c700 1 -- 172.21.15.69:0/283575545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ae41003e0 msgr2=0x7f7ae41080e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae916c700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ae41003e0 0x7f7ae41080e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:34.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae916c700 1 -- 172.21.15.69:0/283575545 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad80095f0 con 0x7f7ae4100d70 2023-12-14T14:08:34.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae916c700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4100d70 0x7f7ae4108620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00b970 tx=0x7f7adc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:34.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae1ffb700 1 -- 172.21.15.69:0/283575545 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc00c930 con 0x7f7ae4100d70 2023-12-14T14:08:34.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae410bd40 con 0x7f7ae4100d70 2023-12-14T14:08:34.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.819+0000 7f7ae1ffb700 1 -- 172.21.15.69:0/283575545 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7adc014440 con 0x7f7ae4100d70 2023-12-14T14:08:34.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.820+0000 7f7ae1ffb700 1 -- 172.21.15.69:0/283575545 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0075d0 con 0x7f7ae4100d70 2023-12-14T14:08:34.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.820+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae410bbb0 con 0x7f7ae4100d70 2023-12-14T14:08:34.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.821+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae41a0950 con 0x7f7ae4100d70 2023-12-14T14:08:34.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.821+0000 7f7ae1ffb700 1 -- 172.21.15.69:0/283575545 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7adc0145b0 con 0x7f7ae4100d70 2023-12-14T14:08:34.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.822+0000 7f7ae1ffb700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ad40a1150 0x7f7ad40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:34.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.822+0000 7f7ae896b700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ad40a1150 0x7f7ad40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:34.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.822+0000 7f7ae1ffb700 1 -- 172.21.15.69:0/283575545 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7adc006e40 con 0x7f7ae4100d70 2023-12-14T14:08:34.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.822+0000 7f7ae896b700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ad40a1150 0x7f7ad40a3600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800b5c0 tx=0x7f7ad8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:34.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:34.826+0000 7f7ae1ffb700 1 -- 172.21.15.69:0/283575545 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7adc04e730 con 0x7f7ae4100d70 2023-12-14T14:08:35.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.017+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f7ae4106170 con 0x7f7ae4100d70 2023-12-14T14:08:35.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.018+0000 7f7ae1ffb700 1 -- 172.21.15.69:0/283575545 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) v1 ==== 74+0+133 (secure 0 0 0) 0x7f7adc095700 con 0x7f7ae4100d70 2023-12-14T14:08:35.017 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ad40a1150 msgr2=0x7f7ad40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ad40a1150 0x7f7ad40a3600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800b5c0 tx=0x7f7ad8005fb0 comp rx=0 tx=0).stop 2023-12-14T14:08:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4100d70 msgr2=0x7f7ae4108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4100d70 0x7f7ae4108620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00b970 tx=0x7f7adc00bc80 comp rx=0 tx=0).stop 2023-12-14T14:08:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 shutdown_connections 2023-12-14T14:08:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7ad40a1150 0x7f7ad40a3600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4100d70 0x7f7ae4108620 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae40ff1e0 0x7f7ae4109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 --2- 172.21.15.69:0/283575545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ae41003e0 0x7f7ae41080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 >> 172.21.15.69:0/283575545 conn(0x7f7ae40fa7f0 msgr2=0x7f7ae40fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 shutdown_connections 2023-12-14T14:08:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:35.020+0000 7f7aeabcf700 1 -- 172.21.15.69:0/283575545 wait complete. 2023-12-14T14:08:35.104 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:08:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:08:34.830+0000 7fa49c4aa640 -1 osd.11 0 log_to_monitors true 2023-12-14T14:08:35.415 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1702562900,"num_in_osds":12,"osd_in_since":1702562901,"num_remapped_pgs":0} 2023-12-14T14:08:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-12-14T14:08:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='osd.11 [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T14:08:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T14:08:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/283575545' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T14:08:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:36.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:36.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:35 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-12-14T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='osd.11 [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/283575545' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:36.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:35 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-12-14T14:08:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='osd.11 [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T14:08:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T14:08:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/283575545' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T14:08:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:08:36.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:36.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:36.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:35 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:36.417 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-14T14:08:36.738 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:08:36.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: Detected new or changed devices on smithi119 2023-12-14T14:08:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi119 to 4278M 2023-12-14T14:08:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:08:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-14T14:08:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: osdmap e75: 12 total, 11 up, 12 in 2023-12-14T14:08:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: from='osd.11 [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:08:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:36 smithi069 ceph-mon[42034]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:08:37.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:08:36.674+0000 7fa491b21700 -1 osd.11 0 waiting for initial osdmap 2023-12-14T14:08:37.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:08:36.691+0000 7fa48b912700 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T14:08:37.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: Detected new or changed devices on smithi119 2023-12-14T14:08:37.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi119 to 4278M 2023-12-14T14:08:37.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:37.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:08:37.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:37.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-14T14:08:37.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: osdmap e75: 12 total, 11 up, 12 in 2023-12-14T14:08:37.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:37.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: from='osd.11 [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:08:37.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:36 smithi119 ceph-mon[43834]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:08:37.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: Detected new or changed devices on smithi119 2023-12-14T14:08:37.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi119 to 4278M 2023-12-14T14:08:37.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:37.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:08:37.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:37.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-14T14:08:37.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: osdmap e75: 12 total, 11 up, 12 in 2023-12-14T14:08:37.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:37.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: from='osd.11 [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:08:37.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:36 smithi081 ceph-mon[43371]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T14:08:37.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.713+0000 7ffbb31fd700 1 -- 172.21.15.69:0/637523094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 msgr2=0x7ffbac107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:37.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.713+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/637523094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 0x7ffbac107630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffba400b0a0 tx=0x7ffba400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.713+0000 7ffbb31fd700 1 -- 172.21.15.69:0/637523094 shutdown_connections 2023-12-14T14:08:37.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.713+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/637523094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 0x7ffbac107630 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.713+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/637523094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbac0ff1e0 0x7ffbac0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.713+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/637523094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac1003e0 0x7ffbac100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.713+0000 7ffbb31fd700 1 -- 172.21.15.69:0/637523094 >> 172.21.15.69:0/637523094 conn(0x7ffbac0fa7f0 msgr2=0x7ffbac0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.713+0000 7ffbb31fd700 1 -- 172.21.15.69:0/637523094 shutdown_connections 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.713+0000 7ffbb31fd700 1 -- 172.21.15.69:0/637523094 wait complete. 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb31fd700 1 Processor -- start 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb31fd700 1 -- start start 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb31fd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbac0ff1e0 0x7ffbac069110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb31fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac1003e0 0x7ffbac19ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb31fd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 0x7ffbac19d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb31fd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac19dc20 con 0x7ffbac100d70 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb31fd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac19dd90 con 0x7ffbac1003e0 2023-12-14T14:08:37.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb31fd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac19df50 con 0x7ffbac0ff1e0 2023-12-14T14:08:37.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb179a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 0x7ffbac19d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:37.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb179a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 0x7ffbac19d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52210/0 (socket says 172.21.15.69:52210) 2023-12-14T14:08:37.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb179a700 1 -- 172.21.15.69:0/3795915695 learned_addr learned my addr 172.21.15.69:0/3795915695 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:37.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb0f99700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbac0ff1e0 0x7ffbac069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:37.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbabfff700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac1003e0 0x7ffbac19ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:37.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb179a700 1 -- 172.21.15.69:0/3795915695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbac0ff1e0 msgr2=0x7ffbac069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:37.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb179a700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbac0ff1e0 0x7ffbac069110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb179a700 1 -- 172.21.15.69:0/3795915695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac1003e0 msgr2=0x7ffbac19ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:37.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb179a700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac1003e0 0x7ffbac19ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb179a700 1 -- 172.21.15.69:0/3795915695 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba4009d00 con 0x7ffbac100d70 2023-12-14T14:08:37.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.714+0000 7ffbb179a700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 0x7ffbac19d480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffba40062a0 tx=0x7ffba4004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:37.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.715+0000 7ffba9ffb700 1 -- 172.21.15.69:0/3795915695 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba400e040 con 0x7ffbac100d70 2023-12-14T14:08:37.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.715+0000 7ffba9ffb700 1 -- 172.21.15.69:0/3795915695 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffba401b660 con 0x7ffbac100d70 2023-12-14T14:08:37.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.715+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac10ab30 con 0x7ffbac100d70 2023-12-14T14:08:37.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.715+0000 7ffba9ffb700 1 -- 172.21.15.69:0/3795915695 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4004280 con 0x7ffbac100d70 2023-12-14T14:08:37.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.715+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac10a9a0 con 0x7ffbac100d70 2023-12-14T14:08:37.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.716+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac066ea0 con 0x7ffbac100d70 2023-12-14T14:08:37.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.717+0000 7ffba9ffb700 1 -- 172.21.15.69:0/3795915695 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ffba401ba80 con 0x7ffbac100d70 2023-12-14T14:08:37.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.717+0000 7ffba9ffb700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb9c0a1150 0x7ffb9c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:37.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.718+0000 7ffba9ffb700 1 -- 172.21.15.69:0/3795915695 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffba40ce300 con 0x7ffbac100d70 2023-12-14T14:08:37.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.718+0000 7ffbb0f99700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb9c0a1150 0x7ffb9c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:37.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.718+0000 7ffbb0f99700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb9c0a1150 0x7ffb9c0a3600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffba0005fd0 tx=0x7ffba0005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:37.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.721+0000 7ffba9ffb700 1 -- 172.21.15.69:0/3795915695 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ffba4097ee0 con 0x7ffbac100d70 2023-12-14T14:08:37.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:37 smithi069 ceph-mon[42034]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:08:37.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:37 smithi069 ceph-mon[42034]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:08:37.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:37 smithi069 ceph-mon[42034]: osdmap e76: 12 total, 11 up, 12 in 2023-12-14T14:08:37.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:37 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:37.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:37 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:37.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.914+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ffbac106080 con 0x7ffbac100d70 2023-12-14T14:08:37.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.914+0000 7ffba9ffb700 1 -- 172.21.15.69:0/3795915695 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) v1 ==== 74+0+133 (secure 0 0 0) 0x7ffba4011390 con 0x7ffbac100d70 2023-12-14T14:08:37.913 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:37.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb9c0a1150 msgr2=0x7ffb9c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb9c0a1150 0x7ffb9c0a3600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffba0005fd0 tx=0x7ffba0005dd0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 msgr2=0x7ffbac19d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 0x7ffbac19d480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffba40062a0 tx=0x7ffba4004db0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 shutdown_connections 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb9c0a1150 0x7ffb9c0a3600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbac100d70 0x7ffbac19d480 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbac0ff1e0 0x7ffbac069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 --2- 172.21.15.69:0/3795915695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac1003e0 0x7ffbac19ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 >> 172.21.15.69:0/3795915695 conn(0x7ffbac0fa7f0 msgr2=0x7ffbac0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:37.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 shutdown_connections 2023-12-14T14:08:37.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:37.916+0000 7ffbb31fd700 1 -- 172.21.15.69:0/3795915695 wait complete. 2023-12-14T14:08:38.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:37 smithi119 ceph-mon[43834]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:08:38.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:37 smithi119 ceph-mon[43834]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:08:38.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:37 smithi119 ceph-mon[43834]: osdmap e76: 12 total, 11 up, 12 in 2023-12-14T14:08:38.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:37 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:38.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:37 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:38.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:37 smithi081 ceph-mon[43371]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T14:08:38.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:37 smithi081 ceph-mon[43371]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T14:08:38.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:37 smithi081 ceph-mon[43371]: osdmap e76: 12 total, 11 up, 12 in 2023-12-14T14:08:38.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:37 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:38.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:37 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:38.256 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1702562917,"num_in_osds":12,"osd_in_since":1702562901,"num_remapped_pgs":0} 2023-12-14T14:08:38.257 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-14T14:08:38.564 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:08:39.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:38 smithi119 ceph-mon[43834]: purged_snaps scrub starts 2023-12-14T14:08:39.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:38 smithi119 ceph-mon[43834]: purged_snaps scrub ok 2023-12-14T14:08:39.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:38 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:39.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:38 smithi119 ceph-mon[43834]: osd.11 [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] boot 2023-12-14T14:08:39.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:38 smithi119 ceph-mon[43834]: osdmap e77: 12 total, 12 up, 12 in 2023-12-14T14:08:39.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:38 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:39.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:38 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3795915695' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T14:08:39.049 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:38 smithi069 ceph-mon[42034]: purged_snaps scrub starts 2023-12-14T14:08:39.049 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:38 smithi069 ceph-mon[42034]: purged_snaps scrub ok 2023-12-14T14:08:39.050 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:38 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:39.050 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:38 smithi069 ceph-mon[42034]: osd.11 [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] boot 2023-12-14T14:08:39.050 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:38 smithi069 ceph-mon[42034]: osdmap e77: 12 total, 12 up, 12 in 2023-12-14T14:08:39.050 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:38 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:39.050 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:38 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3795915695' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T14:08:39.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:38 smithi081 ceph-mon[43371]: purged_snaps scrub starts 2023-12-14T14:08:39.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:38 smithi081 ceph-mon[43371]: purged_snaps scrub ok 2023-12-14T14:08:39.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:38 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:39.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:38 smithi081 ceph-mon[43371]: osd.11 [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] boot 2023-12-14T14:08:39.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:38 smithi081 ceph-mon[43371]: osdmap e77: 12 total, 12 up, 12 in 2023-12-14T14:08:39.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:38 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:08:39.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:38 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3795915695' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T14:08:39.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.578+0000 7fbbe3a54700 1 -- 172.21.15.69:0/1081061404 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 msgr2=0x7fbbdc10a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:39.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.578+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/1081061404 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 0x7fbbdc10a3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009990 tx=0x7fbbd8009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.578+0000 7fbbe3a54700 1 -- 172.21.15.69:0/1081061404 shutdown_connections 2023-12-14T14:08:39.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.578+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/1081061404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbdc10a900 0x7fbbdc10cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.578+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/1081061404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc1013e0 0x7fbbdc1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.578+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/1081061404 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 0x7fbbdc10a3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.578+0000 7fbbe3a54700 1 -- 172.21.15.69:0/1081061404 >> 172.21.15.69:0/1081061404 conn(0x7fbbdc0770d0 msgr2=0x7fbbdc0774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:39.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.578+0000 7fbbe3a54700 1 -- 172.21.15.69:0/1081061404 shutdown_connections 2023-12-14T14:08:39.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.578+0000 7fbbe3a54700 1 -- 172.21.15.69:0/1081061404 wait complete. 2023-12-14T14:08:39.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe3a54700 1 Processor -- start 2023-12-14T14:08:39.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe3a54700 1 -- start start 2023-12-14T14:08:39.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe3a54700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc1013e0 0x7fbbdc196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:39.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe3a54700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 0x7fbbdc1969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:39.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe3a54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbdc10a900 0x7fbbdc19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:39.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe3a54700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc19b430 con 0x7fbbdc101cf0 2023-12-14T14:08:39.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe3a54700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc19b5a0 con 0x7fbbdc10a900 2023-12-14T14:08:39.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe3a54700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc19b760 con 0x7fbbdc1013e0 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe0fef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 0x7fbbdc1969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe0fef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 0x7fbbdc1969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52226/0 (socket says 172.21.15.69:52226) 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe0fef700 1 -- 172.21.15.69:0/422729820 learned_addr learned my addr 172.21.15.69:0/422729820 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.579+0000 7fbbe1ff1700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbdc10a900 0x7fbbdc19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbe17f0700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc1013e0 0x7fbbdc196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbe0fef700 1 -- 172.21.15.69:0/422729820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc1013e0 msgr2=0x7fbbdc196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbe0fef700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc1013e0 0x7fbbdc196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbe0fef700 1 -- 172.21.15.69:0/422729820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbdc10a900 msgr2=0x7fbbdc19ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbe0fef700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbdc10a900 0x7fbbdc19ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbe0fef700 1 -- 172.21.15.69:0/422729820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80095f0 con 0x7fbbdc101cf0 2023-12-14T14:08:39.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbe0fef700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 0x7fbbdc1969b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8006010 tx=0x7fbbd800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:39.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbd27fc700 1 -- 172.21.15.69:0/422729820 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd801d070 con 0x7fbbdc101cf0 2023-12-14T14:08:39.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbd27fc700 1 -- 172.21.15.69:0/422729820 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbd800fb80 con 0x7fbbdc101cf0 2023-12-14T14:08:39.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbd27fc700 1 -- 172.21.15.69:0/422729820 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8017650 con 0x7fbbdc101cf0 2023-12-14T14:08:39.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc110380 con 0x7fbbdc101cf0 2023-12-14T14:08:39.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.580+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc1101f0 con 0x7fbbdc101cf0 2023-12-14T14:08:39.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.581+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc110510 con 0x7fbbdc101cf0 2023-12-14T14:08:39.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.582+0000 7fbbd27fc700 1 -- 172.21.15.69:0/422729820 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fbbd8022470 con 0x7fbbdc101cf0 2023-12-14T14:08:39.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.582+0000 7fbbd27fc700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbbc80a1150 0x7fbbc80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:39.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.583+0000 7fbbe17f0700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbbc80a1150 0x7fbbc80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:39.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.583+0000 7fbbd27fc700 1 -- 172.21.15.69:0/422729820 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbbd80cd580 con 0x7fbbdc101cf0 2023-12-14T14:08:39.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.583+0000 7fbbe17f0700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbbc80a1150 0x7fbbc80a3600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc005950 tx=0x7fbbcc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:39.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.587+0000 7fbbd27fc700 1 -- 172.21.15.69:0/422729820 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fbbd8097200 con 0x7fbbdc101cf0 2023-12-14T14:08:39.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.776+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbdc105220 con 0x7fbbdc101cf0 2023-12-14T14:08:39.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.777+0000 7fbbd27fc700 1 -- 172.21.15.69:0/422729820 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18399 (secure 0 0 0) 0x7fbbd809a820 con 0x7fbbdc101cf0 2023-12-14T14:08:39.778 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:39.778 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":78,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:08:38.679064+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:08:39.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbbc80a1150 msgr2=0x7fbbc80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:39.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbbc80a1150 0x7fbbc80a3600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc005950 tx=0x7fbbcc0058e0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 msgr2=0x7fbbdc1969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:39.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 0x7fbbdc1969b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8006010 tx=0x7fbbd800f690 comp rx=0 tx=0).stop 2023-12-14T14:08:39.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 shutdown_connections 2023-12-14T14:08:39.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbbc80a1150 0x7fbbc80a3600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbdc10a900 0x7fbbdc19ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc1013e0 0x7fbbdc196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 --2- 172.21.15.69:0/422729820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbdc101cf0 0x7fbbdc1969b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:39.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 >> 172.21.15.69:0/422729820 conn(0x7fbbdc0770d0 msgr2=0x7fbbdc102360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:39.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 shutdown_connections 2023-12-14T14:08:39.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:39.779+0000 7fbbe3a54700 1 -- 172.21.15.69:0/422729820 wait complete. 2023-12-14T14:08:39.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:39 smithi069 ceph-mon[42034]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:39.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:39 smithi069 ceph-mon[42034]: osdmap e78: 12 total, 12 up, 12 in 2023-12-14T14:08:40.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:39 smithi119 ceph-mon[43834]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:39 smithi119 ceph-mon[43834]: osdmap e78: 12 total, 12 up, 12 in 2023-12-14T14:08:40.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:39 smithi081 ceph-mon[43371]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-12-14T14:08:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:39 smithi081 ceph-mon[43371]: osdmap e78: 12 total, 12 up, 12 in 2023-12-14T14:08:40.171 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:08:40.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-14T14:08:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:08:40.957 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:40 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/422729820' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:08:41.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:40 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/422729820' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:08:41.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:40 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/422729820' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:08:41.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.552+0000 7f574a3c6700 1 -- 172.21.15.69:0/4264734882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 msgr2=0x7f5744103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:41.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.552+0000 7f574a3c6700 1 --2- 172.21.15.69:0/4264734882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 0x7f5744103de0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57380099c0 tx=0x7f5738009cd0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.552+0000 7f574a3c6700 1 -- 172.21.15.69:0/4264734882 shutdown_connections 2023-12-14T14:08:41.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.552+0000 7f574a3c6700 1 --2- 172.21.15.69:0/4264734882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744104510 0x7f574410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.552+0000 7f574a3c6700 1 --2- 172.21.15.69:0/4264734882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57440ff470 0x7f57440ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.552+0000 7f574a3c6700 1 --2- 172.21.15.69:0/4264734882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 0x7f5744103de0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.552+0000 7f574a3c6700 1 -- 172.21.15.69:0/4264734882 >> 172.21.15.69:0/4264734882 conn(0x7f57440770d0 msgr2=0x7f57440774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:41.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.552+0000 7f574a3c6700 1 -- 172.21.15.69:0/4264734882 shutdown_connections 2023-12-14T14:08:41.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.552+0000 7f574a3c6700 1 -- 172.21.15.69:0/4264734882 wait complete. 2023-12-14T14:08:41.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f574a3c6700 1 Processor -- start 2023-12-14T14:08:41.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f574a3c6700 1 -- start start 2023-12-14T14:08:41.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f574a3c6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57440ff470 0x7f5744100e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:41.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f574a3c6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 0x7f57441013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:41.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f574a3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744104510 0x7f5744101940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:41.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f574a3c6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57441a4890 con 0x7f57440ffe10 2023-12-14T14:08:41.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f574a3c6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57441a4a00 con 0x7f5744104510 2023-12-14T14:08:41.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f574a3c6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57441a4bc0 con 0x7f57440ff470 2023-12-14T14:08:41.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f57437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 0x7f57441013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f57437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 0x7f57441013c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52242/0 (socket says 172.21.15.69:52242) 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f57437fe700 1 -- 172.21.15.69:0/3318215364 learned_addr learned my addr 172.21.15.69:0/3318215364 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f5743fff700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57440ff470 0x7f5744100e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.553+0000 7f5748963700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744104510 0x7f5744101940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f57437fe700 1 -- 172.21.15.69:0/3318215364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57440ff470 msgr2=0x7f5744100e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f57437fe700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57440ff470 0x7f5744100e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f57437fe700 1 -- 172.21.15.69:0/3318215364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744104510 msgr2=0x7f5744101940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f57437fe700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744104510 0x7f5744101940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f57437fe700 1 -- 172.21.15.69:0/3318215364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57380095f0 con 0x7f57440ffe10 2023-12-14T14:08:41.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f5743fff700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57440ff470 0x7f5744100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:08:41.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f57437fe700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 0x7f57441013c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5738006010 tx=0x7f57380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:41.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f57417fa700 1 -- 172.21.15.69:0/3318215364 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573801d070 con 0x7f57440ffe10 2023-12-14T14:08:41.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574410f2e0 con 0x7f57440ffe10 2023-12-14T14:08:41.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f57417fa700 1 -- 172.21.15.69:0/3318215364 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5738004090 con 0x7f57440ffe10 2023-12-14T14:08:41.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f57417fa700 1 -- 172.21.15.69:0/3318215364 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738022ea0 con 0x7f57440ffe10 2023-12-14T14:08:41.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.554+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574410f150 con 0x7f57440ffe10 2023-12-14T14:08:41.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.555+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574410f470 con 0x7f57440ffe10 2023-12-14T14:08:41.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.556+0000 7f57417fa700 1 -- 172.21.15.69:0/3318215364 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f5738003bd0 con 0x7f57440ffe10 2023-12-14T14:08:41.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.556+0000 7f57417fa700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f572c0a1150 0x7f572c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:41.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.556+0000 7f5743fff700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f572c0a1150 0x7f572c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:41.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.556+0000 7f57417fa700 1 -- 172.21.15.69:0/3318215364 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f57380cd710 con 0x7f57440ffe10 2023-12-14T14:08:41.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.557+0000 7f5743fff700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f572c0a1150 0x7f572c0a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5734005950 tx=0x7f5734005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:41.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.561+0000 7f57417fa700 1 -- 172.21.15.69:0/3318215364 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f573805c730 con 0x7f57440ffe10 2023-12-14T14:08:41.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.749+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57441a5540 con 0x7f57440ffe10 2023-12-14T14:08:41.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.750+0000 7f57417fa700 1 -- 172.21.15.69:0/3318215364 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5738097390 con 0x7f57440ffe10 2023-12-14T14:08:41.750 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:08:41.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f572c0a1150 msgr2=0x7f572c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:41.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f572c0a1150 0x7f572c0a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5734005950 tx=0x7f5734005f50 comp rx=0 tx=0).stop 2023-12-14T14:08:41.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 msgr2=0x7f57441013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:41.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 0x7f57441013c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5738006010 tx=0x7f57380057f0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 shutdown_connections 2023-12-14T14:08:41.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f572c0a1150 0x7f572c0a3600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744104510 0x7f5744101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57440ff470 0x7f5744100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 --2- 172.21.15.69:0/3318215364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57440ffe10 0x7f57441013c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:41.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 >> 172.21.15.69:0/3318215364 conn(0x7f57440770d0 msgr2=0x7f5744068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:41.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 shutdown_connections 2023-12-14T14:08:41.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:41.752+0000 7f574a3c6700 1 -- 172.21.15.69:0/3318215364 wait complete. 2023-12-14T14:08:41.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:41 smithi069 ceph-mon[42034]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:42.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:41 smithi119 ceph-mon[43834]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:42.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:41 smithi081 ceph-mon[43371]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:42.175 INFO:tasks.cephadm:Adding mds.a on smithi069 2023-12-14T14:08:42.175 INFO:tasks.cephadm:Adding mds.d on smithi069 2023-12-14T14:08:42.175 INFO:tasks.cephadm:Adding mds.g on smithi069 2023-12-14T14:08:42.175 INFO:tasks.cephadm:Adding mds.j on smithi069 2023-12-14T14:08:42.175 INFO:tasks.cephadm:Adding mds.b on smithi081 2023-12-14T14:08:42.175 INFO:tasks.cephadm:Adding mds.e on smithi081 2023-12-14T14:08:42.175 INFO:tasks.cephadm:Adding mds.h on smithi081 2023-12-14T14:08:42.175 INFO:tasks.cephadm:Adding mds.k on smithi081 2023-12-14T14:08:42.175 INFO:tasks.cephadm:Adding mds.c on smithi119 2023-12-14T14:08:42.176 INFO:tasks.cephadm:Adding mds.f on smithi119 2023-12-14T14:08:42.176 INFO:tasks.cephadm:Adding mds.i on smithi119 2023-12-14T14:08:42.176 INFO:tasks.cephadm:Adding mds.l on smithi119 2023-12-14T14:08:42.176 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph orch apply mds all '12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l' 2023-12-14T14:08:42.496 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:08:42.953 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:42 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3318215364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:08:43.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:42 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3318215364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:08:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:42 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3318215364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:08:43.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.497+0000 7f9a29c98700 1 -- 172.21.15.119:0/864061432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101510 msgr2=0x7f9a24101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:43.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.497+0000 7f9a29c98700 1 --2- 172.21.15.119:0/864061432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101510 0x7f9a24101960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009990 tx=0x7f9a0c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.497+0000 7f9a29c98700 1 -- 172.21.15.119:0/864061432 shutdown_connections 2023-12-14T14:08:43.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.497+0000 7f9a29c98700 1 --2- 172.21.15.119:0/864061432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a24101ea0 0x7f9a24108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.497+0000 7f9a29c98700 1 --2- 172.21.15.119:0/864061432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a24100310 0x7f9a24100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.497+0000 7f9a29c98700 1 --2- 172.21.15.119:0/864061432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101510 0x7f9a24101960 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.497+0000 7f9a29c98700 1 -- 172.21.15.119:0/864061432 >> 172.21.15.119:0/864061432 conn(0x7f9a240fb960 msgr2=0x7f9a240fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:43.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.497+0000 7f9a29c98700 1 -- 172.21.15.119:0/864061432 shutdown_connections 2023-12-14T14:08:43.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.497+0000 7f9a29c98700 1 -- 172.21.15.119:0/864061432 wait complete. 2023-12-14T14:08:43.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a29c98700 1 Processor -- start 2023-12-14T14:08:43.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a29c98700 1 -- start start 2023-12-14T14:08:43.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a29c98700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a24100310 0x7f9a24074890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:43.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a29c98700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a24101510 0x7f9a24072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:43.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a29c98700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101ea0 0x7f9a24073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:43.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a29c98700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a24073ba0 con 0x7f9a24100310 2023-12-14T14:08:43.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a29c98700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a24073d10 con 0x7f9a24101510 2023-12-14T14:08:43.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a29c98700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2419ff60 con 0x7f9a24101ea0 2023-12-14T14:08:43.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a23fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101ea0 0x7f9a24073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:43.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a23fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101ea0 0x7f9a24073420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49038/0 (socket says 172.21.15.119:49038) 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a23fff700 1 -- 172.21.15.119:0/405938539 learned_addr learned my addr 172.21.15.119:0/405938539 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.498+0000 7f9a237fe700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a24100310 0x7f9a24074890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a22ffd700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a24101510 0x7f9a24072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a23fff700 1 -- 172.21.15.119:0/405938539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a24101510 msgr2=0x7f9a24072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a23fff700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a24101510 0x7f9a24072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a23fff700 1 -- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a24100310 msgr2=0x7f9a24074890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a23fff700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a24100310 0x7f9a24074890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a23fff700 1 -- 172.21.15.119:0/405938539 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0095f0 con 0x7f9a24101ea0 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a22ffd700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a24101510 0x7f9a24072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:08:43.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a23fff700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101ea0 0x7f9a24073420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c007d70 tx=0x7f9a1c00a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:43.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a20ff9700 1 -- 172.21.15.119:0/405938539 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00ad40 con 0x7f9a24101ea0 2023-12-14T14:08:43.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a20ff9700 1 -- 172.21.15.119:0/405938539 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a1c0128e0 con 0x7f9a24101ea0 2023-12-14T14:08:43.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2410bc70 con 0x7f9a24101ea0 2023-12-14T14:08:43.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a20ff9700 1 -- 172.21.15.119:0/405938539 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0116b0 con 0x7f9a24101ea0 2023-12-14T14:08:43.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.499+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2410bae0 con 0x7f9a24101ea0 2023-12-14T14:08:43.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.500+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a241077e0 con 0x7f9a24101ea0 2023-12-14T14:08:43.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.501+0000 7f9a20ff9700 1 -- 172.21.15.119:0/405938539 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9a1c012420 con 0x7f9a24101ea0 2023-12-14T14:08:43.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.502+0000 7f9a20ff9700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9a100a11d0 0x7f9a100a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:43.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.503+0000 7f9a20ff9700 1 -- 172.21.15.119:0/405938539 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9a1c0ccb30 con 0x7f9a24101ea0 2023-12-14T14:08:43.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.503+0000 7f9a237fe700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9a100a11d0 0x7f9a100a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:43.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.503+0000 7f9a237fe700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9a100a11d0 0x7f9a100a3680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9a24101370 tx=0x7f9a1400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:43.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.506+0000 7f9a20ff9700 1 -- 172.21.15.119:0/405938539 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9a1c096680 con 0x7f9a24101ea0 2023-12-14T14:08:43.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.702+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a24061a10 con 0x7f9a100a11d0 2023-12-14T14:08:43.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.713+0000 7f9a20ff9700 1 -- 172.21.15.119:0/405938539 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f9a24061a10 con 0x7f9a100a11d0 2023-12-14T14:08:43.713 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mds.all update... 2023-12-14T14:08:43.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9a100a11d0 msgr2=0x7f9a100a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:43.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9a100a11d0 0x7f9a100a3680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9a24101370 tx=0x7f9a1400a3b0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101ea0 msgr2=0x7f9a24073420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101ea0 0x7f9a24073420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c007d70 tx=0x7f9a1c00a340 comp rx=0 tx=0).stop 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 shutdown_connections 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9a100a11d0 0x7f9a100a3680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24101ea0 0x7f9a24073420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a24100310 0x7f9a24074890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 --2- 172.21.15.119:0/405938539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a24101510 0x7f9a24072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 >> 172.21.15.119:0/405938539 conn(0x7f9a240fb960 msgr2=0x7f9a24104920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 shutdown_connections 2023-12-14T14:08:43.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T14:08:43.715+0000 7f9a29c98700 1 -- 172.21.15.119:0/405938539 wait complete. 2023-12-14T14:08:43.972 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:43 smithi119 ceph-mon[43834]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:44.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:43 smithi069 ceph-mon[42034]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:44.091 DEBUG:teuthology.orchestra.run.smithi069:mds.a> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.a.service 2023-12-14T14:08:44.094 DEBUG:teuthology.orchestra.run.smithi069:mds.d> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.d.service 2023-12-14T14:08:44.124 INFO:journalctl@ceph.mds.a.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:08:44.125 DEBUG:teuthology.orchestra.run.smithi069:mds.g> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.g.service 2023-12-14T14:08:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:43 smithi081 ceph-mon[43371]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:44.152 INFO:journalctl@ceph.mds.d.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:08:44.153 DEBUG:teuthology.orchestra.run.smithi069:mds.j> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.j.service 2023-12-14T14:08:44.179 INFO:journalctl@ceph.mds.g.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:08:44.180 DEBUG:teuthology.orchestra.run.smithi081:mds.b> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.b.service 2023-12-14T14:08:44.183 DEBUG:teuthology.orchestra.run.smithi081:mds.e> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.e.service 2023-12-14T14:08:44.206 INFO:journalctl@ceph.mds.j.smithi069.stdout:-- Logs begin at Thu 2023-12-14 13:51:37 UTC. -- 2023-12-14T14:08:44.222 INFO:journalctl@ceph.mds.b.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:08:44.223 DEBUG:teuthology.orchestra.run.smithi081:mds.h> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.h.service 2023-12-14T14:08:44.252 INFO:journalctl@ceph.mds.e.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:08:44.253 DEBUG:teuthology.orchestra.run.smithi081:mds.k> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.k.service 2023-12-14T14:08:44.281 INFO:journalctl@ceph.mds.h.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:08:44.282 DEBUG:teuthology.orchestra.run.smithi119:mds.c> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.c.service 2023-12-14T14:08:44.284 DEBUG:teuthology.orchestra.run.smithi119:mds.f> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.f.service 2023-12-14T14:08:44.309 INFO:journalctl@ceph.mds.k.smithi081.stdout:-- Logs begin at Thu 2023-12-14 13:51:00 UTC. -- 2023-12-14T14:08:44.315 INFO:journalctl@ceph.mds.c.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:08:44.317 DEBUG:teuthology.orchestra.run.smithi119:mds.i> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.i.service 2023-12-14T14:08:44.343 INFO:journalctl@ceph.mds.f.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:08:44.344 DEBUG:teuthology.orchestra.run.smithi119:mds.l> sudo journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.l.service 2023-12-14T14:08:44.371 INFO:journalctl@ceph.mds.i.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:08:44.372 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-12-14T14:08:44.372 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:08:44.398 INFO:journalctl@ceph.mds.l.smithi119.stdout:-- Logs begin at Thu 2023-12-14 13:50:49 UTC. -- 2023-12-14T14:08:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.508+0000 7f3658fa4700 1 -- 172.21.15.69:0/2957649178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36540ff120 msgr2=0x7f36540ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.508+0000 7f3658fa4700 1 --2- 172.21.15.69:0/2957649178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36540ff120 0x7f36540ff530 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3648009990 tx=0x7f3648009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.509+0000 7f3658fa4700 1 -- 172.21.15.69:0/2957649178 shutdown_connections 2023-12-14T14:08:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.509+0000 7f3658fa4700 1 --2- 172.21.15.69:0/2957649178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3654100ca0 0x7f3654107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.509+0000 7f3658fa4700 1 --2- 172.21.15.69:0/2957649178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36540ff120 0x7f36540ff530 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.509+0000 7f3658fa4700 1 --2- 172.21.15.69:0/2957649178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3654100310 0x7f3654100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.509+0000 7f3658fa4700 1 -- 172.21.15.69:0/2957649178 >> 172.21.15.69:0/2957649178 conn(0x7f36540fa700 msgr2=0x7f36540fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.509+0000 7f3658fa4700 1 -- 172.21.15.69:0/2957649178 shutdown_connections 2023-12-14T14:08:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.509+0000 7f3658fa4700 1 -- 172.21.15.69:0/2957649178 wait complete. 2023-12-14T14:08:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3658fa4700 1 Processor -- start 2023-12-14T14:08:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3658fa4700 1 -- start start 2023-12-14T14:08:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3658fa4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36540ff120 0x7f36540699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3658fa4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3654100310 0x7f365419ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3658fa4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3654100ca0 0x7f365419d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3658fa4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365419db40 con 0x7f3654100310 2023-12-14T14:08:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3658fa4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365419dcb0 con 0x7f36540ff120 2023-12-14T14:08:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3658fa4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365419de70 con 0x7f3654100ca0 2023-12-14T14:08:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3651d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3654100310 0x7f365419ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3651d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3654100310 0x7f365419ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52256/0 (socket says 172.21.15.69:52256) 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3651d9b700 1 -- 172.21.15.69:0/1655509405 learned_addr learned my addr 172.21.15.69:0/1655509405 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f365259c700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36540ff120 0x7f36540699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3652d9d700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3654100ca0 0x7f365419d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3651d9b700 1 -- 172.21.15.69:0/1655509405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3654100ca0 msgr2=0x7f365419d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3651d9b700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3654100ca0 0x7f365419d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3651d9b700 1 -- 172.21.15.69:0/1655509405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36540ff120 msgr2=0x7f36540699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3651d9b700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36540ff120 0x7f36540699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3651d9b700 1 -- 172.21.15.69:0/1655509405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480095f0 con 0x7f3654100310 2023-12-14T14:08:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3652d9d700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3654100ca0 0x7f365419d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.510+0000 7f3651d9b700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3654100310 0x7f365419ad20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f364400c920 tx=0x7f364400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.511+0000 7f36437fe700 1 -- 172.21.15.69:0/1655509405 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644007b00 con 0x7f3654100310 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.511+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365410aae0 con 0x7f3654100310 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.511+0000 7f36437fe700 1 -- 172.21.15.69:0/1655509405 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f364400ce70 con 0x7f3654100310 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.511+0000 7f36437fe700 1 -- 172.21.15.69:0/1655509405 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644005460 con 0x7f3654100310 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.511+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365410a950 con 0x7f3654100310 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.512+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365419e610 con 0x7f3654100310 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.513+0000 7f36437fe700 1 -- 172.21.15.69:0/1655509405 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f36440055c0 con 0x7f3654100310 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.513+0000 7f36437fe700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f363c0a1150 0x7f363c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.513+0000 7f36437fe700 1 -- 172.21.15.69:0/1655509405 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f36440cc480 con 0x7f3654100310 2023-12-14T14:08:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.513+0000 7f365259c700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f363c0a1150 0x7f363c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.514+0000 7f365259c700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f363c0a1150 0x7f363c0a3600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f364800b2e0 tx=0x7f3648005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.517+0000 7f36437fe700 1 -- 172.21.15.69:0/1655509405 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3644096070 con 0x7f3654100310 2023-12-14T14:08:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.708+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3654106060 con 0x7f3654100310 2023-12-14T14:08:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.709+0000 7f36437fe700 1 -- 172.21.15.69:0/1655509405 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f3644099690 con 0x7f3654100310 2023-12-14T14:08:44.710 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:44.710 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":78,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:08:38.679064+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:08:44.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f363c0a1150 msgr2=0x7f363c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:44.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f363c0a1150 0x7f363c0a3600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f364800b2e0 tx=0x7f3648005fb0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3654100310 msgr2=0x7f365419ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:44.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3654100310 0x7f365419ad20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f364400c920 tx=0x7f364400cc30 comp rx=0 tx=0).stop 2023-12-14T14:08:44.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 shutdown_connections 2023-12-14T14:08:44.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f363c0a1150 0x7f363c0a3600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3654100ca0 0x7f365419d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36540ff120 0x7f36540699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 --2- 172.21.15.69:0/1655509405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3654100310 0x7f365419ad20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 >> 172.21.15.69:0/1655509405 conn(0x7f36540fa700 msgr2=0x7f36540fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 shutdown_connections 2023-12-14T14:08:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.711+0000 7f3658fa4700 1 -- 172.21.15.69:0/1655509405 wait complete. 2023-12-14T14:08:44.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:08:44.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2023-12-14T14:08:44.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:44.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:44.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:44.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:44.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:44.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:44.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:44.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:44.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:44 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1655509405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:08:44.725 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:08:44.726 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:08:44.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.850+0000 7fc602783700 1 -- 172.21.15.69:0/3861655572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc0ff160 msgr2=0x7fc5fc0ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:44.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.850+0000 7fc602783700 1 --2- 172.21.15.69:0/3861655572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc0ff160 0x7fc5fc0ff570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009990 tx=0x7fc5ec009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.850+0000 7fc602783700 1 -- 172.21.15.69:0/3861655572 shutdown_connections 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.850+0000 7fc602783700 1 --2- 172.21.15.69:0/3861655572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc100ce0 0x7fc5fc1075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.850+0000 7fc602783700 1 --2- 172.21.15.69:0/3861655572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc0ff160 0x7fc5fc0ff570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.850+0000 7fc602783700 1 --2- 172.21.15.69:0/3861655572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5fc100350 0x7fc5fc1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.850+0000 7fc602783700 1 -- 172.21.15.69:0/3861655572 >> 172.21.15.69:0/3861655572 conn(0x7fc5fc0fa780 msgr2=0x7fc5fc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.850+0000 7fc602783700 1 -- 172.21.15.69:0/3861655572 shutdown_connections 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.850+0000 7fc602783700 1 -- 172.21.15.69:0/3861655572 wait complete. 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.851+0000 7fc602783700 1 Processor -- start 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.851+0000 7fc602783700 1 -- start start 2023-12-14T14:08:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.851+0000 7fc602783700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc0ff160 0x7fc5fc069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.851+0000 7fc602783700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5fc100350 0x7fc5fc19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.851+0000 7fc602783700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc100ce0 0x7fc5fc19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc602783700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc19da30 con 0x7fc5fc100ce0 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc602783700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc19dba0 con 0x7fc5fc100350 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc602783700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc19dd60 con 0x7fc5fc0ff160 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc600d20700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc100ce0 0x7fc5fc19d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc600d20700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc100ce0 0x7fc5fc19d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52266/0 (socket says 172.21.15.69:52266) 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc600d20700 1 -- 172.21.15.69:0/2954178994 learned_addr learned my addr 172.21.15.69:0/2954178994 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc5fb7fe700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5fc100350 0x7fc5fc19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc5fbfff700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc0ff160 0x7fc5fc069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc600d20700 1 -- 172.21.15.69:0/2954178994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc0ff160 msgr2=0x7fc5fc069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc600d20700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc0ff160 0x7fc5fc069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc600d20700 1 -- 172.21.15.69:0/2954178994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5fc100350 msgr2=0x7fc5fc19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc600d20700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5fc100350 0x7fc5fc19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc600d20700 1 -- 172.21.15.69:0/2954178994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec0095f0 con 0x7fc5fc100ce0 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc600d20700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc100ce0 0x7fc5fc19d290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4007ee0 tx=0x7fc5f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc5f97fa700 1 -- 172.21.15.69:0/2954178994 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4017070 con 0x7fc5fc100ce0 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc5f97fa700 1 -- 172.21.15.69:0/2954178994 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5f400f040 con 0x7fc5fc100ce0 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc10aad0 con 0x7fc5fc100ce0 2023-12-14T14:08:44.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc5f97fa700 1 -- 172.21.15.69:0/2954178994 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4005580 con 0x7fc5fc100ce0 2023-12-14T14:08:44.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.852+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc10a940 con 0x7fc5fc100ce0 2023-12-14T14:08:44.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.853+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc19e340 con 0x7fc5fc100ce0 2023-12-14T14:08:44.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.854+0000 7fc5f97fa700 1 -- 172.21.15.69:0/2954178994 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc5f400db20 con 0x7fc5fc100ce0 2023-12-14T14:08:44.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.855+0000 7fc5f97fa700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc5e40a1150 0x7fc5e40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:44.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.855+0000 7fc5fbfff700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc5e40a1150 0x7fc5e40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:44.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.855+0000 7fc5f97fa700 1 -- 172.21.15.69:0/2954178994 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc5f40cc1c0 con 0x7fc5fc100ce0 2023-12-14T14:08:44.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.856+0000 7fc5fbfff700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc5e40a1150 0x7fc5e40a3600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00b5c0 tx=0x7fc5ec005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:44.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:44.859+0000 7fc5f97fa700 1 -- 172.21.15.69:0/2954178994 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc5f4095db0 con 0x7fc5fc100ce0 2023-12-14T14:08:45.019 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:08:45.019 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2023-12-14T14:08:45.019 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:45.019 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:45.019 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:45.019 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:45.019 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:45.020 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:45.020 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:45.020 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:45.020 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:44 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1655509405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:08:45.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.048+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5fc105fc0 con 0x7fc5fc100ce0 2023-12-14T14:08:45.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.048+0000 7fc5f97fa700 1 -- 172.21.15.69:0/2954178994 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5f40993d0 con 0x7fc5fc100ce0 2023-12-14T14:08:45.049 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:08:45.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.050+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc5e40a1150 msgr2=0x7fc5e40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:45.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.050+0000 7fc602783700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc5e40a1150 0x7fc5e40a3600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00b5c0 tx=0x7fc5ec005960 comp rx=0 tx=0).stop 2023-12-14T14:08:45.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.050+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc100ce0 msgr2=0x7fc5fc19d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:45.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.050+0000 7fc602783700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc100ce0 0x7fc5fc19d290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4007ee0 tx=0x7fc5f400d3b0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.050+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 shutdown_connections 2023-12-14T14:08:45.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.050+0000 7fc602783700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc5e40a1150 0x7fc5e40a3600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.050+0000 7fc602783700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5fc100ce0 0x7fc5fc19d290 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.050+0000 7fc602783700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc0ff160 0x7fc5fc069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.050+0000 7fc602783700 1 --2- 172.21.15.69:0/2954178994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5fc100350 0x7fc5fc19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.051+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 >> 172.21.15.69:0/2954178994 conn(0x7fc5fc0fa780 msgr2=0x7fc5fc0fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:45.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.051+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 shutdown_connections 2023-12-14T14:08:45.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.051+0000 7fc602783700 1 -- 172.21.15.69:0/2954178994 wait complete. 2023-12-14T14:08:45.063 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:08:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:08:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2023-12-14T14:08:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:08:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:08:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:45.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:45.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:44 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1655509405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:08:45.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.185+0000 7fbb7f262700 1 -- 172.21.15.69:0/877497381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101420 msgr2=0x7fbb78101870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.185+0000 7fbb7f262700 1 --2- 172.21.15.69:0/877497381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101420 0x7fbb78101870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009990 tx=0x7fbb64009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.185+0000 7fbb7f262700 1 -- 172.21.15.69:0/877497381 shutdown_connections 2023-12-14T14:08:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.185+0000 7fbb7f262700 1 --2- 172.21.15.69:0/877497381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78101db0 0x7fbb78108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.185+0000 7fbb7f262700 1 --2- 172.21.15.69:0/877497381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb78100230 0x7fbb78100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.185+0000 7fbb7f262700 1 --2- 172.21.15.69:0/877497381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101420 0x7fbb78101870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.185+0000 7fbb7f262700 1 -- 172.21.15.69:0/877497381 >> 172.21.15.69:0/877497381 conn(0x7fbb780fb810 msgr2=0x7fbb780fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.185+0000 7fbb7f262700 1 -- 172.21.15.69:0/877497381 shutdown_connections 2023-12-14T14:08:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.185+0000 7fbb7f262700 1 -- 172.21.15.69:0/877497381 wait complete. 2023-12-14T14:08:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7f262700 1 Processor -- start 2023-12-14T14:08:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7f262700 1 -- start start 2023-12-14T14:08:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7f262700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb78100230 0x7fbb78195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7f262700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78101420 0x7fbb781964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7f262700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101db0 0x7fbb7819d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7f262700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7819db10 con 0x7fbb78101db0 2023-12-14T14:08:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7f262700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7819dc50 con 0x7fbb78101420 2023-12-14T14:08:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7f262700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7819dde0 con 0x7fbb78100230 2023-12-14T14:08:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7d7ff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101db0 0x7fbb7819d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7d7ff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101db0 0x7fbb7819d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52290/0 (socket says 172.21.15.69:52290) 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7d7ff700 1 -- 172.21.15.69:0/2553464141 learned_addr learned my addr 172.21.15.69:0/2553464141 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb77fff700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78101420 0x7fbb781964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.186+0000 7fbb7cffe700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb78100230 0x7fbb78195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb7d7ff700 1 -- 172.21.15.69:0/2553464141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb78100230 msgr2=0x7fbb78195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb7d7ff700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb78100230 0x7fbb78195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb7d7ff700 1 -- 172.21.15.69:0/2553464141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78101420 msgr2=0x7fbb781964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb7d7ff700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78101420 0x7fbb781964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb7d7ff700 1 -- 172.21.15.69:0/2553464141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb640095f0 con 0x7fbb78101db0 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb7d7ff700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101db0 0x7fbb7819d540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000ef30 tx=0x7fbb7000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb75ffb700 1 -- 172.21.15.69:0/2553464141 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70018070 con 0x7fbb78101db0 2023-12-14T14:08:45.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb75ffb700 1 -- 172.21.15.69:0/2553464141 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb7000f040 con 0x7fbb78101db0 2023-12-14T14:08:45.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7810bb90 con 0x7fbb78101db0 2023-12-14T14:08:45.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb75ffb700 1 -- 172.21.15.69:0/2553464141 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000cdb0 con 0x7fbb78101db0 2023-12-14T14:08:45.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.187+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7810ba00 con 0x7fbb78101db0 2023-12-14T14:08:45.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.188+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb781077c0 con 0x7fbb78101db0 2023-12-14T14:08:45.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.189+0000 7fbb75ffb700 1 -- 172.21.15.69:0/2553464141 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fbb70003a00 con 0x7fbb78101db0 2023-12-14T14:08:45.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.189+0000 7fbb75ffb700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbb680a1150 0x7fbb680a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:45.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.190+0000 7fbb7cffe700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbb680a1150 0x7fbb680a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:45.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.190+0000 7fbb75ffb700 1 -- 172.21.15.69:0/2553464141 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbb700cc0a0 con 0x7fbb78101db0 2023-12-14T14:08:45.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.190+0000 7fbb7cffe700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbb680a1150 0x7fbb680a3600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb78101280 tx=0x7fbb6c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:45.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.194+0000 7fbb75ffb700 1 -- 172.21.15.69:0/2553464141 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fbb70095d20 con 0x7fbb78101db0 2023-12-14T14:08:45.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.430+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb78061930 con 0x7fbb78101db0 2023-12-14T14:08:45.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.430+0000 7fbb75ffb700 1 -- 172.21.15.69:0/2553464141 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7fbb70099340 con 0x7fbb78101db0 2023-12-14T14:08:45.431 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:45.431 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-14T14:08:45.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.432+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbb680a1150 msgr2=0x7fbb680a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.432+0000 7fbb7f262700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbb680a1150 0x7fbb680a3600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb78101280 tx=0x7fbb6c009260 comp rx=0 tx=0).stop 2023-12-14T14:08:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.432+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101db0 msgr2=0x7fbb7819d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.432+0000 7fbb7f262700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101db0 0x7fbb7819d540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000ef30 tx=0x7fbb7000c3a0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.432+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 shutdown_connections 2023-12-14T14:08:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.432+0000 7fbb7f262700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbb680a1150 0x7fbb680a3600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.432+0000 7fbb7f262700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb78101db0 0x7fbb7819d540 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.433+0000 7fbb7f262700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb78100230 0x7fbb78195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.433+0000 7fbb7f262700 1 --2- 172.21.15.69:0/2553464141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78101420 0x7fbb781964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.433+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 >> 172.21.15.69:0/2553464141 conn(0x7fbb780fb810 msgr2=0x7fbb78104900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:45.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.433+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 shutdown_connections 2023-12-14T14:08:45.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:45.433+0000 7fbb7f262700 1 -- 172.21.15.69:0/2553464141 wait complete. 2023-12-14T14:08:45.435 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 1 2023-12-14T14:08:45.721 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 14:08:45 smithi119 systemd[1]: Starting Ceph mds.l for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:08:46.024 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-mds[68806]: -- 172.21.15.119:0/3614004325 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e1d8ef7520 con 0x55e1d8ecc800 2023-12-14T14:08:46.025 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-l[68783]: starting mds.l at 2023-12-14T14:08:46.025 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 14:08:45 smithi119 bash[68768]: 8c040dc1695f3927b0446b7722dcbe183d87066756d99aca66e140010c225536 2023-12-14T14:08:46.025 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 14:08:45 smithi119 systemd[1]: Started Ceph mds.l for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:08:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:08:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:08:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:08:46.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-mon[43834]: Deploying daemon mds.l on smithi119 2023-12-14T14:08:46.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-mon[43834]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:46.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2954178994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:08:46.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:45 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2553464141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:46.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:45 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:46.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:45 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:08:46.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:45 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:08:46.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:45 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:08:46.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:45 smithi069 ceph-mon[42034]: Deploying daemon mds.l on smithi119 2023-12-14T14:08:46.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:45 smithi069 ceph-mon[42034]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:46.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:45 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2954178994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:08:46.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:45 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2553464141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:46.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:45 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:45 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:08:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:45 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:08:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:45 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:08:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:45 smithi081 ceph-mon[43371]: Deploying daemon mds.l on smithi119 2023-12-14T14:08:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:45 smithi081 ceph-mon[43371]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:45 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2954178994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:08:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:45 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2553464141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:47.024 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.119:6832/3794904365,v1:172.21.15.119:6833/3794904365] up:boot 2023-12-14T14:08:47.024 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: fsmap 1 up:standby 2023-12-14T14:08:47.024 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-14T14:08:47.024 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:47.024 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:47.024 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:47.024 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:47.024 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:47.025 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:47.025 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:46 smithi081 ceph-mon[43371]: Deploying daemon mds.k on smithi081 2023-12-14T14:08:47.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.119:6832/3794904365,v1:172.21.15.119:6833/3794904365] up:boot 2023-12-14T14:08:47.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: fsmap 1 up:standby 2023-12-14T14:08:47.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-14T14:08:47.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:47.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:47.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:47.276 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:47.276 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:47.276 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:47.276 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:46 smithi119 ceph-mon[43834]: Deploying daemon mds.k on smithi081 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.119:6832/3794904365,v1:172.21.15.119:6833/3794904365] up:boot 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: fsmap 1 up:standby 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:47.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:46 smithi069 ceph-mon[42034]: Deploying daemon mds.k on smithi081 2023-12-14T14:08:47.374 INFO:journalctl@ceph.mds.k.smithi081.stdout:Dec 14 14:08:47 smithi081 systemd[1]: Starting Ceph mds.k for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:08:47.446 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:08:47.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 -- 172.21.15.69:0/3850202073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 msgr2=0x7f9530108390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:47.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 --2- 172.21.15.69:0/3850202073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 0x7f9530108390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f952800b0a0 tx=0x7f952800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 -- 172.21.15.69:0/3850202073 shutdown_connections 2023-12-14T14:08:47.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 --2- 172.21.15.69:0/3850202073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 0x7f9530108390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 --2- 172.21.15.69:0/3850202073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530100d70 0x7f9530103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 --2- 172.21.15.69:0/3850202073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9530103690 0x7f9530105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 -- 172.21.15.69:0/3850202073 >> 172.21.15.69:0/3850202073 conn(0x7f95300fa750 msgr2=0x7f95300fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:47.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 -- 172.21.15.69:0/3850202073 shutdown_connections 2023-12-14T14:08:47.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 -- 172.21.15.69:0/3850202073 wait complete. 2023-12-14T14:08:47.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.584+0000 7f9538499700 1 Processor -- start 2023-12-14T14:08:47.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9538499700 1 -- start start 2023-12-14T14:08:47.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9538499700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530100d70 0x7f95301960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:47.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9538499700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9530103690 0x7f9530196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:47.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9538499700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 0x7f953019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9538499700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953019dc40 con 0x7f9530105fb0 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9538499700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953019dd80 con 0x7f9530100d70 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9538499700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953019df10 con 0x7f9530103690 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536a36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 0x7f953019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536235700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530100d70 0x7f95301960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536a36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 0x7f953019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52222/0 (socket says 172.21.15.69:52222) 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536a36700 1 -- 172.21.15.69:0/4000179109 learned_addr learned my addr 172.21.15.69:0/4000179109 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9535a34700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9530103690 0x7f9530196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536a36700 1 -- 172.21.15.69:0/4000179109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9530103690 msgr2=0x7f9530196600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:47.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536a36700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9530103690 0x7f9530196600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536a36700 1 -- 172.21.15.69:0/4000179109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530100d70 msgr2=0x7f95301960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536a36700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530100d70 0x7f95301960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536a36700 1 -- 172.21.15.69:0/4000179109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528009d00 con 0x7f9530105fb0 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9535a34700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9530103690 0x7f9530196600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536235700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530100d70 0x7f95301960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f9536a36700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 0x7f953019d670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f95280062a0 tx=0x7f952800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.585+0000 7f95277fe700 1 -- 172.21.15.69:0/4000179109 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800e040 con 0x7f9530105fb0 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.586+0000 7f95277fe700 1 -- 172.21.15.69:0/4000179109 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9528004c60 con 0x7f9530105fb0 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.586+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953010bbe0 con 0x7f9530105fb0 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.586+0000 7f95277fe700 1 -- 172.21.15.69:0/4000179109 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528004750 con 0x7f9530105fb0 2023-12-14T14:08:47.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.586+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953010ba50 con 0x7f9530105fb0 2023-12-14T14:08:47.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.586+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95300fc2c0 con 0x7f9530105fb0 2023-12-14T14:08:47.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.588+0000 7f95277fe700 1 -- 172.21.15.69:0/4000179109 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9528003a00 con 0x7f9530105fb0 2023-12-14T14:08:47.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.588+0000 7f95277fe700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f951c0a1150 0x7f951c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:47.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.588+0000 7f9536235700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f951c0a1150 0x7f951c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:47.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.588+0000 7f95277fe700 1 -- 172.21.15.69:0/4000179109 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f95280ce330 con 0x7f9530105fb0 2023-12-14T14:08:47.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.589+0000 7f9536235700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f951c0a1150 0x7f951c0a3600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9530069a90 tx=0x7f9520009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:47.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.592+0000 7f95277fe700 1 -- 172.21.15.69:0/4000179109 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9528097fb0 con 0x7f9530105fb0 2023-12-14T14:08:47.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.831+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f953002cfe0 con 0x7f9530105fb0 2023-12-14T14:08:47.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.831+0000 7f95277fe700 1 -- 172.21.15.69:0/4000179109 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f95280048b0 con 0x7f9530105fb0 2023-12-14T14:08:47.832 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:47.832 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-14T14:08:47.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.833+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f951c0a1150 msgr2=0x7f951c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:47.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.833+0000 7f9538499700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f951c0a1150 0x7f951c0a3600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9530069a90 tx=0x7f9520009260 comp rx=0 tx=0).stop 2023-12-14T14:08:47.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.833+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 msgr2=0x7f953019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.833+0000 7f9538499700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 0x7f953019d670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f95280062a0 tx=0x7f952800cd70 comp rx=0 tx=0).stop 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.834+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 shutdown_connections 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.834+0000 7f9538499700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f951c0a1150 0x7f951c0a3600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.834+0000 7f9538499700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9530105fb0 0x7f953019d670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.834+0000 7f9538499700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530100d70 0x7f95301960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.834+0000 7f9538499700 1 --2- 172.21.15.69:0/4000179109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9530103690 0x7f9530196600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.834+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 >> 172.21.15.69:0/4000179109 conn(0x7f95300fa750 msgr2=0x7f95301019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.834+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 shutdown_connections 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:47.834+0000 7f9538499700 1 -- 172.21.15.69:0/4000179109 wait complete. 2023-12-14T14:08:47.835 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 2 2023-12-14T14:08:47.888 INFO:journalctl@ceph.mds.k.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-mds[67179]: -- 172.21.15.81:0/1342720991 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563ae24f3520 con 0x563ae24c9000 2023-12-14T14:08:47.888 INFO:journalctl@ceph.mds.k.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-k[67156]: starting mds.k at 2023-12-14T14:08:47.889 INFO:journalctl@ceph.mds.k.smithi081.stdout:Dec 14 14:08:47 smithi081 bash[67141]: e547434a62db85fbd949ebaa1a083a1ef64b83a1d4ac285df5081bbf506a08bb 2023-12-14T14:08:47.889 INFO:journalctl@ceph.mds.k.smithi081.stdout:Dec 14 14:08:47 smithi081 systemd[1]: Started Ceph mds.k for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:08:48.106 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:47 smithi069 ceph-mon[42034]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:48.106 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:47 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:48.106 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:47 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:48.106 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:47 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:48.106 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:47 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:48.106 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:47 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:48.106 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:47 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:48.106 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:47 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4000179109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:48.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-mon[43371]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:48.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:48.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:47 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4000179109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:48.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:47 smithi119 ceph-mon[43834]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:48.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:47 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:48.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:47 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:48.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:47 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:48.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:47 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:48.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:47 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:48.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:47 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:48.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:47 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4000179109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:49.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:48 smithi069 ceph-mon[42034]: Deploying daemon mds.j on smithi069 2023-12-14T14:08:49.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:48 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.81:6832/2145103323,v1:172.21.15.81:6833/2145103323] up:boot 2023-12-14T14:08:49.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:48 smithi069 ceph-mon[42034]: fsmap 2 up:standby 2023-12-14T14:08:49.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:48 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-14T14:08:49.087 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 14:08:48 smithi069 systemd[1]: Starting Ceph mds.j for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:08:49.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:48 smithi081 ceph-mon[43371]: Deploying daemon mds.j on smithi069 2023-12-14T14:08:49.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:48 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.81:6832/2145103323,v1:172.21.15.81:6833/2145103323] up:boot 2023-12-14T14:08:49.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:48 smithi081 ceph-mon[43371]: fsmap 2 up:standby 2023-12-14T14:08:49.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:48 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-14T14:08:49.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:48 smithi119 ceph-mon[43834]: Deploying daemon mds.j on smithi069 2023-12-14T14:08:49.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:48 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.81:6832/2145103323,v1:172.21.15.81:6833/2145103323] up:boot 2023-12-14T14:08:49.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:48 smithi119 ceph-mon[43834]: fsmap 2 up:standby 2023-12-14T14:08:49.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:48 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-14T14:08:49.586 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 14:08:49 smithi069 ceph-mds[75136]: -- 172.21.15.69:0/599566016 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ea39cc9520 con 0x55ea39c9e800 2023-12-14T14:08:49.586 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 14:08:49 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-j[75113]: starting mds.j at 2023-12-14T14:08:49.586 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 14:08:49 smithi069 bash[75098]: 4cce9fef205f1877b4aaa8282165ef0d5b46493203bcb30ad2c97a1ed64401ce 2023-12-14T14:08:49.586 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 14:08:49 smithi069 systemd[1]: Started Ceph mds.j for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:08:49.847 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:08:49.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.981+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/4193267051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100c90 msgr2=0x7fa8c8107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:49.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.981+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/4193267051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100c90 0x7fa8c8107550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000b0a0 tx=0x7fa8c000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:08:49.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.981+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/4193267051 shutdown_connections 2023-12-14T14:08:49.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.981+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/4193267051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100c90 0x7fa8c8107550 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:49.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.981+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/4193267051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c80ff110 0x7fa8c80ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:49.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.981+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/4193267051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c8100300 0x7fa8c8100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:49.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.981+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/4193267051 >> 172.21.15.69:0/4193267051 conn(0x7fa8c80fa6f0 msgr2=0x7fa8c80fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:49.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.981+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/4193267051 shutdown_connections 2023-12-14T14:08:49.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.981+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/4193267051 wait complete. 2023-12-14T14:08:49.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8cd5b2700 1 Processor -- start 2023-12-14T14:08:49.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8cd5b2700 1 -- start start 2023-12-14T14:08:49.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8cd5b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80ff110 0x7fa8c81950a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8cd5b2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100300 0x7fa8c81955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8cd5b2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c8100c90 0x7fa8c819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8cd5b2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c819cc20 con 0x7fa8c8100300 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8cd5b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c819cd60 con 0x7fa8c80ff110 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8cd5b2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c819cef0 con 0x7fa8c8100c90 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8be7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100300 0x7fa8c81955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8be7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100300 0x7fa8c81955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52240/0 (socket says 172.21.15.69:52240) 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8be7fc700 1 -- 172.21.15.69:0/3932975802 learned_addr learned my addr 172.21.15.69:0/3932975802 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8c6ffd700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80ff110 0x7fa8c81950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8c77fe700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c8100c90 0x7fa8c819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8be7fc700 1 -- 172.21.15.69:0/3932975802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c8100c90 msgr2=0x7fa8c819c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8be7fc700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c8100c90 0x7fa8c819c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:49.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8be7fc700 1 -- 172.21.15.69:0/3932975802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80ff110 msgr2=0x7fa8c81950a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8be7fc700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80ff110 0x7fa8c81950a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8be7fc700 1 -- 172.21.15.69:0/3932975802 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c0009d00 con 0x7fa8c8100300 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.982+0000 7fa8c77fe700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c8100c90 0x7fa8c819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.983+0000 7fa8be7fc700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100300 0x7fa8c81955e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000b530 tx=0x7fa8b000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.983+0000 7fa8c4ff9700 1 -- 172.21.15.69:0/3932975802 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0011830 con 0x7fa8c8100300 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.983+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c810ab90 con 0x7fa8c8100300 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.983+0000 7fa8c4ff9700 1 -- 172.21.15.69:0/3932975802 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8b0011e50 con 0x7fa8c8100300 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.983+0000 7fa8c4ff9700 1 -- 172.21.15.69:0/3932975802 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000f2e0 con 0x7fa8c8100300 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.983+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c810aa00 con 0x7fa8c8100300 2023-12-14T14:08:49.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.984+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c8106600 con 0x7fa8c8100300 2023-12-14T14:08:49.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.985+0000 7fa8c4ff9700 1 -- 172.21.15.69:0/3932975802 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa8b0010380 con 0x7fa8c8100300 2023-12-14T14:08:49.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.985+0000 7fa8c4ff9700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa8b40a11d0 0x7fa8b40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:49.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.986+0000 7fa8c4ff9700 1 -- 172.21.15.69:0/3932975802 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa8b00cc070 con 0x7fa8c8100300 2023-12-14T14:08:49.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.986+0000 7fa8c6ffd700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa8b40a11d0 0x7fa8b40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:49.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.986+0000 7fa8c6ffd700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa8b40a11d0 0x7fa8b40a3680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8100160 tx=0x7fa8b8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:49.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:49.990+0000 7fa8c4ff9700 1 -- 172.21.15.69:0/3932975802 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa8b0095bc0 con 0x7fa8c8100300 2023-12-14T14:08:50.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:49 smithi069 ceph-mon[42034]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:50.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:50.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:50.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:50.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:50.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:50.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:49 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:50.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:49 smithi081 ceph-mon[43371]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:49 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:50.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.235+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8c802cfe0 con 0x7fa8c8100300 2023-12-14T14:08:50.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.235+0000 7fa8c4ff9700 1 -- 172.21.15.69:0/3932975802 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2017 (secure 0 0 0) 0x7fa8b00991e0 con 0x7fa8c8100300 2023-12-14T14:08:50.235 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:50.235 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-14T14:08:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa8b40a11d0 msgr2=0x7fa8b40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa8b40a11d0 0x7fa8b40a3680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8100160 tx=0x7fa8b8009190 comp rx=0 tx=0).stop 2023-12-14T14:08:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100300 msgr2=0x7fa8c81955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100300 0x7fa8c81955e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000b530 tx=0x7fa8b000b840 comp rx=0 tx=0).stop 2023-12-14T14:08:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 shutdown_connections 2023-12-14T14:08:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa8b40a11d0 0x7fa8b40a3680 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c8100c90 0x7fa8c819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80ff110 0x7fa8c81950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 --2- 172.21.15.69:0/3932975802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8100300 0x7fa8c81955e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 >> 172.21.15.69:0/3932975802 conn(0x7fa8c80fa6f0 msgr2=0x7fa8c8103740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 shutdown_connections 2023-12-14T14:08:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:50.239+0000 7fa8cd5b2700 1 -- 172.21.15.69:0/3932975802 wait complete. 2023-12-14T14:08:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 3 2023-12-14T14:08:50.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:49 smithi119 ceph-mon[43834]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:50.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:50.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:50.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:50.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:49 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:50.822 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 14:08:50 smithi069 systemd[1]: Starting Ceph mds.d for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:08:51.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:50 smithi081 ceph-mon[43371]: Deploying daemon mds.d on smithi069 2023-12-14T14:08:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:50 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3932975802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:50 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.69:6834/4120690062,v1:172.21.15.69:6835/4120690062] up:boot 2023-12-14T14:08:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:50 smithi081 ceph-mon[43371]: fsmap 3 up:standby 2023-12-14T14:08:51.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:50 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-14T14:08:51.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:50 smithi119 ceph-mon[43834]: Deploying daemon mds.d on smithi069 2023-12-14T14:08:51.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:50 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3932975802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:51.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:50 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.69:6834/4120690062,v1:172.21.15.69:6835/4120690062] up:boot 2023-12-14T14:08:51.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:50 smithi119 ceph-mon[43834]: fsmap 3 up:standby 2023-12-14T14:08:51.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:50 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-14T14:08:51.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:50 smithi069 ceph-mon[42034]: Deploying daemon mds.d on smithi069 2023-12-14T14:08:51.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:50 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3932975802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:51.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:50 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.69:6834/4120690062,v1:172.21.15.69:6835/4120690062] up:boot 2023-12-14T14:08:51.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:50 smithi069 ceph-mon[42034]: fsmap 3 up:standby 2023-12-14T14:08:51.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:50 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-14T14:08:51.336 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 14:08:50 smithi069 bash[75481]: 87835d7523dbb4855025d172af4bdf7b2c3dcb8592101cee338fc744dd89813e 2023-12-14T14:08:51.336 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 14:08:50 smithi069 systemd[1]: Started Ceph mds.d for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:08:51.336 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 14:08:50 smithi069 ceph-mds[75519]: -- 172.21.15.69:0/4158811112 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558395a67520 con 0x558395a3cc00 2023-12-14T14:08:51.336 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 14:08:50 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-d[75496]: starting mds.d at 2023-12-14T14:08:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:52.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:52.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.69:6836/4121849780,v1:172.21.15.69:6837/4121849780] up:boot 2023-12-14T14:08:52.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: fsmap 4 up:standby 2023-12-14T14:08:52.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-14T14:08:52.252 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:08:52.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:52.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:52.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:52.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:52.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:52.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:52.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:52.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.69:6836/4121849780,v1:172.21.15.69:6837/4121849780] up:boot 2023-12-14T14:08:52.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: fsmap 4 up:standby 2023-12-14T14:08:52.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:52 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-14T14:08:52.285 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:52.285 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:52.285 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:52.285 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:52.285 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:52.286 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:52.286 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:52.286 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.69:6836/4121849780,v1:172.21.15.69:6837/4121849780] up:boot 2023-12-14T14:08:52.286 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: fsmap 4 up:standby 2023-12-14T14:08:52.286 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:52 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-14T14:08:52.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.389+0000 7faf64995700 1 -- 172.21.15.69:0/3542291277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 msgr2=0x7faf60107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.389+0000 7faf64995700 1 --2- 172.21.15.69:0/3542291277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 0x7faf60107550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf5800b0a0 tx=0x7faf5800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.389+0000 7faf64995700 1 -- 172.21.15.69:0/3542291277 shutdown_connections 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.389+0000 7faf64995700 1 --2- 172.21.15.69:0/3542291277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 0x7faf60107550 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.389+0000 7faf64995700 1 --2- 172.21.15.69:0/3542291277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf600ff110 0x7faf600ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.389+0000 7faf64995700 1 --2- 172.21.15.69:0/3542291277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf60100300 0x7faf60100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.389+0000 7faf64995700 1 -- 172.21.15.69:0/3542291277 >> 172.21.15.69:0/3542291277 conn(0x7faf600fa6f0 msgr2=0x7faf600fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.389+0000 7faf64995700 1 -- 172.21.15.69:0/3542291277 shutdown_connections 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.389+0000 7faf64995700 1 -- 172.21.15.69:0/3542291277 wait complete. 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.390+0000 7faf64995700 1 Processor -- start 2023-12-14T14:08:52.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.390+0000 7faf64995700 1 -- start start 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.390+0000 7faf64995700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf600ff110 0x7faf60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.390+0000 7faf64995700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf60100300 0x7faf6019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.390+0000 7faf64995700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 0x7faf6019d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.390+0000 7faf64995700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6019db80 con 0x7faf60100c90 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.390+0000 7faf64995700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6019dcf0 con 0x7faf60100300 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.390+0000 7faf64995700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6019deb0 con 0x7faf600ff110 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 0x7faf6019d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 0x7faf6019d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52272/0 (socket says 172.21.15.69:52272) 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5ed9d700 1 -- 172.21.15.69:0/3385627248 learned_addr learned my addr 172.21.15.69:0/3385627248 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5dd9b700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf60100300 0x7faf6019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5e59c700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf600ff110 0x7faf60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:52.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5ed9d700 1 -- 172.21.15.69:0/3385627248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf600ff110 msgr2=0x7faf60068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5ed9d700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf600ff110 0x7faf60068960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5ed9d700 1 -- 172.21.15.69:0/3385627248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf60100300 msgr2=0x7faf6019ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5ed9d700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf60100300 0x7faf6019ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5ed9d700 1 -- 172.21.15.69:0/3385627248 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58009d00 con 0x7faf60100c90 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf5ed9d700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 0x7faf6019d3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf58009fd0 tx=0x7faf58004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf4f7fe700 1 -- 172.21.15.69:0/3385627248 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800e040 con 0x7faf60100c90 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf4f7fe700 1 -- 172.21.15.69:0/3385627248 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf5801d690 con 0x7faf60100c90 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6010aad0 con 0x7faf60100c90 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf4f7fe700 1 -- 172.21.15.69:0/3385627248 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58004260 con 0x7faf60100c90 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.391+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6010a940 con 0x7faf60100c90 2023-12-14T14:08:52.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.392+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf60105f50 con 0x7faf60100c90 2023-12-14T14:08:52.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.393+0000 7faf4f7fe700 1 -- 172.21.15.69:0/3385627248 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7faf5801d800 con 0x7faf60100c90 2023-12-14T14:08:52.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.394+0000 7faf4f7fe700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7faf480a1150 0x7faf480a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:52.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.394+0000 7faf5e59c700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7faf480a1150 0x7faf480a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:52.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.394+0000 7faf4f7fe700 1 -- 172.21.15.69:0/3385627248 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7faf580ce420 con 0x7faf60100c90 2023-12-14T14:08:52.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.394+0000 7faf5e59c700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7faf480a1150 0x7faf480a3600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faf60100160 tx=0x7faf5400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:52.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.398+0000 7faf4f7fe700 1 -- 172.21.15.69:0/3385627248 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7faf58098000 con 0x7faf60100c90 2023-12-14T14:08:52.519 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:08:52 smithi081 systemd[1]: Starting Ceph mds.e for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:08:52.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.629+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf6002cfe0 con 0x7faf60100c90 2023-12-14T14:08:52.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.630+0000 7faf4f7fe700 1 -- 172.21.15.69:0/3385627248 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3531 (secure 0 0 0) 0x7faf58021de0 con 0x7faf60100c90 2023-12-14T14:08:52.630 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:52.630 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-14T14:08:52.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7faf480a1150 msgr2=0x7faf480a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:52.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7faf480a1150 0x7faf480a3600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faf60100160 tx=0x7faf5400a380 comp rx=0 tx=0).stop 2023-12-14T14:08:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 msgr2=0x7faf6019d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 0x7faf6019d3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf58009fd0 tx=0x7faf58004c80 comp rx=0 tx=0).stop 2023-12-14T14:08:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 shutdown_connections 2023-12-14T14:08:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7faf480a1150 0x7faf480a3600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf60100c90 0x7faf6019d3b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf600ff110 0x7faf60068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 --2- 172.21.15.69:0/3385627248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf60100300 0x7faf6019ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 >> 172.21.15.69:0/3385627248 conn(0x7faf600fa6f0 msgr2=0x7faf600fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 shutdown_connections 2023-12-14T14:08:52.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:52.632+0000 7faf64995700 1 -- 172.21.15.69:0/3385627248 wait complete. 2023-12-14T14:08:52.634 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2023-12-14T14:08:53.030 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-mds[67519]: -- 172.21.15.81:0/1930870067 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b62bd7520 con 0x564b62bac800 2023-12-14T14:08:53.031 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:08:52 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-e[67496]: starting mds.e at 2023-12-14T14:08:53.031 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:08:52 smithi081 bash[67481]: 775ed326258ffa0e2b9c4a7ec5237c540e429db4e7bade7e8aa91306f8eef89a 2023-12-14T14:08:53.031 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:08:52 smithi081 systemd[1]: Started Ceph mds.e for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:08:53.294 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:53 smithi119 ceph-mon[43834]: Deploying daemon mds.e on smithi081 2023-12-14T14:08:53.294 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:53 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3385627248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:53.294 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:53.294 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:53.294 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:53.295 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:53.295 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:53.295 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:53 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:53.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:53 smithi069 ceph-mon[42034]: Deploying daemon mds.e on smithi081 2023-12-14T14:08:53.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:53 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3385627248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:53.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:53.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:53.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:53.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:53.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:53.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:53 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:53.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:53 smithi081 ceph-mon[43371]: Deploying daemon mds.e on smithi081 2023-12-14T14:08:53.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:53 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3385627248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:53.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:53.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:53.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:53.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:53.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:53.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:53 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:53.993 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:08:53 smithi119 systemd[1]: Starting Ceph mds.f for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:08:54.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:54 smithi119 ceph-mon[43834]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:54.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:54 smithi119 ceph-mon[43834]: Deploying daemon mds.f on smithi119 2023-12-14T14:08:54.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:54 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.81:6834/3775706969,v1:172.21.15.81:6835/3775706969] up:boot 2023-12-14T14:08:54.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:54 smithi119 ceph-mon[43834]: fsmap 5 up:standby 2023-12-14T14:08:54.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:54 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T14:08:54.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:54 smithi069 ceph-mon[42034]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:54.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:54 smithi069 ceph-mon[42034]: Deploying daemon mds.f on smithi119 2023-12-14T14:08:54.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:54 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.81:6834/3775706969,v1:172.21.15.81:6835/3775706969] up:boot 2023-12-14T14:08:54.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:54 smithi069 ceph-mon[42034]: fsmap 5 up:standby 2023-12-14T14:08:54.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:54 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T14:08:54.397 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:54 smithi081 ceph-mon[43371]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:54.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:54 smithi081 ceph-mon[43371]: Deploying daemon mds.f on smithi119 2023-12-14T14:08:54.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:54 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.81:6834/3775706969,v1:172.21.15.81:6835/3775706969] up:boot 2023-12-14T14:08:54.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:54 smithi081 ceph-mon[43371]: fsmap 5 up:standby 2023-12-14T14:08:54.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:54 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T14:08:54.645 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:08:54.774 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:08:54 smithi119 ceph-mds[69147]: -- 172.21.15.119:0/1098840726 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55de05143520 con 0x55de05119000 2023-12-14T14:08:54.774 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:08:54 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-f[69124]: starting mds.f at 2023-12-14T14:08:54.775 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:08:54 smithi119 bash[69109]: c25d661a17ee1c21100115c2aedd403020a7370f225ff89303e086ed22187686 2023-12-14T14:08:54.775 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:08:54 smithi119 systemd[1]: Started Ceph mds.f for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:08:54.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.780+0000 7fb434c5a700 1 -- 172.21.15.69:0/240413632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101570 msgr2=0x7fb4301019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:54.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.780+0000 7fb434c5a700 1 --2- 172.21.15.69:0/240413632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101570 0x7fb4301019c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb420009990 tx=0x7fb420009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:54.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.780+0000 7fb434c5a700 1 -- 172.21.15.69:0/240413632 shutdown_connections 2023-12-14T14:08:54.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.780+0000 7fb434c5a700 1 --2- 172.21.15.69:0/240413632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb430101f00 0x7fb4301087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:54.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.780+0000 7fb434c5a700 1 --2- 172.21.15.69:0/240413632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4300fe5a0 0x7fb4300fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:54.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.780+0000 7fb434c5a700 1 --2- 172.21.15.69:0/240413632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101570 0x7fb4301019c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:54.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.780+0000 7fb434c5a700 1 -- 172.21.15.69:0/240413632 >> 172.21.15.69:0/240413632 conn(0x7fb4300f9f80 msgr2=0x7fb4300fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:54.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.780+0000 7fb434c5a700 1 -- 172.21.15.69:0/240413632 shutdown_connections 2023-12-14T14:08:54.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.780+0000 7fb434c5a700 1 -- 172.21.15.69:0/240413632 wait complete. 2023-12-14T14:08:54.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb434c5a700 1 Processor -- start 2023-12-14T14:08:54.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb434c5a700 1 -- start start 2023-12-14T14:08:54.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb434c5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4300fe5a0 0x7fb430100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:54.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb434c5a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430101570 0x7fb4300ff520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:54.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb434c5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101f00 0x7fb4300ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:54.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb434c5a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430100200 con 0x7fb430101f00 2023-12-14T14:08:54.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb434c5a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430100370 con 0x7fb4300fe5a0 2023-12-14T14:08:54.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb434c5a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301a0010 con 0x7fb430101570 2023-12-14T14:08:54.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101f00 0x7fb4300ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:54.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42dd9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430101570 0x7fb4300ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:54.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4300fe5a0 0x7fb430100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101f00 0x7fb4300ffa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52288/0 (socket says 172.21.15.69:52288) 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42ed9d700 1 -- 172.21.15.69:0/3482308486 learned_addr learned my addr 172.21.15.69:0/3482308486 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42ed9d700 1 -- 172.21.15.69:0/3482308486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430101570 msgr2=0x7fb4300ff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42ed9d700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430101570 0x7fb4300ff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42ed9d700 1 -- 172.21.15.69:0/3482308486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4300fe5a0 msgr2=0x7fb430100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42ed9d700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4300fe5a0 0x7fb430100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42ed9d700 1 -- 172.21.15.69:0/3482308486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4200095f0 con 0x7fb430101f00 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.781+0000 7fb42ed9d700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101f00 0x7fb4300ffa60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb42800ef30 tx=0x7fb42800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.782+0000 7fb41f7fe700 1 -- 172.21.15.69:0/3482308486 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428018070 con 0x7fb430101f00 2023-12-14T14:08:54.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.782+0000 7fb41f7fe700 1 -- 172.21.15.69:0/3482308486 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb42800f040 con 0x7fb430101f00 2023-12-14T14:08:54.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.782+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43010bbd0 con 0x7fb430101f00 2023-12-14T14:08:54.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.782+0000 7fb41f7fe700 1 -- 172.21.15.69:0/3482308486 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800cd00 con 0x7fb430101f00 2023-12-14T14:08:54.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.782+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43010ba40 con 0x7fb430101f00 2023-12-14T14:08:54.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.783+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb430107300 con 0x7fb430101f00 2023-12-14T14:08:54.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.784+0000 7fb41f7fe700 1 -- 172.21.15.69:0/3482308486 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb428003a00 con 0x7fb430101f00 2023-12-14T14:08:54.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.785+0000 7fb41f7fe700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb4180a1150 0x7fb4180a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:54.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.785+0000 7fb41f7fe700 1 -- 172.21.15.69:0/3482308486 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb4280cc970 con 0x7fb430101f00 2023-12-14T14:08:54.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.785+0000 7fb42e59c700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb4180a1150 0x7fb4180a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:54.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.785+0000 7fb42e59c700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb4180a1150 0x7fb4180a3600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb430068e50 tx=0x7fb424009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:54.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:54.789+0000 7fb41f7fe700 1 -- 172.21.15.69:0/3482308486 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb4280965f0 con 0x7fb430101f00 2023-12-14T14:08:55.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.020+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb430061730 con 0x7fb430101f00 2023-12-14T14:08:55.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.020+0000 7fb41f7fe700 1 -- 172.21.15.69:0/3482308486 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4288 (secure 0 0 0) 0x7fb428099c10 con 0x7fb430101f00 2023-12-14T14:08:55.021 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:55.021 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-12-14T14:08:55.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb4180a1150 msgr2=0x7fb4180a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:55.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb4180a1150 0x7fb4180a3600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb430068e50 tx=0x7fb424009260 comp rx=0 tx=0).stop 2023-12-14T14:08:55.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101f00 msgr2=0x7fb4300ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:55.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101f00 0x7fb4300ffa60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb42800ef30 tx=0x7fb42800c3a0 comp rx=0 tx=0).stop 2023-12-14T14:08:55.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 shutdown_connections 2023-12-14T14:08:55.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb4180a1150 0x7fb4180a3600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:55.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb430101f00 0x7fb4300ffa60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:55.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4300fe5a0 0x7fb430100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:55.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 --2- 172.21.15.69:0/3482308486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430101570 0x7fb4300ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:55.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 >> 172.21.15.69:0/3482308486 conn(0x7fb4300f9f80 msgr2=0x7fb4300fc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:55.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 shutdown_connections 2023-12-14T14:08:55.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:55.022+0000 7fb434c5a700 1 -- 172.21.15.69:0/3482308486 wait complete. 2023-12-14T14:08:55.024 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 6 2023-12-14T14:08:55.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:55.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:55.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:55.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:55.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:55.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:55.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: Deploying daemon mds.c on smithi119 2023-12-14T14:08:55.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:55.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3482308486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:55.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.119:6834/594041854,v1:172.21.15.119:6835/594041854] up:boot 2023-12-14T14:08:55.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: fsmap 6 up:standby 2023-12-14T14:08:55.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:55 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T14:08:55.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: Deploying daemon mds.c on smithi119 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3482308486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.119:6834/594041854,v1:172.21.15.119:6835/594041854] up:boot 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: fsmap 6 up:standby 2023-12-14T14:08:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:55 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: Deploying daemon mds.c on smithi119 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3482308486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.119:6834/594041854,v1:172.21.15.119:6835/594041854] up:boot 2023-12-14T14:08:55.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: fsmap 6 up:standby 2023-12-14T14:08:55.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:55 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T14:08:55.971 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:08:55 smithi119 systemd[1]: Starting Ceph mds.c for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:08:56.525 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:08:56 smithi119 ceph-mds[69491]: -- 172.21.15.119:0/1087425770 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5654d9441520 con 0x5654d9417000 2023-12-14T14:08:56.525 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:08:56 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-c[69468]: starting mds.c at 2023-12-14T14:08:56.525 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:08:56 smithi119 bash[69453]: 53c7cc032f75332de6b342d28aa0082847d974309006979af8d56474c56ff314 2023-12-14T14:08:56.525 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:08:56 smithi119 systemd[1]: Started Ceph mds.c for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:08:57.036 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:08:57.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.171+0000 7fd324328700 1 -- 172.21.15.69:0/3324411242 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c1035b0 msgr2=0x7fd31c105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:57.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.171+0000 7fd324328700 1 --2- 172.21.15.69:0/3324411242 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c1035b0 0x7fd31c105990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009990 tx=0x7fd30c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.171+0000 7fd324328700 1 -- 172.21.15.69:0/3324411242 shutdown_connections 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.171+0000 7fd324328700 1 --2- 172.21.15.69:0/3324411242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd31c105ed0 0x7fd31c108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.171+0000 7fd324328700 1 --2- 172.21.15.69:0/3324411242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd31c100c90 0x7fd31c103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.171+0000 7fd324328700 1 --2- 172.21.15.69:0/3324411242 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c1035b0 0x7fd31c105990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.171+0000 7fd324328700 1 -- 172.21.15.69:0/3324411242 >> 172.21.15.69:0/3324411242 conn(0x7fd31c0fa6f0 msgr2=0x7fd31c0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.171+0000 7fd324328700 1 -- 172.21.15.69:0/3324411242 shutdown_connections 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.171+0000 7fd324328700 1 -- 172.21.15.69:0/3324411242 wait complete. 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd324328700 1 Processor -- start 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd324328700 1 -- start start 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd324328700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c100c90 0x7fd31c100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:57.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd324328700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd31c1035b0 0x7fd31c0fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd324328700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd31c105ed0 0x7fd31c0ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd324328700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0ff920 con 0x7fd31c100c90 2023-12-14T14:08:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd324328700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0ffa90 con 0x7fd31c105ed0 2023-12-14T14:08:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd324328700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c19ff80 con 0x7fd31c1035b0 2023-12-14T14:08:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3220c4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c100c90 0x7fd31c100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3220c4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c100c90 0x7fd31c100600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49540/0 (socket says 172.21.15.69:49540) 2023-12-14T14:08:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3220c4700 1 -- 172.21.15.69:0/89606058 learned_addr learned my addr 172.21.15.69:0/89606058 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3228c5700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd31c105ed0 0x7fd31c0ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3218c3700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd31c1035b0 0x7fd31c0fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3220c4700 1 -- 172.21.15.69:0/89606058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd31c1035b0 msgr2=0x7fd31c0fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3220c4700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd31c1035b0 0x7fd31c0fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3220c4700 1 -- 172.21.15.69:0/89606058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd31c105ed0 msgr2=0x7fd31c0ff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3220c4700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd31c105ed0 0x7fd31c0ff180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3220c4700 1 -- 172.21.15.69:0/89606058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0095f0 con 0x7fd31c100c90 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.172+0000 7fd3228c5700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd31c105ed0 0x7fd31c0ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.173+0000 7fd3220c4700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c100c90 0x7fd31c100600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d980 tx=0x7fd31800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.173+0000 7fd3137fe700 1 -- 172.21.15.69:0/89606058 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318004220 con 0x7fd31c100c90 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.173+0000 7fd3137fe700 1 -- 172.21.15.69:0/89606058 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd318007640 con 0x7fd31c100c90 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.173+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c10bb90 con 0x7fd31c100c90 2023-12-14T14:08:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.173+0000 7fd3137fe700 1 -- 172.21.15.69:0/89606058 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318005690 con 0x7fd31c100c90 2023-12-14T14:08:57.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.173+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c10ba00 con 0x7fd31c100c90 2023-12-14T14:08:57.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.174+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c0fc260 con 0x7fd31c100c90 2023-12-14T14:08:57.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.175+0000 7fd3137fe700 1 -- 172.21.15.69:0/89606058 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fd318004750 con 0x7fd31c100c90 2023-12-14T14:08:57.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.175+0000 7fd3137fe700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3080a1150 0x7fd3080a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:57.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.175+0000 7fd3218c3700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3080a1150 0x7fd3080a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:57.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.175+0000 7fd3137fe700 1 -- 172.21.15.69:0/89606058 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd3180cc290 con 0x7fd31c100c90 2023-12-14T14:08:57.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.176+0000 7fd3218c3700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3080a1150 0x7fd3080a3600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00b2e0 tx=0x7fd30c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:57.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.180+0000 7fd3137fe700 1 -- 172.21.15.69:0/89606058 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd318095e80 con 0x7fd31c100c90 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: Deploying daemon mds.h on smithi081 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.119:6836/2082956632,v1:172.21.15.119:6837/2082956632] up:boot 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: fsmap 7 up:standby 2023-12-14T14:08:57.312 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T14:08:57.313 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mon[43371]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:57.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:57.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: Deploying daemon mds.h on smithi081 2023-12-14T14:08:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.119:6836/2082956632,v1:172.21.15.119:6837/2082956632] up:boot 2023-12-14T14:08:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: fsmap 7 up:standby 2023-12-14T14:08:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T14:08:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:57 smithi069 ceph-mon[42034]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:57.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.412+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd31c02cfe0 con 0x7fd31c100c90 2023-12-14T14:08:57.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.413+0000 7fd3137fe700 1 -- 172.21.15.69:0/89606058 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5805 (secure 0 0 0) 0x7fd3180b9030 con 0x7fd31c100c90 2023-12-14T14:08:57.413 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:57.413 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-12-14T14:08:57.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3080a1150 msgr2=0x7fd3080a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:57.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3080a1150 0x7fd3080a3600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00b2e0 tx=0x7fd30c005fb0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c100c90 msgr2=0x7fd31c100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:57.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c100c90 0x7fd31c100600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d980 tx=0x7fd31800dc90 comp rx=0 tx=0).stop 2023-12-14T14:08:57.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 shutdown_connections 2023-12-14T14:08:57.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3080a1150 0x7fd3080a3600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd31c105ed0 0x7fd31c0ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd31c100c90 0x7fd31c100600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 --2- 172.21.15.69:0/89606058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd31c1035b0 0x7fd31c0fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:57.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 >> 172.21.15.69:0/89606058 conn(0x7fd31c0fa6f0 msgr2=0x7fd31c1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:57.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 shutdown_connections 2023-12-14T14:08:57.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:57.415+0000 7fd324328700 1 -- 172.21.15.69:0/89606058 wait complete. 2023-12-14T14:08:57.416 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-12-14T14:08:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: Deploying daemon mds.h on smithi081 2023-12-14T14:08:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.119:6836/2082956632,v1:172.21.15.119:6837/2082956632] up:boot 2023-12-14T14:08:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: fsmap 7 up:standby 2023-12-14T14:08:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T14:08:57.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:57 smithi119 ceph-mon[43834]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:57.648 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:08:57 smithi081 systemd[1]: Starting Ceph mds.h for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:08:58.148 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-mds[67860]: -- 172.21.15.81:0/2800253158 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562312b15520 con 0x562312aea800 2023-12-14T14:08:58.148 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:08:57 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-h[67837]: starting mds.h at 2023-12-14T14:08:58.148 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:08:57 smithi081 bash[67822]: f2d395c8c02ee802a23b3acf0cf0bb8d129abea8f480acbdc6b6ee2b760daf2a 2023-12-14T14:08:58.148 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:08:57 smithi081 systemd[1]: Started Ceph mds.h for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:08:58.433 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:58 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/89606058' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:58.433 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:58.434 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:58.434 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:58.434 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:58.434 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:58.434 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:58 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:58.434 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:58 smithi119 ceph-mon[43834]: Deploying daemon mds.i on smithi119 2023-12-14T14:08:58.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:58 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/89606058' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:58.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:58.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:58.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:58.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:58.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:58.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:58 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:58.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:58 smithi069 ceph-mon[42034]: Deploying daemon mds.i on smithi119 2023-12-14T14:08:58.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:58 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/89606058' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:08:58.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:58.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:58.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:08:58.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:08:58.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:08:58.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:58 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:08:58.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:58 smithi081 ceph-mon[43371]: Deploying daemon mds.i on smithi119 2023-12-14T14:08:59.145 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:08:59 smithi119 systemd[1]: Starting Ceph mds.i for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:08:59.428 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:08:59.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.565+0000 7f1acafee700 1 -- 172.21.15.69:0/1896984723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100350 msgr2=0x7f1ac41007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:59.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.565+0000 7f1acafee700 1 --2- 172.21.15.69:0/1896984723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100350 0x7f1ac41007a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009990 tx=0x7f1ab0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.565+0000 7f1acafee700 1 -- 172.21.15.69:0/1896984723 shutdown_connections 2023-12-14T14:08:59.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.565+0000 7f1acafee700 1 --2- 172.21.15.69:0/1896984723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac4100ce0 0x7f1ac41075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.565+0000 7f1acafee700 1 --2- 172.21.15.69:0/1896984723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ac40ff160 0x7f1ac40ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.565+0000 7f1acafee700 1 --2- 172.21.15.69:0/1896984723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100350 0x7f1ac41007a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.565+0000 7f1acafee700 1 -- 172.21.15.69:0/1896984723 >> 172.21.15.69:0/1896984723 conn(0x7f1ac40fa780 msgr2=0x7f1ac40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:59.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.565+0000 7f1acafee700 1 -- 172.21.15.69:0/1896984723 shutdown_connections 2023-12-14T14:08:59.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.565+0000 7f1acafee700 1 -- 172.21.15.69:0/1896984723 wait complete. 2023-12-14T14:08:59.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1acafee700 1 Processor -- start 2023-12-14T14:08:59.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1acafee700 1 -- start start 2023-12-14T14:08:59.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1acafee700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac40ff160 0x7f1ac4195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:59.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1acafee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ac4100350 0x7f1ac41964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:59.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1acafee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100ce0 0x7f1ac419d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1acafee700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac419db10 con 0x7f1ac4100ce0 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1acafee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac419dc50 con 0x7f1ac4100350 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1acafee700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac419dde0 con 0x7f1ac40ff160 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1ac958b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100ce0 0x7f1ac419d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1ac958b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100ce0 0x7f1ac419d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49546/0 (socket says 172.21.15.69:49546) 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1ac958b700 1 -- 172.21.15.69:0/1142962962 learned_addr learned my addr 172.21.15.69:0/1142962962 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1ac3fff700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ac4100350 0x7f1ac41964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.566+0000 7f1ac8d8a700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac40ff160 0x7f1ac4195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1ac958b700 1 -- 172.21.15.69:0/1142962962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac40ff160 msgr2=0x7f1ac4195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1ac958b700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac40ff160 0x7f1ac4195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1ac958b700 1 -- 172.21.15.69:0/1142962962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ac4100350 msgr2=0x7f1ac41964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1ac958b700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ac4100350 0x7f1ac41964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1ac958b700 1 -- 172.21.15.69:0/1142962962 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00095f0 con 0x7f1ac4100ce0 2023-12-14T14:08:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1ac958b700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100ce0 0x7f1ac419d540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1abc007970 tx=0x7f1abc007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1ac1ffb700 1 -- 172.21.15.69:0/1142962962 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc017070 con 0x7f1ac4100ce0 2023-12-14T14:08:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1ac1ffb700 1 -- 172.21.15.69:0/1142962962 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1abc00f040 con 0x7f1ac4100ce0 2023-12-14T14:08:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac410aac0 con 0x7f1ac4100ce0 2023-12-14T14:08:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1ac1ffb700 1 -- 172.21.15.69:0/1142962962 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc013a20 con 0x7f1ac4100ce0 2023-12-14T14:08:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.567+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac410a930 con 0x7f1ac4100ce0 2023-12-14T14:08:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.568+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac4107240 con 0x7f1ac4100ce0 2023-12-14T14:08:59.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.569+0000 7f1ac1ffb700 1 -- 172.21.15.69:0/1142962962 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1abc00dd30 con 0x7f1ac4100ce0 2023-12-14T14:08:59.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.569+0000 7f1ac1ffb700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ab40a1150 0x7f1ab40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:08:59.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.570+0000 7f1ac1ffb700 1 -- 172.21.15.69:0/1142962962 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1abc0cbb30 con 0x7f1ac4100ce0 2023-12-14T14:08:59.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.570+0000 7f1ac8d8a700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ab40a1150 0x7f1ab40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:08:59.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.570+0000 7f1ac8d8a700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ab40a1150 0x7f1ab40a3600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1ac41001b0 tx=0x7f1ab800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:08:59.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.574+0000 7f1ac1ffb700 1 -- 172.21.15.69:0/1142962962 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1abc095720 con 0x7f1ac4100ce0 2023-12-14T14:08:59.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:59 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] up:boot 2023-12-14T14:08:59.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:59 smithi119 ceph-mon[43834]: fsmap 8 up:standby 2023-12-14T14:08:59.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:59 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T14:08:59.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:08:59 smithi119 ceph-mon[43834]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:59.774 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:08:59 smithi119 ceph-mds[69842]: -- 172.21.15.119:0/1681513769 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d5983b5520 con 0x55d59838a800 2023-12-14T14:08:59.774 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:08:59 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-i[69819]: starting mds.i at 2023-12-14T14:08:59.775 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:08:59 smithi119 bash[69804]: 5e1a9737636892352c7c009d9c0fa609ef3191533e39febb00d268d858cfe033 2023-12-14T14:08:59.775 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:08:59 smithi119 systemd[1]: Started Ceph mds.i for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:08:59.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.825+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ac4061930 con 0x7f1ac4100ce0 2023-12-14T14:08:59.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.825+0000 7f1ac1ffb700 1 -- 172.21.15.69:0/1142962962 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6562 (secure 0 0 0) 0x7f1abc098d40 con 0x7f1ac4100ce0 2023-12-14T14:08:59.825 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:08:59.825 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.827+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ab40a1150 msgr2=0x7f1ab40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.827+0000 7f1acafee700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ab40a1150 0x7f1ab40a3600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1ac41001b0 tx=0x7f1ab800b410 comp rx=0 tx=0).stop 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.827+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100ce0 msgr2=0x7f1ac419d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.827+0000 7f1acafee700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100ce0 0x7f1ac419d540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1abc007970 tx=0x7f1abc007c80 comp rx=0 tx=0).stop 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.828+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 shutdown_connections 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.828+0000 7f1acafee700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ab40a1150 0x7f1ab40a3600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.828+0000 7f1acafee700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac4100ce0 0x7f1ac419d540 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.828+0000 7f1acafee700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac40ff160 0x7f1ac4195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.828+0000 7f1acafee700 1 --2- 172.21.15.69:0/1142962962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ac4100350 0x7f1ac41964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.828+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 >> 172.21.15.69:0/1142962962 conn(0x7f1ac40fa780 msgr2=0x7f1ac40fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.828+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 shutdown_connections 2023-12-14T14:08:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:08:59.828+0000 7f1acafee700 1 -- 172.21.15.69:0/1142962962 wait complete. 2023-12-14T14:08:59.829 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 9 2023-12-14T14:08:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:59 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] up:boot 2023-12-14T14:08:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:59 smithi069 ceph-mon[42034]: fsmap 8 up:standby 2023-12-14T14:08:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:59 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T14:08:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:08:59 smithi069 ceph-mon[42034]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:08:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:59 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] up:boot 2023-12-14T14:08:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:59 smithi081 ceph-mon[43371]: fsmap 8 up:standby 2023-12-14T14:08:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:59 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T14:08:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:08:59 smithi081 ceph-mon[43371]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: Deploying daemon mds.g on smithi069 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1142962962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] up:boot 2023-12-14T14:09:00.793 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: fsmap 9 up:standby 2023-12-14T14:09:00.794 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:00 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T14:09:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:09:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:09:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:00.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: Deploying daemon mds.g on smithi069 2023-12-14T14:09:00.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1142962962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:00.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] up:boot 2023-12-14T14:09:00.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: fsmap 9 up:standby 2023-12-14T14:09:00.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:00 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T14:09:01.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: Deploying daemon mds.g on smithi069 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1142962962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] up:boot 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: fsmap 9 up:standby 2023-12-14T14:09:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:00 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T14:09:01.085 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 14:09:00 smithi069 systemd[1]: Starting Ceph mds.g for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:09:01.585 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 14:09:01 smithi069 ceph-mds[76042]: -- 172.21.15.69:0/503223481 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55775198f520 con 0x557751964800 2023-12-14T14:09:01.586 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 14:09:01 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-g[76019]: starting mds.g at 2023-12-14T14:09:01.586 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 14:09:01 smithi069 bash[76004]: 0555105ed5d392fbdba479c328d6b57c801058880474a95e218f4a323ba30cef 2023-12-14T14:09:01.586 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 14:09:01 smithi069 systemd[1]: Started Ceph mds.g for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:09:01.841 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:09:01.868 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:01 smithi069 ceph-mon[42034]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:01.868 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:01.868 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:01.868 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:01.869 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:09:01.869 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:09:01.869 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:01 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:01.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:01 smithi081 ceph-mon[43371]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:09:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:09:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:01 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.974+0000 7fe0505e3700 1 -- 172.21.15.69:0/2745965979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048100d10 msgr2=0x7fe0481030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.974+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2745965979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048100d10 0x7fe0481030f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe038009990 tx=0x7fe038009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.974+0000 7fe0505e3700 1 -- 172.21.15.69:0/2745965979 shutdown_connections 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.974+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2745965979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048105f50 0x7fe048108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.974+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2745965979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048100d10 0x7fe0481030f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.974+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2745965979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe048103630 0x7fe048105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.974+0000 7fe0505e3700 1 -- 172.21.15.69:0/2745965979 >> 172.21.15.69:0/2745965979 conn(0x7fe0480fa6f0 msgr2=0x7fe0480fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.974+0000 7fe0505e3700 1 -- 172.21.15.69:0/2745965979 shutdown_connections 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.974+0000 7fe0505e3700 1 -- 172.21.15.69:0/2745965979 wait complete. 2023-12-14T14:09:01.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe0505e3700 1 Processor -- start 2023-12-14T14:09:01.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe0505e3700 1 -- start start 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe0505e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048100d10 0x7fe048195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe0505e3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe048103630 0x7fe048196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe0505e3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048105f50 0x7fe04819d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe0505e3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04819db70 con 0x7fe048105f50 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe0505e3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04819dcb0 con 0x7fe048100d10 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe0505e3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04819de40 con 0x7fe048103630 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe04eb80700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048105f50 0x7fe04819d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe04eb80700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048105f50 0x7fe04819d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49578/0 (socket says 172.21.15.69:49578) 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.975+0000 7fe04eb80700 1 -- 172.21.15.69:0/2071924470 learned_addr learned my addr 172.21.15.69:0/2071924470 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe04db7e700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe048103630 0x7fe048196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe04e37f700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048100d10 0x7fe048195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe04eb80700 1 -- 172.21.15.69:0/2071924470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe048103630 msgr2=0x7fe048196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:01.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe04eb80700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe048103630 0x7fe048196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe04eb80700 1 -- 172.21.15.69:0/2071924470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048100d10 msgr2=0x7fe048195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe04eb80700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048100d10 0x7fe048195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe04eb80700 1 -- 172.21.15.69:0/2071924470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380095f0 con 0x7fe048105f50 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe04eb80700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048105f50 0x7fe04819d5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe04000ada0 tx=0x7fe04000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe03f7fe700 1 -- 172.21.15.69:0/2071924470 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000f070 con 0x7fe048105f50 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe03f7fe700 1 -- 172.21.15.69:0/2071924470 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe040007b30 con 0x7fe048105f50 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04810bbc0 con 0x7fe048105f50 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe03f7fe700 1 -- 172.21.15.69:0/2071924470 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040005440 con 0x7fe048105f50 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.976+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04810ba30 con 0x7fe048105f50 2023-12-14T14:09:01.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.977+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0480fc260 con 0x7fe048105f50 2023-12-14T14:09:01.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.979+0000 7fe03f7fe700 1 -- 172.21.15.69:0/2071924470 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe040004ad0 con 0x7fe048105f50 2023-12-14T14:09:01.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.979+0000 7fe03f7fe700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe0340a1150 0x7fe0340a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:01.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.979+0000 7fe04e37f700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe0340a1150 0x7fe0340a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:01.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.979+0000 7fe03f7fe700 1 -- 172.21.15.69:0/2071924470 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe0400cc110 con 0x7fe048105f50 2023-12-14T14:09:01.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.980+0000 7fe04e37f700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe0340a1150 0x7fe0340a3600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe03800b5c0 tx=0x7fe038005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:01.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:01.983+0000 7fe03f7fe700 1 -- 172.21.15.69:0/2071924470 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe040095d90 con 0x7fe048105f50 2023-12-14T14:09:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:01 smithi119 ceph-mon[43834]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:09:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:09:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:01 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:02.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.223+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe04802cfe0 con 0x7fe048105f50 2023-12-14T14:09:02.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.224+0000 7fe03f7fe700 1 -- 172.21.15.69:0/2071924470 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7324 (secure 0 0 0) 0x7fe0400993b0 con 0x7fe048105f50 2023-12-14T14:09:02.224 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:02.224 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-12-14T14:09:02.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe0340a1150 msgr2=0x7fe0340a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:02.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe0340a1150 0x7fe0340a3600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe03800b5c0 tx=0x7fe038005fb0 comp rx=0 tx=0).stop 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048105f50 msgr2=0x7fe04819d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048105f50 0x7fe04819d5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe04000ada0 tx=0x7fe04000c330 comp rx=0 tx=0).stop 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 shutdown_connections 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe0340a1150 0x7fe0340a3600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe048105f50 0x7fe04819d5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048100d10 0x7fe048195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 --2- 172.21.15.69:0/2071924470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe048103630 0x7fe048196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 >> 172.21.15.69:0/2071924470 conn(0x7fe0480fa6f0 msgr2=0x7fe048101970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 shutdown_connections 2023-12-14T14:09:02.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:02.226+0000 7fe0505e3700 1 -- 172.21.15.69:0/2071924470 wait complete. 2023-12-14T14:09:02.228 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 10 2023-12-14T14:09:02.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:02 smithi069 ceph-mon[42034]: Deploying daemon mds.a on smithi069 2023-12-14T14:09:02.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:02 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2071924470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:02.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:02 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.69:6838/3643556663,v1:172.21.15.69:6839/3643556663] up:boot 2023-12-14T14:09:02.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:02 smithi069 ceph-mon[42034]: fsmap 10 up:standby 2023-12-14T14:09:02.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:02 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-14T14:09:02.837 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 14:09:02 smithi069 systemd[1]: Starting Ceph mds.a for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:09:02.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:02 smithi081 ceph-mon[43371]: Deploying daemon mds.a on smithi069 2023-12-14T14:09:02.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:02 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2071924470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:02.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:02 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.69:6838/3643556663,v1:172.21.15.69:6839/3643556663] up:boot 2023-12-14T14:09:02.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:02 smithi081 ceph-mon[43371]: fsmap 10 up:standby 2023-12-14T14:09:02.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:02 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-14T14:09:03.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:02 smithi119 ceph-mon[43834]: Deploying daemon mds.a on smithi069 2023-12-14T14:09:03.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:02 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2071924470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:03.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:02 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.69:6838/3643556663,v1:172.21.15.69:6839/3643556663] up:boot 2023-12-14T14:09:03.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:02 smithi119 ceph-mon[43834]: fsmap 10 up:standby 2023-12-14T14:09:03.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:02 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-14T14:09:03.336 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 14:09:03 smithi069 ceph-mds[76432]: -- 172.21.15.69:0/1372118870 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556095499520 con 0x55609546e800 2023-12-14T14:09:03.336 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 14:09:03 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-a[76409]: starting mds.a at 2023-12-14T14:09:03.336 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 14:09:03 smithi069 bash[76394]: 0796523e3308d74a24ec7bc25e24753c4328e72bc38fde9b824b46ee0e94e962 2023-12-14T14:09:03.336 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 14:09:03 smithi069 systemd[1]: Started Ceph mds.a for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:09:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:03 smithi081 ceph-mon[43371]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:09:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:09:03.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:03 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:04.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:03 smithi119 ceph-mon[43834]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:04.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:09:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:09:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:03 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:04.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:03 smithi069 ceph-mon[42034]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:04.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:04.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:04.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:04.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T14:09:04.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T14:09:04.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:03 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:04.241 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:09:04.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.384+0000 7f40aeb80700 1 -- 172.21.15.69:0/2144119852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a80fe4e0 msgr2=0x7f40a80fe8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:04.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.384+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2144119852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a80fe4e0 0x7f40a80fe8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f409c009990 tx=0x7f409c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.384+0000 7f40aeb80700 1 -- 172.21.15.69:0/2144119852 shutdown_connections 2023-12-14T14:09:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.384+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2144119852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a8101e40 0x7f40a8108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.384+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2144119852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a80fe4e0 0x7f40a80fe8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.384+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2144119852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40a81014b0 0x7f40a8101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.384+0000 7f40aeb80700 1 -- 172.21.15.69:0/2144119852 >> 172.21.15.69:0/2144119852 conn(0x7f40a80f9e80 msgr2=0x7f40a80fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.384+0000 7f40aeb80700 1 -- 172.21.15.69:0/2144119852 shutdown_connections 2023-12-14T14:09:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.384+0000 7f40aeb80700 1 -- 172.21.15.69:0/2144119852 wait complete. 2023-12-14T14:09:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40aeb80700 1 Processor -- start 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40aeb80700 1 -- start start 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40aeb80700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40a80fe4e0 0x7f40a8100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40aeb80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a81014b0 0x7f40a80ff460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40aeb80700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a8101e40 0x7f40a80ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40aeb80700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8100140 con 0x7f40a8101e40 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40aeb80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81002b0 con 0x7f40a81014b0 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40aeb80700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81a0070 con 0x7f40a80fe4e0 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ad11d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a8101e40 0x7f40a80ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40a7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a81014b0 0x7f40a80ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ad11d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a8101e40 0x7f40a80ff9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49606/0 (socket says 172.21.15.69:49606) 2023-12-14T14:09:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ad11d700 1 -- 172.21.15.69:0/2183459268 learned_addr learned my addr 172.21.15.69:0/2183459268 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ac91c700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40a80fe4e0 0x7f40a8100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ad11d700 1 -- 172.21.15.69:0/2183459268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40a80fe4e0 msgr2=0x7f40a8100e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ad11d700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40a80fe4e0 0x7f40a8100e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ad11d700 1 -- 172.21.15.69:0/2183459268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a81014b0 msgr2=0x7f40a80ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ad11d700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a81014b0 0x7f40a80ff460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ad11d700 1 -- 172.21.15.69:0/2183459268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c0095f0 con 0x7f40a8101e40 2023-12-14T14:09:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40a7fff700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a81014b0 0x7f40a80ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:09:04.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.385+0000 7f40ac91c700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40a80fe4e0 0x7f40a8100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:04.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.386+0000 7f40ad11d700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a8101e40 0x7f40a80ff9a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f40a000ef30 tx=0x7f40a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:04.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.386+0000 7f40a5ffb700 1 -- 172.21.15.69:0/2183459268 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0018070 con 0x7f40a8101e40 2023-12-14T14:09:04.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.386+0000 7f40a5ffb700 1 -- 172.21.15.69:0/2183459268 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40a000f040 con 0x7f40a8101e40 2023-12-14T14:09:04.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.386+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a810bbb0 con 0x7f40a8101e40 2023-12-14T14:09:04.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.386+0000 7f40a5ffb700 1 -- 172.21.15.69:0/2183459268 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000cdb0 con 0x7f40a8101e40 2023-12-14T14:09:04.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.386+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a810ba20 con 0x7f40a8101e40 2023-12-14T14:09:04.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.387+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a8107270 con 0x7f40a8101e40 2023-12-14T14:09:04.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.388+0000 7f40a5ffb700 1 -- 172.21.15.69:0/2183459268 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f40a0003a00 con 0x7f40a8101e40 2023-12-14T14:09:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.388+0000 7f40a5ffb700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f40980a1150 0x7f40980a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.388+0000 7f40ac91c700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f40980a1150 0x7f40980a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.388+0000 7f40a5ffb700 1 -- 172.21.15.69:0/2183459268 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f40a00cc0a0 con 0x7f40a8101e40 2023-12-14T14:09:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.389+0000 7f40ac91c700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f40980a1150 0x7f40980a3600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f409c00b2e0 tx=0x7f409c005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.393+0000 7f40a5ffb700 1 -- 172.21.15.69:0/2183459268 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f40a0095d20 con 0x7f40a8101e40 2023-12-14T14:09:04.617 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:09:04 smithi081 systemd[1]: Starting Ceph mds.b for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:09:04.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.626+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40a8061700 con 0x7f40a8101e40 2023-12-14T14:09:04.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.627+0000 7f40a5ffb700 1 -- 172.21.15.69:0/2183459268 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8840 (secure 0 0 0) 0x7f40a0099340 con 0x7f40a8101e40 2023-12-14T14:09:04.626 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:04.627 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-12-14T14:09:04.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f40980a1150 msgr2=0x7f40980a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:04.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f40980a1150 0x7f40980a3600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f409c00b2e0 tx=0x7f409c005e80 comp rx=0 tx=0).stop 2023-12-14T14:09:04.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a8101e40 msgr2=0x7f40a80ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:04.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a8101e40 0x7f40a80ff9a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f40a000ef30 tx=0x7f40a000c3a0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 shutdown_connections 2023-12-14T14:09:04.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f40980a1150 0x7f40980a3600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a8101e40 0x7f40a80ff9a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40a80fe4e0 0x7f40a8100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 --2- 172.21.15.69:0/2183459268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a81014b0 0x7f40a80ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:04.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 >> 172.21.15.69:0/2183459268 conn(0x7f40a80f9e80 msgr2=0x7f40a80fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:04.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 shutdown_connections 2023-12-14T14:09:04.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:04.629+0000 7f40aeb80700 1 -- 172.21.15.69:0/2183459268 wait complete. 2023-12-14T14:09:04.630 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 12 2023-12-14T14:09:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:04 smithi081 ceph-mon[43371]: Deploying daemon mds.b on smithi081 2023-12-14T14:09:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:04 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.69:6840/2792118918,v1:172.21.15.69:6841/2792118918] up:boot 2023-12-14T14:09:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:04 smithi081 ceph-mon[43371]: fsmap 11 up:standby 2023-12-14T14:09:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:04 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-14T14:09:04.898 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:09:04 smithi081 ceph-mds[68200]: -- 172.21.15.81:0/3739454397 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5652f0739520 con 0x5652f070f000 2023-12-14T14:09:04.898 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:09:04 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-b[68177]: starting mds.b at 2023-12-14T14:09:04.898 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:09:04 smithi081 bash[68162]: 7799e12db426219d9d25f2547ec7a85b8b64a28472f02eec398b5dea4ee8be16 2023-12-14T14:09:04.899 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:09:04 smithi081 systemd[1]: Started Ceph mds.b for 5d58180a-9a89-11ee-95a3-87774f69a715. 2023-12-14T14:09:05.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:04 smithi119 ceph-mon[43834]: Deploying daemon mds.b on smithi081 2023-12-14T14:09:05.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:04 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.69:6840/2792118918,v1:172.21.15.69:6841/2792118918] up:boot 2023-12-14T14:09:05.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:04 smithi119 ceph-mon[43834]: fsmap 11 up:standby 2023-12-14T14:09:05.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:04 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-14T14:09:05.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:04 smithi069 ceph-mon[42034]: Deploying daemon mds.b on smithi081 2023-12-14T14:09:05.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:04 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.69:6840/2792118918,v1:172.21.15.69:6841/2792118918] up:boot 2023-12-14T14:09:05.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:04 smithi069 ceph-mon[42034]: fsmap 11 up:standby 2023-12-14T14:09:05.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:04 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-14T14:09:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:05 smithi081 ceph-mon[43371]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:05 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2183459268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:09:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:05 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:05 smithi119 ceph-mon[43834]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:06.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:05 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2183459268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:06.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:09:06.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:05 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:05 smithi069 ceph-mon[42034]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:06.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:05 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2183459268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:06.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:09:06.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:05 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.641 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:09:06.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.769+0000 7f583818c700 1 -- 172.21.15.69:0/1582799666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101dd0 msgr2=0x7f5830108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:06.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.769+0000 7f583818c700 1 --2- 172.21.15.69:0/1582799666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101dd0 0x7f5830108690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f582800b0a0 tx=0x7f582800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:06.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.769+0000 7f583818c700 1 -- 172.21.15.69:0/1582799666 shutdown_connections 2023-12-14T14:09:06.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.769+0000 7f583818c700 1 --2- 172.21.15.69:0/1582799666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101dd0 0x7f5830108690 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:06.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.769+0000 7f583818c700 1 --2- 172.21.15.69:0/1582799666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5830100250 0x7f5830100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:06.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.769+0000 7f583818c700 1 --2- 172.21.15.69:0/1582799666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830101440 0x7f5830101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:06.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.769+0000 7f583818c700 1 -- 172.21.15.69:0/1582799666 >> 172.21.15.69:0/1582799666 conn(0x7f58300fb830 msgr2=0x7f58300fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:06.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.769+0000 7f583818c700 1 -- 172.21.15.69:0/1582799666 shutdown_connections 2023-12-14T14:09:06.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.769+0000 7f583818c700 1 -- 172.21.15.69:0/1582799666 wait complete. 2023-12-14T14:09:06.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f583818c700 1 Processor -- start 2023-12-14T14:09:06.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f583818c700 1 -- start start 2023-12-14T14:09:06.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f583818c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5830100250 0x7f5830196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:06.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f583818c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101440 0x7f58301966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:06.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f583818c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830101dd0 0x7f583019d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:06.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f583818c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583019dd00 con 0x7f5830101440 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f583818c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583019de40 con 0x7f5830101dd0 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f583818c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583019dfd0 con 0x7f5830100250 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f5835727700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101440 0x7f58301966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.770+0000 7f5835727700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101440 0x7f58301966c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47788/0 (socket says 172.21.15.69:47788) 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5835727700 1 -- 172.21.15.69:0/615173395 learned_addr learned my addr 172.21.15.69:0/615173395 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5836729700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830101dd0 0x7f583019d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5835f28700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5830100250 0x7f5830196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5835727700 1 -- 172.21.15.69:0/615173395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5830100250 msgr2=0x7f5830196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5835727700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5830100250 0x7f5830196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5835727700 1 -- 172.21.15.69:0/615173395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830101dd0 msgr2=0x7f583019d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5835727700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830101dd0 0x7f583019d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5835727700 1 -- 172.21.15.69:0/615173395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828009d00 con 0x7f5830101440 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5835f28700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5830100250 0x7f5830196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.771+0000 7f5835727700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101440 0x7f58301966c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f582000d950 tx=0x7f582000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:06.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.772+0000 7f5826ffd700 1 -- 172.21.15.69:0/615173395 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820009940 con 0x7f5830101440 2023-12-14T14:09:06.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.772+0000 7f5826ffd700 1 -- 172.21.15.69:0/615173395 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5820010460 con 0x7f5830101440 2023-12-14T14:09:06.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.772+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583010bca0 con 0x7f5830101440 2023-12-14T14:09:06.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.772+0000 7f5826ffd700 1 -- 172.21.15.69:0/615173395 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000f620 con 0x7f5830101440 2023-12-14T14:09:06.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.772+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583010bb10 con 0x7f5830101440 2023-12-14T14:09:06.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.773+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5830107090 con 0x7f5830101440 2023-12-14T14:09:06.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.774+0000 7f5826ffd700 1 -- 172.21.15.69:0/615173395 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f58200108d0 con 0x7f5830101440 2023-12-14T14:09:06.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.775+0000 7f5826ffd700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f581c0a11d0 0x7f581c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:06.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.775+0000 7f5835f28700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f581c0a11d0 0x7f581c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:06.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.775+0000 7f5826ffd700 1 -- 172.21.15.69:0/615173395 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f58200cc270 con 0x7f5830101440 2023-12-14T14:09:06.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.775+0000 7f5835f28700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f581c0a11d0 0x7f581c0a3680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f58301012a0 tx=0x7f582c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:06.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:06.779+0000 7f5826ffd700 1 -- 172.21.15.69:0/615173395 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5820095e60 con 0x7f5830101440 2023-12-14T14:09:06.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:06 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] up:boot 2023-12-14T14:09:06.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:06 smithi081 ceph-mon[43371]: fsmap 12 up:standby 2023-12-14T14:09:06.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:06 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T14:09:06.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:06 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:06 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:06 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:06 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:06 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:06.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:06 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:06 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] up:boot 2023-12-14T14:09:07.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:06 smithi119 ceph-mon[43834]: fsmap 12 up:standby 2023-12-14T14:09:07.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:06 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T14:09:07.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:06 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:06 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:06 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:06 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:06 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:06 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.029+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f583002cfe0 con 0x7f5830101440 2023-12-14T14:09:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.030+0000 7f5826ffd700 1 -- 172.21.15.69:0/615173395 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9598 (secure 0 0 0) 0x7f5820099480 con 0x7f5830101440 2023-12-14T14:09:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:07.029 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-12-14T14:09:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f581c0a11d0 msgr2=0x7f581c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f581c0a11d0 0x7f581c0a3680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f58301012a0 tx=0x7f582c008040 comp rx=0 tx=0).stop 2023-12-14T14:09:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101440 msgr2=0x7f58301966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101440 0x7f58301966c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f582000d950 tx=0x7f582000dc60 comp rx=0 tx=0).stop 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 shutdown_connections 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f581c0a11d0 0x7f581c0a3680 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830101dd0 0x7f583019d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5830100250 0x7f5830196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 --2- 172.21.15.69:0/615173395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5830101440 0x7f58301966c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 >> 172.21.15.69:0/615173395 conn(0x7f58300fb830 msgr2=0x7f58300fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 shutdown_connections 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.032+0000 7f583818c700 1 -- 172.21.15.69:0/615173395 wait complete. 2023-12-14T14:09:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 13 2023-12-14T14:09:07.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:06 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] up:boot 2023-12-14T14:09:07.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:06 smithi069 ceph-mon[42034]: fsmap 12 up:standby 2023-12-14T14:09:07.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:06 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T14:09:07.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:06 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:06 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:06 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:06 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:06 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.043 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:06 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.044 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:09:07.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.170+0000 7f4c0b385700 1 -- 172.21.15.69:0/969551552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04100c90 msgr2=0x7f4c04103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.170+0000 7f4c0b385700 1 --2- 172.21.15.69:0/969551552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04100c90 0x7f4c04103070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009990 tx=0x7f4c00009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.170+0000 7f4c0b385700 1 -- 172.21.15.69:0/969551552 shutdown_connections 2023-12-14T14:09:07.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.170+0000 7f4c0b385700 1 --2- 172.21.15.69:0/969551552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c04105ed0 0x7f4c04108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.170+0000 7f4c0b385700 1 --2- 172.21.15.69:0/969551552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04100c90 0x7f4c04103070 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.170+0000 7f4c0b385700 1 --2- 172.21.15.69:0/969551552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c041035b0 0x7f4c04105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.170+0000 7f4c0b385700 1 -- 172.21.15.69:0/969551552 >> 172.21.15.69:0/969551552 conn(0x7f4c040fa6f0 msgr2=0x7f4c040fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:07.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.170+0000 7f4c0b385700 1 -- 172.21.15.69:0/969551552 shutdown_connections 2023-12-14T14:09:07.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.170+0000 7f4c0b385700 1 -- 172.21.15.69:0/969551552 wait complete. 2023-12-14T14:09:07.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c0b385700 1 Processor -- start 2023-12-14T14:09:07.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c0b385700 1 -- start start 2023-12-14T14:09:07.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c0b385700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c04100c90 0x7f4c04195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c0b385700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c041035b0 0x7f4c04196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c0b385700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c04105ed0 0x7f4c0419d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c0b385700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0419dad0 con 0x7f4c041035b0 2023-12-14T14:09:07.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c0b385700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0419dc10 con 0x7f4c04100c90 2023-12-14T14:09:07.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c0b385700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0419dda0 con 0x7f4c04105ed0 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c08920700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c041035b0 0x7f4c04196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c08920700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c041035b0 0x7f4c04196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47796/0 (socket says 172.21.15.69:47796) 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c09121700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c04100c90 0x7f4c04195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c08920700 1 -- 172.21.15.69:0/2315093012 learned_addr learned my addr 172.21.15.69:0/2315093012 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.171+0000 7f4c09922700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c04105ed0 0x7f4c0419d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4c08920700 1 -- 172.21.15.69:0/2315093012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c04105ed0 msgr2=0x7f4c0419d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4c08920700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c04105ed0 0x7f4c0419d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4c08920700 1 -- 172.21.15.69:0/2315093012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c04100c90 msgr2=0x7f4c04195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4c08920700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c04100c90 0x7f4c04195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4c08920700 1 -- 172.21.15.69:0/2315093012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf4009520 con 0x7f4c041035b0 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4c09121700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c04100c90 0x7f4c04195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4c08920700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c041035b0 0x7f4c04196490 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400eb30 tx=0x7f4bf400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4bfa7fc700 1 -- 172.21.15.69:0/2315093012 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4009880 con 0x7f4c041035b0 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4bfa7fc700 1 -- 172.21.15.69:0/2315093012 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bf40044e0 con 0x7f4c041035b0 2023-12-14T14:09:07.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c000095f0 con 0x7f4c041035b0 2023-12-14T14:09:07.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4bfa7fc700 1 -- 172.21.15.69:0/2315093012 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4003d80 con 0x7f4c041035b0 2023-12-14T14:09:07.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.172+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0410bb90 con 0x7f4c041035b0 2023-12-14T14:09:07.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.173+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0410bd20 con 0x7f4c041035b0 2023-12-14T14:09:07.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.175+0000 7f4bfa7fc700 1 -- 172.21.15.69:0/2315093012 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4bf4003f00 con 0x7f4c041035b0 2023-12-14T14:09:07.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.175+0000 7f4bfa7fc700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4bf00a1150 0x7f4bf00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.176+0000 7f4c09121700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4bf00a1150 0x7f4bf00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.176+0000 7f4bfa7fc700 1 -- 172.21.15.69:0/2315093012 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4bf4014070 con 0x7f4c041035b0 2023-12-14T14:09:07.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.176+0000 7f4c09121700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4bf00a1150 0x7f4bf00a3600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000b2e0 tx=0x7f4c00005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:07.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.178+0000 7f4bfa7fc700 1 -- 172.21.15.69:0/2315093012 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4bf4096700 con 0x7f4c041035b0 2023-12-14T14:09:07.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.395+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c040fc260 con 0x7f4c041035b0 2023-12-14T14:09:07.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.396+0000 7f4bfa7fc700 1 -- 172.21.15.69:0/2315093012 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f4bf4099d20 con 0x7f4c041035b0 2023-12-14T14:09:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:07.395 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":78,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:08:38.679064+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4bf00a1150 msgr2=0x7f4bf00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4bf00a1150 0x7f4bf00a3600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000b2e0 tx=0x7f4c00005fb0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c041035b0 msgr2=0x7f4c04196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c041035b0 0x7f4c04196490 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400eb30 tx=0x7f4bf400ee40 comp rx=0 tx=0).stop 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 shutdown_connections 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4bf00a1150 0x7f4bf00a3600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c04105ed0 0x7f4c0419d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c04100c90 0x7f4c04195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 --2- 172.21.15.69:0/2315093012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c041035b0 0x7f4c04196490 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 >> 172.21.15.69:0/2315093012 conn(0x7f4c040fa6f0 msgr2=0x7f4c041018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 shutdown_connections 2023-12-14T14:09:07.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.398+0000 7f4c0b385700 1 -- 172.21.15.69:0/2315093012 wait complete. 2023-12-14T14:09:07.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:09:07.410 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:09:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 -- 172.21.15.69:0/43500570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 msgr2=0x7fd438103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 --2- 172.21.15.69:0/43500570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 0x7fd438103080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd434009990 tx=0x7fd434009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 -- 172.21.15.69:0/43500570 shutdown_connections 2023-12-14T14:09:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 --2- 172.21.15.69:0/43500570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd438105ee0 0x7fd438108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 --2- 172.21.15.69:0/43500570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 0x7fd438103080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 --2- 172.21.15.69:0/43500570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4381035c0 0x7fd4381059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 -- 172.21.15.69:0/43500570 >> 172.21.15.69:0/43500570 conn(0x7fd4380fa740 msgr2=0x7fd4380fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 -- 172.21.15.69:0/43500570 shutdown_connections 2023-12-14T14:09:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 -- 172.21.15.69:0/43500570 wait complete. 2023-12-14T14:09:07.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 Processor -- start 2023-12-14T14:09:07.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 -- start start 2023-12-14T14:09:07.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 0x7fd438195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4381035c0 0x7fd438196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd438105ee0 0x7fd43819d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43819db60 con 0x7fd438100ca0 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43819dca0 con 0x7fd438105ee0 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.540+0000 7fd44066e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43819de30 con 0x7fd4381035c0 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43e40a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 0x7fd438195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43dc09700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4381035c0 0x7fd438196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43e40a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 0x7fd438195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47824/0 (socket says 172.21.15.69:47824) 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43e40a700 1 -- 172.21.15.69:0/3124400320 learned_addr learned my addr 172.21.15.69:0/3124400320 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43ec0b700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd438105ee0 0x7fd43819d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43e40a700 1 -- 172.21.15.69:0/3124400320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4381035c0 msgr2=0x7fd438196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43e40a700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4381035c0 0x7fd438196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43e40a700 1 -- 172.21.15.69:0/3124400320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd438105ee0 msgr2=0x7fd43819d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43e40a700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd438105ee0 0x7fd43819d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43e40a700 1 -- 172.21.15.69:0/3124400320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340095f0 con 0x7fd438100ca0 2023-12-14T14:09:07.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd43e40a700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 0x7fd438195fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd43400b680 tx=0x7fd4340057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:07.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd42f7fe700 1 -- 172.21.15.69:0/3124400320 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43401d070 con 0x7fd438100ca0 2023-12-14T14:09:07.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43810bbf0 con 0x7fd438100ca0 2023-12-14T14:09:07.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd42f7fe700 1 -- 172.21.15.69:0/3124400320 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd434022470 con 0x7fd438100ca0 2023-12-14T14:09:07.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd42f7fe700 1 -- 172.21.15.69:0/3124400320 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434017650 con 0x7fd438100ca0 2023-12-14T14:09:07.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.541+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43810ba60 con 0x7fd438100ca0 2023-12-14T14:09:07.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.542+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4380fc2b0 con 0x7fd438100ca0 2023-12-14T14:09:07.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.543+0000 7fd42f7fe700 1 -- 172.21.15.69:0/3124400320 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fd4340225e0 con 0x7fd438100ca0 2023-12-14T14:09:07.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.544+0000 7fd42f7fe700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4240a1150 0x7fd4240a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.544+0000 7fd42f7fe700 1 -- 172.21.15.69:0/3124400320 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd4340cd980 con 0x7fd438100ca0 2023-12-14T14:09:07.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.544+0000 7fd43dc09700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4240a1150 0x7fd4240a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.544+0000 7fd43dc09700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4240a1150 0x7fd4240a3600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd428007c60 tx=0x7fd4280073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:07.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.548+0000 7fd42f7fe700 1 -- 172.21.15.69:0/3124400320 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd434097600 con 0x7fd438100ca0 2023-12-14T14:09:07.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.746+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd438061930 con 0x7fd438100ca0 2023-12-14T14:09:07.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.746+0000 7fd42f7fe700 1 -- 172.21.15.69:0/3124400320 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd43409ac20 con 0x7fd438100ca0 2023-12-14T14:09:07.745 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4240a1150 msgr2=0x7fd4240a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4240a1150 0x7fd4240a3600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd428007c60 tx=0x7fd4280073d0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 msgr2=0x7fd438195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 0x7fd438195fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd43400b680 tx=0x7fd4340057b0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 shutdown_connections 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd4240a1150 0x7fd4240a3600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd438105ee0 0x7fd43819d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd438100ca0 0x7fd438195fe0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 --2- 172.21.15.69:0/3124400320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4381035c0 0x7fd438196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.748+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 >> 172.21.15.69:0/3124400320 conn(0x7fd4380fa740 msgr2=0x7fd438101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.749+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 shutdown_connections 2023-12-14T14:09:07.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.749+0000 7fd44066e700 1 -- 172.21.15.69:0/3124400320 wait complete. 2023-12-14T14:09:07.759 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:07.759 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:07.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:09:07.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:09:07.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:09:07.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:09:07.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:09:07.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:09:07.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/615173395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:07.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:07 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2315093012' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:07.761 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-14T14:09:07.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/615173395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:07 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2315093012' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 -- 172.21.15.69:0/3716830991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c100ca0 msgr2=0x7fc21c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 --2- 172.21.15.69:0/3716830991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c100ca0 0x7fc21c103080 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc218009990 tx=0x7fc218009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 -- 172.21.15.69:0/3716830991 shutdown_connections 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 --2- 172.21.15.69:0/3716830991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c105ee0 0x7fc21c108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 --2- 172.21.15.69:0/3716830991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c100ca0 0x7fc21c103080 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 --2- 172.21.15.69:0/3716830991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c1035c0 0x7fc21c1059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 -- 172.21.15.69:0/3716830991 >> 172.21.15.69:0/3716830991 conn(0x7fc21c0fa700 msgr2=0x7fc21c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 -- 172.21.15.69:0/3716830991 shutdown_connections 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 -- 172.21.15.69:0/3716830991 wait complete. 2023-12-14T14:09:07.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.903+0000 7fc223fe2700 1 Processor -- start 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc223fe2700 1 -- start start 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc223fe2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c100ca0 0x7fc21c100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc223fe2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c1035c0 0x7fc21c0fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc223fe2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c105ee0 0x7fc21c0ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc223fe2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0ff930 con 0x7fc21c1035c0 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc223fe2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0ffaa0 con 0x7fc21c105ee0 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc223fe2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1a0030 con 0x7fc21c100ca0 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22157d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c1035c0 0x7fc21c0fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22157d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c1035c0 0x7fc21c0fec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47854/0 (socket says 172.21.15.69:47854) 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22157d700 1 -- 172.21.15.69:0/402397859 learned_addr learned my addr 172.21.15.69:0/402397859 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc221d7e700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c100ca0 0x7fc21c100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22257f700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c105ee0 0x7fc21c0ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22157d700 1 -- 172.21.15.69:0/402397859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c100ca0 msgr2=0x7fc21c100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22157d700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c100ca0 0x7fc21c100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22157d700 1 -- 172.21.15.69:0/402397859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c105ee0 msgr2=0x7fc21c0ff190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22157d700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c105ee0 0x7fc21c0ff190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22157d700 1 -- 172.21.15.69:0/402397859 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214009c40 con 0x7fc21c1035c0 2023-12-14T14:09:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc22157d700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c1035c0 0x7fc21c0fec50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e9a0 tx=0x7fc20c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc212ffd700 1 -- 172.21.15.69:0/402397859 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c009790 con 0x7fc21c1035c0 2023-12-14T14:09:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.904+0000 7fc212ffd700 1 -- 172.21.15.69:0/402397859 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc20c00ce80 con 0x7fc21c1035c0 2023-12-14T14:09:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.905+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2180095f0 con 0x7fc21c1035c0 2023-12-14T14:09:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.905+0000 7fc212ffd700 1 -- 172.21.15.69:0/402397859 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c018680 con 0x7fc21c1035c0 2023-12-14T14:09:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.905+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c10bbd0 con 0x7fc21c1035c0 2023-12-14T14:09:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.905+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c0fc270 con 0x7fc21c1035c0 2023-12-14T14:09:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.907+0000 7fc212ffd700 1 -- 172.21.15.69:0/402397859 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc20c010430 con 0x7fc21c1035c0 2023-12-14T14:09:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.907+0000 7fc212ffd700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2080a11d0 0x7fc2080a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.908+0000 7fc221d7e700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2080a11d0 0x7fc2080a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.908+0000 7fc212ffd700 1 -- 172.21.15.69:0/402397859 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc20c014070 con 0x7fc21c1035c0 2023-12-14T14:09:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.908+0000 7fc221d7e700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2080a11d0 0x7fc2080a3680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc21800b2e0 tx=0x7fc218005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:07.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:07.911+0000 7fc212ffd700 1 -- 172.21.15.69:0/402397859 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc20c096570 con 0x7fc21c1035c0 2023-12-14T14:09:08.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:08.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:08.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:09:08.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:09:08.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:08.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:09:08.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:09:08.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:09:08.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:09:08.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/615173395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:08.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:07 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2315093012' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.144+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc21c02cfe0 con 0x7fc21c1035c0 2023-12-14T14:09:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.144+0000 7fc212ffd700 1 -- 172.21.15.69:0/402397859 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc20c099b90 con 0x7fc21c1035c0 2023-12-14T14:09:08.144 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:08.144 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2023-12-14T14:09:08.144 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:09:08.144 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2023-12-14T14:09:08.144 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2023-12-14T14:09:08.144 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:09:08.144 INFO:teuthology.orchestra.run.smithi069.stdout:] 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.146+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2080a11d0 msgr2=0x7fc2080a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.146+0000 7fc223fe2700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2080a11d0 0x7fc2080a3680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc21800b2e0 tx=0x7fc218005fb0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.146+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c1035c0 msgr2=0x7fc21c0fec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.146+0000 7fc223fe2700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c1035c0 0x7fc21c0fec50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e9a0 tx=0x7fc20c00ecb0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.147+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 shutdown_connections 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.147+0000 7fc223fe2700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2080a11d0 0x7fc2080a3680 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.147+0000 7fc223fe2700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c105ee0 0x7fc21c0ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.147+0000 7fc223fe2700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c100ca0 0x7fc21c100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.147+0000 7fc223fe2700 1 --2- 172.21.15.69:0/402397859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc21c1035c0 0x7fc21c0fec50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.147+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 >> 172.21.15.69:0/402397859 conn(0x7fc21c0fa700 msgr2=0x7fc21c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.147+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 shutdown_connections 2023-12-14T14:09:08.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.147+0000 7fc223fe2700 1 -- 172.21.15.69:0/402397859 wait complete. 2023-12-14T14:09:08.159 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-14T14:09:08.159 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-14T14:09:08.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 -- 172.21.15.69:0/901283407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278105f40 msgr2=0x7fe278108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:08.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 --2- 172.21.15.69:0/901283407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278105f40 0x7fe278108340 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe27000b0a0 tx=0x7fe27000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 -- 172.21.15.69:0/901283407 shutdown_connections 2023-12-14T14:09:08.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 --2- 172.21.15.69:0/901283407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278105f40 0x7fe278108340 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 --2- 172.21.15.69:0/901283407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe278100d00 0x7fe2781030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 --2- 172.21.15.69:0/901283407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278103620 0x7fe278105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 -- 172.21.15.69:0/901283407 >> 172.21.15.69:0/901283407 conn(0x7fe2780fa740 msgr2=0x7fe2780fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:08.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 -- 172.21.15.69:0/901283407 shutdown_connections 2023-12-14T14:09:08.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 -- 172.21.15.69:0/901283407 wait complete. 2023-12-14T14:09:08.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 Processor -- start 2023-12-14T14:09:08.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.292+0000 7fe27e422700 1 -- start start 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe27e422700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278100d00 0x7fe278196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe27e422700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe278103620 0x7fe2781965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe27e422700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278105f40 0x7fe27819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe27e422700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27819dbf0 con 0x7fe278100d00 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe27e422700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27819dd30 con 0x7fe278105f40 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe27e422700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27819dec0 con 0x7fe278103620 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe277fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278100d00 0x7fe278196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe277fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278100d00 0x7fe278196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47874/0 (socket says 172.21.15.69:47874) 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe277fff700 1 -- 172.21.15.69:0/3439496430 learned_addr learned my addr 172.21.15.69:0/3439496430 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe27c9bf700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278105f40 0x7fe27819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:08.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe2777fe700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe278103620 0x7fe2781965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe277fff700 1 -- 172.21.15.69:0/3439496430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe278103620 msgr2=0x7fe2781965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe277fff700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe278103620 0x7fe2781965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe277fff700 1 -- 172.21.15.69:0/3439496430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278105f40 msgr2=0x7fe27819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe277fff700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278105f40 0x7fe27819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe277fff700 1 -- 172.21.15.69:0/3439496430 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270009d00 con 0x7fe278100d00 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe277fff700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278100d00 0x7fe278196070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe26800e9a0 tx=0x7fe26800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe2757fa700 1 -- 172.21.15.69:0/3439496430 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268009790 con 0x7fe278100d00 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.293+0000 7fe2757fa700 1 -- 172.21.15.69:0/3439496430 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe26800cbd0 con 0x7fe278100d00 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.294+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27810bc30 con 0x7fe278100d00 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.294+0000 7fe2757fa700 1 -- 172.21.15.69:0/3439496430 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268018680 con 0x7fe278100d00 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.294+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27810baa0 con 0x7fe278100d00 2023-12-14T14:09:08.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.295+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2780fc2b0 con 0x7fe278100d00 2023-12-14T14:09:08.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.296+0000 7fe2757fa700 1 -- 172.21.15.69:0/3439496430 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe26800cd40 con 0x7fe278100d00 2023-12-14T14:09:08.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.297+0000 7fe2757fa700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe2600a11d0 0x7fe2600a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:08.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.297+0000 7fe2777fe700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe2600a11d0 0x7fe2600a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:08.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.297+0000 7fe2757fa700 1 -- 172.21.15.69:0/3439496430 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe268014070 con 0x7fe278100d00 2023-12-14T14:09:08.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.297+0000 7fe2777fe700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe2600a11d0 0x7fe2600a3680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe26c005950 tx=0x7fe26c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:08.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.300+0000 7fe2757fa700 1 -- 172.21.15.69:0/3439496430 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe2680964f0 con 0x7fe278100d00 2023-12-14T14:09:08.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:08.491+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe2780619b0 con 0x7fe278100d00 2023-12-14T14:09:09.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3124400320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/402397859' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:09:09.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:08 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3124400320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/402397859' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:09.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:09:09.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:08 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3124400320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/402397859' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:09:09.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:08 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:09:09.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.198+0000 7fe2757fa700 1 -- 172.21.15.69:0/3439496430 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe268099b10 con 0x7fe278100d00 2023-12-14T14:09:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.202+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe2600a11d0 msgr2=0x7fe2600a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.202+0000 7fe27e422700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe2600a11d0 0x7fe2600a3680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe26c005950 tx=0x7fe26c0058e0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.202+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278100d00 msgr2=0x7fe278196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.202+0000 7fe27e422700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278100d00 0x7fe278196070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe26800e9a0 tx=0x7fe26800ecb0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.203+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 shutdown_connections 2023-12-14T14:09:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.203+0000 7fe27e422700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe2600a11d0 0x7fe2600a3680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.203+0000 7fe27e422700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278105f40 0x7fe27819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.203+0000 7fe27e422700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe278100d00 0x7fe278196070 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.203+0000 7fe27e422700 1 --2- 172.21.15.69:0/3439496430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe278103620 0x7fe2781965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.203+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 >> 172.21.15.69:0/3439496430 conn(0x7fe2780fa740 msgr2=0x7fe278101960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.203+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 shutdown_connections 2023-12-14T14:09:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.203+0000 7fe27e422700 1 -- 172.21.15.69:0/3439496430 wait complete. 2023-12-14T14:09:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2023-12-14T14:09:09.216 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-14T14:09:09.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 -- 172.21.15.69:0/155022636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 msgr2=0x7f02e00ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:09.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 --2- 172.21.15.69:0/155022636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 0x7f02e00ff530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009990 tx=0x7f02dc009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 -- 172.21.15.69:0/155022636 shutdown_connections 2023-12-14T14:09:09.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 --2- 172.21.15.69:0/155022636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0100ca0 0x7f02e0107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 --2- 172.21.15.69:0/155022636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 0x7f02e00ff530 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 --2- 172.21.15.69:0/155022636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02e0100310 0x7f02e0100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 -- 172.21.15.69:0/155022636 >> 172.21.15.69:0/155022636 conn(0x7f02e00fa740 msgr2=0x7f02e00fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:09.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 -- 172.21.15.69:0/155022636 shutdown_connections 2023-12-14T14:09:09.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 -- 172.21.15.69:0/155022636 wait complete. 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 Processor -- start 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.350+0000 7f02e7edd700 1 -- start start 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e7edd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 0x7f02e0195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e7edd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02e0100310 0x7f02e0196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e7edd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0100ca0 0x7f02e019d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e7edd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e019daf0 con 0x7f02e00ff120 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e7edd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e019dc30 con 0x7f02e0100ca0 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e7edd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e019ddc0 con 0x7f02e0100310 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5c79700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 0x7f02e0195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5c79700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 0x7f02e0195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47902/0 (socket says 172.21.15.69:47902) 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5c79700 1 -- 172.21.15.69:0/668066515 learned_addr learned my addr 172.21.15.69:0/668066515 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5478700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02e0100310 0x7f02e0196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e647a700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0100ca0 0x7f02e019d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5c79700 1 -- 172.21.15.69:0/668066515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02e0100310 msgr2=0x7f02e0196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5c79700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02e0100310 0x7f02e0196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5c79700 1 -- 172.21.15.69:0/668066515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0100ca0 msgr2=0x7f02e019d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5c79700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0100ca0 0x7f02e019d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5c79700 1 -- 172.21.15.69:0/668066515 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0095f0 con 0x7f02e00ff120 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e647a700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0100ca0 0x7f02e019d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e5c79700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 0x7f02e0195fc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02dc000c00 tx=0x7f02dc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02d6ffd700 1 -- 172.21.15.69:0/668066515 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc01d070 con 0x7f02e00ff120 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e010aa90 con 0x7f02e00ff120 2023-12-14T14:09:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02d6ffd700 1 -- 172.21.15.69:0/668066515 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02dc004060 con 0x7f02e00ff120 2023-12-14T14:09:09.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02d6ffd700 1 -- 172.21.15.69:0/668066515 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc022d30 con 0x7f02e00ff120 2023-12-14T14:09:09.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.351+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e010a900 con 0x7f02e00ff120 2023-12-14T14:09:09.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.352+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e0107250 con 0x7f02e00ff120 2023-12-14T14:09:09.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.354+0000 7f02d6ffd700 1 -- 172.21.15.69:0/668066515 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f02dc003ba0 con 0x7f02e00ff120 2023-12-14T14:09:09.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.354+0000 7f02d6ffd700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f02cc0a1150 0x7f02cc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:09.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.354+0000 7f02d6ffd700 1 -- 172.21.15.69:0/668066515 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f02dc0cdc60 con 0x7f02e00ff120 2023-12-14T14:09:09.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.354+0000 7f02e5478700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f02cc0a1150 0x7f02cc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:09.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.355+0000 7f02e5478700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f02cc0a1150 0x7f02cc0a3600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02d0005950 tx=0x7f02d000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.358+0000 7f02d6ffd700 1 -- 172.21.15.69:0/668066515 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f02dc097770 con 0x7f02e00ff120 2023-12-14T14:09:09.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:09.549+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f02e00619b0 con 0x7f02e00ff120 2023-12-14T14:09:10.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:09 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:09:10.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:09 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:09:10.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:09 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:09:10.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:09 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:09:10.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:09 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3439496430' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-14T14:09:10.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:09 smithi069 ceph-mon[42034]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:10.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:09 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3439496430' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-14T14:09:10.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:09 smithi069 ceph-mon[42034]: osdmap e79: 12 total, 12 up, 12 in 2023-12-14T14:09:10.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:09 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:09:10.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:09 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:09:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:09 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:09:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:09 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:09:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:09 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3439496430' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-14T14:09:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:09 smithi081 ceph-mon[43371]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:09 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3439496430' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-14T14:09:10.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:09 smithi081 ceph-mon[43371]: osdmap e79: 12 total, 12 up, 12 in 2023-12-14T14:09:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.200+0000 7f02d6ffd700 1 -- 172.21.15.69:0/668066515 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) v1 ==== 170+0+0 (secure 0 0 0) 0x7f02dc09ad90 con 0x7f02e00ff120 2023-12-14T14:09:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f02cc0a1150 msgr2=0x7f02cc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f02cc0a1150 0x7f02cc0a3600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02d0005950 tx=0x7f02d000b410 comp rx=0 tx=0).stop 2023-12-14T14:09:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 msgr2=0x7f02e0195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 0x7f02e0195fc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02dc000c00 tx=0x7f02dc0047b0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 shutdown_connections 2023-12-14T14:09:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f02cc0a1150 0x7f02cc0a3600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0100ca0 0x7f02e019d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02e00ff120 0x7f02e0195fc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 --2- 172.21.15.69:0/668066515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02e0100310 0x7f02e0196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 >> 172.21.15.69:0/668066515 conn(0x7f02e00fa740 msgr2=0x7f02e00fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 shutdown_connections 2023-12-14T14:09:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.205+0000 7f02e7edd700 1 -- 172.21.15.69:0/668066515 wait complete. 2023-12-14T14:09:10.218 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2023-12-14T14:09:10.231 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-14T14:09:10.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:09 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:09:10.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:09 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:09:10.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:09 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:09:10.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:09 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:09:10.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:09 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3439496430' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-14T14:09:10.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:09 smithi119 ceph-mon[43834]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:10.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:09 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3439496430' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-14T14:09:10.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:09 smithi119 ceph-mon[43834]: osdmap e79: 12 total, 12 up, 12 in 2023-12-14T14:09:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 -- 172.21.15.69:0/2916671374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc105f00 msgr2=0x7fa7fc108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 --2- 172.21.15.69:0/2916671374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc105f00 0x7fa7fc108360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400b0a0 tx=0x7fa7f400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 -- 172.21.15.69:0/2916671374 shutdown_connections 2023-12-14T14:09:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 --2- 172.21.15.69:0/2916671374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc105f00 0x7fa7fc108360 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 --2- 172.21.15.69:0/2916671374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7fc100cc0 0x7fa7fc1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 --2- 172.21.15.69:0/2916671374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7fc1035e0 0x7fa7fc1059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 -- 172.21.15.69:0/2916671374 >> 172.21.15.69:0/2916671374 conn(0x7fa7fc0fa740 msgr2=0x7fa7fc0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 -- 172.21.15.69:0/2916671374 shutdown_connections 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 -- 172.21.15.69:0/2916671374 wait complete. 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 Processor -- start 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 -- start start 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7fc100cc0 0x7fa7fc100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc1035e0 0x7fa7fc0fec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7fc105f00 0x7fa7fc0ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0ff950 con 0x7fa7fc1035e0 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0ffac0 con 0x7fa7fc105f00 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.357+0000 7fa803eff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1a0090 con 0x7fa7fc100cc0 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa80149a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc1035e0 0x7fa7fc0fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa80149a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc1035e0 0x7fa7fc0fec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47922/0 (socket says 172.21.15.69:47922) 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa80149a700 1 -- 172.21.15.69:0/2718454394 learned_addr learned my addr 172.21.15.69:0/2718454394 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa801c9b700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7fc100cc0 0x7fa7fc100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa80149a700 1 -- 172.21.15.69:0/2718454394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7fc100cc0 msgr2=0x7fa7fc100630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa80149a700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7fc100cc0 0x7fa7fc100630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa80149a700 1 -- 172.21.15.69:0/2718454394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7fc105f00 msgr2=0x7fa7fc0ff1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa80149a700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7fc105f00 0x7fa7fc0ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa80149a700 1 -- 172.21.15.69:0/2718454394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4009d00 con 0x7fa7fc1035e0 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa80149a700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc1035e0 0x7fa7fc0fec70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800d950 tx=0x7fa7f800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/2718454394 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8009940 con 0x7fa7fc1035e0 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7fc10bc00 con 0x7fa7fc1035e0 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc10ba70 con 0x7fa7fc1035e0 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/2718454394 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7f8010460 con 0x7fa7fc1035e0 2023-12-14T14:09:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.358+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/2718454394 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f800f620 con 0x7fa7fc1035e0 2023-12-14T14:09:10.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.359+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e0005320 con 0x7fa7fc1035e0 2023-12-14T14:09:10.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.361+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/2718454394 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa7f8009aa0 con 0x7fa7fc1035e0 2023-12-14T14:09:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.362+0000 7fa7f2ffd700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa7e80a1150 0x7fa7e80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.362+0000 7fa801c9b700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa7e80a1150 0x7fa7e80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.362+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/2718454394 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7879+0+0 (secure 0 0 0) 0x7fa7f80cc500 con 0x7fa7fc1035e0 2023-12-14T14:09:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.362+0000 7fa801c9b700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa7e80a1150 0x7fa7e80a3600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec005950 tx=0x7fa7ec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:10.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.365+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/2718454394 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa7f8095e00 con 0x7fa7fc1035e0 2023-12-14T14:09:10.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.597+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa7e0005cc0 con 0x7fa7fc1035e0 2023-12-14T14:09:10.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.607+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/2718454394 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa7f80200c0 con 0x7fa7fc1035e0 2023-12-14T14:09:10.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.625+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa7e80a1150 msgr2=0x7fa7e80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.625+0000 7fa803eff700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa7e80a1150 0x7fa7e80a3600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec005950 tx=0x7fa7ec00b410 comp rx=0 tx=0).stop 2023-12-14T14:09:10.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.625+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc1035e0 msgr2=0x7fa7fc0fec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.625+0000 7fa803eff700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc1035e0 0x7fa7fc0fec70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800d950 tx=0x7fa7f800dc60 comp rx=0 tx=0).stop 2023-12-14T14:09:10.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.627+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 shutdown_connections 2023-12-14T14:09:10.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.627+0000 7fa803eff700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa7e80a1150 0x7fa7e80a3600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.627+0000 7fa803eff700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7fc105f00 0x7fa7fc0ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.627+0000 7fa803eff700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7fc100cc0 0x7fa7fc100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.627+0000 7fa803eff700 1 --2- 172.21.15.69:0/2718454394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7fc1035e0 0x7fa7fc0fec70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.627+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 >> 172.21.15.69:0/2718454394 conn(0x7fa7fc0fa740 msgr2=0x7fa7fc101920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:10.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.628+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 shutdown_connections 2023-12-14T14:09:10.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.628+0000 7fa803eff700 1 -- 172.21.15.69:0/2718454394 wait complete. 2023-12-14T14:09:10.628 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 2 and data pool 3 2023-12-14T14:09:10.642 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:09:10.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.763+0000 7f750f597700 1 -- 172.21.15.69:0/995824737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 msgr2=0x7f7508103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.763+0000 7f750f597700 1 --2- 172.21.15.69:0/995824737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 0x7f7508103070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009990 tx=0x7f74f8009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.763+0000 7f750f597700 1 -- 172.21.15.69:0/995824737 shutdown_connections 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.763+0000 7f750f597700 1 --2- 172.21.15.69:0/995824737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7508105ed0 0x7f7508108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.763+0000 7f750f597700 1 --2- 172.21.15.69:0/995824737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 0x7f7508103070 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.763+0000 7f750f597700 1 --2- 172.21.15.69:0/995824737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75081035b0 0x7f7508105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.763+0000 7f750f597700 1 -- 172.21.15.69:0/995824737 >> 172.21.15.69:0/995824737 conn(0x7f75080fa6f0 msgr2=0x7f75080fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.763+0000 7f750f597700 1 -- 172.21.15.69:0/995824737 shutdown_connections 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.763+0000 7f750f597700 1 -- 172.21.15.69:0/995824737 wait complete. 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750f597700 1 Processor -- start 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750f597700 1 -- start start 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750f597700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 0x7f7508100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:10.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750f597700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75081035b0 0x7f75080fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750f597700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508105ed0 0x7f75080ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750f597700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75080ff920 con 0x7f7508100c90 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750f597700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75080ffa90 con 0x7f7508105ed0 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750f597700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75081a0060 con 0x7f75081035b0 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750d333700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 0x7f7508100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750d333700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 0x7f7508100600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47944/0 (socket says 172.21.15.69:47944) 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750d333700 1 -- 172.21.15.69:0/3591010817 learned_addr learned my addr 172.21.15.69:0/3591010817 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750db34700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508105ed0 0x7f75080ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750cb32700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75081035b0 0x7f75080fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750d333700 1 -- 172.21.15.69:0/3591010817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75081035b0 msgr2=0x7f75080fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.764+0000 7f750d333700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75081035b0 0x7f75080fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.765+0000 7f750d333700 1 -- 172.21.15.69:0/3591010817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508105ed0 msgr2=0x7f75080ff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.765+0000 7f750d333700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508105ed0 0x7f75080ff180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.765+0000 7f750d333700 1 -- 172.21.15.69:0/3591010817 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f80095f0 con 0x7f7508100c90 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.765+0000 7f750d333700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 0x7f7508100600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f74f8006010 tx=0x7f74f800f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.765+0000 7f74fe7fc700 1 -- 172.21.15.69:0/3591010817 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f801d070 con 0x7f7508100c90 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.765+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750810bc20 con 0x7f7508100c90 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.765+0000 7f74fe7fc700 1 -- 172.21.15.69:0/3591010817 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74f800fca0 con 0x7f7508100c90 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.765+0000 7f74fe7fc700 1 -- 172.21.15.69:0/3591010817 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f80176e0 con 0x7f7508100c90 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.765+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750810ba90 con 0x7f7508100c90 2023-12-14T14:09:10.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.766+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75080fc260 con 0x7f7508100c90 2023-12-14T14:09:10.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.767+0000 7f74fe7fc700 1 -- 172.21.15.69:0/3591010817 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f74f8017840 con 0x7f7508100c90 2023-12-14T14:09:10.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.767+0000 7f74fe7fc700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f74f40a1150 0x7f74f40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:10.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.767+0000 7f74fe7fc700 1 -- 172.21.15.69:0/3591010817 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f74f80cdec0 con 0x7f7508100c90 2023-12-14T14:09:10.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.767+0000 7f750cb32700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f74f40a1150 0x7f74f40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:10.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.768+0000 7f750cb32700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f74f40a1150 0x7f74f40a3600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7504005fd0 tx=0x7f750400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:10.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.771+0000 7f74fe7fc700 1 -- 172.21.15.69:0/3591010817 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f74f80977f0 con 0x7f7508100c90 2023-12-14T14:09:10.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.964+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f750802cfe0 con 0x7f7508100c90 2023-12-14T14:09:10.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.965+0000 7f74fe7fc700 1 -- 172.21.15.69:0/3591010817 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22109 (secure 0 0 0) 0x7f74f809ae10 con 0x7f7508100c90 2023-12-14T14:09:10.964 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:10.965 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:09:10.597829+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:09:10.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f74f40a1150 msgr2=0x7f74f40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f74f40a1150 0x7f74f40a3600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7504005fd0 tx=0x7f750400a560 comp rx=0 tx=0).stop 2023-12-14T14:09:10.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 msgr2=0x7f7508100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:10.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 0x7f7508100600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f74f8006010 tx=0x7f74f800f7b0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 shutdown_connections 2023-12-14T14:09:10.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f74f40a1150 0x7f74f40a3600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508105ed0 0x7f75080ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7508100c90 0x7f7508100600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 --2- 172.21.15.69:0/3591010817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75081035b0 0x7f75080fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:10.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.967+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 >> 172.21.15.69:0/3591010817 conn(0x7f75080fa6f0 msgr2=0x7f7508101970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:10.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.968+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 shutdown_connections 2023-12-14T14:09:10.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:10.968+0000 7f750f597700 1 -- 172.21.15.69:0/3591010817 wait complete. 2023-12-14T14:09:10.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:10 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/668066515' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-14T14:09:10.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:10 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/668066515' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-14T14:09:10.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:10 smithi069 ceph-mon[42034]: osdmap e80: 12 total, 12 up, 12 in 2023-12-14T14:09:10.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:10 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2718454394' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-14T14:09:10.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:10 smithi069 ceph-mon[42034]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-14T14:09:10.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:10 smithi069 ceph-mon[42034]: osdmap e81: 12 total, 12 up, 12 in 2023-12-14T14:09:10.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:10 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2718454394' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-14T14:09:10.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:10 smithi069 ceph-mon[42034]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-14T14:09:10.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:10 smithi069 ceph-mon[42034]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-14T14:09:10.979 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:09:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.102+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/1136967384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100300 msgr2=0x7f0dc8100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.102+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/1136967384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100300 0x7f0dc8100750 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009990 tx=0x7f0db0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.102+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/1136967384 shutdown_connections 2023-12-14T14:09:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.102+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/1136967384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc8100c90 0x7f0dc8107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.102+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/1136967384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc80ff110 0x7f0dc80ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.102+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/1136967384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100300 0x7f0dc8100750 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.102+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/1136967384 >> 172.21.15.69:0/1136967384 conn(0x7f0dc80fa6f0 msgr2=0x7f0dc80fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.102+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/1136967384 shutdown_connections 2023-12-14T14:09:11.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.102+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/1136967384 wait complete. 2023-12-14T14:09:11.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.103+0000 7f0dcd2fd700 1 Processor -- start 2023-12-14T14:09:11.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.103+0000 7f0dcd2fd700 1 -- start start 2023-12-14T14:09:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.103+0000 7f0dcd2fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc80ff110 0x7f0dc8194ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.103+0000 7f0dcd2fd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc8100300 0x7f0dc8195400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.103+0000 7f0dcd2fd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100c90 0x7f0dc819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.103+0000 7f0dcd2fd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc819ca40 con 0x7f0dc8100c90 2023-12-14T14:09:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.103+0000 7f0dcd2fd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc819cb80 con 0x7f0dc80ff110 2023-12-14T14:09:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.103+0000 7f0dcd2fd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc819cd10 con 0x7f0dc8100300 2023-12-14T14:09:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100c90 0x7f0dc819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100c90 0x7f0dc819c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47968/0 (socket says 172.21.15.69:47968) 2023-12-14T14:09:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc77fe700 1 -- 172.21.15.69:0/3371643067 learned_addr learned my addr 172.21.15.69:0/3371643067 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc67fc700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc8100300 0x7f0dc8195400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc6ffd700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc80ff110 0x7f0dc8194ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc77fe700 1 -- 172.21.15.69:0/3371643067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc8100300 msgr2=0x7f0dc8195400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc77fe700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc8100300 0x7f0dc8195400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc77fe700 1 -- 172.21.15.69:0/3371643067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc80ff110 msgr2=0x7f0dc8194ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc77fe700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc80ff110 0x7f0dc8194ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc77fe700 1 -- 172.21.15.69:0/3371643067 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00095f0 con 0x7f0dc8100c90 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dc77fe700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100c90 0x7f0dc819c470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000d980 tx=0x7f0dc000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dbffff700 1 -- 172.21.15.69:0/3371643067 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0004a30 con 0x7f0dc8100c90 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dbffff700 1 -- 172.21.15.69:0/3371643067 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0dc000b5c0 con 0x7f0dc8100c90 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc810aac0 con 0x7f0dc8100c90 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dbffff700 1 -- 172.21.15.69:0/3371643067 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0009b50 con 0x7f0dc8100c90 2023-12-14T14:09:11.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.104+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc810a930 con 0x7f0dc8100c90 2023-12-14T14:09:11.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.105+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc8106090 con 0x7f0dc8100c90 2023-12-14T14:09:11.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.106+0000 7f0dbffff700 1 -- 172.21.15.69:0/3371643067 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0dc0009cb0 con 0x7f0dc8100c90 2023-12-14T14:09:11.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.107+0000 7f0dbffff700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0db40a1150 0x7f0db40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:11.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.107+0000 7f0dc6ffd700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0db40a1150 0x7f0db40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:11.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.107+0000 7f0dbffff700 1 -- 172.21.15.69:0/3371643067 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0dc00cc6a0 con 0x7f0dc8100c90 2023-12-14T14:09:11.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.107+0000 7f0dc6ffd700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0db40a1150 0x7f0db40a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8100160 tx=0x7f0db8009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:11.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.111+0000 7f0dbffff700 1 -- 172.21.15.69:0/3371643067 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0dc0095ea0 con 0x7f0dc8100c90 2023-12-14T14:09:11.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:10 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/668066515' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-14T14:09:11.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:10 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/668066515' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-14T14:09:11.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:10 smithi081 ceph-mon[43371]: osdmap e80: 12 total, 12 up, 12 in 2023-12-14T14:09:11.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:10 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2718454394' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-14T14:09:11.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:10 smithi081 ceph-mon[43371]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-14T14:09:11.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:10 smithi081 ceph-mon[43371]: osdmap e81: 12 total, 12 up, 12 in 2023-12-14T14:09:11.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:10 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2718454394' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-14T14:09:11.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:10 smithi081 ceph-mon[43371]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-14T14:09:11.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:10 smithi081 ceph-mon[43371]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-14T14:09:11.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:10 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/668066515' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-14T14:09:11.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:10 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/668066515' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-14T14:09:11.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:10 smithi119 ceph-mon[43834]: osdmap e80: 12 total, 12 up, 12 in 2023-12-14T14:09:11.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:10 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2718454394' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-14T14:09:11.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:10 smithi119 ceph-mon[43834]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-14T14:09:11.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:10 smithi119 ceph-mon[43834]: osdmap e81: 12 total, 12 up, 12 in 2023-12-14T14:09:11.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:10 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2718454394' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-14T14:09:11.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:10 smithi119 ceph-mon[43834]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-14T14:09:11.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:10 smithi119 ceph-mon[43834]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-14T14:09:11.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.301+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dc802d030 con 0x7f0dc8100c90 2023-12-14T14:09:11.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.303+0000 7f0dbffff700 1 -- 172.21.15.69:0/3371643067 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22109 (secure 0 0 0) 0x7f0dc00994c0 con 0x7f0dc8100c90 2023-12-14T14:09:11.303 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:11.303 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:09:10.597829+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:09:11.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0db40a1150 msgr2=0x7f0db40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:11.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0db40a1150 0x7f0db40a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8100160 tx=0x7f0db8009040 comp rx=0 tx=0).stop 2023-12-14T14:09:11.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100c90 msgr2=0x7f0dc819c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:11.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100c90 0x7f0dc819c470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000d980 tx=0x7f0dc000dc90 comp rx=0 tx=0).stop 2023-12-14T14:09:11.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 shutdown_connections 2023-12-14T14:09:11.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0db40a1150 0x7f0db40a3600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc8100c90 0x7f0dc819c470 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc80ff110 0x7f0dc8194ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 --2- 172.21.15.69:0/3371643067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc8100300 0x7f0dc8195400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 >> 172.21.15.69:0/3371643067 conn(0x7f0dc80fa6f0 msgr2=0x7f0dc80fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:11.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 shutdown_connections 2023-12-14T14:09:11.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.305+0000 7f0dcd2fd700 1 -- 172.21.15.69:0/3371643067 wait complete. 2023-12-14T14:09:11.317 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-14T14:09:11.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.442+0000 7f6eef371700 1 -- 172.21.15.69:0/3582096861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee80ffa80 msgr2=0x7f6ee80ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:11.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.442+0000 7f6eef371700 1 --2- 172.21.15.69:0/3582096861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee80ffa80 0x7f6ee80ffed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009990 tx=0x7f6ee4009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.442+0000 7f6eef371700 1 -- 172.21.15.69:0/3582096861 shutdown_connections 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.442+0000 7f6eef371700 1 --2- 172.21.15.69:0/3582096861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee8100410 0x7f6ee8106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.442+0000 7f6eef371700 1 --2- 172.21.15.69:0/3582096861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ee80fe890 0x7f6ee80feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.442+0000 7f6eef371700 1 --2- 172.21.15.69:0/3582096861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee80ffa80 0x7f6ee80ffed0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.442+0000 7f6eef371700 1 -- 172.21.15.69:0/3582096861 >> 172.21.15.69:0/3582096861 conn(0x7f6ee80f9ed0 msgr2=0x7f6ee80fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.442+0000 7f6eef371700 1 -- 172.21.15.69:0/3582096861 shutdown_connections 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.442+0000 7f6eef371700 1 -- 172.21.15.69:0/3582096861 wait complete. 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eef371700 1 Processor -- start 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eef371700 1 -- start start 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eef371700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee80fe890 0x7f6ee8195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eef371700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ee80ffa80 0x7f6ee81964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eef371700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee8100410 0x7f6ee819d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eef371700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee819db00 con 0x7f6ee8100410 2023-12-14T14:09:11.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eef371700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee819dc40 con 0x7f6ee80fe890 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eef371700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee819ddd0 con 0x7f6ee80ffa80 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eed90e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee8100410 0x7f6ee819d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eed90e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee8100410 0x7f6ee819d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47998/0 (socket says 172.21.15.69:47998) 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eed90e700 1 -- 172.21.15.69:0/3222266790 learned_addr learned my addr 172.21.15.69:0/3222266790 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eed10d700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee80fe890 0x7f6ee8195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eed90e700 1 -- 172.21.15.69:0/3222266790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ee80ffa80 msgr2=0x7f6ee81964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eed90e700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ee80ffa80 0x7f6ee81964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eed90e700 1 -- 172.21.15.69:0/3222266790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee80fe890 msgr2=0x7f6ee8195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eed90e700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee80fe890 0x7f6ee8195f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.443+0000 7f6eed90e700 1 -- 172.21.15.69:0/3222266790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40095f0 con 0x7f6ee8100410 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.444+0000 7f6eed90e700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee8100410 0x7f6ee819d530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0007d70 tx=0x7f6ee000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.444+0000 7f6ede7fc700 1 -- 172.21.15.69:0/3222266790 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000ad40 con 0x7f6ee8100410 2023-12-14T14:09:11.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.444+0000 7f6ede7fc700 1 -- 172.21.15.69:0/3222266790 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ee00128e0 con 0x7f6ee8100410 2023-12-14T14:09:11.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.444+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee810aad0 con 0x7f6ee8100410 2023-12-14T14:09:11.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.444+0000 7f6ede7fc700 1 -- 172.21.15.69:0/3222266790 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011780 con 0x7f6ee8100410 2023-12-14T14:09:11.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.444+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee810a940 con 0x7f6ee8100410 2023-12-14T14:09:11.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.445+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee819e520 con 0x7f6ee8100410 2023-12-14T14:09:11.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.446+0000 7f6ede7fc700 1 -- 172.21.15.69:0/3222266790 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f6ee0012a50 con 0x7f6ee8100410 2023-12-14T14:09:11.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.446+0000 7f6ede7fc700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ed40a1150 0x7f6ed40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:11.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.446+0000 7f6eed10d700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ed40a1150 0x7f6ed40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:11.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.447+0000 7f6ede7fc700 1 -- 172.21.15.69:0/3222266790 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6ee00ccaf0 con 0x7f6ee8100410 2023-12-14T14:09:11.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.447+0000 7f6eed10d700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ed40a1150 0x7f6ed40a3600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80ff8e0 tx=0x7f6ed8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:11.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.451+0000 7f6ede7fc700 1 -- 172.21.15.69:0/3222266790 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6ee0096390 con 0x7f6ee8100410 2023-12-14T14:09:11.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:11.688+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6ee819ead0 con 0x7f6ee8100410 2023-12-14T14:09:12.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:11 smithi069 ceph-mon[42034]: pgmap v221: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:12.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:11 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3591010817' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:12.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:11 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] up:active 2023-12-14T14:09:12.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:11 smithi069 ceph-mon[42034]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T14:09:12.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:11 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3371643067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:12.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:11 smithi069 ceph-mon[42034]: osdmap e82: 12 total, 12 up, 12 in 2023-12-14T14:09:12.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:11 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3222266790' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-14T14:09:12.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:11 smithi081 ceph-mon[43371]: pgmap v221: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:12.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:11 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3591010817' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:12.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:11 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] up:active 2023-12-14T14:09:12.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:11 smithi081 ceph-mon[43371]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T14:09:12.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:11 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3371643067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:12.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:11 smithi081 ceph-mon[43371]: osdmap e82: 12 total, 12 up, 12 in 2023-12-14T14:09:12.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:11 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3222266790' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-14T14:09:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:11 smithi119 ceph-mon[43834]: pgmap v221: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:09:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:11 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3591010817' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:11 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] up:active 2023-12-14T14:09:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:11 smithi119 ceph-mon[43834]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T14:09:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:11 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3371643067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:12.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:11 smithi119 ceph-mon[43834]: osdmap e82: 12 total, 12 up, 12 in 2023-12-14T14:09:12.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:11 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3222266790' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-14T14:09:12.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.612+0000 7f6ede7fc700 1 -- 172.21.15.69:0/3222266790 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6ee00160b0 con 0x7f6ee8100410 2023-12-14T14:09:12.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ed40a1150 msgr2=0x7f6ed40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ed40a1150 0x7f6ed40a3600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80ff8e0 tx=0x7f6ed8009260 comp rx=0 tx=0).stop 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee8100410 msgr2=0x7f6ee819d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee8100410 0x7f6ee819d530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0007d70 tx=0x7f6ee000a340 comp rx=0 tx=0).stop 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 shutdown_connections 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6ed40a1150 0x7f6ed40a3600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ee8100410 0x7f6ee819d530 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee80fe890 0x7f6ee8195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 --2- 172.21.15.69:0/3222266790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ee80ffa80 0x7f6ee81964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 >> 172.21.15.69:0/3222266790 conn(0x7f6ee80f9ed0 msgr2=0x7f6ee8107600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 shutdown_connections 2023-12-14T14:09:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.615+0000 7f6eef371700 1 -- 172.21.15.69:0/3222266790 wait complete. 2023-12-14T14:09:12.629 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-12-14T14:09:12.629 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-14T14:09:12.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.760+0000 7f9c851d4700 1 -- 172.21.15.69:0/2895275595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c800fe4d0 msgr2=0x7f9c800fe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:12.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.760+0000 7f9c851d4700 1 --2- 172.21.15.69:0/2895275595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c800fe4d0 0x7f9c800fe8e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009990 tx=0x7f9c74009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.760+0000 7f9c851d4700 1 -- 172.21.15.69:0/2895275595 shutdown_connections 2023-12-14T14:09:12.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.760+0000 7f9c851d4700 1 --2- 172.21.15.69:0/2895275595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c80101e30 0x7f9c801086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.760+0000 7f9c851d4700 1 --2- 172.21.15.69:0/2895275595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c800fe4d0 0x7f9c800fe8e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.760+0000 7f9c851d4700 1 --2- 172.21.15.69:0/2895275595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c801014a0 0x7f9c801018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.760+0000 7f9c851d4700 1 -- 172.21.15.69:0/2895275595 >> 172.21.15.69:0/2895275595 conn(0x7f9c800f9ed0 msgr2=0x7f9c800fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:12.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.760+0000 7f9c851d4700 1 -- 172.21.15.69:0/2895275595 shutdown_connections 2023-12-14T14:09:12.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.760+0000 7f9c851d4700 1 -- 172.21.15.69:0/2895275595 wait complete. 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c851d4700 1 Processor -- start 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c851d4700 1 -- start start 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c851d4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c800fe4d0 0x7f9c80195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c851d4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c801014a0 0x7f9c801964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c851d4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80101e30 0x7f9c8019d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c851d4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8019db20 con 0x7f9c801014a0 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c851d4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8019dc60 con 0x7f9c80101e30 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c851d4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8019ddf0 con 0x7f9c800fe4d0 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c801014a0 0x7f9c801964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c801014a0 0x7f9c801964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48016/0 (socket says 172.21.15.69:48016) 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c7e59c700 1 -- 172.21.15.69:0/1152287257 learned_addr learned my addr 172.21.15.69:0/1152287257 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.761+0000 7f9c7f59e700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80101e30 0x7f9c8019d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c7ed9d700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c800fe4d0 0x7f9c80195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c7e59c700 1 -- 172.21.15.69:0/1152287257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c800fe4d0 msgr2=0x7f9c80195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c7e59c700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c800fe4d0 0x7f9c80195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c7e59c700 1 -- 172.21.15.69:0/1152287257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80101e30 msgr2=0x7f9c8019d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c7e59c700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80101e30 0x7f9c8019d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c7e59c700 1 -- 172.21.15.69:0/1152287257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740095f0 con 0x7f9c801014a0 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c7e59c700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c801014a0 0x7f9c801964e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000c9b0 tx=0x7f9c7000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c67fff700 1 -- 172.21.15.69:0/1152287257 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70007b00 con 0x7f9c801014a0 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c67fff700 1 -- 172.21.15.69:0/1152287257 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c70007c60 con 0x7f9c801014a0 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8010bc50 con 0x7f9c801014a0 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c67fff700 1 -- 172.21.15.69:0/1152287257 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70018660 con 0x7f9c801014a0 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.762+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8010bac0 con 0x7f9c801014a0 2023-12-14T14:09:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.763+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8019e540 con 0x7f9c801014a0 2023-12-14T14:09:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.764+0000 7f9c67fff700 1 -- 172.21.15.69:0/1152287257 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9c7000f450 con 0x7f9c801014a0 2023-12-14T14:09:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.765+0000 7f9c67fff700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9c680a1150 0x7f9c680a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.765+0000 7f9c7ed9d700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9c680a1150 0x7f9c680a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.765+0000 7f9c67fff700 1 -- 172.21.15.69:0/1152287257 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9c700cca50 con 0x7f9c801014a0 2023-12-14T14:09:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.765+0000 7f9c7ed9d700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9c680a1150 0x7f9c680a3600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400b5c0 tx=0x7f9c74005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:12.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:12.768+0000 7f9c67fff700 1 -- 172.21.15.69:0/1152287257 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9c70096380 con 0x7f9c801014a0 2023-12-14T14:09:13.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.004+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f9c80107130 con 0x7f9c801014a0 2023-12-14T14:09:13.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.786+0000 7f9c67fff700 1 -- 172.21.15.69:0/1152287257 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v17) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9c700999a0 con 0x7f9c801014a0 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9c680a1150 msgr2=0x7f9c680a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9c680a1150 0x7f9c680a3600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400b5c0 tx=0x7f9c74005fb0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c801014a0 msgr2=0x7f9c801964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c801014a0 0x7f9c801964e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000c9b0 tx=0x7f9c7000ccc0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 shutdown_connections 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9c680a1150 0x7f9c680a3600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80101e30 0x7f9c8019d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c800fe4d0 0x7f9c80195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 --2- 172.21.15.69:0/1152287257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c801014a0 0x7f9c801964e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.789+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 >> 172.21.15.69:0/1152287257 conn(0x7f9c800f9ed0 msgr2=0x7f9c800fc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.790+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 shutdown_connections 2023-12-14T14:09:13.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.790+0000 7f9c851d4700 1 -- 172.21.15.69:0/1152287257 wait complete. 2023-12-14T14:09:13.806 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-12-14T14:09:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:13 smithi081 ceph-mon[43371]: pgmap v223: 97 pgs: 3 creating+peering, 56 active+clean, 38 unknown; 578 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 7 op/s 2023-12-14T14:09:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:13 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3222266790' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-14T14:09:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:13 smithi081 ceph-mon[43371]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T14:09:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:13 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1152287257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-14T14:09:13.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.937+0000 7f256fa2c700 1 -- 172.21.15.69:0/270864709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 msgr2=0x7f2568108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:13.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.937+0000 7f256fa2c700 1 --2- 172.21.15.69:0/270864709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 0x7f2568108360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f256000b0a0 tx=0x7f256000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.937+0000 7f256fa2c700 1 -- 172.21.15.69:0/270864709 shutdown_connections 2023-12-14T14:09:13.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.937+0000 7f256fa2c700 1 --2- 172.21.15.69:0/270864709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 0x7f2568108360 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.937+0000 7f256fa2c700 1 --2- 172.21.15.69:0/270864709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2568100d40 0x7f2568103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.937+0000 7f256fa2c700 1 --2- 172.21.15.69:0/270864709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568103660 0x7f2568105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.937+0000 7f256fa2c700 1 -- 172.21.15.69:0/270864709 >> 172.21.15.69:0/270864709 conn(0x7f25680fa740 msgr2=0x7f25680fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.937+0000 7f256fa2c700 1 -- 172.21.15.69:0/270864709 shutdown_connections 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.937+0000 7f256fa2c700 1 -- 172.21.15.69:0/270864709 wait complete. 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256fa2c700 1 Processor -- start 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256fa2c700 1 -- start start 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256fa2c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100d40 0x7f25681006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256fa2c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2568103660 0x7f25680fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256fa2c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 0x7f25680ff230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256fa2c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680ff9d0 con 0x7f2568105f80 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256fa2c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680ffb40 con 0x7f2568100d40 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256fa2c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25681a0040 con 0x7f2568103660 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256dfc9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 0x7f25680ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256dfc9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 0x7f25680ff230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48040/0 (socket says 172.21.15.69:48040) 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256dfc9700 1 -- 172.21.15.69:0/1137688967 learned_addr learned my addr 172.21.15.69:0/1137688967 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:13.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256d7c8700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100d40 0x7f25681006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256cfc7700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2568103660 0x7f25680fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256dfc9700 1 -- 172.21.15.69:0/1137688967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2568103660 msgr2=0x7f25680fecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256dfc9700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2568103660 0x7f25680fecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256dfc9700 1 -- 172.21.15.69:0/1137688967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100d40 msgr2=0x7f25681006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256dfc9700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100d40 0x7f25681006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256dfc9700 1 -- 172.21.15.69:0/1137688967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009d00 con 0x7f2568105f80 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f256dfc9700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 0x7f25680ff230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f25600062a0 tx=0x7f2560004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.938+0000 7f255e7fc700 1 -- 172.21.15.69:0/1137688967 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e040 con 0x7f2568105f80 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.939+0000 7f255e7fc700 1 -- 172.21.15.69:0/1137688967 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f256000cec0 con 0x7f2568105f80 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.939+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256810bbe0 con 0x7f2568105f80 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.939+0000 7f255e7fc700 1 -- 172.21.15.69:0/1137688967 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560004020 con 0x7f2568105f80 2023-12-14T14:09:13.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.939+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256810ba50 con 0x7f2568105f80 2023-12-14T14:09:13.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.940+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25680fc2b0 con 0x7f2568105f80 2023-12-14T14:09:13.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.940+0000 7f255e7fc700 1 -- 172.21.15.69:0/1137688967 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f256001d690 con 0x7f2568105f80 2023-12-14T14:09:13.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.941+0000 7f255e7fc700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25540a11d0 0x7f25540a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:13.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.941+0000 7f256d7c8700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25540a11d0 0x7f25540a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:13.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.941+0000 7f255e7fc700 1 -- 172.21.15.69:0/1137688967 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f25600cdf20 con 0x7f2568105f80 2023-12-14T14:09:13.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.941+0000 7f256d7c8700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25540a11d0 0x7f25540a3680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f255800ac50 tx=0x7f255800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:13.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:13.945+0000 7f255e7fc700 1 -- 172.21.15.69:0/1137688967 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2560097850 con 0x7f2568105f80 2023-12-14T14:09:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:13 smithi119 ceph-mon[43834]: pgmap v223: 97 pgs: 3 creating+peering, 56 active+clean, 38 unknown; 578 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 7 op/s 2023-12-14T14:09:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:13 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3222266790' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-14T14:09:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:13 smithi119 ceph-mon[43834]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T14:09:14.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:13 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1152287257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-14T14:09:14.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:13 smithi069 ceph-mon[42034]: pgmap v223: 97 pgs: 3 creating+peering, 56 active+clean, 38 unknown; 578 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 7 op/s 2023-12-14T14:09:14.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:13 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3222266790' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-14T14:09:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:13 smithi069 ceph-mon[42034]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T14:09:14.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:13 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1152287257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-14T14:09:14.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.179+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f256802cfe0 con 0x7f2568105f80 2023-12-14T14:09:14.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.794+0000 7f255e7fc700 1 -- 172.21.15.69:0/1137688967 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f256009ae70 con 0x7f2568105f80 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.796+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25540a11d0 msgr2=0x7f25540a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.796+0000 7f256fa2c700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25540a11d0 0x7f25540a3680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f255800ac50 tx=0x7f255800a380 comp rx=0 tx=0).stop 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.796+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 msgr2=0x7f25680ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.796+0000 7f256fa2c700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 0x7f25680ff230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f25600062a0 tx=0x7f2560004d00 comp rx=0 tx=0).stop 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.797+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 shutdown_connections 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.797+0000 7f256fa2c700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25540a11d0 0x7f25540a3680 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.797+0000 7f256fa2c700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568105f80 0x7f25680ff230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.797+0000 7f256fa2c700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100d40 0x7f25681006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.797+0000 7f256fa2c700 1 --2- 172.21.15.69:0/1137688967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2568103660 0x7f25680fecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.797+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 >> 172.21.15.69:0/1137688967 conn(0x7f25680fa740 msgr2=0x7f25681019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:14.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.797+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 shutdown_connections 2023-12-14T14:09:14.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.797+0000 7f256fa2c700 1 -- 172.21.15.69:0/1137688967 wait complete. 2023-12-14T14:09:14.814 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-14T14:09:14.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:14 smithi081 ceph-mon[43371]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-14T14:09:14.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:14 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1152287257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-14T14:09:14.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:14 smithi081 ceph-mon[43371]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-14T14:09:14.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:14 smithi081 ceph-mon[43371]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T14:09:14.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:14 smithi081 ceph-mon[43371]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-12-14T14:09:14.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:14 smithi081 ceph-mon[43371]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-12-14T14:09:14.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:14 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1137688967' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-14T14:09:14.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 -- 172.21.15.69:0/4206868820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 msgr2=0x7f787c108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:14.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 --2- 172.21.15.69:0/4206868820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 0x7f787c108360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f787400b0a0 tx=0x7f787400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 -- 172.21.15.69:0/4206868820 shutdown_connections 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 --2- 172.21.15.69:0/4206868820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 0x7f787c108360 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 --2- 172.21.15.69:0/4206868820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787c100cc0 0x7f787c1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 --2- 172.21.15.69:0/4206868820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f787c1035e0 0x7f787c1059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 -- 172.21.15.69:0/4206868820 >> 172.21.15.69:0/4206868820 conn(0x7f787c0fa740 msgr2=0x7f787c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 -- 172.21.15.69:0/4206868820 shutdown_connections 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 -- 172.21.15.69:0/4206868820 wait complete. 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 Processor -- start 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.945+0000 7f7881b23700 1 -- start start 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7881b23700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787c100cc0 0x7f787c100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7881b23700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f787c1035e0 0x7f787c0fec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7881b23700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 0x7f787c0ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:14.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7881b23700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0ff950 con 0x7f787c105f00 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7881b23700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0ffac0 con 0x7f787c100cc0 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7881b23700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c1a0050 con 0x7f787c1035e0 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 0x7f787c0ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 0x7f787c0ff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48056/0 (socket says 172.21.15.69:48056) 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787bfff700 1 -- 172.21.15.69:0/2316392023 learned_addr learned my addr 172.21.15.69:0/2316392023 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787affd700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f787c1035e0 0x7f787c0fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787b7fe700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787c100cc0 0x7f787c100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787bfff700 1 -- 172.21.15.69:0/2316392023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f787c1035e0 msgr2=0x7f787c0fec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787bfff700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f787c1035e0 0x7f787c0fec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787bfff700 1 -- 172.21.15.69:0/2316392023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787c100cc0 msgr2=0x7f787c100630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787bfff700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787c100cc0 0x7f787c100630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787bfff700 1 -- 172.21.15.69:0/2316392023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874009d00 con 0x7f787c105f00 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f787bfff700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 0x7f787c0ff1b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f787400b070 tx=0x7f7874004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:14.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7878ff9700 1 -- 172.21.15.69:0/2316392023 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787400e040 con 0x7f787c105f00 2023-12-14T14:09:14.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7878ff9700 1 -- 172.21.15.69:0/2316392023 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f787401bd20 con 0x7f787c105f00 2023-12-14T14:09:14.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7878ff9700 1 -- 172.21.15.69:0/2316392023 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874005910 con 0x7f787c105f00 2023-12-14T14:09:14.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c10bba0 con 0x7f787c105f00 2023-12-14T14:09:14.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.946+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c10ba10 con 0x7f787c105f00 2023-12-14T14:09:14.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.947+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c0fc2b0 con 0x7f787c105f00 2023-12-14T14:09:14.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.949+0000 7f7878ff9700 1 -- 172.21.15.69:0/2316392023 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7874005040 con 0x7f787c105f00 2023-12-14T14:09:14.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.949+0000 7f7878ff9700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f78640a1150 0x7f78640a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:14.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.949+0000 7f787b7fe700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f78640a1150 0x7f78640a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:14.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.949+0000 7f7878ff9700 1 -- 172.21.15.69:0/2316392023 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f78740ced60 con 0x7f787c105f00 2023-12-14T14:09:14.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.950+0000 7f787b7fe700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f78640a1150 0x7f78640a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7870005ea0 tx=0x7f7870005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:14.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:14.952+0000 7f7878ff9700 1 -- 172.21.15.69:0/2316392023 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7874098690 con 0x7f787c105f00 2023-12-14T14:09:15.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:14 smithi119 ceph-mon[43834]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-14T14:09:15.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:14 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1152287257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-14T14:09:15.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:14 smithi119 ceph-mon[43834]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-14T14:09:15.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:14 smithi119 ceph-mon[43834]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T14:09:15.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:14 smithi119 ceph-mon[43834]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-12-14T14:09:15.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:14 smithi119 ceph-mon[43834]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-12-14T14:09:15.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:14 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1137688967' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-14T14:09:15.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:14 smithi069 ceph-mon[42034]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-14T14:09:15.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:14 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1152287257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-14T14:09:15.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:14 smithi069 ceph-mon[42034]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-14T14:09:15.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:14 smithi069 ceph-mon[42034]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T14:09:15.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:14 smithi069 ceph-mon[42034]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-12-14T14:09:15.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:14 smithi069 ceph-mon[42034]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-12-14T14:09:15.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:14 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1137688967' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-14T14:09:15.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.188+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f787c067160 con 0x7f787c105f00 2023-12-14T14:09:15.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.801+0000 7f7878ff9700 1 -- 172.21.15.69:0/2316392023 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7874009500 con 0x7f787c105f00 2023-12-14T14:09:15.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.803+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f78640a1150 msgr2=0x7f78640a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.803+0000 7f7881b23700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f78640a1150 0x7f78640a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7870005ea0 tx=0x7f7870005e30 comp rx=0 tx=0).stop 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.803+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 msgr2=0x7f787c0ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.803+0000 7f7881b23700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 0x7f787c0ff1b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f787400b070 tx=0x7f7874004db0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.804+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 shutdown_connections 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.804+0000 7f7881b23700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f78640a1150 0x7f78640a3600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.804+0000 7f7881b23700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f787c105f00 0x7f787c0ff1b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.804+0000 7f7881b23700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787c100cc0 0x7f787c100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.804+0000 7f7881b23700 1 --2- 172.21.15.69:0/2316392023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f787c1035e0 0x7f787c0fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.804+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 >> 172.21.15.69:0/2316392023 conn(0x7f787c0fa740 msgr2=0x7f787c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:15.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.804+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 shutdown_connections 2023-12-14T14:09:15.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.804+0000 7f7881b23700 1 -- 172.21.15.69:0/2316392023 wait complete. 2023-12-14T14:09:15.819 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-12-14T14:09:15.819 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-12-14T14:09:15.898 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-b[68177]: 2023-12-14T14:09:15.633+0000 7fc7431d9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-14T14:09:15.898 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-b[68177]: 2023-12-14T14:09:15.633+0000 7fc7431d9700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-12-14T14:09:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: pgmap v224: 97 pgs: 3 creating+peering, 84 active+clean, 10 unknown; 579 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2023-12-14T14:09:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] up:active 2023-12-14T14:09:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1137688967' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-14T14:09:15.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-14T14:09:15.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-14T14:09:15.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: Cluster is now healthy 2023-12-14T14:09:15.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-12-14T14:09:15.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-12-14T14:09:15.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-12-14T14:09:15.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:15 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2316392023' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-14T14:09:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.953+0000 7ff5baaa9700 1 -- 172.21.15.69:0/2693235040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 msgr2=0x7ff5b4100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.953+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/2693235040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 0x7ff5b4100780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009990 tx=0x7ff5a0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.953+0000 7ff5baaa9700 1 -- 172.21.15.69:0/2693235040 shutdown_connections 2023-12-14T14:09:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.953+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/2693235040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b4100cc0 0x7ff5b4107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.953+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/2693235040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40ff140 0x7ff5b40ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.953+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/2693235040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 0x7ff5b4100780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.953+0000 7ff5baaa9700 1 -- 172.21.15.69:0/2693235040 >> 172.21.15.69:0/2693235040 conn(0x7ff5b40fa780 msgr2=0x7ff5b40fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.953+0000 7ff5baaa9700 1 -- 172.21.15.69:0/2693235040 shutdown_connections 2023-12-14T14:09:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.953+0000 7ff5baaa9700 1 -- 172.21.15.69:0/2693235040 wait complete. 2023-12-14T14:09:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5baaa9700 1 Processor -- start 2023-12-14T14:09:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5baaa9700 1 -- start start 2023-12-14T14:09:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5baaa9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b40ff140 0x7ff5b4069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5baaa9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 0x7ff5b419ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5baaa9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b4100cc0 0x7ff5b419d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5baaa9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b419db60 con 0x7ff5b4100330 2023-12-14T14:09:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5baaa9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b419dcd0 con 0x7ff5b4100cc0 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5baaa9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b419de90 con 0x7ff5b40ff140 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 0x7ff5b419ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 0x7ff5b419ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48082/0 (socket says 172.21.15.69:48082) 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b3fff700 1 -- 172.21.15.69:0/3414713714 learned_addr learned my addr 172.21.15.69:0/3414713714 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b9046700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b4100cc0 0x7ff5b419d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b3fff700 1 -- 172.21.15.69:0/3414713714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b40ff140 msgr2=0x7ff5b4069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b8845700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b40ff140 0x7ff5b4069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b3fff700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b40ff140 0x7ff5b4069b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b3fff700 1 -- 172.21.15.69:0/3414713714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b4100cc0 msgr2=0x7ff5b419d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b3fff700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b4100cc0 0x7ff5b419d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b3fff700 1 -- 172.21.15.69:0/3414713714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00095f0 con 0x7ff5b4100330 2023-12-14T14:09:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.954+0000 7ff5b3fff700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 0x7ff5b419ad80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0005910 tx=0x7ff5a0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.955+0000 7ff5b1ffb700 1 -- 172.21.15.69:0/3414713714 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a001d070 con 0x7ff5b4100330 2023-12-14T14:09:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.955+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b410ab70 con 0x7ff5b4100330 2023-12-14T14:09:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.955+0000 7ff5b1ffb700 1 -- 172.21.15.69:0/3414713714 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5a00041d0 con 0x7ff5b4100330 2023-12-14T14:09:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.955+0000 7ff5b1ffb700 1 -- 172.21.15.69:0/3414713714 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000f460 con 0x7ff5b4100330 2023-12-14T14:09:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.955+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b410a9e0 con 0x7ff5b4100330 2023-12-14T14:09:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.956+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b4067e40 con 0x7ff5b4100330 2023-12-14T14:09:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.957+0000 7ff5b1ffb700 1 -- 172.21.15.69:0/3414713714 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff5a00226e0 con 0x7ff5b4100330 2023-12-14T14:09:15.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.957+0000 7ff5b1ffb700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff5a40a1150 0x7ff5a40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:15.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.958+0000 7ff5b8845700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff5a40a1150 0x7ff5a40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:15.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.958+0000 7ff5b1ffb700 1 -- 172.21.15.69:0/3414713714 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff5a00cde90 con 0x7ff5b4100330 2023-12-14T14:09:15.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.958+0000 7ff5b8845700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff5a40a1150 0x7ff5a40a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4100190 tx=0x7ff5a8005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:15.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:15.961+0000 7ff5b1ffb700 1 -- 172.21.15.69:0/3414713714 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff5a0097720 con 0x7ff5b4100330 2023-12-14T14:09:16.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: pgmap v224: 97 pgs: 3 creating+peering, 84 active+clean, 10 unknown; 579 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2023-12-14T14:09:16.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] up:active 2023-12-14T14:09:16.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1137688967' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-14T14:09:16.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-14T14:09:16.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-14T14:09:16.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: Cluster is now healthy 2023-12-14T14:09:16.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-12-14T14:09:16.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-12-14T14:09:16.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-12-14T14:09:16.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:15 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2316392023' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-14T14:09:16.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.182+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5b4060f30 con 0x7ff5a40a1150 2023-12-14T14:09:16.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.223+0000 7ff5b1ffb700 1 -- 172.21.15.69:0/3414713714 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff5b4060f30 con 0x7ff5a40a1150 2023-12-14T14:09:16.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff5a40a1150 msgr2=0x7ff5a40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff5a40a1150 0x7ff5a40a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4100190 tx=0x7ff5a8005cf0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 msgr2=0x7ff5b419ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 0x7ff5b419ad80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0005910 tx=0x7ff5a0009f90 comp rx=0 tx=0).stop 2023-12-14T14:09:16.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 shutdown_connections 2023-12-14T14:09:16.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff5a40a1150 0x7ff5a40a3600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b4100cc0 0x7ff5b419d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b40ff140 0x7ff5b4069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 --2- 172.21.15.69:0/3414713714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b4100330 0x7ff5b419ad80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 >> 172.21.15.69:0/3414713714 conn(0x7ff5b40fa780 msgr2=0x7ff5b40fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:16.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 shutdown_connections 2023-12-14T14:09:16.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.225+0000 7ff5baaa9700 1 -- 172.21.15.69:0/3414713714 wait complete. 2023-12-14T14:09:16.237 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: pgmap v224: 97 pgs: 3 creating+peering, 84 active+clean, 10 unknown; 579 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] up:active 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1137688967' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: Cluster is now healthy 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-12-14T14:09:16.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:15 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2316392023' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-14T14:09:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 -- 172.21.15.69:0/1147142503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab00ffaa0 msgr2=0x7ffab00fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1147142503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab00ffaa0 0x7ffab00fff10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400b0a0 tx=0x7ffaa400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 -- 172.21.15.69:0/1147142503 shutdown_connections 2023-12-14T14:09:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1147142503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab0100450 0x7ffab0106cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1147142503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab00fe9f0 0x7ffab00fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1147142503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab00ffaa0 0x7ffab00fff10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 -- 172.21.15.69:0/1147142503 >> 172.21.15.69:0/1147142503 conn(0x7ffab00f9a70 msgr2=0x7ffab00fbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 -- 172.21.15.69:0/1147142503 shutdown_connections 2023-12-14T14:09:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 -- 172.21.15.69:0/1147142503 wait complete. 2023-12-14T14:09:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.364+0000 7ffab52c2700 1 Processor -- start 2023-12-14T14:09:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffab52c2700 1 -- start start 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffab52c2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00fe9f0 0x7ffab0196100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffab52c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab00ffaa0 0x7ffab0196640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffab52c2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0100450 0x7ffab019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffab52c2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab019dc80 con 0x7ffab0100450 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffab52c2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab019ddc0 con 0x7ffab00ffaa0 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffab52c2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab019df50 con 0x7ffab00fe9f0 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0100450 0x7ffab019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0100450 0x7ffab019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40268/0 (socket says 172.21.15.69:40268) 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaf7fe700 1 -- 172.21.15.69:0/1776670243 learned_addr learned my addr 172.21.15.69:0/1776670243 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaae7fc700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab00ffaa0 0x7ffab0196640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaeffd700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00fe9f0 0x7ffab0196100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaf7fe700 1 -- 172.21.15.69:0/1776670243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00fe9f0 msgr2=0x7ffab0196100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaf7fe700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00fe9f0 0x7ffab0196100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaf7fe700 1 -- 172.21.15.69:0/1776670243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab00ffaa0 msgr2=0x7ffab0196640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaf7fe700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab00ffaa0 0x7ffab0196640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaf7fe700 1 -- 172.21.15.69:0/1776670243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4009d00 con 0x7ffab0100450 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaae7fc700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab00ffaa0 0x7ffab0196640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffaaf7fe700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0100450 0x7ffab019d6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ea50 tx=0x7ffaa000ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.365+0000 7ffa97fff700 1 -- 172.21.15.69:0/1776670243 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000cb90 con 0x7ffab0100450 2023-12-14T14:09:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.366+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab0109950 con 0x7ffab0100450 2023-12-14T14:09:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.366+0000 7ffa97fff700 1 -- 172.21.15.69:0/1776670243 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffaa000ccf0 con 0x7ffab0100450 2023-12-14T14:09:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.366+0000 7ffa97fff700 1 -- 172.21.15.69:0/1776670243 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0017470 con 0x7ffab0100450 2023-12-14T14:09:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.366+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab01097c0 con 0x7ffab0100450 2023-12-14T14:09:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.366+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab019e650 con 0x7ffab0100450 2023-12-14T14:09:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.367+0000 7ffa97fff700 1 -- 172.21.15.69:0/1776670243 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ffaa0004750 con 0x7ffab0100450 2023-12-14T14:09:16.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.368+0000 7ffa97fff700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffa980a1150 0x7ffa980a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:16.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.368+0000 7ffaaeffd700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffa980a1150 0x7ffa980a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:16.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.368+0000 7ffa97fff700 1 -- 172.21.15.69:0/1776670243 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ffaa00ccd60 con 0x7ffab0100450 2023-12-14T14:09:16.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.368+0000 7ffaaeffd700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffa980a1150 0x7ffa980a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005950 tx=0x7ffaa80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:16.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.372+0000 7ffa97fff700 1 -- 172.21.15.69:0/1776670243 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ffaa0096600 con 0x7ffab0100450 2023-12-14T14:09:16.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:09:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:09:16.187+0000 7fcc2ec55700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:09:16.586 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:09:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:09:16.187+0000 7fcc2ec55700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:09:16.586 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:09:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:09:16.187+0000 7fcc2ec55700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:09:16.586 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:09:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:09:16.187+0000 7fcc2ec55700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:09:16.586 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:09:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:09:16.187+0000 7fcc2ec55700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:09:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.594+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7ffab019ec00 con 0x7ffa980a1150 2023-12-14T14:09:16.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.598+0000 7ffa97fff700 1 -- 172.21.15.69:0/1776670243 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7ffab019ec00 con 0x7ffa980a1150 2023-12-14T14:09:16.597 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/_nogroup/sv_0/c9e27e80-289a-48cd-88a8-96cafec8bb8f 2023-12-14T14:09:16.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffa980a1150 msgr2=0x7ffa980a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffa980a1150 0x7ffa980a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005950 tx=0x7ffaa80058e0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0100450 msgr2=0x7ffab019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0100450 0x7ffab019d6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ea50 tx=0x7ffaa000ee10 comp rx=0 tx=0).stop 2023-12-14T14:09:16.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 shutdown_connections 2023-12-14T14:09:16.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffa980a1150 0x7ffa980a3600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0100450 0x7ffab019d6b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00fe9f0 0x7ffab0196100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 --2- 172.21.15.69:0/1776670243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab00ffaa0 0x7ffab0196640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 >> 172.21.15.69:0/1776670243 conn(0x7ffab00f9a70 msgr2=0x7ffab00fbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:16.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 shutdown_connections 2023-12-14T14:09:16.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.600+0000 7ffab52c2700 1 -- 172.21.15.69:0/1776670243 wait complete. 2023-12-14T14:09:16.612 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-12-14T14:09:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 -- 172.21.15.69:0/3767541314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc0fe4d0 msgr2=0x7f4dbc0fe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 --2- 172.21.15.69:0/3767541314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc0fe4d0 0x7f4dbc0fe8e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009990 tx=0x7f4dac009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 -- 172.21.15.69:0/3767541314 shutdown_connections 2023-12-14T14:09:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 --2- 172.21.15.69:0/3767541314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dbc101e30 0x7f4dbc1086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 --2- 172.21.15.69:0/3767541314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc0fe4d0 0x7f4dbc0fe8e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 --2- 172.21.15.69:0/3767541314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dbc1014a0 0x7f4dbc1018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 -- 172.21.15.69:0/3767541314 >> 172.21.15.69:0/3767541314 conn(0x7f4dbc0f9ed0 msgr2=0x7f4dbc0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 -- 172.21.15.69:0/3767541314 shutdown_connections 2023-12-14T14:09:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 -- 172.21.15.69:0/3767541314 wait complete. 2023-12-14T14:09:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.739+0000 7f4dc376e700 1 Processor -- start 2023-12-14T14:09:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc376e700 1 -- start start 2023-12-14T14:09:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc376e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dbc0fe4d0 0x7f4dbc195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc376e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dbc1014a0 0x7f4dbc196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc376e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc101e30 0x7f4dbc19d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc376e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc19db40 con 0x7f4dbc101e30 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc376e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc19dc80 con 0x7f4dbc1014a0 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc376e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc19de10 con 0x7f4dbc0fe4d0 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc1d0b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc101e30 0x7f4dbc19d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc1d0b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc101e30 0x7f4dbc19d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40292/0 (socket says 172.21.15.69:40292) 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc1d0b700 1 -- 172.21.15.69:0/865921833 learned_addr learned my addr 172.21.15.69:0/865921833 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc0d09700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dbc1014a0 0x7f4dbc196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc150a700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dbc0fe4d0 0x7f4dbc195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc1d0b700 1 -- 172.21.15.69:0/865921833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dbc0fe4d0 msgr2=0x7f4dbc195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc1d0b700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dbc0fe4d0 0x7f4dbc195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc1d0b700 1 -- 172.21.15.69:0/865921833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dbc1014a0 msgr2=0x7f4dbc196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc1d0b700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dbc1014a0 0x7f4dbc196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc1d0b700 1 -- 172.21.15.69:0/865921833 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0095f0 con 0x7f4dbc101e30 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc1d0b700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc101e30 0x7f4dbc19d570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4db400ada0 tx=0x7f4db400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4db27fc700 1 -- 172.21.15.69:0/865921833 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400f070 con 0x7f4dbc101e30 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc10bb80 con 0x7f4dbc101e30 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.740+0000 7f4db27fc700 1 -- 172.21.15.69:0/865921833 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4db4007b30 con 0x7f4dbc101e30 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.741+0000 7f4db27fc700 1 -- 172.21.15.69:0/865921833 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40053e0 con 0x7f4dbc101e30 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.741+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc10b9f0 con 0x7f4dbc101e30 2023-12-14T14:09:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.741+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc107260 con 0x7f4dbc101e30 2023-12-14T14:09:16.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.743+0000 7f4db27fc700 1 -- 172.21.15.69:0/865921833 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4db400c980 con 0x7f4dbc101e30 2023-12-14T14:09:16.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.744+0000 7f4db27fc700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4da80a1150 0x7f4da80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:16.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.744+0000 7f4dc150a700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4da80a1150 0x7f4da80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:16.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.744+0000 7f4db27fc700 1 -- 172.21.15.69:0/865921833 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4db40cc490 con 0x7f4dbc101e30 2023-12-14T14:09:16.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.744+0000 7f4dc150a700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4da80a1150 0x7f4da80a3600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4dac006010 tx=0x7f4dac00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:16.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.747+0000 7f4db27fc700 1 -- 172.21.15.69:0/865921833 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4db4095d20 con 0x7f4dbc101e30 2023-12-14T14:09:16.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.967+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dbc061c00 con 0x7f4da80a1150 2023-12-14T14:09:16.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.989+0000 7f4db27fc700 1 -- 172.21.15.69:0/865921833 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4dbc061c00 con 0x7f4da80a1150 2023-12-14T14:09:16.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4da80a1150 msgr2=0x7f4da80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4da80a1150 0x7f4da80a3600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4dac006010 tx=0x7f4dac00b540 comp rx=0 tx=0).stop 2023-12-14T14:09:16.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc101e30 msgr2=0x7f4dbc19d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:16.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc101e30 0x7f4dbc19d570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4db400ada0 tx=0x7f4db400c330 comp rx=0 tx=0).stop 2023-12-14T14:09:16.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 shutdown_connections 2023-12-14T14:09:16.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4da80a1150 0x7f4da80a3600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4dbc101e30 0x7f4dbc19d570 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dbc0fe4d0 0x7f4dbc195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 --2- 172.21.15.69:0/865921833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dbc1014a0 0x7f4dbc196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:16.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 >> 172.21.15.69:0/865921833 conn(0x7f4dbc0f9ed0 msgr2=0x7f4dbc0fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:16.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 shutdown_connections 2023-12-14T14:09:16.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:16.992+0000 7f4dc376e700 1 -- 172.21.15.69:0/865921833 wait complete. 2023-12-14T14:09:17.002 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:16 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] up:active 2023-12-14T14:09:17.002 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:16 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2316392023' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-14T14:09:17.002 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:16 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-12-14T14:09:17.002 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:16 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:09:17.003 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-12-14T14:09:17.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.129+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3327812550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ff370 msgr2=0x7f5a540ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.129+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3327812550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ff370 0x7f5a540ff7e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009990 tx=0x7f5a50009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.129+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3327812550 shutdown_connections 2023-12-14T14:09:17.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.129+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3327812550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a540ffd20 0x7f5a541075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.129+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3327812550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a54100720 0x7f5a54100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.129+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3327812550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ff370 0x7f5a540ff7e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.129+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3327812550 >> 172.21.15.69:0/3327812550 conn(0x7f5a540f9ed0 msgr2=0x7f5a540fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.129+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3327812550 shutdown_connections 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.129+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3327812550 wait complete. 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5bcb4700 1 Processor -- start 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5bcb4700 1 -- start start 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5bcb4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a540ff370 0x7f5a54195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5bcb4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ffd20 0x7f5a54196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5bcb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a54100720 0x7f5a5419d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5bcb4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5419da90 con 0x7f5a540ffd20 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5bcb4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5419dbd0 con 0x7f5a54100720 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5bcb4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5419dd60 con 0x7f5a540ff370 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5924f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ffd20 0x7f5a54196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5924f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ffd20 0x7f5a54196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40316/0 (socket says 172.21.15.69:40316) 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5924f700 1 -- 172.21.15.69:0/3775679701 learned_addr learned my addr 172.21.15.69:0/3775679701 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5a251700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a54100720 0x7f5a5419d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5924f700 1 -- 172.21.15.69:0/3775679701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a540ff370 msgr2=0x7f5a54195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5924f700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a540ff370 0x7f5a54195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5924f700 1 -- 172.21.15.69:0/3775679701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a54100720 msgr2=0x7f5a5419d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5924f700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a54100720 0x7f5a5419d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.130+0000 7f5a5924f700 1 -- 172.21.15.69:0/3775679701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a500095f0 con 0x7f5a540ffd20 2023-12-14T14:09:17.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.131+0000 7f5a5924f700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ffd20 0x7f5a54196450 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5a50000c00 tx=0x7f5a5000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:17.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.131+0000 7f5a4affd700 1 -- 172.21.15.69:0/3775679701 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5001d070 con 0x7f5a540ffd20 2023-12-14T14:09:17.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.131+0000 7f5a4affd700 1 -- 172.21.15.69:0/3775679701 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a5000fc30 con 0x7f5a540ffd20 2023-12-14T14:09:17.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.131+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5410aaf0 con 0x7f5a540ffd20 2023-12-14T14:09:17.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.131+0000 7f5a4affd700 1 -- 172.21.15.69:0/3775679701 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50017770 con 0x7f5a540ffd20 2023-12-14T14:09:17.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.131+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5410a960 con 0x7f5a540ffd20 2023-12-14T14:09:17.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.132+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5419e270 con 0x7f5a540ffd20 2023-12-14T14:09:17.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.133+0000 7f5a4affd700 1 -- 172.21.15.69:0/3775679701 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f5a50022a30 con 0x7f5a540ffd20 2023-12-14T14:09:17.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.133+0000 7f5a4affd700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5a400a1150 0x7f5a400a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.134+0000 7f5a59a50700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5a400a1150 0x7f5a400a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.134+0000 7f5a4affd700 1 -- 172.21.15.69:0/3775679701 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5a500cdc20 con 0x7f5a540ffd20 2023-12-14T14:09:17.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.134+0000 7f5a59a50700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5a400a1150 0x7f5a400a3600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5a54067bb0 tx=0x7f5a44005ca0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:17.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.138+0000 7f5a4affd700 1 -- 172.21.15.69:0/3775679701 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5a50097550 con 0x7f5a540ffd20 2023-12-14T14:09:17.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:16 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] up:active 2023-12-14T14:09:17.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:16 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2316392023' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-14T14:09:17.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:16 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-12-14T14:09:17.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:16 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:09:17.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.256+0000 7f5a4affd700 1 -- 172.21.15.69:0/3775679701 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5a50097920 con 0x7f5a540ffd20 2023-12-14T14:09:17.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:16 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] up:active 2023-12-14T14:09:17.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:16 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2316392023' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-14T14:09:17.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:16 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-12-14T14:09:17.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:16 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:09:17.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.368+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a5419e820 con 0x7f5a400a1150 2023-12-14T14:09:17.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.371+0000 7f5a4affd700 1 -- 172.21.15.69:0/3775679701 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f5a5419e820 con 0x7f5a400a1150 2023-12-14T14:09:17.371 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/_nogroup/sv_1/59bb03c0-a245-4660-a310-b0f548fdcdde 2023-12-14T14:09:17.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5a400a1150 msgr2=0x7f5a400a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5a400a1150 0x7f5a400a3600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5a54067bb0 tx=0x7f5a44005ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ffd20 msgr2=0x7f5a54196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ffd20 0x7f5a54196450 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5a50000c00 tx=0x7f5a5000f790 comp rx=0 tx=0).stop 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 shutdown_connections 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5a400a1150 0x7f5a400a3600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a54100720 0x7f5a5419d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a540ff370 0x7f5a54195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 --2- 172.21.15.69:0/3775679701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a540ffd20 0x7f5a54196450 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 >> 172.21.15.69:0/3775679701 conn(0x7f5a540f9ed0 msgr2=0x7f5a540fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:17.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 shutdown_connections 2023-12-14T14:09:17.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.374+0000 7f5a5bcb4700 1 -- 172.21.15.69:0/3775679701 wait complete. 2023-12-14T14:09:17.385 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:09:17.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 -- 172.21.15.69:0/2318836828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ffe00 msgr2=0x7f8a80100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 --2- 172.21.15.69:0/2318836828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ffe00 0x7f8a80100270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800b0a0 tx=0x7f8a7800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 -- 172.21.15.69:0/2318836828 shutdown_connections 2023-12-14T14:09:17.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 --2- 172.21.15.69:0/2318836828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ffe00 0x7f8a80100270 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 --2- 172.21.15.69:0/2318836828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a800feb00 0x7f8a800fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 --2- 172.21.15.69:0/2318836828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a800ff450 0x7f8a800ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 -- 172.21.15.69:0/2318836828 >> 172.21.15.69:0/2318836828 conn(0x7f8a800fa6f0 msgr2=0x7f8a800fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 -- 172.21.15.69:0/2318836828 shutdown_connections 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 -- 172.21.15.69:0/2318836828 wait complete. 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.508+0000 7f8a85386700 1 Processor -- start 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a85386700 1 -- start start 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a85386700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a800feb00 0x7f8a801982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a85386700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ff450 0x7f8a801987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a85386700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a800ffe00 0x7f8a8019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a85386700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8019fe20 con 0x7f8a800ff450 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a85386700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8019ff60 con 0x7f8a800feb00 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a85386700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a801a00f0 con 0x7f8a800ffe00 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ff450 0x7f8a801987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ff450 0x7f8a801987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40332/0 (socket says 172.21.15.69:40332) 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7e7fc700 1 -- 172.21.15.69:0/10773743 learned_addr learned my addr 172.21.15.69:0/10773743 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7effd700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a800feb00 0x7f8a801982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7f7fe700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a800ffe00 0x7f8a8019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7e7fc700 1 -- 172.21.15.69:0/10773743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a800ffe00 msgr2=0x7f8a8019f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7e7fc700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a800ffe00 0x7f8a8019f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7e7fc700 1 -- 172.21.15.69:0/10773743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a800feb00 msgr2=0x7f8a801982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7e7fc700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a800feb00 0x7f8a801982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7e7fc700 1 -- 172.21.15.69:0/10773743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a78009d00 con 0x7f8a800ff450 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a7e7fc700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ff450 0x7f8a801987e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000d950 tx=0x7f8a7000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a67fff700 1 -- 172.21.15.69:0/10773743 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000f890 con 0x7f8a800ff450 2023-12-14T14:09:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.509+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8010dd70 con 0x7f8a800ff450 2023-12-14T14:09:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.510+0000 7f8a67fff700 1 -- 172.21.15.69:0/10773743 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a70010460 con 0x7f8a800ff450 2023-12-14T14:09:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.510+0000 7f8a67fff700 1 -- 172.21.15.69:0/10773743 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000e610 con 0x7f8a800ff450 2023-12-14T14:09:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.510+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8010dbe0 con 0x7f8a800ff450 2023-12-14T14:09:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.510+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a801098e0 con 0x7f8a800ff450 2023-12-14T14:09:17.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.512+0000 7f8a67fff700 1 -- 172.21.15.69:0/10773743 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8a700108d0 con 0x7f8a800ff450 2023-12-14T14:09:17.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.512+0000 7f8a67fff700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a680a11e0 0x7f8a680a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.512+0000 7f8a7effd700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a680a11e0 0x7f8a680a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.513+0000 7f8a67fff700 1 -- 172.21.15.69:0/10773743 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8a700cc730 con 0x7f8a800ff450 2023-12-14T14:09:17.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.513+0000 7f8a7effd700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a680a11e0 0x7f8a680a3690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a74005950 tx=0x7f8a7400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:17.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.516+0000 7f8a67fff700 1 -- 172.21.15.69:0/10773743 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8a70095e50 con 0x7f8a800ff450 2023-12-14T14:09:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.747+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a80061700 con 0x7f8a800ff450 2023-12-14T14:09:17.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.748+0000 7f8a67fff700 1 -- 172.21.15.69:0/10773743 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f8a70016090 con 0x7f8a800ff450 2023-12-14T14:09:17.748 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:17.748 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:09:17.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.750+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a680a11e0 msgr2=0x7f8a680a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.750+0000 7f8a85386700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a680a11e0 0x7f8a680a3690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a74005950 tx=0x7f8a7400b410 comp rx=0 tx=0).stop 2023-12-14T14:09:17.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.750+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ff450 msgr2=0x7f8a801987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.750+0000 7f8a85386700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ff450 0x7f8a801987e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000d950 tx=0x7f8a7000dc60 comp rx=0 tx=0).stop 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.750+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 shutdown_connections 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.751+0000 7f8a85386700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a680a11e0 0x7f8a680a3690 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.751+0000 7f8a85386700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a800ffe00 0x7f8a8019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.751+0000 7f8a85386700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a800feb00 0x7f8a801982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.751+0000 7f8a85386700 1 --2- 172.21.15.69:0/10773743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a800ff450 0x7f8a801987e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.751+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 >> 172.21.15.69:0/10773743 conn(0x7f8a800fa6f0 msgr2=0x7f8a800fc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.751+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 shutdown_connections 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.751+0000 7f8a85386700 1 -- 172.21.15.69:0/10773743 wait complete. 2023-12-14T14:09:17.751 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:09:17.763 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:09:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 -- 172.21.15.69:0/74216374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa40ff110 msgr2=0x7f2fa40ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 --2- 172.21.15.69:0/74216374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa40ff110 0x7f2fa40ff520 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00b0a0 tx=0x7f2f9c00b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 -- 172.21.15.69:0/74216374 shutdown_connections 2023-12-14T14:09:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 --2- 172.21.15.69:0/74216374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa4100c90 0x7f2fa4107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 --2- 172.21.15.69:0/74216374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa40ff110 0x7f2fa40ff520 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 --2- 172.21.15.69:0/74216374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa4100300 0x7f2fa4100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 -- 172.21.15.69:0/74216374 >> 172.21.15.69:0/74216374 conn(0x7f2fa40fa6f0 msgr2=0x7f2fa40fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 -- 172.21.15.69:0/74216374 shutdown_connections 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 -- 172.21.15.69:0/74216374 wait complete. 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 Processor -- start 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.886+0000 7f2fac446700 1 -- start start 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2fac446700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa40ff110 0x7f2fa4109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2fac446700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa4100300 0x7f2fa4108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2fac446700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa4100c90 0x7f2fa4108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2fac446700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4108d20 con 0x7f2fa4100c90 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2fac446700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4108e90 con 0x7f2fa4100300 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2fac446700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa41a01c0 con 0x7f2fa40ff110 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa9e3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa4100c90 0x7f2fa4108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa9e3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa4100c90 0x7f2fa4108580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40358/0 (socket says 172.21.15.69:40358) 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa9e3700 1 -- 172.21.15.69:0/3028790495 learned_addr learned my addr 172.21.15.69:0/3028790495 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa1e2700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa40ff110 0x7f2fa4109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2fa99e1700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa4100300 0x7f2fa4108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa9e3700 1 -- 172.21.15.69:0/3028790495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa40ff110 msgr2=0x7f2fa4109a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa9e3700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa40ff110 0x7f2fa4109a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa9e3700 1 -- 172.21.15.69:0/3028790495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa4100300 msgr2=0x7f2fa4108040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa9e3700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa4100300 0x7f2fa4108040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa9e3700 1 -- 172.21.15.69:0/3028790495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c009d00 con 0x7f2fa4100c90 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa1e2700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa40ff110 0x7f2fa4109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2faa9e3700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa4100c90 0x7f2fa4108580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000c900 tx=0x7f2fa000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2f9b7fe700 1 -- 172.21.15.69:0/3028790495 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0007b00 con 0x7f2fa4100c90 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa410bca0 con 0x7f2fa4100c90 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2f9b7fe700 1 -- 172.21.15.69:0/3028790495 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fa0007c60 con 0x7f2fa4100c90 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2f9b7fe700 1 -- 172.21.15.69:0/3028790495 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0018660 con 0x7f2fa4100c90 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.887+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa410bb10 con 0x7f2fa4100c90 2023-12-14T14:09:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.888+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa4105ff0 con 0x7f2fa4100c90 2023-12-14T14:09:17.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.889+0000 7f2f9b7fe700 1 -- 172.21.15.69:0/3028790495 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f2fa000f450 con 0x7f2fa4100c90 2023-12-14T14:09:17.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.890+0000 7f2f9b7fe700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2f900a11e0 0x7f2f900a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:17.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.890+0000 7f2faa1e2700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2f900a11e0 0x7f2f900a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:17.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.890+0000 7f2f9b7fe700 1 -- 172.21.15.69:0/3028790495 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2fa00cc8c0 con 0x7f2fa4100c90 2023-12-14T14:09:17.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.891+0000 7f2faa1e2700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2f900a11e0 0x7f2f900a3690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c007a60 tx=0x7f2f9c006000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:17.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:17.895+0000 7f2f9b7fe700 1 -- 172.21.15.69:0/3028790495 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2fa0096060 con 0x7f2fa4100c90 2023-12-14T14:09:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.085+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fa402cfe0 con 0x7f2fa4100c90 2023-12-14T14:09:18.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:17 smithi069 ceph-mon[42034]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:18.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:17 smithi069 ceph-mon[42034]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:18.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:17 smithi069 ceph-mon[42034]: pgmap v225: 97 pgs: 97 active+clean; 597 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 8.3 KiB/s wr, 16 op/s 2023-12-14T14:09:18.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:17 smithi069 ceph-mon[42034]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:18.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:17 smithi069 ceph-mon[42034]: mgrmap e17: x(active, since 5m), standbys: z, y 2023-12-14T14:09:18.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:17 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/10773743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.087+0000 7f2f9b7fe700 1 -- 172.21.15.69:0/3028790495 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22096 (secure 0 0 0) 0x7f2fa0099680 con 0x7f2fa4100c90 2023-12-14T14:09:18.087 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:18.087 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":82,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:09:11.600086+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:09:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2f900a11e0 msgr2=0x7f2f900a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2f900a11e0 0x7f2f900a3690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c007a60 tx=0x7f2f9c006000 comp rx=0 tx=0).stop 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa4100c90 msgr2=0x7f2fa4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa4100c90 0x7f2fa4108580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000c900 tx=0x7f2fa000ccc0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 shutdown_connections 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f2f900a11e0 0x7f2f900a3690 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa4100c90 0x7f2fa4108580 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa40ff110 0x7f2fa4109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 --2- 172.21.15.69:0/3028790495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa4100300 0x7f2fa4108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.089+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 >> 172.21.15.69:0/3028790495 conn(0x7f2fa40fa6f0 msgr2=0x7f2fa40fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.090+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 shutdown_connections 2023-12-14T14:09:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.090+0000 7f2fac446700 1 -- 172.21.15.69:0/3028790495 wait complete. 2023-12-14T14:09:18.101 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-14T14:09:18.102 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T14:09:18.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:17 smithi081 ceph-mon[43371]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:18.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:17 smithi081 ceph-mon[43371]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:18.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:17 smithi081 ceph-mon[43371]: pgmap v225: 97 pgs: 97 active+clean; 597 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 8.3 KiB/s wr, 16 op/s 2023-12-14T14:09:18.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:17 smithi081 ceph-mon[43371]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:18.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:17 smithi081 ceph-mon[43371]: mgrmap e17: x(active, since 5m), standbys: z, y 2023-12-14T14:09:18.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:17 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/10773743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:18.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 -- 172.21.15.69:0/2042949284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101430 msgr2=0x7fdcd4101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 --2- 172.21.15.69:0/2042949284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101430 0x7fdcd4101880 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009990 tx=0x7fdcc4009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 -- 172.21.15.69:0/2042949284 shutdown_connections 2023-12-14T14:09:18.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 --2- 172.21.15.69:0/2042949284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd4101dc0 0x7fdcd4108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 --2- 172.21.15.69:0/2042949284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd4100240 0x7fdcd4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 --2- 172.21.15.69:0/2042949284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101430 0x7fdcd4101880 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 -- 172.21.15.69:0/2042949284 >> 172.21.15.69:0/2042949284 conn(0x7fdcd40fb820 msgr2=0x7fdcd40fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:18.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 -- 172.21.15.69:0/2042949284 shutdown_connections 2023-12-14T14:09:18.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 -- 172.21.15.69:0/2042949284 wait complete. 2023-12-14T14:09:18.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.226+0000 7fdcd9417700 1 Processor -- start 2023-12-14T14:09:18.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd9417700 1 -- start start 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd9417700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd4100240 0x7fdcd40748a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd9417700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd4101430 0x7fdcd4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd9417700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101dc0 0x7fdcd4073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd9417700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4073bc0 con 0x7fdcd4101dc0 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd9417700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4073d30 con 0x7fdcd4101430 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd9417700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41a0070 con 0x7fdcd4100240 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101dc0 0x7fdcd4073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101dc0 0x7fdcd4073420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40382/0 (socket says 172.21.15.69:40382) 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd37fe700 1 -- 172.21.15.69:0/878061439 learned_addr learned my addr 172.21.15.69:0/878061439 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:18.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd27fc700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd4101430 0x7fdcd4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd2ffd700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd4100240 0x7fdcd40748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd37fe700 1 -- 172.21.15.69:0/878061439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd4100240 msgr2=0x7fdcd40748a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd37fe700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd4100240 0x7fdcd40748a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd37fe700 1 -- 172.21.15.69:0/878061439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd4101430 msgr2=0x7fdcd4072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd37fe700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd4101430 0x7fdcd4072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd37fe700 1 -- 172.21.15.69:0/878061439 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40095f0 con 0x7fdcd4101dc0 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd37fe700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101dc0 0x7fdcd4073420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdccc007ee0 tx=0x7fdccc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcbbfff700 1 -- 172.21.15.69:0/878061439 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc00ddd0 con 0x7fdcd4101dc0 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd410bc00 con 0x7fdcd4101dc0 2023-12-14T14:09:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcbbfff700 1 -- 172.21.15.69:0/878061439 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdccc00f040 con 0x7fdcd4101dc0 2023-12-14T14:09:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.227+0000 7fdcbbfff700 1 -- 172.21.15.69:0/878061439 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0048e0 con 0x7fdcd4101dc0 2023-12-14T14:09:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.228+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd410ba70 con 0x7fdcd4101dc0 2023-12-14T14:09:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.229+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd41a0760 con 0x7fdcd4101dc0 2023-12-14T14:09:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.229+0000 7fdcbbfff700 1 -- 172.21.15.69:0/878061439 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fdccc003a00 con 0x7fdcd4101dc0 2023-12-14T14:09:18.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.230+0000 7fdcbbfff700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdcbc0a11e0 0x7fdcbc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:18.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.230+0000 7fdcbbfff700 1 -- 172.21.15.69:0/878061439 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdccc0cc240 con 0x7fdcd4101dc0 2023-12-14T14:09:18.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.230+0000 7fdcd2ffd700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdcbc0a11e0 0x7fdcbc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:18.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.230+0000 7fdcd2ffd700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdcbc0a11e0 0x7fdcbc0a3690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4101290 tx=0x7fdcc8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:18.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.234+0000 7fdcbbfff700 1 -- 172.21.15.69:0/878061439 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdccc04e730 con 0x7fdcd4101dc0 2023-12-14T14:09:18.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:17 smithi119 ceph-mon[43834]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:18.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:17 smithi119 ceph-mon[43834]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:18.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:17 smithi119 ceph-mon[43834]: pgmap v225: 97 pgs: 97 active+clean; 597 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 8.3 KiB/s wr, 16 op/s 2023-12-14T14:09:18.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:17 smithi119 ceph-mon[43834]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:18.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:17 smithi119 ceph-mon[43834]: mgrmap e17: x(active, since 5m), standbys: z, y 2023-12-14T14:09:18.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:17 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/10773743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:18.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.418+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdcd41a0dd0 con 0x7fdcbc0a11e0 2023-12-14T14:09:18.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.428+0000 7fdcbbfff700 1 -- 172.21.15.69:0/878061439 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328241 (secure 0 0 0) 0x7fdcd41a0dd0 con 0x7fdcbc0a11e0 2023-12-14T14:09:18.434 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:18.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdcbc0a11e0 msgr2=0x7fdcbc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdcbc0a11e0 0x7fdcbc0a3690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4101290 tx=0x7fdcc8009260 comp rx=0 tx=0).stop 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101dc0 msgr2=0x7fdcd4073420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101dc0 0x7fdcd4073420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdccc007ee0 tx=0x7fdccc00d3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 shutdown_connections 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdcbc0a11e0 0x7fdcbc0a3690 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcd4101dc0 0x7fdcd4073420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd4100240 0x7fdcd40748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 --2- 172.21.15.69:0/878061439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd4101430 0x7fdcd4072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 >> 172.21.15.69:0/878061439 conn(0x7fdcd40fb820 msgr2=0x7fdcd40fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:18.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 shutdown_connections 2023-12-14T14:09:18.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.432+0000 7fdcd9417700 1 -- 172.21.15.69:0/878061439 wait complete. 2023-12-14T14:09:18.440 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T14:09:18.443 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2023-12-14T14:09:16.605007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":611688,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":275,"num_write_kb":2991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":267,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":77632,"kb_used_data":10592,"kb_used_omap":0,"kb_used_meta":66944,"kb_avail":1124864192,"statfs":{"total":1151940427776,"available":1151860932608,"internally_reserved":0,"allocated":10846208,"data_stored":6845378,"data_compressed":107034,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":68550656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21320,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":94,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.406427"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611392+0000","last_change":"2023-12-14T14:09:10.621884+0000","last_active":"2023-12-14T14:09:11.611392+0000","last_peered":"2023-12-14T14:09:11.611392+0000","last_clean":"2023-12-14T14:09:11.611392+0000","last_became_active":"2023-12-14T14:09:10.621605+0000","last_became_peered":"2023-12-14T14:09:10.621605+0000","last_unstale":"2023-12-14T14:09:11.611392+0000","last_undegraded":"2023-12-14T14:09:11.611392+0000","last_fullsized":"2023-12-14T14:09:11.611392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:52:34.121106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450636+0000","last_change":"2023-12-14T14:09:10.621555+0000","last_active":"2023-12-14T14:09:12.450636+0000","last_peered":"2023-12-14T14:09:12.450636+0000","last_clean":"2023-12-14T14:09:12.450636+0000","last_became_active":"2023-12-14T14:09:10.621265+0000","last_became_peered":"2023-12-14T14:09:10.621265+0000","last_unstale":"2023-12-14T14:09:12.450636+0000","last_undegraded":"2023-12-14T14:09:12.450636+0000","last_fullsized":"2023-12-14T14:09:12.450636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:46:18.920671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450457+0000","last_change":"2023-12-14T14:09:10.623575+0000","last_active":"2023-12-14T14:09:12.450457+0000","last_peered":"2023-12-14T14:09:12.450457+0000","last_clean":"2023-12-14T14:09:12.450457+0000","last_became_active":"2023-12-14T14:09:10.623289+0000","last_became_peered":"2023-12-14T14:09:10.623289+0000","last_unstale":"2023-12-14T14:09:12.450457+0000","last_undegraded":"2023-12-14T14:09:12.450457+0000","last_fullsized":"2023-12-14T14:09:12.450457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:21:24.793809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611562+0000","last_change":"2023-12-14T14:09:10.622850+0000","last_active":"2023-12-14T14:09:11.611562+0000","last_peered":"2023-12-14T14:09:11.611562+0000","last_clean":"2023-12-14T14:09:11.611562+0000","last_became_active":"2023-12-14T14:09:10.622456+0000","last_became_peered":"2023-12-14T14:09:10.622456+0000","last_unstale":"2023-12-14T14:09:11.611562+0000","last_undegraded":"2023-12-14T14:09:11.611562+0000","last_fullsized":"2023-12-14T14:09:11.611562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:33:10.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449942+0000","last_change":"2023-12-14T14:09:10.623459+0000","last_active":"2023-12-14T14:09:12.449942+0000","last_peered":"2023-12-14T14:09:12.449942+0000","last_clean":"2023-12-14T14:09:12.449942+0000","last_became_active":"2023-12-14T14:09:10.623100+0000","last_became_peered":"2023-12-14T14:09:10.623100+0000","last_unstale":"2023-12-14T14:09:12.449942+0000","last_undegraded":"2023-12-14T14:09:12.449942+0000","last_fullsized":"2023-12-14T14:09:12.449942+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:15:11.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450472+0000","last_change":"2023-12-14T14:09:10.624663+0000","last_active":"2023-12-14T14:09:12.450472+0000","last_peered":"2023-12-14T14:09:12.450472+0000","last_clean":"2023-12-14T14:09:12.450472+0000","last_became_active":"2023-12-14T14:09:10.624313+0000","last_became_peered":"2023-12-14T14:09:10.624313+0000","last_unstale":"2023-12-14T14:09:12.450472+0000","last_undegraded":"2023-12-14T14:09:12.450472+0000","last_fullsized":"2023-12-14T14:09:12.450472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:36:58.959484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626715+0000","last_change":"2023-12-14T14:09:10.622519+0000","last_active":"2023-12-14T14:09:11.626715+0000","last_peered":"2023-12-14T14:09:11.626715+0000","last_clean":"2023-12-14T14:09:11.626715+0000","last_became_active":"2023-12-14T14:09:10.622147+0000","last_became_peered":"2023-12-14T14:09:10.622147+0000","last_unstale":"2023-12-14T14:09:11.626715+0000","last_undegraded":"2023-12-14T14:09:11.626715+0000","last_fullsized":"2023-12-14T14:09:11.626715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:06:54.114410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407505+0000","last_change":"2023-12-14T14:09:10.622762+0000","last_active":"2023-12-14T14:09:12.407505+0000","last_peered":"2023-12-14T14:09:12.407505+0000","last_clean":"2023-12-14T14:09:12.407505+0000","last_became_active":"2023-12-14T14:09:10.622199+0000","last_became_peered":"2023-12-14T14:09:10.622199+0000","last_unstale":"2023-12-14T14:09:12.407505+0000","last_undegraded":"2023-12-14T14:09:12.407505+0000","last_fullsized":"2023-12-14T14:09:12.407505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:05:12.024946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T14:09:10.629670+0000","last_change":"2023-12-14T14:09:10.625452+0000","last_active":"2023-12-14T14:09:10.629670+0000","last_peered":"2023-12-14T14:09:10.629670+0000","last_clean":"2023-12-14T14:09:10.629670+0000","last_became_active":"2023-12-14T14:09:10.620053+0000","last_became_peered":"2023-12-14T14:09:10.620053+0000","last_unstale":"2023-12-14T14:09:10.629670+0000","last_undegraded":"2023-12-14T14:09:10.629670+0000","last_fullsized":"2023-12-14T14:09:10.629670+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:26:53.654353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.451174+0000","last_change":"2023-12-14T14:09:10.631871+0000","last_active":"2023-12-14T14:09:12.451174+0000","last_peered":"2023-12-14T14:09:12.451174+0000","last_clean":"2023-12-14T14:09:12.451174+0000","last_became_active":"2023-12-14T14:09:10.631549+0000","last_became_peered":"2023-12-14T14:09:10.631549+0000","last_unstale":"2023-12-14T14:09:12.451174+0000","last_undegraded":"2023-12-14T14:09:12.451174+0000","last_fullsized":"2023-12-14T14:09:12.451174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:05:03.676055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626995+0000","last_change":"2023-12-14T14:09:10.633572+0000","last_active":"2023-12-14T14:09:11.626995+0000","last_peered":"2023-12-14T14:09:11.626995+0000","last_clean":"2023-12-14T14:09:11.626995+0000","last_became_active":"2023-12-14T14:09:10.633251+0000","last_became_peered":"2023-12-14T14:09:10.633251+0000","last_unstale":"2023-12-14T14:09:11.626995+0000","last_undegraded":"2023-12-14T14:09:11.626995+0000","last_fullsized":"2023-12-14T14:09:11.626995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:12:19.816759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611430+0000","last_change":"2023-12-14T14:09:10.630621+0000","last_active":"2023-12-14T14:09:11.611430+0000","last_peered":"2023-12-14T14:09:11.611430+0000","last_clean":"2023-12-14T14:09:11.611430+0000","last_became_active":"2023-12-14T14:09:10.630196+0000","last_became_peered":"2023-12-14T14:09:10.630196+0000","last_unstale":"2023-12-14T14:09:11.611430+0000","last_undegraded":"2023-12-14T14:09:11.611430+0000","last_fullsized":"2023-12-14T14:09:11.611430+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:47:07.876989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610386+0000","last_change":"2023-12-14T14:09:10.617111+0000","last_active":"2023-12-14T14:09:11.610386+0000","last_peered":"2023-12-14T14:09:11.610386+0000","last_clean":"2023-12-14T14:09:11.610386+0000","last_became_active":"2023-12-14T14:09:10.616817+0000","last_became_peered":"2023-12-14T14:09:10.616817+0000","last_unstale":"2023-12-14T14:09:11.610386+0000","last_undegraded":"2023-12-14T14:09:11.610386+0000","last_fullsized":"2023-12-14T14:09:11.610386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:32:53.038532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450326+0000","last_change":"2023-12-14T14:09:10.620373+0000","last_active":"2023-12-14T14:09:12.450326+0000","last_peered":"2023-12-14T14:09:12.450326+0000","last_clean":"2023-12-14T14:09:12.450326+0000","last_became_active":"2023-12-14T14:09:10.620107+0000","last_became_peered":"2023-12-14T14:09:10.620107+0000","last_unstale":"2023-12-14T14:09:12.450326+0000","last_undegraded":"2023-12-14T14:09:12.450326+0000","last_fullsized":"2023-12-14T14:09:12.450326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:21:44.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450001+0000","last_change":"2023-12-14T14:09:10.624554+0000","last_active":"2023-12-14T14:09:12.450001+0000","last_peered":"2023-12-14T14:09:12.450001+0000","last_clean":"2023-12-14T14:09:12.450001+0000","last_became_active":"2023-12-14T14:09:10.624255+0000","last_became_peered":"2023-12-14T14:09:10.624255+0000","last_unstale":"2023-12-14T14:09:12.450001+0000","last_undegraded":"2023-12-14T14:09:12.450001+0000","last_fullsized":"2023-12-14T14:09:12.450001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:28:58.674883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T14:09:10.633540+0000","last_change":"2023-12-14T14:09:10.632464+0000","last_active":"2023-12-14T14:09:10.633540+0000","last_peered":"2023-12-14T14:09:10.633540+0000","last_clean":"2023-12-14T14:09:10.633540+0000","last_became_active":"2023-12-14T14:09:10.632102+0000","last_became_peered":"2023-12-14T14:09:10.632102+0000","last_unstale":"2023-12-14T14:09:10.633540+0000","last_undegraded":"2023-12-14T14:09:10.633540+0000","last_fullsized":"2023-12-14T14:09:10.633540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:55:24.858306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611548+0000","last_change":"2023-12-14T14:09:10.619144+0000","last_active":"2023-12-14T14:09:11.611548+0000","last_peered":"2023-12-14T14:09:11.611548+0000","last_clean":"2023-12-14T14:09:11.611548+0000","last_became_active":"2023-12-14T14:09:10.618833+0000","last_became_peered":"2023-12-14T14:09:10.618833+0000","last_unstale":"2023-12-14T14:09:11.611548+0000","last_undegraded":"2023-12-14T14:09:11.611548+0000","last_fullsized":"2023-12-14T14:09:11.611548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:39:23.775221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450257+0000","last_change":"2023-12-14T14:09:10.619062+0000","last_active":"2023-12-14T14:09:12.450257+0000","last_peered":"2023-12-14T14:09:12.450257+0000","last_clean":"2023-12-14T14:09:12.450257+0000","last_became_active":"2023-12-14T14:09:10.618750+0000","last_became_peered":"2023-12-14T14:09:10.618750+0000","last_unstale":"2023-12-14T14:09:12.450257+0000","last_undegraded":"2023-12-14T14:09:12.450257+0000","last_fullsized":"2023-12-14T14:09:12.450257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:28:30.651988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450436+0000","last_change":"2023-12-14T14:09:10.621410+0000","last_active":"2023-12-14T14:09:12.450436+0000","last_peered":"2023-12-14T14:09:12.450436+0000","last_clean":"2023-12-14T14:09:12.450436+0000","last_became_active":"2023-12-14T14:09:10.621037+0000","last_became_peered":"2023-12-14T14:09:10.621037+0000","last_unstale":"2023-12-14T14:09:12.450436+0000","last_undegraded":"2023-12-14T14:09:12.450436+0000","last_fullsized":"2023-12-14T14:09:12.450436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:39:09.650960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450254+0000","last_change":"2023-12-14T14:09:10.218180+0000","last_active":"2023-12-14T14:09:12.450254+0000","last_peered":"2023-12-14T14:09:12.450254+0000","last_clean":"2023-12-14T14:09:12.450254+0000","last_became_active":"2023-12-14T14:09:10.217856+0000","last_became_peered":"2023-12-14T14:09:10.217856+0000","last_unstale":"2023-12-14T14:09:12.450254+0000","last_undegraded":"2023-12-14T14:09:12.450254+0000","last_fullsized":"2023-12-14T14:09:12.450254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:34:17.405766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407962+0000","last_change":"2023-12-14T14:09:10.628500+0000","last_active":"2023-12-14T14:09:12.407962+0000","last_peered":"2023-12-14T14:09:12.407962+0000","last_clean":"2023-12-14T14:09:12.407962+0000","last_became_active":"2023-12-14T14:09:10.628120+0000","last_became_peered":"2023-12-14T14:09:10.628120+0000","last_unstale":"2023-12-14T14:09:12.407962+0000","last_undegraded":"2023-12-14T14:09:12.407962+0000","last_fullsized":"2023-12-14T14:09:12.407962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:34:44.660042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.408005+0000","last_change":"2023-12-14T14:09:10.218608+0000","last_active":"2023-12-14T14:09:12.408005+0000","last_peered":"2023-12-14T14:09:12.408005+0000","last_clean":"2023-12-14T14:09:12.408005+0000","last_became_active":"2023-12-14T14:09:10.218010+0000","last_became_peered":"2023-12-14T14:09:10.218010+0000","last_unstale":"2023-12-14T14:09:12.408005+0000","last_undegraded":"2023-12-14T14:09:12.408005+0000","last_fullsized":"2023-12-14T14:09:12.408005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:35:05.683768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450785+0000","last_change":"2023-12-14T14:09:10.621972+0000","last_active":"2023-12-14T14:09:12.450785+0000","last_peered":"2023-12-14T14:09:12.450785+0000","last_clean":"2023-12-14T14:09:12.450785+0000","last_became_active":"2023-12-14T14:09:10.621685+0000","last_became_peered":"2023-12-14T14:09:10.621685+0000","last_unstale":"2023-12-14T14:09:12.450785+0000","last_undegraded":"2023-12-14T14:09:12.450785+0000","last_fullsized":"2023-12-14T14:09:12.450785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:13:06.816242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.806768+0000","last_change":"2023-12-14T14:09:10.220860+0000","last_active":"2023-12-14T14:09:14.806768+0000","last_peered":"2023-12-14T14:09:14.806768+0000","last_clean":"2023-12-14T14:09:14.806768+0000","last_became_active":"2023-12-14T14:09:10.219802+0000","last_became_peered":"2023-12-14T14:09:10.219802+0000","last_unstale":"2023-12-14T14:09:14.806768+0000","last_undegraded":"2023-12-14T14:09:14.806768+0000","last_fullsized":"2023-12-14T14:09:14.806768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:01:27.246337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T14:09:10.630250+0000","last_change":"2023-12-14T14:09:10.626807+0000","last_active":"2023-12-14T14:09:10.630250+0000","last_peered":"2023-12-14T14:09:10.630250+0000","last_clean":"2023-12-14T14:09:10.630250+0000","last_became_active":"2023-12-14T14:09:10.626450+0000","last_became_peered":"2023-12-14T14:09:10.626450+0000","last_unstale":"2023-12-14T14:09:10.630250+0000","last_undegraded":"2023-12-14T14:09:10.630250+0000","last_fullsized":"2023-12-14T14:09:10.630250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:38:28.831108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450628+0000","last_change":"2023-12-14T14:09:10.216515+0000","last_active":"2023-12-14T14:09:12.450628+0000","last_peered":"2023-12-14T14:09:12.450628+0000","last_clean":"2023-12-14T14:09:12.450628+0000","last_became_active":"2023-12-14T14:09:10.216175+0000","last_became_peered":"2023-12-14T14:09:10.216175+0000","last_unstale":"2023-12-14T14:09:12.450628+0000","last_undegraded":"2023-12-14T14:09:12.450628+0000","last_fullsized":"2023-12-14T14:09:12.450628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:52:31.006083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374755+0000","last_change":"2023-12-14T14:09:10.627664+0000","last_active":"2023-12-14T14:09:12.374755+0000","last_peered":"2023-12-14T14:09:12.374755+0000","last_clean":"2023-12-14T14:09:12.374755+0000","last_became_active":"2023-12-14T14:09:10.627376+0000","last_became_peered":"2023-12-14T14:09:10.627376+0000","last_unstale":"2023-12-14T14:09:12.374755+0000","last_undegraded":"2023-12-14T14:09:12.374755+0000","last_fullsized":"2023-12-14T14:09:12.374755+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:41:03.037811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:15.812301+0000","last_change":"2023-12-14T14:09:10.218806+0000","last_active":"2023-12-14T14:09:15.812301+0000","last_peered":"2023-12-14T14:09:15.812301+0000","last_clean":"2023-12-14T14:09:15.812301+0000","last_became_active":"2023-12-14T14:09:10.218441+0000","last_became_peered":"2023-12-14T14:09:10.218441+0000","last_unstale":"2023-12-14T14:09:15.812301+0000","last_undegraded":"2023-12-14T14:09:15.812301+0000","last_fullsized":"2023-12-14T14:09:15.812301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:50:30.949849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450206+0000","last_change":"2023-12-14T14:09:10.622903+0000","last_active":"2023-12-14T14:09:12.450206+0000","last_peered":"2023-12-14T14:09:12.450206+0000","last_clean":"2023-12-14T14:09:12.450206+0000","last_became_active":"2023-12-14T14:09:10.622261+0000","last_became_peered":"2023-12-14T14:09:10.622261+0000","last_unstale":"2023-12-14T14:09:12.450206+0000","last_undegraded":"2023-12-14T14:09:12.450206+0000","last_fullsized":"2023-12-14T14:09:12.450206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:17:13.547591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.809526+0000","last_change":"2023-12-14T14:09:10.222254+0000","last_active":"2023-12-14T14:09:14.809526+0000","last_peered":"2023-12-14T14:09:14.809526+0000","last_clean":"2023-12-14T14:09:14.809526+0000","last_became_active":"2023-12-14T14:09:10.221861+0000","last_became_peered":"2023-12-14T14:09:10.221861+0000","last_unstale":"2023-12-14T14:09:14.809526+0000","last_undegraded":"2023-12-14T14:09:14.809526+0000","last_fullsized":"2023-12-14T14:09:14.809526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:12:17.252109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374542+0000","last_change":"2023-12-14T14:09:10.625646+0000","last_active":"2023-12-14T14:09:12.374542+0000","last_peered":"2023-12-14T14:09:12.374542+0000","last_clean":"2023-12-14T14:09:12.374542+0000","last_became_active":"2023-12-14T14:09:10.625179+0000","last_became_peered":"2023-12-14T14:09:10.625179+0000","last_unstale":"2023-12-14T14:09:12.374542+0000","last_undegraded":"2023-12-14T14:09:12.374542+0000","last_fullsized":"2023-12-14T14:09:12.374542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:28:56.557023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610111+0000","last_change":"2023-12-14T14:09:10.212885+0000","last_active":"2023-12-14T14:09:11.610111+0000","last_peered":"2023-12-14T14:09:11.610111+0000","last_clean":"2023-12-14T14:09:11.610111+0000","last_became_active":"2023-12-14T14:09:10.212311+0000","last_became_peered":"2023-12-14T14:09:10.212311+0000","last_unstale":"2023-12-14T14:09:11.610111+0000","last_undegraded":"2023-12-14T14:09:11.610111+0000","last_fullsized":"2023-12-14T14:09:11.610111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:36:02.124214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407399+0000","last_change":"2023-12-14T14:09:10.620795+0000","last_active":"2023-12-14T14:09:12.407399+0000","last_peered":"2023-12-14T14:09:12.407399+0000","last_clean":"2023-12-14T14:09:12.407399+0000","last_became_active":"2023-12-14T14:09:10.620453+0000","last_became_peered":"2023-12-14T14:09:10.620453+0000","last_unstale":"2023-12-14T14:09:12.407399+0000","last_undegraded":"2023-12-14T14:09:12.407399+0000","last_fullsized":"2023-12-14T14:09:12.407399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:54:17.454367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374266+0000","last_change":"2023-12-14T14:09:10.218969+0000","last_active":"2023-12-14T14:09:12.374266+0000","last_peered":"2023-12-14T14:09:12.374266+0000","last_clean":"2023-12-14T14:09:12.374266+0000","last_became_active":"2023-12-14T14:09:10.218624+0000","last_became_peered":"2023-12-14T14:09:10.218624+0000","last_unstale":"2023-12-14T14:09:12.374266+0000","last_undegraded":"2023-12-14T14:09:12.374266+0000","last_fullsized":"2023-12-14T14:09:12.374266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:47:39.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450113+0000","last_change":"2023-12-14T14:09:10.619202+0000","last_active":"2023-12-14T14:09:12.450113+0000","last_peered":"2023-12-14T14:09:12.450113+0000","last_clean":"2023-12-14T14:09:12.450113+0000","last_became_active":"2023-12-14T14:09:10.618944+0000","last_became_peered":"2023-12-14T14:09:10.618944+0000","last_unstale":"2023-12-14T14:09:12.450113+0000","last_undegraded":"2023-12-14T14:09:12.450113+0000","last_fullsized":"2023-12-14T14:09:12.450113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:01:48.400281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800832+0000","last_change":"2023-12-14T14:09:10.214323+0000","last_active":"2023-12-14T14:09:13.800832+0000","last_peered":"2023-12-14T14:09:13.800832+0000","last_clean":"2023-12-14T14:09:13.800832+0000","last_became_active":"2023-12-14T14:09:10.213998+0000","last_became_peered":"2023-12-14T14:09:10.213998+0000","last_unstale":"2023-12-14T14:09:13.800832+0000","last_undegraded":"2023-12-14T14:09:13.800832+0000","last_fullsized":"2023-12-14T14:09:13.800832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:42:36.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T14:09:10.630065+0000","last_change":"2023-12-14T14:09:10.626967+0000","last_active":"2023-12-14T14:09:10.630065+0000","last_peered":"2023-12-14T14:09:10.630065+0000","last_clean":"2023-12-14T14:09:10.630065+0000","last_became_active":"2023-12-14T14:09:10.626589+0000","last_became_peered":"2023-12-14T14:09:10.626589+0000","last_unstale":"2023-12-14T14:09:10.630065+0000","last_undegraded":"2023-12-14T14:09:10.630065+0000","last_fullsized":"2023-12-14T14:09:10.630065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:12:01.913290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626928+0000","last_change":"2023-12-14T14:09:10.221868+0000","last_active":"2023-12-14T14:09:11.626928+0000","last_peered":"2023-12-14T14:09:11.626928+0000","last_clean":"2023-12-14T14:09:11.626928+0000","last_became_active":"2023-12-14T14:09:10.221378+0000","last_became_peered":"2023-12-14T14:09:10.221378+0000","last_unstale":"2023-12-14T14:09:11.626928+0000","last_undegraded":"2023-12-14T14:09:11.626928+0000","last_fullsized":"2023-12-14T14:09:11.626928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:00:02.721676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450749+0000","last_change":"2023-12-14T14:09:10.630669+0000","last_active":"2023-12-14T14:09:12.450749+0000","last_peered":"2023-12-14T14:09:12.450749+0000","last_clean":"2023-12-14T14:09:12.450749+0000","last_became_active":"2023-12-14T14:09:10.630351+0000","last_became_peered":"2023-12-14T14:09:10.630351+0000","last_unstale":"2023-12-14T14:09:12.450749+0000","last_undegraded":"2023-12-14T14:09:12.450749+0000","last_fullsized":"2023-12-14T14:09:12.450749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:39:01.883621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800086+0000","last_change":"2023-12-14T14:09:10.214352+0000","last_active":"2023-12-14T14:09:13.800086+0000","last_peered":"2023-12-14T14:09:13.800086+0000","last_clean":"2023-12-14T14:09:13.800086+0000","last_became_active":"2023-12-14T14:09:10.213873+0000","last_became_peered":"2023-12-14T14:09:10.213873+0000","last_unstale":"2023-12-14T14:09:13.800086+0000","last_undegraded":"2023-12-14T14:09:13.800086+0000","last_fullsized":"2023-12-14T14:09:13.800086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:34:30.048744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T14:09:10.631827+0000","last_change":"2023-12-14T14:09:10.631272+0000","last_active":"2023-12-14T14:09:10.631827+0000","last_peered":"2023-12-14T14:09:10.631827+0000","last_clean":"2023-12-14T14:09:10.631827+0000","last_became_active":"2023-12-14T14:09:10.630923+0000","last_became_peered":"2023-12-14T14:09:10.630923+0000","last_unstale":"2023-12-14T14:09:10.631827+0000","last_undegraded":"2023-12-14T14:09:10.631827+0000","last_fullsized":"2023-12-14T14:09:10.631827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:30:57.254347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'14","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:16.216348+0000","last_change":"2023-12-14T14:09:10.219006+0000","last_active":"2023-12-14T14:09:16.216348+0000","last_peered":"2023-12-14T14:09:16.216348+0000","last_clean":"2023-12-14T14:09:16.216348+0000","last_became_active":"2023-12-14T14:09:10.218694+0000","last_became_peered":"2023-12-14T14:09:10.218694+0000","last_unstale":"2023-12-14T14:09:16.216348+0000","last_undegraded":"2023-12-14T14:09:16.216348+0000","last_fullsized":"2023-12-14T14:09:16.216348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:24:00.199652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18929,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450731+0000","last_change":"2023-12-14T14:09:10.624056+0000","last_active":"2023-12-14T14:09:12.450731+0000","last_peered":"2023-12-14T14:09:12.450731+0000","last_clean":"2023-12-14T14:09:12.450731+0000","last_became_active":"2023-12-14T14:09:10.623622+0000","last_became_peered":"2023-12-14T14:09:10.623622+0000","last_unstale":"2023-12-14T14:09:12.450731+0000","last_undegraded":"2023-12-14T14:09:12.450731+0000","last_fullsized":"2023-12-14T14:09:12.450731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:21:01.045406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.801871+0000","last_change":"2023-12-14T14:09:10.215236+0000","last_active":"2023-12-14T14:09:13.801871+0000","last_peered":"2023-12-14T14:09:13.801871+0000","last_clean":"2023-12-14T14:09:13.801871+0000","last_became_active":"2023-12-14T14:09:10.214941+0000","last_became_peered":"2023-12-14T14:09:10.214941+0000","last_unstale":"2023-12-14T14:09:13.801871+0000","last_undegraded":"2023-12-14T14:09:13.801871+0000","last_fullsized":"2023-12-14T14:09:13.801871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:56:39.026819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610145+0000","last_change":"2023-12-14T14:09:10.625352+0000","last_active":"2023-12-14T14:09:11.610145+0000","last_peered":"2023-12-14T14:09:11.610145+0000","last_clean":"2023-12-14T14:09:11.610145+0000","last_became_active":"2023-12-14T14:09:10.625037+0000","last_became_peered":"2023-12-14T14:09:10.625037+0000","last_unstale":"2023-12-14T14:09:11.610145+0000","last_undegraded":"2023-12-14T14:09:11.610145+0000","last_fullsized":"2023-12-14T14:09:11.610145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:04:20.861942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.801523+0000","last_change":"2023-12-14T14:09:10.219028+0000","last_active":"2023-12-14T14:09:13.801523+0000","last_peered":"2023-12-14T14:09:13.801523+0000","last_clean":"2023-12-14T14:09:13.801523+0000","last_became_active":"2023-12-14T14:09:10.218687+0000","last_became_peered":"2023-12-14T14:09:10.218687+0000","last_unstale":"2023-12-14T14:09:13.801523+0000","last_undegraded":"2023-12-14T14:09:13.801523+0000","last_fullsized":"2023-12-14T14:09:13.801523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:28:56.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627176+0000","last_change":"2023-12-14T14:09:10.623660+0000","last_active":"2023-12-14T14:09:11.627176+0000","last_peered":"2023-12-14T14:09:11.627176+0000","last_clean":"2023-12-14T14:09:11.627176+0000","last_became_active":"2023-12-14T14:09:10.623321+0000","last_became_peered":"2023-12-14T14:09:10.623321+0000","last_unstale":"2023-12-14T14:09:11.627176+0000","last_undegraded":"2023-12-14T14:09:11.627176+0000","last_fullsized":"2023-12-14T14:09:11.627176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:57:57.403056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611062+0000","last_change":"2023-12-14T14:09:10.217849+0000","last_active":"2023-12-14T14:09:11.611062+0000","last_peered":"2023-12-14T14:09:11.611062+0000","last_clean":"2023-12-14T14:09:11.611062+0000","last_became_active":"2023-12-14T14:09:10.217501+0000","last_became_peered":"2023-12-14T14:09:10.217501+0000","last_unstale":"2023-12-14T14:09:11.611062+0000","last_undegraded":"2023-12-14T14:09:11.611062+0000","last_fullsized":"2023-12-14T14:09:11.611062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:56:37.539435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626553+0000","last_change":"2023-12-14T14:09:10.627193+0000","last_active":"2023-12-14T14:09:11.626553+0000","last_peered":"2023-12-14T14:09:11.626553+0000","last_clean":"2023-12-14T14:09:11.626553+0000","last_became_active":"2023-12-14T14:09:10.626887+0000","last_became_peered":"2023-12-14T14:09:10.626887+0000","last_unstale":"2023-12-14T14:09:11.626553+0000","last_undegraded":"2023-12-14T14:09:11.626553+0000","last_fullsized":"2023-12-14T14:09:11.626553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:48.943605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.808366+0000","last_change":"2023-12-14T14:09:10.220564+0000","last_active":"2023-12-14T14:09:14.808366+0000","last_peered":"2023-12-14T14:09:14.808366+0000","last_clean":"2023-12-14T14:09:14.808366+0000","last_became_active":"2023-12-14T14:09:10.219921+0000","last_became_peered":"2023-12-14T14:09:10.219921+0000","last_unstale":"2023-12-14T14:09:14.808366+0000","last_undegraded":"2023-12-14T14:09:14.808366+0000","last_fullsized":"2023-12-14T14:09:14.808366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:01.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374323+0000","last_change":"2023-12-14T14:09:10.625056+0000","last_active":"2023-12-14T14:09:12.374323+0000","last_peered":"2023-12-14T14:09:12.374323+0000","last_clean":"2023-12-14T14:09:12.374323+0000","last_became_active":"2023-12-14T14:09:10.624626+0000","last_became_peered":"2023-12-14T14:09:10.624626+0000","last_unstale":"2023-12-14T14:09:12.374323+0000","last_undegraded":"2023-12-14T14:09:12.374323+0000","last_fullsized":"2023-12-14T14:09:12.374323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:19:24.087342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450772+0000","last_change":"2023-12-14T14:09:10.215413+0000","last_active":"2023-12-14T14:09:12.450772+0000","last_peered":"2023-12-14T14:09:12.450772+0000","last_clean":"2023-12-14T14:09:12.450772+0000","last_became_active":"2023-12-14T14:09:10.214925+0000","last_became_peered":"2023-12-14T14:09:10.214925+0000","last_unstale":"2023-12-14T14:09:12.450772+0000","last_undegraded":"2023-12-14T14:09:12.450772+0000","last_fullsized":"2023-12-14T14:09:12.450772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:29.337362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611673+0000","last_change":"2023-12-14T14:09:10.629879+0000","last_active":"2023-12-14T14:09:11.611673+0000","last_peered":"2023-12-14T14:09:11.611673+0000","last_clean":"2023-12-14T14:09:11.611673+0000","last_became_active":"2023-12-14T14:09:10.629539+0000","last_became_peered":"2023-12-14T14:09:10.629539+0000","last_unstale":"2023-12-14T14:09:11.611673+0000","last_undegraded":"2023-12-14T14:09:11.611673+0000","last_fullsized":"2023-12-14T14:09:11.611673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:39:43.910568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450107+0000","last_change":"2023-12-14T14:09:10.214875+0000","last_active":"2023-12-14T14:09:12.450107+0000","last_peered":"2023-12-14T14:09:12.450107+0000","last_clean":"2023-12-14T14:09:12.450107+0000","last_became_active":"2023-12-14T14:09:10.214518+0000","last_became_peered":"2023-12-14T14:09:10.214518+0000","last_unstale":"2023-12-14T14:09:12.450107+0000","last_undegraded":"2023-12-14T14:09:12.450107+0000","last_fullsized":"2023-12-14T14:09:12.450107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:47:45.358021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450946+0000","last_change":"2023-12-14T14:09:10.619279+0000","last_active":"2023-12-14T14:09:12.450946+0000","last_peered":"2023-12-14T14:09:12.450946+0000","last_clean":"2023-12-14T14:09:12.450946+0000","last_became_active":"2023-12-14T14:09:10.618794+0000","last_became_peered":"2023-12-14T14:09:10.618794+0000","last_unstale":"2023-12-14T14:09:12.450946+0000","last_undegraded":"2023-12-14T14:09:12.450946+0000","last_fullsized":"2023-12-14T14:09:12.450946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:26:59.987926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626844+0000","last_change":"2023-12-14T14:09:10.222213+0000","last_active":"2023-12-14T14:09:11.626844+0000","last_peered":"2023-12-14T14:09:11.626844+0000","last_clean":"2023-12-14T14:09:11.626844+0000","last_became_active":"2023-12-14T14:09:10.221314+0000","last_became_peered":"2023-12-14T14:09:10.221314+0000","last_unstale":"2023-12-14T14:09:11.626844+0000","last_undegraded":"2023-12-14T14:09:11.626844+0000","last_fullsized":"2023-12-14T14:09:11.626844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:08:22.888160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450812+0000","last_change":"2023-12-14T14:09:10.624523+0000","last_active":"2023-12-14T14:09:12.450812+0000","last_peered":"2023-12-14T14:09:12.450812+0000","last_clean":"2023-12-14T14:09:12.450812+0000","last_became_active":"2023-12-14T14:09:10.624204+0000","last_became_peered":"2023-12-14T14:09:10.624204+0000","last_unstale":"2023-12-14T14:09:12.450812+0000","last_undegraded":"2023-12-14T14:09:12.450812+0000","last_fullsized":"2023-12-14T14:09:12.450812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:57:02.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374413+0000","last_change":"2023-12-14T14:09:10.626166+0000","last_active":"2023-12-14T14:09:12.374413+0000","last_peered":"2023-12-14T14:09:12.374413+0000","last_clean":"2023-12-14T14:09:12.374413+0000","last_became_active":"2023-12-14T14:09:10.625831+0000","last_became_peered":"2023-12-14T14:09:10.625831+0000","last_unstale":"2023-12-14T14:09:12.374413+0000","last_undegraded":"2023-12-14T14:09:12.374413+0000","last_fullsized":"2023-12-14T14:09:12.374413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:37:59.030750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.799869+0000","last_change":"2023-12-14T14:09:10.217759+0000","last_active":"2023-12-14T14:09:13.799869+0000","last_peered":"2023-12-14T14:09:13.799869+0000","last_clean":"2023-12-14T14:09:13.799869+0000","last_became_active":"2023-12-14T14:09:10.217454+0000","last_became_peered":"2023-12-14T14:09:10.217454+0000","last_unstale":"2023-12-14T14:09:13.799869+0000","last_undegraded":"2023-12-14T14:09:13.799869+0000","last_fullsized":"2023-12-14T14:09:13.799869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:31:22.360965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407749+0000","last_change":"2023-12-14T14:09:10.619315+0000","last_active":"2023-12-14T14:09:12.407749+0000","last_peered":"2023-12-14T14:09:12.407749+0000","last_clean":"2023-12-14T14:09:12.407749+0000","last_became_active":"2023-12-14T14:09:10.619020+0000","last_became_peered":"2023-12-14T14:09:10.619020+0000","last_unstale":"2023-12-14T14:09:12.407749+0000","last_undegraded":"2023-12-14T14:09:12.407749+0000","last_fullsized":"2023-12-14T14:09:12.407749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:29:53.925419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.799815+0000","last_change":"2023-12-14T14:09:10.214557+0000","last_active":"2023-12-14T14:09:13.799815+0000","last_peered":"2023-12-14T14:09:13.799815+0000","last_clean":"2023-12-14T14:09:13.799815+0000","last_became_active":"2023-12-14T14:09:10.214179+0000","last_became_peered":"2023-12-14T14:09:10.214179+0000","last_unstale":"2023-12-14T14:09:13.799815+0000","last_undegraded":"2023-12-14T14:09:13.799815+0000","last_fullsized":"2023-12-14T14:09:13.799815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:06:48.176436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626607+0000","last_change":"2023-12-14T14:08:24.268746+0000","last_active":"2023-12-14T14:09:11.626607+0000","last_peered":"2023-12-14T14:09:11.626607+0000","last_clean":"2023-12-14T14:09:11.626607+0000","last_became_active":"2023-12-14T14:08:24.268402+0000","last_became_peered":"2023-12-14T14:08:24.268402+0000","last_unstale":"2023-12-14T14:09:11.626607+0000","last_undegraded":"2023-12-14T14:09:11.626607+0000","last_fullsized":"2023-12-14T14:09:11.626607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_clean_scrub_stamp":"2023-12-14T14:05:59.057653+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:48.663897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.609978+0000","last_change":"2023-12-14T14:09:10.623899+0000","last_active":"2023-12-14T14:09:11.609978+0000","last_peered":"2023-12-14T14:09:11.609978+0000","last_clean":"2023-12-14T14:09:11.609978+0000","last_became_active":"2023-12-14T14:09:10.623585+0000","last_became_peered":"2023-12-14T14:09:10.623585+0000","last_unstale":"2023-12-14T14:09:11.609978+0000","last_undegraded":"2023-12-14T14:09:11.609978+0000","last_fullsized":"2023-12-14T14:09:11.609978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:33:27.382237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626925+0000","last_change":"2023-12-14T14:09:10.221812+0000","last_active":"2023-12-14T14:09:11.626925+0000","last_peered":"2023-12-14T14:09:11.626925+0000","last_clean":"2023-12-14T14:09:11.626925+0000","last_became_active":"2023-12-14T14:09:10.221483+0000","last_became_peered":"2023-12-14T14:09:10.221483+0000","last_unstale":"2023-12-14T14:09:11.626925+0000","last_undegraded":"2023-12-14T14:09:11.626925+0000","last_fullsized":"2023-12-14T14:09:11.626925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:57:05.696384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450884+0000","last_change":"2023-12-14T14:09:10.217249+0000","last_active":"2023-12-14T14:09:12.450884+0000","last_peered":"2023-12-14T14:09:12.450884+0000","last_clean":"2023-12-14T14:09:12.450884+0000","last_became_active":"2023-12-14T14:09:10.216953+0000","last_became_peered":"2023-12-14T14:09:10.216953+0000","last_unstale":"2023-12-14T14:09:12.450884+0000","last_undegraded":"2023-12-14T14:09:12.450884+0000","last_fullsized":"2023-12-14T14:09:12.450884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:09:55.765717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610375+0000","last_change":"2023-12-14T14:09:10.616264+0000","last_active":"2023-12-14T14:09:11.610375+0000","last_peered":"2023-12-14T14:09:11.610375+0000","last_clean":"2023-12-14T14:09:11.610375+0000","last_became_active":"2023-12-14T14:09:10.615993+0000","last_became_peered":"2023-12-14T14:09:10.615993+0000","last_unstale":"2023-12-14T14:09:11.610375+0000","last_undegraded":"2023-12-14T14:09:11.610375+0000","last_fullsized":"2023-12-14T14:09:11.610375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:30:03.296839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450102+0000","last_change":"2023-12-14T14:09:10.218040+0000","last_active":"2023-12-14T14:09:12.450102+0000","last_peered":"2023-12-14T14:09:12.450102+0000","last_clean":"2023-12-14T14:09:12.450102+0000","last_became_active":"2023-12-14T14:09:10.217698+0000","last_became_peered":"2023-12-14T14:09:10.217698+0000","last_unstale":"2023-12-14T14:09:12.450102+0000","last_undegraded":"2023-12-14T14:09:12.450102+0000","last_fullsized":"2023-12-14T14:09:12.450102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:35:43.055944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407899+0000","last_change":"2023-12-14T14:09:10.626705+0000","last_active":"2023-12-14T14:09:12.407899+0000","last_peered":"2023-12-14T14:09:12.407899+0000","last_clean":"2023-12-14T14:09:12.407899+0000","last_became_active":"2023-12-14T14:09:10.626390+0000","last_became_peered":"2023-12-14T14:09:10.626390+0000","last_unstale":"2023-12-14T14:09:12.407899+0000","last_undegraded":"2023-12-14T14:09:12.407899+0000","last_fullsized":"2023-12-14T14:09:12.407899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:45:08.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800616+0000","last_change":"2023-12-14T14:09:10.224068+0000","last_active":"2023-12-14T14:09:13.800616+0000","last_peered":"2023-12-14T14:09:13.800616+0000","last_clean":"2023-12-14T14:09:13.800616+0000","last_became_active":"2023-12-14T14:09:10.223709+0000","last_became_peered":"2023-12-14T14:09:10.223709+0000","last_unstale":"2023-12-14T14:09:13.800616+0000","last_undegraded":"2023-12-14T14:09:13.800616+0000","last_fullsized":"2023-12-14T14:09:13.800616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:35:58.218289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450674+0000","last_change":"2023-12-14T14:09:10.633221+0000","last_active":"2023-12-14T14:09:12.450674+0000","last_peered":"2023-12-14T14:09:12.450674+0000","last_clean":"2023-12-14T14:09:12.450674+0000","last_became_active":"2023-12-14T14:09:10.632881+0000","last_became_peered":"2023-12-14T14:09:10.632881+0000","last_unstale":"2023-12-14T14:09:12.450674+0000","last_undegraded":"2023-12-14T14:09:12.450674+0000","last_fullsized":"2023-12-14T14:09:12.450674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:08:31.873299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T14:09:10.609592+0000","last_change":"2023-12-14T14:09:10.219793+0000","last_active":"2023-12-14T14:09:10.609592+0000","last_peered":"2023-12-14T14:09:10.609592+0000","last_clean":"2023-12-14T14:09:10.609592+0000","last_became_active":"2023-12-14T14:09:10.219485+0000","last_became_peered":"2023-12-14T14:09:10.219485+0000","last_unstale":"2023-12-14T14:09:10.609592+0000","last_undegraded":"2023-12-14T14:09:10.609592+0000","last_fullsized":"2023-12-14T14:09:10.609592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:48:24.995186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450086+0000","last_change":"2023-12-14T14:09:10.622064+0000","last_active":"2023-12-14T14:09:12.450086+0000","last_peered":"2023-12-14T14:09:12.450086+0000","last_clean":"2023-12-14T14:09:12.450086+0000","last_became_active":"2023-12-14T14:09:10.621741+0000","last_became_peered":"2023-12-14T14:09:10.621741+0000","last_unstale":"2023-12-14T14:09:12.450086+0000","last_undegraded":"2023-12-14T14:09:12.450086+0000","last_fullsized":"2023-12-14T14:09:12.450086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:17:02.821975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800868+0000","last_change":"2023-12-14T14:09:10.209152+0000","last_active":"2023-12-14T14:09:13.800868+0000","last_peered":"2023-12-14T14:09:13.800868+0000","last_clean":"2023-12-14T14:09:13.800868+0000","last_became_active":"2023-12-14T14:09:10.208798+0000","last_became_peered":"2023-12-14T14:09:10.208798+0000","last_unstale":"2023-12-14T14:09:13.800868+0000","last_undegraded":"2023-12-14T14:09:13.800868+0000","last_fullsized":"2023-12-14T14:09:13.800868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:25:32.056408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611049+0000","last_change":"2023-12-14T14:09:10.616109+0000","last_active":"2023-12-14T14:09:11.611049+0000","last_peered":"2023-12-14T14:09:11.611049+0000","last_clean":"2023-12-14T14:09:11.611049+0000","last_became_active":"2023-12-14T14:09:10.615694+0000","last_became_peered":"2023-12-14T14:09:10.615694+0000","last_unstale":"2023-12-14T14:09:11.611049+0000","last_undegraded":"2023-12-14T14:09:11.611049+0000","last_fullsized":"2023-12-14T14:09:11.611049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:44:27.502084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450250+0000","last_change":"2023-12-14T14:09:10.224376+0000","last_active":"2023-12-14T14:09:12.450250+0000","last_peered":"2023-12-14T14:09:12.450250+0000","last_clean":"2023-12-14T14:09:12.450250+0000","last_became_active":"2023-12-14T14:09:10.224010+0000","last_became_peered":"2023-12-14T14:09:10.224010+0000","last_unstale":"2023-12-14T14:09:12.450250+0000","last_undegraded":"2023-12-14T14:09:12.450250+0000","last_fullsized":"2023-12-14T14:09:12.450250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:35:42.162264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407641+0000","last_change":"2023-12-14T14:09:10.622490+0000","last_active":"2023-12-14T14:09:12.407641+0000","last_peered":"2023-12-14T14:09:12.407641+0000","last_clean":"2023-12-14T14:09:12.407641+0000","last_became_active":"2023-12-14T14:09:10.622154+0000","last_became_peered":"2023-12-14T14:09:10.622154+0000","last_unstale":"2023-12-14T14:09:12.407641+0000","last_undegraded":"2023-12-14T14:09:12.407641+0000","last_fullsized":"2023-12-14T14:09:12.407641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:58:24.317257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800622+0000","last_change":"2023-12-14T14:09:10.220343+0000","last_active":"2023-12-14T14:09:13.800622+0000","last_peered":"2023-12-14T14:09:13.800622+0000","last_clean":"2023-12-14T14:09:13.800622+0000","last_became_active":"2023-12-14T14:09:10.219657+0000","last_became_peered":"2023-12-14T14:09:10.219657+0000","last_unstale":"2023-12-14T14:09:13.800622+0000","last_undegraded":"2023-12-14T14:09:13.800622+0000","last_fullsized":"2023-12-14T14:09:13.800622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:07:17.459573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627001+0000","last_change":"2023-12-14T14:09:10.633980+0000","last_active":"2023-12-14T14:09:11.627001+0000","last_peered":"2023-12-14T14:09:11.627001+0000","last_clean":"2023-12-14T14:09:11.627001+0000","last_became_active":"2023-12-14T14:09:10.633541+0000","last_became_peered":"2023-12-14T14:09:10.633541+0000","last_unstale":"2023-12-14T14:09:11.627001+0000","last_undegraded":"2023-12-14T14:09:11.627001+0000","last_fullsized":"2023-12-14T14:09:11.627001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:23:06.057252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450327+0000","last_change":"2023-12-14T14:09:10.218042+0000","last_active":"2023-12-14T14:09:12.450327+0000","last_peered":"2023-12-14T14:09:12.450327+0000","last_clean":"2023-12-14T14:09:12.450327+0000","last_became_active":"2023-12-14T14:09:10.217540+0000","last_became_peered":"2023-12-14T14:09:10.217540+0000","last_unstale":"2023-12-14T14:09:12.450327+0000","last_undegraded":"2023-12-14T14:09:12.450327+0000","last_fullsized":"2023-12-14T14:09:12.450327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:59:44.996931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627141+0000","last_change":"2023-12-14T14:09:10.633527+0000","last_active":"2023-12-14T14:09:11.627141+0000","last_peered":"2023-12-14T14:09:11.627141+0000","last_clean":"2023-12-14T14:09:11.627141+0000","last_became_active":"2023-12-14T14:09:10.632614+0000","last_became_peered":"2023-12-14T14:09:10.632614+0000","last_unstale":"2023-12-14T14:09:11.627141+0000","last_undegraded":"2023-12-14T14:09:11.627141+0000","last_fullsized":"2023-12-14T14:09:11.627141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:11:48.151945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374713+0000","last_change":"2023-12-14T14:09:10.211731+0000","last_active":"2023-12-14T14:09:12.374713+0000","last_peered":"2023-12-14T14:09:12.374713+0000","last_clean":"2023-12-14T14:09:12.374713+0000","last_became_active":"2023-12-14T14:09:10.211366+0000","last_became_peered":"2023-12-14T14:09:10.211366+0000","last_unstale":"2023-12-14T14:09:12.374713+0000","last_undegraded":"2023-12-14T14:09:12.374713+0000","last_fullsized":"2023-12-14T14:09:12.374713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:09:57.281728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626861+0000","last_change":"2023-12-14T14:09:10.621483+0000","last_active":"2023-12-14T14:09:11.626861+0000","last_peered":"2023-12-14T14:09:11.626861+0000","last_clean":"2023-12-14T14:09:11.626861+0000","last_became_active":"2023-12-14T14:09:10.621105+0000","last_became_peered":"2023-12-14T14:09:10.621105+0000","last_unstale":"2023-12-14T14:09:11.626861+0000","last_undegraded":"2023-12-14T14:09:11.626861+0000","last_fullsized":"2023-12-14T14:09:11.626861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:14:24.242449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610479+0000","last_change":"2023-12-14T14:09:10.218688+0000","last_active":"2023-12-14T14:09:11.610479+0000","last_peered":"2023-12-14T14:09:11.610479+0000","last_clean":"2023-12-14T14:09:11.610479+0000","last_became_active":"2023-12-14T14:09:10.218339+0000","last_became_peered":"2023-12-14T14:09:10.218339+0000","last_unstale":"2023-12-14T14:09:11.610479+0000","last_undegraded":"2023-12-14T14:09:11.610479+0000","last_fullsized":"2023-12-14T14:09:11.610479+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:14.404008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627129+0000","last_change":"2023-12-14T14:09:10.633084+0000","last_active":"2023-12-14T14:09:11.627129+0000","last_peered":"2023-12-14T14:09:11.627129+0000","last_clean":"2023-12-14T14:09:11.627129+0000","last_became_active":"2023-12-14T14:09:10.632544+0000","last_became_peered":"2023-12-14T14:09:10.632544+0000","last_unstale":"2023-12-14T14:09:11.627129+0000","last_undegraded":"2023-12-14T14:09:11.627129+0000","last_fullsized":"2023-12-14T14:09:11.627129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:28:57.465267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611142+0000","last_change":"2023-12-14T14:09:10.618373+0000","last_active":"2023-12-14T14:09:11.611142+0000","last_peered":"2023-12-14T14:09:11.611142+0000","last_clean":"2023-12-14T14:09:11.611142+0000","last_became_active":"2023-12-14T14:09:10.618028+0000","last_became_peered":"2023-12-14T14:09:10.618028+0000","last_unstale":"2023-12-14T14:09:11.611142+0000","last_undegraded":"2023-12-14T14:09:11.611142+0000","last_fullsized":"2023-12-14T14:09:11.611142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:56:41.817157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449871+0000","last_change":"2023-12-14T14:09:10.622775+0000","last_active":"2023-12-14T14:09:12.449871+0000","last_peered":"2023-12-14T14:09:12.449871+0000","last_clean":"2023-12-14T14:09:12.449871+0000","last_became_active":"2023-12-14T14:09:10.622407+0000","last_became_peered":"2023-12-14T14:09:10.622407+0000","last_unstale":"2023-12-14T14:09:12.449871+0000","last_undegraded":"2023-12-14T14:09:12.449871+0000","last_fullsized":"2023-12-14T14:09:12.449871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:58:30.740484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450305+0000","last_change":"2023-12-14T14:09:10.622137+0000","last_active":"2023-12-14T14:09:12.450305+0000","last_peered":"2023-12-14T14:09:12.450305+0000","last_clean":"2023-12-14T14:09:12.450305+0000","last_became_active":"2023-12-14T14:09:10.621829+0000","last_became_peered":"2023-12-14T14:09:10.621829+0000","last_unstale":"2023-12-14T14:09:12.450305+0000","last_undegraded":"2023-12-14T14:09:12.450305+0000","last_fullsized":"2023-12-14T14:09:12.450305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:46:53.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450718+0000","last_change":"2023-12-14T14:09:10.625511+0000","last_active":"2023-12-14T14:09:12.450718+0000","last_peered":"2023-12-14T14:09:12.450718+0000","last_clean":"2023-12-14T14:09:12.450718+0000","last_became_active":"2023-12-14T14:09:10.624863+0000","last_became_peered":"2023-12-14T14:09:10.624863+0000","last_unstale":"2023-12-14T14:09:12.450718+0000","last_undegraded":"2023-12-14T14:09:12.450718+0000","last_fullsized":"2023-12-14T14:09:12.450718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:00:15.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610492+0000","last_change":"2023-12-14T14:09:10.623824+0000","last_active":"2023-12-14T14:09:11.610492+0000","last_peered":"2023-12-14T14:09:11.610492+0000","last_clean":"2023-12-14T14:09:11.610492+0000","last_became_active":"2023-12-14T14:09:10.623482+0000","last_became_peered":"2023-12-14T14:09:10.623482+0000","last_unstale":"2023-12-14T14:09:11.610492+0000","last_undegraded":"2023-12-14T14:09:11.610492+0000","last_fullsized":"2023-12-14T14:09:11.610492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:34:46.976441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611365+0000","last_change":"2023-12-14T14:09:10.618004+0000","last_active":"2023-12-14T14:09:11.611365+0000","last_peered":"2023-12-14T14:09:11.611365+0000","last_clean":"2023-12-14T14:09:11.611365+0000","last_became_active":"2023-12-14T14:09:10.617184+0000","last_became_peered":"2023-12-14T14:09:10.617184+0000","last_unstale":"2023-12-14T14:09:11.611365+0000","last_undegraded":"2023-12-14T14:09:11.611365+0000","last_fullsized":"2023-12-14T14:09:11.611365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:11:15.687914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450821+0000","last_change":"2023-12-14T14:09:10.621183+0000","last_active":"2023-12-14T14:09:12.450821+0000","last_peered":"2023-12-14T14:09:12.450821+0000","last_clean":"2023-12-14T14:09:12.450821+0000","last_became_active":"2023-12-14T14:09:10.620474+0000","last_became_peered":"2023-12-14T14:09:10.620474+0000","last_unstale":"2023-12-14T14:09:12.450821+0000","last_undegraded":"2023-12-14T14:09:12.450821+0000","last_fullsized":"2023-12-14T14:09:12.450821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:36:42.247213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407830+0000","last_change":"2023-12-14T14:09:10.630668+0000","last_active":"2023-12-14T14:09:12.407830+0000","last_peered":"2023-12-14T14:09:12.407830+0000","last_clean":"2023-12-14T14:09:12.407830+0000","last_became_active":"2023-12-14T14:09:10.630337+0000","last_became_peered":"2023-12-14T14:09:10.630337+0000","last_unstale":"2023-12-14T14:09:12.407830+0000","last_undegraded":"2023-12-14T14:09:12.407830+0000","last_fullsized":"2023-12-14T14:09:12.407830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:04:48.631722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374293+0000","last_change":"2023-12-14T14:09:10.619550+0000","last_active":"2023-12-14T14:09:12.374293+0000","last_peered":"2023-12-14T14:09:12.374293+0000","last_clean":"2023-12-14T14:09:12.374293+0000","last_became_active":"2023-12-14T14:09:10.619029+0000","last_became_peered":"2023-12-14T14:09:10.619029+0000","last_unstale":"2023-12-14T14:09:12.374293+0000","last_undegraded":"2023-12-14T14:09:12.374293+0000","last_fullsized":"2023-12-14T14:09:12.374293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:27:15.911087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407515+0000","last_change":"2023-12-14T14:09:10.622158+0000","last_active":"2023-12-14T14:09:12.407515+0000","last_peered":"2023-12-14T14:09:12.407515+0000","last_clean":"2023-12-14T14:09:12.407515+0000","last_became_active":"2023-12-14T14:09:10.621853+0000","last_became_peered":"2023-12-14T14:09:10.621853+0000","last_unstale":"2023-12-14T14:09:12.407515+0000","last_undegraded":"2023-12-14T14:09:12.407515+0000","last_fullsized":"2023-12-14T14:09:12.407515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:24:30.913464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T14:09:10.630096+0000","last_change":"2023-12-14T14:09:10.627728+0000","last_active":"2023-12-14T14:09:10.630096+0000","last_peered":"2023-12-14T14:09:10.630096+0000","last_clean":"2023-12-14T14:09:10.630096+0000","last_became_active":"2023-12-14T14:09:10.627352+0000","last_became_peered":"2023-12-14T14:09:10.627352+0000","last_unstale":"2023-12-14T14:09:10.630096+0000","last_undegraded":"2023-12-14T14:09:10.630096+0000","last_fullsized":"2023-12-14T14:09:10.630096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:32:57.247037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610301+0000","last_change":"2023-12-14T14:09:10.625676+0000","last_active":"2023-12-14T14:09:11.610301+0000","last_peered":"2023-12-14T14:09:11.610301+0000","last_clean":"2023-12-14T14:09:11.610301+0000","last_became_active":"2023-12-14T14:09:10.625191+0000","last_became_peered":"2023-12-14T14:09:10.625191+0000","last_unstale":"2023-12-14T14:09:11.610301+0000","last_undegraded":"2023-12-14T14:09:11.610301+0000","last_fullsized":"2023-12-14T14:09:11.610301+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:24:53.447990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611702+0000","last_change":"2023-12-14T14:09:10.624258+0000","last_active":"2023-12-14T14:09:11.611702+0000","last_peered":"2023-12-14T14:09:11.611702+0000","last_clean":"2023-12-14T14:09:11.611702+0000","last_became_active":"2023-12-14T14:09:10.623917+0000","last_became_peered":"2023-12-14T14:09:10.623917+0000","last_unstale":"2023-12-14T14:09:11.611702+0000","last_undegraded":"2023-12-14T14:09:11.611702+0000","last_fullsized":"2023-12-14T14:09:11.611702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:13:30.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21197,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":93,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":28915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481801,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5924,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739228,"statfs":{"total":95995035648,"available":95988969472,"internally_reserved":0,"allocated":880640,"data_stored":423416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":10,"up_from":70,"seq":300647710734,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6208,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738944,"statfs":{"total":95995035648,"available":95988678656,"internally_reserved":0,"allocated":974848,"data_stored":1017268,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":9,"up_from":65,"seq":279172874256,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6056,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739096,"statfs":{"total":95995035648,"available":95988834304,"internally_reserved":0,"allocated":884736,"data_stored":423998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.376},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.505},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.621},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.58499999999999996}]},{"osd":8,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.48399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103189,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6264,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738888,"statfs":{"total":95995035648,"available":95988621312,"internally_reserved":0,"allocated":901120,"data_stored":424154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.623},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.37},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67100000000000004}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.443},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.61199999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364823,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6284,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738868,"statfs":{"total":95995035648,"available":95988600832,"internally_reserved":0,"allocated":921600,"data_stored":1005796,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.311}]},{"osd":1,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.621},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69599999999999995}]},{"osd":8,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.747}]},{"osd":9,"last update":"Thu Dec 14 14:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78600000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6180,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738972,"statfs":{"total":95995035648,"available":95988707328,"internally_reserved":0,"allocated":880640,"data_stored":423416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.314,"5min":0.245,"15min":0.245},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.377},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.35799999999999998},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.441,"15min":0.42499999999999999},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.35999999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.68500000000000005}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56999999999999995}]},{"osd":9,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.57699999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7076,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93738076,"statfs":{"total":95995035648,"available":95987789824,"internally_reserved":0,"allocated":880640,"data_stored":416410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.499,"15min":0.501},"min":{"1min":0.307,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79200000000000004,"5min":0.87,"15min":0.87},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.33400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68999999999999995,"5min":0.751,"15min":0.751},"last":0.62},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:08:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.503,"15min":0.5},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70099999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67400000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.34300000000000003}]},{"osd":5,"last update":"Thu Dec 14 14:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47399999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.67800000000000005}]},{"osd":9,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.63200000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7088,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93738064,"statfs":{"total":95995035648,"available":95987777536,"internally_reserved":0,"allocated":892928,"data_stored":424110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.39000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.497}]},{"osd":2,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.84899999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.34100000000000003},"min":{"1min":0.29899999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.623},{"interface":"front","average":{"1min":0.437,"5min":0.38600000000000001,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.53300000000000003,"15min":0.51500000000000001},"min":{"1min":0.40600000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76600000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Dec 14 14:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.80800000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Dec 14 14:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72899999999999998}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.76800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411368,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7152,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738000,"statfs":{"total":95995035648,"available":95987712000,"internally_reserved":0,"allocated":892928,"data_stored":424741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.33600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Dec 14 14:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.49099999999999999,"15min":0.46300000000000002},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.74399999999999999,"5min":0.877,"15min":0.877},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Dec 14 14:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.41099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.755}]},{"osd":5,"last update":"Thu Dec 14 14:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Dec 14 14:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Dec 14 14:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.80300000000000005}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.878}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215142,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":897024,"data_stored":423700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.32200000000000001,"15min":0.312},"min":{"1min":0.28199999999999997,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33300000000000002},"min":{"1min":0.23200000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.629},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.41499999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Dec 14 14:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.35299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.45400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Dec 14 14:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Dec 14 14:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Dec 14 14:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65600000000000003}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58899999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953506,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6376,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738776,"statfs":{"total":95995035648,"available":95988506624,"internally_reserved":0,"allocated":884736,"data_stored":423438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.498}]},{"osd":1,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.34699999999999998},"min":{"1min":0.29599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.35499999999999998},"min":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.505}]},{"osd":2,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.505,"15min":0.501},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Dec 14 14:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Dec 14 14:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Dec 14 14:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55500000000000005}]},{"osd":8,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.86899999999999999}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.73899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":5,"up_from":37,"seq":158913789983,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6508,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738644,"statfs":{"total":95995035648,"available":95988371456,"internally_reserved":0,"allocated":954368,"data_stored":1014931,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.505,"15min":0.495},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.438,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.503},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.432,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.38200000000000001,"15min":0.374},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.28899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.745},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.498,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.755,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.87}]},{"osd":4,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.44900000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":1.014}]},{"osd":6,"last update":"Thu Dec 14 14:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.032}]},{"osd":7,"last update":"Thu Dec 14 14:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":1.127}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.81799999999999995}]},{"osd":9,"last update":"Thu Dec 14 14:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":1.075}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T14:09:18.454 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T14:09:18.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.606+0000 7f10496ec700 1 -- 172.21.15.69:0/3328241504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044100d20 msgr2=0x7f1044103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.606+0000 7f10496ec700 1 --2- 172.21.15.69:0/3328241504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044100d20 0x7f1044103100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1034009990 tx=0x7f1034009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 -- 172.21.15.69:0/3328241504 shutdown_connections 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 --2- 172.21.15.69:0/3328241504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1044105f60 0x7f1044108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 --2- 172.21.15.69:0/3328241504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044100d20 0x7f1044103100 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 --2- 172.21.15.69:0/3328241504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1044103640 0x7f1044105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 -- 172.21.15.69:0/3328241504 >> 172.21.15.69:0/3328241504 conn(0x7f10440fa780 msgr2=0x7f10440fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 -- 172.21.15.69:0/3328241504 shutdown_connections 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 -- 172.21.15.69:0/3328241504 wait complete. 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 Processor -- start 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 -- start start 2023-12-14T14:09:18.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1044100d20 0x7f1044196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:18.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044103640 0x7f1044196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:18.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1044105f60 0x7f104419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:18.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104419dbb0 con 0x7f1044103640 2023-12-14T14:09:18.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104419dcf0 con 0x7f1044105f60 2023-12-14T14:09:18.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.607+0000 7f10496ec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104419de80 con 0x7f1044100d20 2023-12-14T14:09:18.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10427fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044103640 0x7f1044196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:18.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10427fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044103640 0x7f1044196570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40404/0 (socket says 172.21.15.69:40404) 2023-12-14T14:09:18.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10427fc700 1 -- 172.21.15.69:0/1516093411 learned_addr learned my addr 172.21.15.69:0/1516093411 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:18.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f1042ffd700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1044100d20 0x7f1044196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:18.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10437fe700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1044105f60 0x7f104419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:18.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10427fc700 1 -- 172.21.15.69:0/1516093411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1044100d20 msgr2=0x7f1044196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10427fc700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1044100d20 0x7f1044196030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10427fc700 1 -- 172.21.15.69:0/1516093411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1044105f60 msgr2=0x7f104419d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10427fc700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1044105f60 0x7f104419d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10427fc700 1 -- 172.21.15.69:0/1516093411 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340095f0 con 0x7f1044103640 2023-12-14T14:09:18.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10437fe700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1044105f60 0x7f104419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:18.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10427fc700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044103640 0x7f1044196570 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f103800b530 tx=0x7f103800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:18.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f102bfff700 1 -- 172.21.15.69:0/1516093411 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038011830 con 0x7f1044103640 2023-12-14T14:09:18.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f102bfff700 1 -- 172.21.15.69:0/1516093411 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1038011e50 con 0x7f1044103640 2023-12-14T14:09:18.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104410bc80 con 0x7f1044103640 2023-12-14T14:09:18.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f102bfff700 1 -- 172.21.15.69:0/1516093411 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103800f2e0 con 0x7f1044103640 2023-12-14T14:09:18.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.608+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104410baf0 con 0x7f1044103640 2023-12-14T14:09:18.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.609+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10440fc2f0 con 0x7f1044103640 2023-12-14T14:09:18.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.610+0000 7f102bfff700 1 -- 172.21.15.69:0/1516093411 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1038010580 con 0x7f1044103640 2023-12-14T14:09:18.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.611+0000 7f102bfff700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f102c0a1260 0x7f102c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:18.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.611+0000 7f1042ffd700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f102c0a1260 0x7f102c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:18.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.611+0000 7f102bfff700 1 -- 172.21.15.69:0/1516093411 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f10380cc960 con 0x7f1044103640 2023-12-14T14:09:18.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.611+0000 7f1042ffd700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f102c0a1260 0x7f102c0a3710 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1034006010 tx=0x7f103400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:18.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.614+0000 7f102bfff700 1 -- 172.21.15.69:0/1516093411 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1038096110 con 0x7f1044103640 2023-12-14T14:09:18.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.804+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1044061c90 con 0x7f102c0a1260 2023-12-14T14:09:18.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.814+0000 7f102bfff700 1 -- 172.21.15.69:0/1516093411 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328448 (secure 0 0 0) 0x7f1044061c90 con 0x7f102c0a1260 2023-12-14T14:09:18.819 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:18.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f102c0a1260 msgr2=0x7f102c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f102c0a1260 0x7f102c0a3710 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1034006010 tx=0x7f103400b540 comp rx=0 tx=0).stop 2023-12-14T14:09:18.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044103640 msgr2=0x7f1044196570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:18.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044103640 0x7f1044196570 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f103800b530 tx=0x7f103800b8f0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 shutdown_connections 2023-12-14T14:09:18.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f102c0a1260 0x7f102c0a3710 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1044105f60 0x7f104419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1044100d20 0x7f1044196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 --2- 172.21.15.69:0/1516093411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1044103640 0x7f1044196570 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:18.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 >> 172.21.15.69:0/1516093411 conn(0x7f10440fa780 msgr2=0x7f1044101980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:18.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 shutdown_connections 2023-12-14T14:09:18.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:18.818+0000 7f10496ec700 1 -- 172.21.15.69:0/1516093411 wait complete. 2023-12-14T14:09:18.824 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T14:09:18.829 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2023-12-14T14:09:18.605482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":611688,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":147,"num_read_kb":128,"num_write":294,"num_write_kb":2991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":77764,"kb_used_data":10660,"kb_used_omap":0,"kb_used_meta":67008,"kb_avail":1124864060,"statfs":{"total":1151940427776,"available":1151860797440,"internally_reserved":0,"allocated":10915840,"data_stored":6882013,"data_compressed":107034,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":68616192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21320,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":113,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002750"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611392+0000","last_change":"2023-12-14T14:09:10.621884+0000","last_active":"2023-12-14T14:09:11.611392+0000","last_peered":"2023-12-14T14:09:11.611392+0000","last_clean":"2023-12-14T14:09:11.611392+0000","last_became_active":"2023-12-14T14:09:10.621605+0000","last_became_peered":"2023-12-14T14:09:10.621605+0000","last_unstale":"2023-12-14T14:09:11.611392+0000","last_undegraded":"2023-12-14T14:09:11.611392+0000","last_fullsized":"2023-12-14T14:09:11.611392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:52:34.121106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450636+0000","last_change":"2023-12-14T14:09:10.621555+0000","last_active":"2023-12-14T14:09:12.450636+0000","last_peered":"2023-12-14T14:09:12.450636+0000","last_clean":"2023-12-14T14:09:12.450636+0000","last_became_active":"2023-12-14T14:09:10.621265+0000","last_became_peered":"2023-12-14T14:09:10.621265+0000","last_unstale":"2023-12-14T14:09:12.450636+0000","last_undegraded":"2023-12-14T14:09:12.450636+0000","last_fullsized":"2023-12-14T14:09:12.450636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:46:18.920671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450457+0000","last_change":"2023-12-14T14:09:10.623575+0000","last_active":"2023-12-14T14:09:12.450457+0000","last_peered":"2023-12-14T14:09:12.450457+0000","last_clean":"2023-12-14T14:09:12.450457+0000","last_became_active":"2023-12-14T14:09:10.623289+0000","last_became_peered":"2023-12-14T14:09:10.623289+0000","last_unstale":"2023-12-14T14:09:12.450457+0000","last_undegraded":"2023-12-14T14:09:12.450457+0000","last_fullsized":"2023-12-14T14:09:12.450457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:21:24.793809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611562+0000","last_change":"2023-12-14T14:09:10.622850+0000","last_active":"2023-12-14T14:09:11.611562+0000","last_peered":"2023-12-14T14:09:11.611562+0000","last_clean":"2023-12-14T14:09:11.611562+0000","last_became_active":"2023-12-14T14:09:10.622456+0000","last_became_peered":"2023-12-14T14:09:10.622456+0000","last_unstale":"2023-12-14T14:09:11.611562+0000","last_undegraded":"2023-12-14T14:09:11.611562+0000","last_fullsized":"2023-12-14T14:09:11.611562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:33:10.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449942+0000","last_change":"2023-12-14T14:09:10.623459+0000","last_active":"2023-12-14T14:09:12.449942+0000","last_peered":"2023-12-14T14:09:12.449942+0000","last_clean":"2023-12-14T14:09:12.449942+0000","last_became_active":"2023-12-14T14:09:10.623100+0000","last_became_peered":"2023-12-14T14:09:10.623100+0000","last_unstale":"2023-12-14T14:09:12.449942+0000","last_undegraded":"2023-12-14T14:09:12.449942+0000","last_fullsized":"2023-12-14T14:09:12.449942+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:15:11.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450472+0000","last_change":"2023-12-14T14:09:10.624663+0000","last_active":"2023-12-14T14:09:12.450472+0000","last_peered":"2023-12-14T14:09:12.450472+0000","last_clean":"2023-12-14T14:09:12.450472+0000","last_became_active":"2023-12-14T14:09:10.624313+0000","last_became_peered":"2023-12-14T14:09:10.624313+0000","last_unstale":"2023-12-14T14:09:12.450472+0000","last_undegraded":"2023-12-14T14:09:12.450472+0000","last_fullsized":"2023-12-14T14:09:12.450472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:36:58.959484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626715+0000","last_change":"2023-12-14T14:09:10.622519+0000","last_active":"2023-12-14T14:09:11.626715+0000","last_peered":"2023-12-14T14:09:11.626715+0000","last_clean":"2023-12-14T14:09:11.626715+0000","last_became_active":"2023-12-14T14:09:10.622147+0000","last_became_peered":"2023-12-14T14:09:10.622147+0000","last_unstale":"2023-12-14T14:09:11.626715+0000","last_undegraded":"2023-12-14T14:09:11.626715+0000","last_fullsized":"2023-12-14T14:09:11.626715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:06:54.114410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407505+0000","last_change":"2023-12-14T14:09:10.622762+0000","last_active":"2023-12-14T14:09:12.407505+0000","last_peered":"2023-12-14T14:09:12.407505+0000","last_clean":"2023-12-14T14:09:12.407505+0000","last_became_active":"2023-12-14T14:09:10.622199+0000","last_became_peered":"2023-12-14T14:09:10.622199+0000","last_unstale":"2023-12-14T14:09:12.407505+0000","last_undegraded":"2023-12-14T14:09:12.407505+0000","last_fullsized":"2023-12-14T14:09:12.407505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:05:12.024946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450680+0000","last_change":"2023-12-14T14:09:10.625452+0000","last_active":"2023-12-14T14:09:12.450680+0000","last_peered":"2023-12-14T14:09:12.450680+0000","last_clean":"2023-12-14T14:09:12.450680+0000","last_became_active":"2023-12-14T14:09:10.620053+0000","last_became_peered":"2023-12-14T14:09:10.620053+0000","last_unstale":"2023-12-14T14:09:12.450680+0000","last_undegraded":"2023-12-14T14:09:12.450680+0000","last_fullsized":"2023-12-14T14:09:12.450680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:44:53.320690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.451174+0000","last_change":"2023-12-14T14:09:10.631871+0000","last_active":"2023-12-14T14:09:12.451174+0000","last_peered":"2023-12-14T14:09:12.451174+0000","last_clean":"2023-12-14T14:09:12.451174+0000","last_became_active":"2023-12-14T14:09:10.631549+0000","last_became_peered":"2023-12-14T14:09:10.631549+0000","last_unstale":"2023-12-14T14:09:12.451174+0000","last_undegraded":"2023-12-14T14:09:12.451174+0000","last_fullsized":"2023-12-14T14:09:12.451174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:05:03.676055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626995+0000","last_change":"2023-12-14T14:09:10.633572+0000","last_active":"2023-12-14T14:09:11.626995+0000","last_peered":"2023-12-14T14:09:11.626995+0000","last_clean":"2023-12-14T14:09:11.626995+0000","last_became_active":"2023-12-14T14:09:10.633251+0000","last_became_peered":"2023-12-14T14:09:10.633251+0000","last_unstale":"2023-12-14T14:09:11.626995+0000","last_undegraded":"2023-12-14T14:09:11.626995+0000","last_fullsized":"2023-12-14T14:09:11.626995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:12:19.816759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611430+0000","last_change":"2023-12-14T14:09:10.630621+0000","last_active":"2023-12-14T14:09:11.611430+0000","last_peered":"2023-12-14T14:09:11.611430+0000","last_clean":"2023-12-14T14:09:11.611430+0000","last_became_active":"2023-12-14T14:09:10.630196+0000","last_became_peered":"2023-12-14T14:09:10.630196+0000","last_unstale":"2023-12-14T14:09:11.611430+0000","last_undegraded":"2023-12-14T14:09:11.611430+0000","last_fullsized":"2023-12-14T14:09:11.611430+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:47:07.876989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610386+0000","last_change":"2023-12-14T14:09:10.617111+0000","last_active":"2023-12-14T14:09:11.610386+0000","last_peered":"2023-12-14T14:09:11.610386+0000","last_clean":"2023-12-14T14:09:11.610386+0000","last_became_active":"2023-12-14T14:09:10.616817+0000","last_became_peered":"2023-12-14T14:09:10.616817+0000","last_unstale":"2023-12-14T14:09:11.610386+0000","last_undegraded":"2023-12-14T14:09:11.610386+0000","last_fullsized":"2023-12-14T14:09:11.610386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:32:53.038532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450326+0000","last_change":"2023-12-14T14:09:10.620373+0000","last_active":"2023-12-14T14:09:12.450326+0000","last_peered":"2023-12-14T14:09:12.450326+0000","last_clean":"2023-12-14T14:09:12.450326+0000","last_became_active":"2023-12-14T14:09:10.620107+0000","last_became_peered":"2023-12-14T14:09:10.620107+0000","last_unstale":"2023-12-14T14:09:12.450326+0000","last_undegraded":"2023-12-14T14:09:12.450326+0000","last_fullsized":"2023-12-14T14:09:12.450326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:21:44.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450001+0000","last_change":"2023-12-14T14:09:10.624554+0000","last_active":"2023-12-14T14:09:12.450001+0000","last_peered":"2023-12-14T14:09:12.450001+0000","last_clean":"2023-12-14T14:09:12.450001+0000","last_became_active":"2023-12-14T14:09:10.624255+0000","last_became_peered":"2023-12-14T14:09:10.624255+0000","last_unstale":"2023-12-14T14:09:12.450001+0000","last_undegraded":"2023-12-14T14:09:12.450001+0000","last_fullsized":"2023-12-14T14:09:12.450001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:28:58.674883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449876+0000","last_change":"2023-12-14T14:09:10.632464+0000","last_active":"2023-12-14T14:09:12.449876+0000","last_peered":"2023-12-14T14:09:12.449876+0000","last_clean":"2023-12-14T14:09:12.449876+0000","last_became_active":"2023-12-14T14:09:10.632102+0000","last_became_peered":"2023-12-14T14:09:10.632102+0000","last_unstale":"2023-12-14T14:09:12.449876+0000","last_undegraded":"2023-12-14T14:09:12.449876+0000","last_fullsized":"2023-12-14T14:09:12.449876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:48:12.491292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611548+0000","last_change":"2023-12-14T14:09:10.619144+0000","last_active":"2023-12-14T14:09:11.611548+0000","last_peered":"2023-12-14T14:09:11.611548+0000","last_clean":"2023-12-14T14:09:11.611548+0000","last_became_active":"2023-12-14T14:09:10.618833+0000","last_became_peered":"2023-12-14T14:09:10.618833+0000","last_unstale":"2023-12-14T14:09:11.611548+0000","last_undegraded":"2023-12-14T14:09:11.611548+0000","last_fullsized":"2023-12-14T14:09:11.611548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:39:23.775221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450257+0000","last_change":"2023-12-14T14:09:10.619062+0000","last_active":"2023-12-14T14:09:12.450257+0000","last_peered":"2023-12-14T14:09:12.450257+0000","last_clean":"2023-12-14T14:09:12.450257+0000","last_became_active":"2023-12-14T14:09:10.618750+0000","last_became_peered":"2023-12-14T14:09:10.618750+0000","last_unstale":"2023-12-14T14:09:12.450257+0000","last_undegraded":"2023-12-14T14:09:12.450257+0000","last_fullsized":"2023-12-14T14:09:12.450257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:28:30.651988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450436+0000","last_change":"2023-12-14T14:09:10.621410+0000","last_active":"2023-12-14T14:09:12.450436+0000","last_peered":"2023-12-14T14:09:12.450436+0000","last_clean":"2023-12-14T14:09:12.450436+0000","last_became_active":"2023-12-14T14:09:10.621037+0000","last_became_peered":"2023-12-14T14:09:10.621037+0000","last_unstale":"2023-12-14T14:09:12.450436+0000","last_undegraded":"2023-12-14T14:09:12.450436+0000","last_fullsized":"2023-12-14T14:09:12.450436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:39:09.650960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.807814+0000","last_change":"2023-12-14T14:09:10.218180+0000","last_active":"2023-12-14T14:09:14.807814+0000","last_peered":"2023-12-14T14:09:14.807814+0000","last_clean":"2023-12-14T14:09:14.807814+0000","last_became_active":"2023-12-14T14:09:10.217856+0000","last_became_peered":"2023-12-14T14:09:10.217856+0000","last_unstale":"2023-12-14T14:09:14.807814+0000","last_undegraded":"2023-12-14T14:09:14.807814+0000","last_fullsized":"2023-12-14T14:09:14.807814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:34:17.405766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407962+0000","last_change":"2023-12-14T14:09:10.628500+0000","last_active":"2023-12-14T14:09:12.407962+0000","last_peered":"2023-12-14T14:09:12.407962+0000","last_clean":"2023-12-14T14:09:12.407962+0000","last_became_active":"2023-12-14T14:09:10.628120+0000","last_became_peered":"2023-12-14T14:09:10.628120+0000","last_unstale":"2023-12-14T14:09:12.407962+0000","last_undegraded":"2023-12-14T14:09:12.407962+0000","last_fullsized":"2023-12-14T14:09:12.407962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:34:44.660042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.408005+0000","last_change":"2023-12-14T14:09:10.218608+0000","last_active":"2023-12-14T14:09:12.408005+0000","last_peered":"2023-12-14T14:09:12.408005+0000","last_clean":"2023-12-14T14:09:12.408005+0000","last_became_active":"2023-12-14T14:09:10.218010+0000","last_became_peered":"2023-12-14T14:09:10.218010+0000","last_unstale":"2023-12-14T14:09:12.408005+0000","last_undegraded":"2023-12-14T14:09:12.408005+0000","last_fullsized":"2023-12-14T14:09:12.408005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:35:05.683768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450785+0000","last_change":"2023-12-14T14:09:10.621972+0000","last_active":"2023-12-14T14:09:12.450785+0000","last_peered":"2023-12-14T14:09:12.450785+0000","last_clean":"2023-12-14T14:09:12.450785+0000","last_became_active":"2023-12-14T14:09:10.621685+0000","last_became_peered":"2023-12-14T14:09:10.621685+0000","last_unstale":"2023-12-14T14:09:12.450785+0000","last_undegraded":"2023-12-14T14:09:12.450785+0000","last_fullsized":"2023-12-14T14:09:12.450785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:13:06.816242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.806768+0000","last_change":"2023-12-14T14:09:10.220860+0000","last_active":"2023-12-14T14:09:14.806768+0000","last_peered":"2023-12-14T14:09:14.806768+0000","last_clean":"2023-12-14T14:09:14.806768+0000","last_became_active":"2023-12-14T14:09:10.219802+0000","last_became_peered":"2023-12-14T14:09:10.219802+0000","last_unstale":"2023-12-14T14:09:14.806768+0000","last_undegraded":"2023-12-14T14:09:14.806768+0000","last_fullsized":"2023-12-14T14:09:14.806768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:01:27.246337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450032+0000","last_change":"2023-12-14T14:09:10.626807+0000","last_active":"2023-12-14T14:09:12.450032+0000","last_peered":"2023-12-14T14:09:12.450032+0000","last_clean":"2023-12-14T14:09:12.450032+0000","last_became_active":"2023-12-14T14:09:10.626450+0000","last_became_peered":"2023-12-14T14:09:10.626450+0000","last_unstale":"2023-12-14T14:09:12.450032+0000","last_undegraded":"2023-12-14T14:09:12.450032+0000","last_fullsized":"2023-12-14T14:09:12.450032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:25:06.887649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450628+0000","last_change":"2023-12-14T14:09:10.216515+0000","last_active":"2023-12-14T14:09:12.450628+0000","last_peered":"2023-12-14T14:09:12.450628+0000","last_clean":"2023-12-14T14:09:12.450628+0000","last_became_active":"2023-12-14T14:09:10.216175+0000","last_became_peered":"2023-12-14T14:09:10.216175+0000","last_unstale":"2023-12-14T14:09:12.450628+0000","last_undegraded":"2023-12-14T14:09:12.450628+0000","last_fullsized":"2023-12-14T14:09:12.450628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:52:31.006083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374755+0000","last_change":"2023-12-14T14:09:10.627664+0000","last_active":"2023-12-14T14:09:12.374755+0000","last_peered":"2023-12-14T14:09:12.374755+0000","last_clean":"2023-12-14T14:09:12.374755+0000","last_became_active":"2023-12-14T14:09:10.627376+0000","last_became_peered":"2023-12-14T14:09:10.627376+0000","last_unstale":"2023-12-14T14:09:12.374755+0000","last_undegraded":"2023-12-14T14:09:12.374755+0000","last_fullsized":"2023-12-14T14:09:12.374755+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:41:03.037811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:15.812301+0000","last_change":"2023-12-14T14:09:10.218806+0000","last_active":"2023-12-14T14:09:15.812301+0000","last_peered":"2023-12-14T14:09:15.812301+0000","last_clean":"2023-12-14T14:09:15.812301+0000","last_became_active":"2023-12-14T14:09:10.218441+0000","last_became_peered":"2023-12-14T14:09:10.218441+0000","last_unstale":"2023-12-14T14:09:15.812301+0000","last_undegraded":"2023-12-14T14:09:15.812301+0000","last_fullsized":"2023-12-14T14:09:15.812301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:50:30.949849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450206+0000","last_change":"2023-12-14T14:09:10.622903+0000","last_active":"2023-12-14T14:09:12.450206+0000","last_peered":"2023-12-14T14:09:12.450206+0000","last_clean":"2023-12-14T14:09:12.450206+0000","last_became_active":"2023-12-14T14:09:10.622261+0000","last_became_peered":"2023-12-14T14:09:10.622261+0000","last_unstale":"2023-12-14T14:09:12.450206+0000","last_undegraded":"2023-12-14T14:09:12.450206+0000","last_fullsized":"2023-12-14T14:09:12.450206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:17:13.547591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.809526+0000","last_change":"2023-12-14T14:09:10.222254+0000","last_active":"2023-12-14T14:09:14.809526+0000","last_peered":"2023-12-14T14:09:14.809526+0000","last_clean":"2023-12-14T14:09:14.809526+0000","last_became_active":"2023-12-14T14:09:10.221861+0000","last_became_peered":"2023-12-14T14:09:10.221861+0000","last_unstale":"2023-12-14T14:09:14.809526+0000","last_undegraded":"2023-12-14T14:09:14.809526+0000","last_fullsized":"2023-12-14T14:09:14.809526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:12:17.252109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374542+0000","last_change":"2023-12-14T14:09:10.625646+0000","last_active":"2023-12-14T14:09:12.374542+0000","last_peered":"2023-12-14T14:09:12.374542+0000","last_clean":"2023-12-14T14:09:12.374542+0000","last_became_active":"2023-12-14T14:09:10.625179+0000","last_became_peered":"2023-12-14T14:09:10.625179+0000","last_unstale":"2023-12-14T14:09:12.374542+0000","last_undegraded":"2023-12-14T14:09:12.374542+0000","last_fullsized":"2023-12-14T14:09:12.374542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:28:56.557023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610111+0000","last_change":"2023-12-14T14:09:10.212885+0000","last_active":"2023-12-14T14:09:11.610111+0000","last_peered":"2023-12-14T14:09:11.610111+0000","last_clean":"2023-12-14T14:09:11.610111+0000","last_became_active":"2023-12-14T14:09:10.212311+0000","last_became_peered":"2023-12-14T14:09:10.212311+0000","last_unstale":"2023-12-14T14:09:11.610111+0000","last_undegraded":"2023-12-14T14:09:11.610111+0000","last_fullsized":"2023-12-14T14:09:11.610111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:36:02.124214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407399+0000","last_change":"2023-12-14T14:09:10.620795+0000","last_active":"2023-12-14T14:09:12.407399+0000","last_peered":"2023-12-14T14:09:12.407399+0000","last_clean":"2023-12-14T14:09:12.407399+0000","last_became_active":"2023-12-14T14:09:10.620453+0000","last_became_peered":"2023-12-14T14:09:10.620453+0000","last_unstale":"2023-12-14T14:09:12.407399+0000","last_undegraded":"2023-12-14T14:09:12.407399+0000","last_fullsized":"2023-12-14T14:09:12.407399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:54:17.454367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374266+0000","last_change":"2023-12-14T14:09:10.218969+0000","last_active":"2023-12-14T14:09:12.374266+0000","last_peered":"2023-12-14T14:09:12.374266+0000","last_clean":"2023-12-14T14:09:12.374266+0000","last_became_active":"2023-12-14T14:09:10.218624+0000","last_became_peered":"2023-12-14T14:09:10.218624+0000","last_unstale":"2023-12-14T14:09:12.374266+0000","last_undegraded":"2023-12-14T14:09:12.374266+0000","last_fullsized":"2023-12-14T14:09:12.374266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:47:39.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450113+0000","last_change":"2023-12-14T14:09:10.619202+0000","last_active":"2023-12-14T14:09:12.450113+0000","last_peered":"2023-12-14T14:09:12.450113+0000","last_clean":"2023-12-14T14:09:12.450113+0000","last_became_active":"2023-12-14T14:09:10.618944+0000","last_became_peered":"2023-12-14T14:09:10.618944+0000","last_unstale":"2023-12-14T14:09:12.450113+0000","last_undegraded":"2023-12-14T14:09:12.450113+0000","last_fullsized":"2023-12-14T14:09:12.450113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:01:48.400281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800832+0000","last_change":"2023-12-14T14:09:10.214323+0000","last_active":"2023-12-14T14:09:13.800832+0000","last_peered":"2023-12-14T14:09:13.800832+0000","last_clean":"2023-12-14T14:09:13.800832+0000","last_became_active":"2023-12-14T14:09:10.213998+0000","last_became_peered":"2023-12-14T14:09:10.213998+0000","last_unstale":"2023-12-14T14:09:13.800832+0000","last_undegraded":"2023-12-14T14:09:13.800832+0000","last_fullsized":"2023-12-14T14:09:13.800832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:42:36.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450376+0000","last_change":"2023-12-14T14:09:10.626967+0000","last_active":"2023-12-14T14:09:12.450376+0000","last_peered":"2023-12-14T14:09:12.450376+0000","last_clean":"2023-12-14T14:09:12.450376+0000","last_became_active":"2023-12-14T14:09:10.626589+0000","last_became_peered":"2023-12-14T14:09:10.626589+0000","last_unstale":"2023-12-14T14:09:12.450376+0000","last_undegraded":"2023-12-14T14:09:12.450376+0000","last_fullsized":"2023-12-14T14:09:12.450376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:18:05.427208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800485+0000","last_change":"2023-12-14T14:09:10.221868+0000","last_active":"2023-12-14T14:09:13.800485+0000","last_peered":"2023-12-14T14:09:13.800485+0000","last_clean":"2023-12-14T14:09:13.800485+0000","last_became_active":"2023-12-14T14:09:10.221378+0000","last_became_peered":"2023-12-14T14:09:10.221378+0000","last_unstale":"2023-12-14T14:09:13.800485+0000","last_undegraded":"2023-12-14T14:09:13.800485+0000","last_fullsized":"2023-12-14T14:09:13.800485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:00:02.721676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450749+0000","last_change":"2023-12-14T14:09:10.630669+0000","last_active":"2023-12-14T14:09:12.450749+0000","last_peered":"2023-12-14T14:09:12.450749+0000","last_clean":"2023-12-14T14:09:12.450749+0000","last_became_active":"2023-12-14T14:09:10.630351+0000","last_became_peered":"2023-12-14T14:09:10.630351+0000","last_unstale":"2023-12-14T14:09:12.450749+0000","last_undegraded":"2023-12-14T14:09:12.450749+0000","last_fullsized":"2023-12-14T14:09:12.450749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:39:01.883621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800086+0000","last_change":"2023-12-14T14:09:10.214352+0000","last_active":"2023-12-14T14:09:13.800086+0000","last_peered":"2023-12-14T14:09:13.800086+0000","last_clean":"2023-12-14T14:09:13.800086+0000","last_became_active":"2023-12-14T14:09:10.213873+0000","last_became_peered":"2023-12-14T14:09:10.213873+0000","last_unstale":"2023-12-14T14:09:13.800086+0000","last_undegraded":"2023-12-14T14:09:13.800086+0000","last_fullsized":"2023-12-14T14:09:13.800086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:34:30.048744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450214+0000","last_change":"2023-12-14T14:09:10.631272+0000","last_active":"2023-12-14T14:09:12.450214+0000","last_peered":"2023-12-14T14:09:12.450214+0000","last_clean":"2023-12-14T14:09:12.450214+0000","last_became_active":"2023-12-14T14:09:10.630923+0000","last_became_peered":"2023-12-14T14:09:10.630923+0000","last_unstale":"2023-12-14T14:09:12.450214+0000","last_undegraded":"2023-12-14T14:09:12.450214+0000","last_fullsized":"2023-12-14T14:09:12.450214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:21:37.270983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'14","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:16.216348+0000","last_change":"2023-12-14T14:09:10.219006+0000","last_active":"2023-12-14T14:09:16.216348+0000","last_peered":"2023-12-14T14:09:16.216348+0000","last_clean":"2023-12-14T14:09:16.216348+0000","last_became_active":"2023-12-14T14:09:10.218694+0000","last_became_peered":"2023-12-14T14:09:10.218694+0000","last_unstale":"2023-12-14T14:09:16.216348+0000","last_undegraded":"2023-12-14T14:09:16.216348+0000","last_fullsized":"2023-12-14T14:09:16.216348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:24:00.199652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18929,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450731+0000","last_change":"2023-12-14T14:09:10.624056+0000","last_active":"2023-12-14T14:09:12.450731+0000","last_peered":"2023-12-14T14:09:12.450731+0000","last_clean":"2023-12-14T14:09:12.450731+0000","last_became_active":"2023-12-14T14:09:10.623622+0000","last_became_peered":"2023-12-14T14:09:10.623622+0000","last_unstale":"2023-12-14T14:09:12.450731+0000","last_undegraded":"2023-12-14T14:09:12.450731+0000","last_fullsized":"2023-12-14T14:09:12.450731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:21:01.045406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.801871+0000","last_change":"2023-12-14T14:09:10.215236+0000","last_active":"2023-12-14T14:09:13.801871+0000","last_peered":"2023-12-14T14:09:13.801871+0000","last_clean":"2023-12-14T14:09:13.801871+0000","last_became_active":"2023-12-14T14:09:10.214941+0000","last_became_peered":"2023-12-14T14:09:10.214941+0000","last_unstale":"2023-12-14T14:09:13.801871+0000","last_undegraded":"2023-12-14T14:09:13.801871+0000","last_fullsized":"2023-12-14T14:09:13.801871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:56:39.026819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610145+0000","last_change":"2023-12-14T14:09:10.625352+0000","last_active":"2023-12-14T14:09:11.610145+0000","last_peered":"2023-12-14T14:09:11.610145+0000","last_clean":"2023-12-14T14:09:11.610145+0000","last_became_active":"2023-12-14T14:09:10.625037+0000","last_became_peered":"2023-12-14T14:09:10.625037+0000","last_unstale":"2023-12-14T14:09:11.610145+0000","last_undegraded":"2023-12-14T14:09:11.610145+0000","last_fullsized":"2023-12-14T14:09:11.610145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:04:20.861942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.801523+0000","last_change":"2023-12-14T14:09:10.219028+0000","last_active":"2023-12-14T14:09:13.801523+0000","last_peered":"2023-12-14T14:09:13.801523+0000","last_clean":"2023-12-14T14:09:13.801523+0000","last_became_active":"2023-12-14T14:09:10.218687+0000","last_became_peered":"2023-12-14T14:09:10.218687+0000","last_unstale":"2023-12-14T14:09:13.801523+0000","last_undegraded":"2023-12-14T14:09:13.801523+0000","last_fullsized":"2023-12-14T14:09:13.801523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:28:56.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627176+0000","last_change":"2023-12-14T14:09:10.623660+0000","last_active":"2023-12-14T14:09:11.627176+0000","last_peered":"2023-12-14T14:09:11.627176+0000","last_clean":"2023-12-14T14:09:11.627176+0000","last_became_active":"2023-12-14T14:09:10.623321+0000","last_became_peered":"2023-12-14T14:09:10.623321+0000","last_unstale":"2023-12-14T14:09:11.627176+0000","last_undegraded":"2023-12-14T14:09:11.627176+0000","last_fullsized":"2023-12-14T14:09:11.627176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:57:57.403056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611062+0000","last_change":"2023-12-14T14:09:10.217849+0000","last_active":"2023-12-14T14:09:11.611062+0000","last_peered":"2023-12-14T14:09:11.611062+0000","last_clean":"2023-12-14T14:09:11.611062+0000","last_became_active":"2023-12-14T14:09:10.217501+0000","last_became_peered":"2023-12-14T14:09:10.217501+0000","last_unstale":"2023-12-14T14:09:11.611062+0000","last_undegraded":"2023-12-14T14:09:11.611062+0000","last_fullsized":"2023-12-14T14:09:11.611062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:56:37.539435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626553+0000","last_change":"2023-12-14T14:09:10.627193+0000","last_active":"2023-12-14T14:09:11.626553+0000","last_peered":"2023-12-14T14:09:11.626553+0000","last_clean":"2023-12-14T14:09:11.626553+0000","last_became_active":"2023-12-14T14:09:10.626887+0000","last_became_peered":"2023-12-14T14:09:10.626887+0000","last_unstale":"2023-12-14T14:09:11.626553+0000","last_undegraded":"2023-12-14T14:09:11.626553+0000","last_fullsized":"2023-12-14T14:09:11.626553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:48.943605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.808366+0000","last_change":"2023-12-14T14:09:10.220564+0000","last_active":"2023-12-14T14:09:14.808366+0000","last_peered":"2023-12-14T14:09:14.808366+0000","last_clean":"2023-12-14T14:09:14.808366+0000","last_became_active":"2023-12-14T14:09:10.219921+0000","last_became_peered":"2023-12-14T14:09:10.219921+0000","last_unstale":"2023-12-14T14:09:14.808366+0000","last_undegraded":"2023-12-14T14:09:14.808366+0000","last_fullsized":"2023-12-14T14:09:14.808366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:01.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374323+0000","last_change":"2023-12-14T14:09:10.625056+0000","last_active":"2023-12-14T14:09:12.374323+0000","last_peered":"2023-12-14T14:09:12.374323+0000","last_clean":"2023-12-14T14:09:12.374323+0000","last_became_active":"2023-12-14T14:09:10.624626+0000","last_became_peered":"2023-12-14T14:09:10.624626+0000","last_unstale":"2023-12-14T14:09:12.374323+0000","last_undegraded":"2023-12-14T14:09:12.374323+0000","last_fullsized":"2023-12-14T14:09:12.374323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:19:24.087342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450772+0000","last_change":"2023-12-14T14:09:10.215413+0000","last_active":"2023-12-14T14:09:12.450772+0000","last_peered":"2023-12-14T14:09:12.450772+0000","last_clean":"2023-12-14T14:09:12.450772+0000","last_became_active":"2023-12-14T14:09:10.214925+0000","last_became_peered":"2023-12-14T14:09:10.214925+0000","last_unstale":"2023-12-14T14:09:12.450772+0000","last_undegraded":"2023-12-14T14:09:12.450772+0000","last_fullsized":"2023-12-14T14:09:12.450772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:29.337362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611673+0000","last_change":"2023-12-14T14:09:10.629879+0000","last_active":"2023-12-14T14:09:11.611673+0000","last_peered":"2023-12-14T14:09:11.611673+0000","last_clean":"2023-12-14T14:09:11.611673+0000","last_became_active":"2023-12-14T14:09:10.629539+0000","last_became_peered":"2023-12-14T14:09:10.629539+0000","last_unstale":"2023-12-14T14:09:11.611673+0000","last_undegraded":"2023-12-14T14:09:11.611673+0000","last_fullsized":"2023-12-14T14:09:11.611673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:39:43.910568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450107+0000","last_change":"2023-12-14T14:09:10.214875+0000","last_active":"2023-12-14T14:09:12.450107+0000","last_peered":"2023-12-14T14:09:12.450107+0000","last_clean":"2023-12-14T14:09:12.450107+0000","last_became_active":"2023-12-14T14:09:10.214518+0000","last_became_peered":"2023-12-14T14:09:10.214518+0000","last_unstale":"2023-12-14T14:09:12.450107+0000","last_undegraded":"2023-12-14T14:09:12.450107+0000","last_fullsized":"2023-12-14T14:09:12.450107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:47:45.358021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450946+0000","last_change":"2023-12-14T14:09:10.619279+0000","last_active":"2023-12-14T14:09:12.450946+0000","last_peered":"2023-12-14T14:09:12.450946+0000","last_clean":"2023-12-14T14:09:12.450946+0000","last_became_active":"2023-12-14T14:09:10.618794+0000","last_became_peered":"2023-12-14T14:09:10.618794+0000","last_unstale":"2023-12-14T14:09:12.450946+0000","last_undegraded":"2023-12-14T14:09:12.450946+0000","last_fullsized":"2023-12-14T14:09:12.450946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:26:59.987926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.879730+0000","last_change":"2023-12-14T14:09:10.222213+0000","last_active":"2023-12-14T14:09:11.879730+0000","last_peered":"2023-12-14T14:09:11.879730+0000","last_clean":"2023-12-14T14:09:11.879730+0000","last_became_active":"2023-12-14T14:09:10.221314+0000","last_became_peered":"2023-12-14T14:09:10.221314+0000","last_unstale":"2023-12-14T14:09:11.879730+0000","last_undegraded":"2023-12-14T14:09:11.879730+0000","last_fullsized":"2023-12-14T14:09:11.879730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:08:22.888160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450812+0000","last_change":"2023-12-14T14:09:10.624523+0000","last_active":"2023-12-14T14:09:12.450812+0000","last_peered":"2023-12-14T14:09:12.450812+0000","last_clean":"2023-12-14T14:09:12.450812+0000","last_became_active":"2023-12-14T14:09:10.624204+0000","last_became_peered":"2023-12-14T14:09:10.624204+0000","last_unstale":"2023-12-14T14:09:12.450812+0000","last_undegraded":"2023-12-14T14:09:12.450812+0000","last_fullsized":"2023-12-14T14:09:12.450812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:57:02.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374413+0000","last_change":"2023-12-14T14:09:10.626166+0000","last_active":"2023-12-14T14:09:12.374413+0000","last_peered":"2023-12-14T14:09:12.374413+0000","last_clean":"2023-12-14T14:09:12.374413+0000","last_became_active":"2023-12-14T14:09:10.625831+0000","last_became_peered":"2023-12-14T14:09:10.625831+0000","last_unstale":"2023-12-14T14:09:12.374413+0000","last_undegraded":"2023-12-14T14:09:12.374413+0000","last_fullsized":"2023-12-14T14:09:12.374413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:37:59.030750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.799869+0000","last_change":"2023-12-14T14:09:10.217759+0000","last_active":"2023-12-14T14:09:13.799869+0000","last_peered":"2023-12-14T14:09:13.799869+0000","last_clean":"2023-12-14T14:09:13.799869+0000","last_became_active":"2023-12-14T14:09:10.217454+0000","last_became_peered":"2023-12-14T14:09:10.217454+0000","last_unstale":"2023-12-14T14:09:13.799869+0000","last_undegraded":"2023-12-14T14:09:13.799869+0000","last_fullsized":"2023-12-14T14:09:13.799869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:31:22.360965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407749+0000","last_change":"2023-12-14T14:09:10.619315+0000","last_active":"2023-12-14T14:09:12.407749+0000","last_peered":"2023-12-14T14:09:12.407749+0000","last_clean":"2023-12-14T14:09:12.407749+0000","last_became_active":"2023-12-14T14:09:10.619020+0000","last_became_peered":"2023-12-14T14:09:10.619020+0000","last_unstale":"2023-12-14T14:09:12.407749+0000","last_undegraded":"2023-12-14T14:09:12.407749+0000","last_fullsized":"2023-12-14T14:09:12.407749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:29:53.925419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.799815+0000","last_change":"2023-12-14T14:09:10.214557+0000","last_active":"2023-12-14T14:09:13.799815+0000","last_peered":"2023-12-14T14:09:13.799815+0000","last_clean":"2023-12-14T14:09:13.799815+0000","last_became_active":"2023-12-14T14:09:10.214179+0000","last_became_peered":"2023-12-14T14:09:10.214179+0000","last_unstale":"2023-12-14T14:09:13.799815+0000","last_undegraded":"2023-12-14T14:09:13.799815+0000","last_fullsized":"2023-12-14T14:09:13.799815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:06:48.176436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626607+0000","last_change":"2023-12-14T14:08:24.268746+0000","last_active":"2023-12-14T14:09:11.626607+0000","last_peered":"2023-12-14T14:09:11.626607+0000","last_clean":"2023-12-14T14:09:11.626607+0000","last_became_active":"2023-12-14T14:08:24.268402+0000","last_became_peered":"2023-12-14T14:08:24.268402+0000","last_unstale":"2023-12-14T14:09:11.626607+0000","last_undegraded":"2023-12-14T14:09:11.626607+0000","last_fullsized":"2023-12-14T14:09:11.626607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_clean_scrub_stamp":"2023-12-14T14:05:59.057653+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:48.663897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.609978+0000","last_change":"2023-12-14T14:09:10.623899+0000","last_active":"2023-12-14T14:09:11.609978+0000","last_peered":"2023-12-14T14:09:11.609978+0000","last_clean":"2023-12-14T14:09:11.609978+0000","last_became_active":"2023-12-14T14:09:10.623585+0000","last_became_peered":"2023-12-14T14:09:10.623585+0000","last_unstale":"2023-12-14T14:09:11.609978+0000","last_undegraded":"2023-12-14T14:09:11.609978+0000","last_fullsized":"2023-12-14T14:09:11.609978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:33:27.382237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.807161+0000","last_change":"2023-12-14T14:09:10.221812+0000","last_active":"2023-12-14T14:09:14.807161+0000","last_peered":"2023-12-14T14:09:14.807161+0000","last_clean":"2023-12-14T14:09:14.807161+0000","last_became_active":"2023-12-14T14:09:10.221483+0000","last_became_peered":"2023-12-14T14:09:10.221483+0000","last_unstale":"2023-12-14T14:09:14.807161+0000","last_undegraded":"2023-12-14T14:09:14.807161+0000","last_fullsized":"2023-12-14T14:09:14.807161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:57:05.696384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450884+0000","last_change":"2023-12-14T14:09:10.217249+0000","last_active":"2023-12-14T14:09:12.450884+0000","last_peered":"2023-12-14T14:09:12.450884+0000","last_clean":"2023-12-14T14:09:12.450884+0000","last_became_active":"2023-12-14T14:09:10.216953+0000","last_became_peered":"2023-12-14T14:09:10.216953+0000","last_unstale":"2023-12-14T14:09:12.450884+0000","last_undegraded":"2023-12-14T14:09:12.450884+0000","last_fullsized":"2023-12-14T14:09:12.450884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:09:55.765717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610375+0000","last_change":"2023-12-14T14:09:10.616264+0000","last_active":"2023-12-14T14:09:11.610375+0000","last_peered":"2023-12-14T14:09:11.610375+0000","last_clean":"2023-12-14T14:09:11.610375+0000","last_became_active":"2023-12-14T14:09:10.615993+0000","last_became_peered":"2023-12-14T14:09:10.615993+0000","last_unstale":"2023-12-14T14:09:11.610375+0000","last_undegraded":"2023-12-14T14:09:11.610375+0000","last_fullsized":"2023-12-14T14:09:11.610375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:30:03.296839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.807714+0000","last_change":"2023-12-14T14:09:10.218040+0000","last_active":"2023-12-14T14:09:14.807714+0000","last_peered":"2023-12-14T14:09:14.807714+0000","last_clean":"2023-12-14T14:09:14.807714+0000","last_became_active":"2023-12-14T14:09:10.217698+0000","last_became_peered":"2023-12-14T14:09:10.217698+0000","last_unstale":"2023-12-14T14:09:14.807714+0000","last_undegraded":"2023-12-14T14:09:14.807714+0000","last_fullsized":"2023-12-14T14:09:14.807714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:35:43.055944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407899+0000","last_change":"2023-12-14T14:09:10.626705+0000","last_active":"2023-12-14T14:09:12.407899+0000","last_peered":"2023-12-14T14:09:12.407899+0000","last_clean":"2023-12-14T14:09:12.407899+0000","last_became_active":"2023-12-14T14:09:10.626390+0000","last_became_peered":"2023-12-14T14:09:10.626390+0000","last_unstale":"2023-12-14T14:09:12.407899+0000","last_undegraded":"2023-12-14T14:09:12.407899+0000","last_fullsized":"2023-12-14T14:09:12.407899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:45:08.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800616+0000","last_change":"2023-12-14T14:09:10.224068+0000","last_active":"2023-12-14T14:09:13.800616+0000","last_peered":"2023-12-14T14:09:13.800616+0000","last_clean":"2023-12-14T14:09:13.800616+0000","last_became_active":"2023-12-14T14:09:10.223709+0000","last_became_peered":"2023-12-14T14:09:10.223709+0000","last_unstale":"2023-12-14T14:09:13.800616+0000","last_undegraded":"2023-12-14T14:09:13.800616+0000","last_fullsized":"2023-12-14T14:09:13.800616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:35:58.218289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450674+0000","last_change":"2023-12-14T14:09:10.633221+0000","last_active":"2023-12-14T14:09:12.450674+0000","last_peered":"2023-12-14T14:09:12.450674+0000","last_clean":"2023-12-14T14:09:12.450674+0000","last_became_active":"2023-12-14T14:09:10.632881+0000","last_became_peered":"2023-12-14T14:09:10.632881+0000","last_unstale":"2023-12-14T14:09:12.450674+0000","last_undegraded":"2023-12-14T14:09:12.450674+0000","last_fullsized":"2023-12-14T14:09:12.450674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:08:31.873299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.801999+0000","last_change":"2023-12-14T14:09:10.219793+0000","last_active":"2023-12-14T14:09:13.801999+0000","last_peered":"2023-12-14T14:09:13.801999+0000","last_clean":"2023-12-14T14:09:13.801999+0000","last_became_active":"2023-12-14T14:09:10.219485+0000","last_became_peered":"2023-12-14T14:09:10.219485+0000","last_unstale":"2023-12-14T14:09:13.801999+0000","last_undegraded":"2023-12-14T14:09:13.801999+0000","last_fullsized":"2023-12-14T14:09:13.801999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:12:52.521261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450086+0000","last_change":"2023-12-14T14:09:10.622064+0000","last_active":"2023-12-14T14:09:12.450086+0000","last_peered":"2023-12-14T14:09:12.450086+0000","last_clean":"2023-12-14T14:09:12.450086+0000","last_became_active":"2023-12-14T14:09:10.621741+0000","last_became_peered":"2023-12-14T14:09:10.621741+0000","last_unstale":"2023-12-14T14:09:12.450086+0000","last_undegraded":"2023-12-14T14:09:12.450086+0000","last_fullsized":"2023-12-14T14:09:12.450086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:17:02.821975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800868+0000","last_change":"2023-12-14T14:09:10.209152+0000","last_active":"2023-12-14T14:09:13.800868+0000","last_peered":"2023-12-14T14:09:13.800868+0000","last_clean":"2023-12-14T14:09:13.800868+0000","last_became_active":"2023-12-14T14:09:10.208798+0000","last_became_peered":"2023-12-14T14:09:10.208798+0000","last_unstale":"2023-12-14T14:09:13.800868+0000","last_undegraded":"2023-12-14T14:09:13.800868+0000","last_fullsized":"2023-12-14T14:09:13.800868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:25:32.056408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611049+0000","last_change":"2023-12-14T14:09:10.616109+0000","last_active":"2023-12-14T14:09:11.611049+0000","last_peered":"2023-12-14T14:09:11.611049+0000","last_clean":"2023-12-14T14:09:11.611049+0000","last_became_active":"2023-12-14T14:09:10.615694+0000","last_became_peered":"2023-12-14T14:09:10.615694+0000","last_unstale":"2023-12-14T14:09:11.611049+0000","last_undegraded":"2023-12-14T14:09:11.611049+0000","last_fullsized":"2023-12-14T14:09:11.611049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:44:27.502084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450250+0000","last_change":"2023-12-14T14:09:10.224376+0000","last_active":"2023-12-14T14:09:12.450250+0000","last_peered":"2023-12-14T14:09:12.450250+0000","last_clean":"2023-12-14T14:09:12.450250+0000","last_became_active":"2023-12-14T14:09:10.224010+0000","last_became_peered":"2023-12-14T14:09:10.224010+0000","last_unstale":"2023-12-14T14:09:12.450250+0000","last_undegraded":"2023-12-14T14:09:12.450250+0000","last_fullsized":"2023-12-14T14:09:12.450250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:35:42.162264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407641+0000","last_change":"2023-12-14T14:09:10.622490+0000","last_active":"2023-12-14T14:09:12.407641+0000","last_peered":"2023-12-14T14:09:12.407641+0000","last_clean":"2023-12-14T14:09:12.407641+0000","last_became_active":"2023-12-14T14:09:10.622154+0000","last_became_peered":"2023-12-14T14:09:10.622154+0000","last_unstale":"2023-12-14T14:09:12.407641+0000","last_undegraded":"2023-12-14T14:09:12.407641+0000","last_fullsized":"2023-12-14T14:09:12.407641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:58:24.317257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800622+0000","last_change":"2023-12-14T14:09:10.220343+0000","last_active":"2023-12-14T14:09:13.800622+0000","last_peered":"2023-12-14T14:09:13.800622+0000","last_clean":"2023-12-14T14:09:13.800622+0000","last_became_active":"2023-12-14T14:09:10.219657+0000","last_became_peered":"2023-12-14T14:09:10.219657+0000","last_unstale":"2023-12-14T14:09:13.800622+0000","last_undegraded":"2023-12-14T14:09:13.800622+0000","last_fullsized":"2023-12-14T14:09:13.800622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:07:17.459573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627001+0000","last_change":"2023-12-14T14:09:10.633980+0000","last_active":"2023-12-14T14:09:11.627001+0000","last_peered":"2023-12-14T14:09:11.627001+0000","last_clean":"2023-12-14T14:09:11.627001+0000","last_became_active":"2023-12-14T14:09:10.633541+0000","last_became_peered":"2023-12-14T14:09:10.633541+0000","last_unstale":"2023-12-14T14:09:11.627001+0000","last_undegraded":"2023-12-14T14:09:11.627001+0000","last_fullsized":"2023-12-14T14:09:11.627001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:23:06.057252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450327+0000","last_change":"2023-12-14T14:09:10.218042+0000","last_active":"2023-12-14T14:09:12.450327+0000","last_peered":"2023-12-14T14:09:12.450327+0000","last_clean":"2023-12-14T14:09:12.450327+0000","last_became_active":"2023-12-14T14:09:10.217540+0000","last_became_peered":"2023-12-14T14:09:10.217540+0000","last_unstale":"2023-12-14T14:09:12.450327+0000","last_undegraded":"2023-12-14T14:09:12.450327+0000","last_fullsized":"2023-12-14T14:09:12.450327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:59:44.996931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627141+0000","last_change":"2023-12-14T14:09:10.633527+0000","last_active":"2023-12-14T14:09:11.627141+0000","last_peered":"2023-12-14T14:09:11.627141+0000","last_clean":"2023-12-14T14:09:11.627141+0000","last_became_active":"2023-12-14T14:09:10.632614+0000","last_became_peered":"2023-12-14T14:09:10.632614+0000","last_unstale":"2023-12-14T14:09:11.627141+0000","last_undegraded":"2023-12-14T14:09:11.627141+0000","last_fullsized":"2023-12-14T14:09:11.627141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:11:48.151945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374713+0000","last_change":"2023-12-14T14:09:10.211731+0000","last_active":"2023-12-14T14:09:12.374713+0000","last_peered":"2023-12-14T14:09:12.374713+0000","last_clean":"2023-12-14T14:09:12.374713+0000","last_became_active":"2023-12-14T14:09:10.211366+0000","last_became_peered":"2023-12-14T14:09:10.211366+0000","last_unstale":"2023-12-14T14:09:12.374713+0000","last_undegraded":"2023-12-14T14:09:12.374713+0000","last_fullsized":"2023-12-14T14:09:12.374713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:09:57.281728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626861+0000","last_change":"2023-12-14T14:09:10.621483+0000","last_active":"2023-12-14T14:09:11.626861+0000","last_peered":"2023-12-14T14:09:11.626861+0000","last_clean":"2023-12-14T14:09:11.626861+0000","last_became_active":"2023-12-14T14:09:10.621105+0000","last_became_peered":"2023-12-14T14:09:10.621105+0000","last_unstale":"2023-12-14T14:09:11.626861+0000","last_undegraded":"2023-12-14T14:09:11.626861+0000","last_fullsized":"2023-12-14T14:09:11.626861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:14:24.242449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610479+0000","last_change":"2023-12-14T14:09:10.218688+0000","last_active":"2023-12-14T14:09:11.610479+0000","last_peered":"2023-12-14T14:09:11.610479+0000","last_clean":"2023-12-14T14:09:11.610479+0000","last_became_active":"2023-12-14T14:09:10.218339+0000","last_became_peered":"2023-12-14T14:09:10.218339+0000","last_unstale":"2023-12-14T14:09:11.610479+0000","last_undegraded":"2023-12-14T14:09:11.610479+0000","last_fullsized":"2023-12-14T14:09:11.610479+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:14.404008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627129+0000","last_change":"2023-12-14T14:09:10.633084+0000","last_active":"2023-12-14T14:09:11.627129+0000","last_peered":"2023-12-14T14:09:11.627129+0000","last_clean":"2023-12-14T14:09:11.627129+0000","last_became_active":"2023-12-14T14:09:10.632544+0000","last_became_peered":"2023-12-14T14:09:10.632544+0000","last_unstale":"2023-12-14T14:09:11.627129+0000","last_undegraded":"2023-12-14T14:09:11.627129+0000","last_fullsized":"2023-12-14T14:09:11.627129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:28:57.465267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611142+0000","last_change":"2023-12-14T14:09:10.618373+0000","last_active":"2023-12-14T14:09:11.611142+0000","last_peered":"2023-12-14T14:09:11.611142+0000","last_clean":"2023-12-14T14:09:11.611142+0000","last_became_active":"2023-12-14T14:09:10.618028+0000","last_became_peered":"2023-12-14T14:09:10.618028+0000","last_unstale":"2023-12-14T14:09:11.611142+0000","last_undegraded":"2023-12-14T14:09:11.611142+0000","last_fullsized":"2023-12-14T14:09:11.611142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:56:41.817157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449871+0000","last_change":"2023-12-14T14:09:10.622775+0000","last_active":"2023-12-14T14:09:12.449871+0000","last_peered":"2023-12-14T14:09:12.449871+0000","last_clean":"2023-12-14T14:09:12.449871+0000","last_became_active":"2023-12-14T14:09:10.622407+0000","last_became_peered":"2023-12-14T14:09:10.622407+0000","last_unstale":"2023-12-14T14:09:12.449871+0000","last_undegraded":"2023-12-14T14:09:12.449871+0000","last_fullsized":"2023-12-14T14:09:12.449871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:58:30.740484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450305+0000","last_change":"2023-12-14T14:09:10.622137+0000","last_active":"2023-12-14T14:09:12.450305+0000","last_peered":"2023-12-14T14:09:12.450305+0000","last_clean":"2023-12-14T14:09:12.450305+0000","last_became_active":"2023-12-14T14:09:10.621829+0000","last_became_peered":"2023-12-14T14:09:10.621829+0000","last_unstale":"2023-12-14T14:09:12.450305+0000","last_undegraded":"2023-12-14T14:09:12.450305+0000","last_fullsized":"2023-12-14T14:09:12.450305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:46:53.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450718+0000","last_change":"2023-12-14T14:09:10.625511+0000","last_active":"2023-12-14T14:09:12.450718+0000","last_peered":"2023-12-14T14:09:12.450718+0000","last_clean":"2023-12-14T14:09:12.450718+0000","last_became_active":"2023-12-14T14:09:10.624863+0000","last_became_peered":"2023-12-14T14:09:10.624863+0000","last_unstale":"2023-12-14T14:09:12.450718+0000","last_undegraded":"2023-12-14T14:09:12.450718+0000","last_fullsized":"2023-12-14T14:09:12.450718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:00:15.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610492+0000","last_change":"2023-12-14T14:09:10.623824+0000","last_active":"2023-12-14T14:09:11.610492+0000","last_peered":"2023-12-14T14:09:11.610492+0000","last_clean":"2023-12-14T14:09:11.610492+0000","last_became_active":"2023-12-14T14:09:10.623482+0000","last_became_peered":"2023-12-14T14:09:10.623482+0000","last_unstale":"2023-12-14T14:09:11.610492+0000","last_undegraded":"2023-12-14T14:09:11.610492+0000","last_fullsized":"2023-12-14T14:09:11.610492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:34:46.976441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611365+0000","last_change":"2023-12-14T14:09:10.618004+0000","last_active":"2023-12-14T14:09:11.611365+0000","last_peered":"2023-12-14T14:09:11.611365+0000","last_clean":"2023-12-14T14:09:11.611365+0000","last_became_active":"2023-12-14T14:09:10.617184+0000","last_became_peered":"2023-12-14T14:09:10.617184+0000","last_unstale":"2023-12-14T14:09:11.611365+0000","last_undegraded":"2023-12-14T14:09:11.611365+0000","last_fullsized":"2023-12-14T14:09:11.611365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:11:15.687914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450821+0000","last_change":"2023-12-14T14:09:10.621183+0000","last_active":"2023-12-14T14:09:12.450821+0000","last_peered":"2023-12-14T14:09:12.450821+0000","last_clean":"2023-12-14T14:09:12.450821+0000","last_became_active":"2023-12-14T14:09:10.620474+0000","last_became_peered":"2023-12-14T14:09:10.620474+0000","last_unstale":"2023-12-14T14:09:12.450821+0000","last_undegraded":"2023-12-14T14:09:12.450821+0000","last_fullsized":"2023-12-14T14:09:12.450821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:36:42.247213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407830+0000","last_change":"2023-12-14T14:09:10.630668+0000","last_active":"2023-12-14T14:09:12.407830+0000","last_peered":"2023-12-14T14:09:12.407830+0000","last_clean":"2023-12-14T14:09:12.407830+0000","last_became_active":"2023-12-14T14:09:10.630337+0000","last_became_peered":"2023-12-14T14:09:10.630337+0000","last_unstale":"2023-12-14T14:09:12.407830+0000","last_undegraded":"2023-12-14T14:09:12.407830+0000","last_fullsized":"2023-12-14T14:09:12.407830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:04:48.631722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374293+0000","last_change":"2023-12-14T14:09:10.619550+0000","last_active":"2023-12-14T14:09:12.374293+0000","last_peered":"2023-12-14T14:09:12.374293+0000","last_clean":"2023-12-14T14:09:12.374293+0000","last_became_active":"2023-12-14T14:09:10.619029+0000","last_became_peered":"2023-12-14T14:09:10.619029+0000","last_unstale":"2023-12-14T14:09:12.374293+0000","last_undegraded":"2023-12-14T14:09:12.374293+0000","last_fullsized":"2023-12-14T14:09:12.374293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:27:15.911087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407515+0000","last_change":"2023-12-14T14:09:10.622158+0000","last_active":"2023-12-14T14:09:12.407515+0000","last_peered":"2023-12-14T14:09:12.407515+0000","last_clean":"2023-12-14T14:09:12.407515+0000","last_became_active":"2023-12-14T14:09:10.621853+0000","last_became_peered":"2023-12-14T14:09:10.621853+0000","last_unstale":"2023-12-14T14:09:12.407515+0000","last_undegraded":"2023-12-14T14:09:12.407515+0000","last_fullsized":"2023-12-14T14:09:12.407515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:24:30.913464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450085+0000","last_change":"2023-12-14T14:09:10.627728+0000","last_active":"2023-12-14T14:09:12.450085+0000","last_peered":"2023-12-14T14:09:12.450085+0000","last_clean":"2023-12-14T14:09:12.450085+0000","last_became_active":"2023-12-14T14:09:10.627352+0000","last_became_peered":"2023-12-14T14:09:10.627352+0000","last_unstale":"2023-12-14T14:09:12.450085+0000","last_undegraded":"2023-12-14T14:09:12.450085+0000","last_fullsized":"2023-12-14T14:09:12.450085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:35:42.468155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610301+0000","last_change":"2023-12-14T14:09:10.625676+0000","last_active":"2023-12-14T14:09:11.610301+0000","last_peered":"2023-12-14T14:09:11.610301+0000","last_clean":"2023-12-14T14:09:11.610301+0000","last_became_active":"2023-12-14T14:09:10.625191+0000","last_became_peered":"2023-12-14T14:09:10.625191+0000","last_unstale":"2023-12-14T14:09:11.610301+0000","last_undegraded":"2023-12-14T14:09:11.610301+0000","last_fullsized":"2023-12-14T14:09:11.610301+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:24:53.447990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611702+0000","last_change":"2023-12-14T14:09:10.624258+0000","last_active":"2023-12-14T14:09:11.611702+0000","last_peered":"2023-12-14T14:09:11.611702+0000","last_clean":"2023-12-14T14:09:11.611702+0000","last_became_active":"2023-12-14T14:09:10.623917+0000","last_became_peered":"2023-12-14T14:09:10.623917+0000","last_unstale":"2023-12-14T14:09:11.611702+0000","last_undegraded":"2023-12-14T14:09:11.611702+0000","last_fullsized":"2023-12-14T14:09:11.611702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:13:30.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21197,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":112,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":48410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481801,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5924,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739228,"statfs":{"total":95995035648,"available":95988969472,"internally_reserved":0,"allocated":880640,"data_stored":423416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":10,"up_from":70,"seq":300647710734,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6208,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738944,"statfs":{"total":95995035648,"available":95988678656,"internally_reserved":0,"allocated":974848,"data_stored":1017268,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":9,"up_from":65,"seq":279172874257,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6072,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739080,"statfs":{"total":95995035648,"available":95988817920,"internally_reserved":0,"allocated":901120,"data_stored":424234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.626},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.372},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.503}]},{"osd":6,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65200000000000002}]},{"osd":8,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.55800000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103189,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6264,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738888,"statfs":{"total":95995035648,"available":95988621312,"internally_reserved":0,"allocated":901120,"data_stored":424154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.623},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.37},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67100000000000004}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.443},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.61199999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364824,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6372,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738780,"statfs":{"total":95995035648,"available":95988510720,"internally_reserved":0,"allocated":946176,"data_stored":1016260,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.311}]},{"osd":1,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.437},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.629}]},{"osd":5,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.58699999999999997}]},{"osd":8,"last update":"Thu Dec 14 14:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.80100000000000005}]},{"osd":9,"last update":"Thu Dec 14 14:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70199999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":6,"up_from":45,"seq":193273528347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6180,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738972,"statfs":{"total":95995035648,"available":95988707328,"internally_reserved":0,"allocated":880640,"data_stored":423416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.314,"5min":0.245,"15min":0.245},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.377},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.35799999999999998},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.441,"15min":0.42499999999999999},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.35999999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.68500000000000005}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56999999999999995}]},{"osd":9,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.57699999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7104,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93738048,"statfs":{"total":95995035648,"available":95987761152,"internally_reserved":0,"allocated":909312,"data_stored":442345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.499,"15min":0.501},"min":{"1min":0.307,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79200000000000004,"5min":0.87,"15min":0.87},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.33400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68999999999999995,"5min":0.751,"15min":0.751},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:08:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.503,"15min":0.5},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70099999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67400000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Dec 14 14:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86099999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53900000000000003}]},{"osd":8,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76900000000000002}]},{"osd":9,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.83699999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7088,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93738064,"statfs":{"total":95995035648,"available":95987777536,"internally_reserved":0,"allocated":892928,"data_stored":424110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.39000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.497}]},{"osd":2,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.84899999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.34100000000000003},"min":{"1min":0.29899999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.623},{"interface":"front","average":{"1min":0.437,"5min":0.38600000000000001,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.53300000000000003,"15min":0.51500000000000001},"min":{"1min":0.40600000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76600000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Dec 14 14:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.80800000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Dec 14 14:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72899999999999998}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.76800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411368,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7152,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738000,"statfs":{"total":95995035648,"available":95987712000,"internally_reserved":0,"allocated":892928,"data_stored":424741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.33600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Dec 14 14:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.49099999999999999,"15min":0.46300000000000002},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.74399999999999999,"5min":0.877,"15min":0.877},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Dec 14 14:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.41099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.755}]},{"osd":5,"last update":"Thu Dec 14 14:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Dec 14 14:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Dec 14 14:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.80300000000000005}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.878}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215142,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":897024,"data_stored":423700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.32200000000000001,"15min":0.312},"min":{"1min":0.28199999999999997,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33300000000000002},"min":{"1min":0.23200000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.629},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.41499999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Dec 14 14:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.35299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.45400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Dec 14 14:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Dec 14 14:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Dec 14 14:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65600000000000003}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58899999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953506,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6376,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738776,"statfs":{"total":95995035648,"available":95988506624,"internally_reserved":0,"allocated":884736,"data_stored":423438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.498}]},{"osd":1,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.34699999999999998},"min":{"1min":0.29599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.35499999999999998},"min":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.505}]},{"osd":2,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.505,"15min":0.501},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Dec 14 14:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Dec 14 14:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Dec 14 14:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55500000000000005}]},{"osd":8,"last update":"Thu Dec 14 14:08:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.86899999999999999}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.73899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":5,"up_from":37,"seq":158913789983,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6508,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738644,"statfs":{"total":95995035648,"available":95988371456,"internally_reserved":0,"allocated":954368,"data_stored":1014931,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.505,"15min":0.495},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.438,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.503},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.432,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.38200000000000001,"15min":0.374},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.28899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.745},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.498,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.755,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.87}]},{"osd":4,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.44900000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":1.014}]},{"osd":6,"last update":"Thu Dec 14 14:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.032}]},{"osd":7,"last update":"Thu Dec 14 14:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":1.127}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.81799999999999995}]},{"osd":9,"last update":"Thu Dec 14 14:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":1.075}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":18929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T14:09:18.835 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-14T14:09:18.835 INFO:tasks.cephadm:Setting up client nodes... 2023-12-14T14:09:18.836 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-14T14:09:19.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:18 smithi069 ceph-mon[42034]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:19.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:18 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3028790495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:19.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:18 smithi081 ceph-mon[43371]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:19.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:18 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3028790495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:19.176 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:19.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:18 smithi119 ceph-mon[43834]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:09:19.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:18 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3028790495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:20.003 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:19 smithi069 ceph-mon[42034]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:20.003 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:19 smithi069 ceph-mon[42034]: pgmap v226: 97 pgs: 97 active+clean; 597 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 6.6 KiB/s wr, 15 op/s 2023-12-14T14:09:20.003 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:19 smithi069 ceph-mon[42034]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:20.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:19 smithi081 ceph-mon[43371]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:20.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:19 smithi081 ceph-mon[43371]: pgmap v226: 97 pgs: 97 active+clean; 597 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 6.6 KiB/s wr, 15 op/s 2023-12-14T14:09:20.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:19 smithi081 ceph-mon[43371]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.187+0000 7f6fc7721700 1 -- 172.21.15.69:0/590025721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 msgr2=0x7f6fc0105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.187+0000 7f6fc7721700 1 --2- 172.21.15.69:0/590025721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 0x7f6fc0105a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009990 tx=0x7f6fbc009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.187+0000 7f6fc7721700 1 -- 172.21.15.69:0/590025721 shutdown_connections 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.187+0000 7f6fc7721700 1 --2- 172.21.15.69:0/590025721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc0105fb0 0x7f6fc0108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.187+0000 7f6fc7721700 1 --2- 172.21.15.69:0/590025721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0100d70 0x7f6fc0103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.187+0000 7f6fc7721700 1 --2- 172.21.15.69:0/590025721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 0x7f6fc0105a70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.187+0000 7f6fc7721700 1 -- 172.21.15.69:0/590025721 >> 172.21.15.69:0/590025721 conn(0x7f6fc00fa7f0 msgr2=0x7f6fc00fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.187+0000 7f6fc7721700 1 -- 172.21.15.69:0/590025721 shutdown_connections 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.187+0000 7f6fc7721700 1 -- 172.21.15.69:0/590025721 wait complete. 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc7721700 1 Processor -- start 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc7721700 1 -- start start 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc7721700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0100d70 0x7f6fc0196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc7721700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 0x7f6fc0196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc7721700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc0105fb0 0x7f6fc019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc7721700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc019dcb0 con 0x7f6fc0103690 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc7721700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc019ddf0 con 0x7f6fc0100d70 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc7721700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc019df80 con 0x7f6fc0105fb0 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc4cbc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 0x7f6fc0196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc4cbc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 0x7f6fc0196660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40414/0 (socket says 172.21.15.69:40414) 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.188+0000 7f6fc4cbc700 1 -- 172.21.15.69:0/3239159410 learned_addr learned my addr 172.21.15.69:0/3239159410 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc5cbe700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc0105fb0 0x7f6fc019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc54bd700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0100d70 0x7f6fc0196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc4cbc700 1 -- 172.21.15.69:0/3239159410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc0105fb0 msgr2=0x7f6fc019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc4cbc700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc0105fb0 0x7f6fc019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc4cbc700 1 -- 172.21.15.69:0/3239159410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0100d70 msgr2=0x7f6fc0196120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc4cbc700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0100d70 0x7f6fc0196120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc4cbc700 1 -- 172.21.15.69:0/3239159410 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc0095f0 con 0x7f6fc0103690 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc5cbe700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc0105fb0 0x7f6fc019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc54bd700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0100d70 0x7f6fc0196120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc4cbc700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 0x7f6fc0196660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0059d0 tx=0x7f6fbc00f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fb67fc700 1 -- 172.21.15.69:0/3239159410 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc01d070 con 0x7f6fc0103690 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc010bd50 con 0x7f6fc0103690 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fb67fc700 1 -- 172.21.15.69:0/3239159410 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fbc00fc60 con 0x7f6fc0103690 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fb67fc700 1 -- 172.21.15.69:0/3239159410 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0176e0 con 0x7f6fc0103690 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.189+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc010bbc0 con 0x7f6fc0103690 2023-12-14T14:09:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.190+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc00fc360 con 0x7f6fc0103690 2023-12-14T14:09:20.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.191+0000 7f6fb67fc700 1 -- 172.21.15.69:0/3239159410 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6fbc0229c0 con 0x7f6fc0103690 2023-12-14T14:09:20.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.191+0000 7f6fb67fc700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6fac0a11e0 0x7f6fac0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:20.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.191+0000 7f6fc54bd700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6fac0a11e0 0x7f6fac0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:20.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.192+0000 7f6fb67fc700 1 -- 172.21.15.69:0/3239159410 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6fbc0cddc0 con 0x7f6fc0103690 2023-12-14T14:09:20.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.192+0000 7f6fc54bd700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6fac0a11e0 0x7f6fac0a3690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0007900 tx=0x7f6fb0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:20.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.196+0000 7f6fb67fc700 1 -- 172.21.15.69:0/3239159410 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6fbc05c730 con 0x7f6fc0103690 2023-12-14T14:09:20.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:19 smithi119 ceph-mon[43834]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:20.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:19 smithi119 ceph-mon[43834]: pgmap v226: 97 pgs: 97 active+clean; 597 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 6.6 KiB/s wr, 15 op/s 2023-12-14T14:09:20.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:19 smithi119 ceph-mon[43834]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:20.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.464+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f6fc002cfe0 con 0x7f6fc0103690 2023-12-14T14:09:20.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.469+0000 7f6fb67fc700 1 -- 172.21.15.69:0/3239159410 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f6fbc0975f0 con 0x7f6fc0103690 2023-12-14T14:09:20.468 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2023-12-14T14:09:20.468 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCQDHtlMR28GxAAOF63wdS+CT6KSsGjNAixDg== 2023-12-14T14:09:20.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6fac0a11e0 msgr2=0x7f6fac0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:20.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6fac0a11e0 0x7f6fac0a3690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0007900 tx=0x7f6fb0008040 comp rx=0 tx=0).stop 2023-12-14T14:09:20.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 msgr2=0x7f6fc0196660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:20.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 0x7f6fc0196660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0059d0 tx=0x7f6fbc00f7b0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 shutdown_connections 2023-12-14T14:09:20.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6fac0a11e0 0x7f6fac0a3690 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc0105fb0 0x7f6fc019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0100d70 0x7f6fc0196120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 --2- 172.21.15.69:0/3239159410 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0103690 0x7f6fc0196660 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:20.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 >> 172.21.15.69:0/3239159410 conn(0x7f6fc00fa7f0 msgr2=0x7f6fc01019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:20.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 shutdown_connections 2023-12-14T14:09:20.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:20.471+0000 7f6fc7721700 1 -- 172.21.15.69:0/3239159410 wait complete. 2023-12-14T14:09:20.855 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:09:20.856 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-14T14:09:20.856 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-14T14:09:20.898 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-14T14:09:20.898 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-14T14:09:20.898 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph mgr dump --format=json 2023-12-14T14:09:21.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:20 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3239159410' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-14T14:09:21.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:20 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3239159410' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-14T14:09:21.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:20 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3239159410' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-14T14:09:21.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:20 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3239159410' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-14T14:09:21.247 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:21.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:20 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3239159410' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-14T14:09:21.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:20 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3239159410' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-14T14:09:22.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:21 smithi069 ceph-mon[42034]: pgmap v227: 97 pgs: 97 active+clean; 599 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2023-12-14T14:09:22.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:21 smithi081 ceph-mon[43371]: pgmap v227: 97 pgs: 97 active+clean; 599 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2023-12-14T14:09:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.269+0000 7fdcc3f43700 1 -- 172.21.15.69:0/943967744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 msgr2=0x7fdcbc103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.269+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/943967744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 0x7fdcbc103dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0099c0 tx=0x7fdcac009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 -- 172.21.15.69:0/943967744 shutdown_connections 2023-12-14T14:09:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/943967744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcbc104500 0x7fdcbc10c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/943967744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcbc0ff460 0x7fdcbc0ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/943967744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 0x7fdcbc103dd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 -- 172.21.15.69:0/943967744 >> 172.21.15.69:0/943967744 conn(0x7fdcbc0770a0 msgr2=0x7fdcbc0774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:22.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 -- 172.21.15.69:0/943967744 shutdown_connections 2023-12-14T14:09:22.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 -- 172.21.15.69:0/943967744 wait complete. 2023-12-14T14:09:22.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 Processor -- start 2023-12-14T14:09:22.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 -- start start 2023-12-14T14:09:22.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.270+0000 7fdcc3f43700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcbc0ff460 0x7fdcbc197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:22.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc3f43700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 0x7fdcbc197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:22.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc3f43700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcbc104500 0x7fdcbc1a2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:22.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc3f43700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc198160 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc3f43700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc1a28d0 con 0x7fdcbc104500 2023-12-14T14:09:22.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc3f43700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc1a2a40 con 0x7fdcbc0ff460 2023-12-14T14:09:22.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc14de700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 0x7fdcbc197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:22.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc14de700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 0x7fdcbc197850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40428/0 (socket says 172.21.15.69:40428) 2023-12-14T14:09:22.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc14de700 1 -- 172.21.15.69:0/3272699491 learned_addr learned my addr 172.21.15.69:0/3272699491 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:22.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc24e0700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcbc104500 0x7fdcbc1a2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:22.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc1cdf700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcbc0ff460 0x7fdcbc197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:22.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc14de700 1 -- 172.21.15.69:0/3272699491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcbc0ff460 msgr2=0x7fdcbc197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:22.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc14de700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcbc0ff460 0x7fdcbc197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc14de700 1 -- 172.21.15.69:0/3272699491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcbc104500 msgr2=0x7fdcbc1a2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc14de700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcbc104500 0x7fdcbc1a2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc14de700 1 -- 172.21.15.69:0/3272699491 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0095f0 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc24e0700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcbc104500 0x7fdcbc1a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc14de700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 0x7fdcbc197850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdcac006010 tx=0x7fdcac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcb2ffd700 1 -- 172.21.15.69:0/3272699491 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac01d070 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcb2ffd700 1 -- 172.21.15.69:0/3272699491 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcac004090 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcb2ffd700 1 -- 172.21.15.69:0/3272699491 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac022ea0 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc10f310 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.271+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc10f180 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.272+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc10f4a0 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.273+0000 7fdcb2ffd700 1 -- 172.21.15.69:0/3272699491 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fdcac003bd0 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:21 smithi119 ceph-mon[43834]: pgmap v227: 97 pgs: 97 active+clean; 599 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2023-12-14T14:09:22.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.274+0000 7fdcb2ffd700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdca80a11e0 0x7fdca80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:22.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.274+0000 7fdcc1cdf700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdca80a11e0 0x7fdca80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:22.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.274+0000 7fdcb2ffd700 1 -- 172.21.15.69:0/3272699491 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdcac0cdc30 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.274+0000 7fdcc1cdf700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdca80a11e0 0x7fdca80a3690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8006fd0 tx=0x7fdcb8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:22.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.278+0000 7fdcb2ffd700 1 -- 172.21.15.69:0/3272699491 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdcac05c730 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.526+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdcbc066ea0 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.531+0000 7fdcb2ffd700 1 -- 172.21.15.69:0/3272699491 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260122 (secure 0 0 0) 0x7fdcac027090 con 0x7fdcbc0ffe00 2023-12-14T14:09:22.533 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdca80a11e0 msgr2=0x7fdca80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdca80a11e0 0x7fdca80a3690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8006fd0 tx=0x7fdcb8008040 comp rx=0 tx=0).stop 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 msgr2=0x7fdcbc197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 0x7fdcbc197850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdcac006010 tx=0x7fdcac0057f0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 shutdown_connections 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdca80a11e0 0x7fdca80a3690 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcbc104500 0x7fdcbc1a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcbc0ff460 0x7fdcbc197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 --2- 172.21.15.69:0/3272699491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcbc0ffe00 0x7fdcbc197850 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 >> 172.21.15.69:0/3272699491 conn(0x7fdcbc0770a0 msgr2=0x7fdcbc0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 shutdown_connections 2023-12-14T14:09:22.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:22.534+0000 7fdcc3f43700 1 -- 172.21.15.69:0/3272699491 wait complete. 2023-12-14T14:09:22.973 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":933503151},{"type":"v1","addr":"172.21.15.69:6801","nonce":933503151}]},"active_addr":"172.21.15.69:6801/933503151","active_change":"2023-12-14T14:04:10.545534+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.69:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":590492119}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3288224909}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":2692968417}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":4262786097}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3434546944}]}]} 2023-12-14T14:09:22.977 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-14T14:09:22.977 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-14T14:09:22.977 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-14T14:09:23.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:22 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3272699491' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-14T14:09:23.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:22 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3272699491' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-14T14:09:23.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:22 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3272699491' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-14T14:09:23.289 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:24.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:23 smithi069 ceph-mon[42034]: pgmap v228: 97 pgs: 97 active+clean; 621 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.9 KiB/s wr, 15 op/s 2023-12-14T14:09:24.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:23 smithi081 ceph-mon[43371]: pgmap v228: 97 pgs: 97 active+clean; 621 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.9 KiB/s wr, 15 op/s 2023-12-14T14:09:24.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:23 smithi119 ceph-mon[43834]: pgmap v228: 97 pgs: 97 active+clean; 621 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.9 KiB/s wr, 15 op/s 2023-12-14T14:09:24.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.401+0000 7f190eba8700 1 -- 172.21.15.69:0/689228351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 msgr2=0x7f1908100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:24.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.401+0000 7f190eba8700 1 --2- 172.21.15.69:0/689228351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 0x7f1908100910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0099c0 tx=0x7f18fc009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.401+0000 7f190eba8700 1 -- 172.21.15.69:0/689228351 shutdown_connections 2023-12-14T14:09:24.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.401+0000 7f190eba8700 1 --2- 172.21.15.69:0/689228351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19081055e0 0x7f190810d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.401+0000 7f190eba8700 1 --2- 172.21.15.69:0/689228351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 0x7f1908100910 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.401+0000 7f190eba8700 1 --2- 172.21.15.69:0/689228351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1908100ee0 0x7f1908104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.401+0000 7f190eba8700 1 -- 172.21.15.69:0/689228351 >> 172.21.15.69:0/689228351 conn(0x7f19080fbdc0 msgr2=0x7f19080fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:24.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.401+0000 7f190eba8700 1 -- 172.21.15.69:0/689228351 shutdown_connections 2023-12-14T14:09:24.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.401+0000 7f190eba8700 1 -- 172.21.15.69:0/689228351 wait complete. 2023-12-14T14:09:24.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.402+0000 7f190eba8700 1 Processor -- start 2023-12-14T14:09:24.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.402+0000 7f190eba8700 1 -- start start 2023-12-14T14:09:24.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.402+0000 7f190eba8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 0x7f1908072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:24.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.402+0000 7f190eba8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1908100ee0 0x7f1908073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:24.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.402+0000 7f190eba8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19081055e0 0x7f19080738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:24.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.402+0000 7f190eba8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19081a4890 con 0x7f1908100540 2023-12-14T14:09:24.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.402+0000 7f190eba8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19081a4a00 con 0x7f1908100ee0 2023-12-14T14:09:24.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.402+0000 7f190eba8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19081a4bc0 con 0x7f19081055e0 2023-12-14T14:09:24.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.402+0000 7f190c944700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 0x7f1908072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:24.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190c944700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 0x7f1908072df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40438/0 (socket says 172.21.15.69:40438) 2023-12-14T14:09:24.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190c944700 1 -- 172.21.15.69:0/3103714825 learned_addr learned my addr 172.21.15.69:0/3103714825 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:24.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f1907fff700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1908100ee0 0x7f1908073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:24.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190d145700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19081055e0 0x7f19080738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:24.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190c944700 1 -- 172.21.15.69:0/3103714825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19081055e0 msgr2=0x7f19080738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:24.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190c944700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19081055e0 0x7f19080738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190c944700 1 -- 172.21.15.69:0/3103714825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1908100ee0 msgr2=0x7f1908073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190c944700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1908100ee0 0x7f1908073330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190c944700 1 -- 172.21.15.69:0/3103714825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc0095f0 con 0x7f1908100540 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190d145700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19081055e0 0x7f19080738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f1907fff700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1908100ee0 0x7f1908073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190c944700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 0x7f1908072df0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009990 tx=0x7f18fc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f1905ffb700 1 -- 172.21.15.69:0/3103714825 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc01d070 con 0x7f1908100540 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1908110340 con 0x7f1908100540 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f1905ffb700 1 -- 172.21.15.69:0/3103714825 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18fc004010 con 0x7f1908100540 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f1905ffb700 1 -- 172.21.15.69:0/3103714825 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc022d40 con 0x7f1908100540 2023-12-14T14:09:24.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.403+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19081101b0 con 0x7f1908100540 2023-12-14T14:09:24.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.404+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19081104d0 con 0x7f1908100540 2023-12-14T14:09:24.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.405+0000 7f1905ffb700 1 -- 172.21.15.69:0/3103714825 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f18fc022470 con 0x7f1908100540 2023-12-14T14:09:24.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.406+0000 7f1905ffb700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f18f80a11e0 0x7f18f80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:24.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.406+0000 7f1907fff700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f18f80a11e0 0x7f18f80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:24.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.406+0000 7f1905ffb700 1 -- 172.21.15.69:0/3103714825 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f18fc0ce110 con 0x7f1908100540 2023-12-14T14:09:24.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.406+0000 7f1907fff700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f18f80a11e0 0x7f18f80a3690 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18f4005950 tx=0x7f18f40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:24.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.410+0000 7f1905ffb700 1 -- 172.21.15.69:0/3103714825 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f18fc0978c0 con 0x7f1908100540 2023-12-14T14:09:24.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.599+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19081a5540 con 0x7f1908100540 2023-12-14T14:09:24.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.601+0000 7f1905ffb700 1 -- 172.21.15.69:0/3103714825 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22096 (secure 0 0 0) 0x7f18fc09aee0 con 0x7f1908100540 2023-12-14T14:09:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:24.602 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":82,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:09:11.600086+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:09:24.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f18f80a11e0 msgr2=0x7f18f80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:24.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f18f80a11e0 0x7f18f80a3690 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18f4005950 tx=0x7f18f40058e0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 msgr2=0x7f1908072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:24.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 0x7f1908072df0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009990 tx=0x7f18fc009580 comp rx=0 tx=0).stop 2023-12-14T14:09:24.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 shutdown_connections 2023-12-14T14:09:24.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f18f80a11e0 0x7f18f80a3690 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19081055e0 0x7f19080738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1908100540 0x7f1908072df0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 --2- 172.21.15.69:0/3103714825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1908100ee0 0x7f1908073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:24.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 >> 172.21.15.69:0/3103714825 conn(0x7f19080fbdc0 msgr2=0x7f19080fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:24.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 shutdown_connections 2023-12-14T14:09:24.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:24.603+0000 7f190eba8700 1 -- 172.21.15.69:0/3103714825 wait complete. 2023-12-14T14:09:24.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:24 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3103714825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:25.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:24 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3103714825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:25.178 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-14T14:09:25.179 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-14T14:09:25.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:24 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3103714825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:25.490 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:25.950 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:25 smithi069 ceph-mon[42034]: pgmap v229: 97 pgs: 97 active+clean; 621 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2023-12-14T14:09:26.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:25 smithi081 ceph-mon[43371]: pgmap v229: 97 pgs: 97 active+clean; 621 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2023-12-14T14:09:26.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:25 smithi119 ceph-mon[43834]: pgmap v229: 97 pgs: 97 active+clean; 621 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2023-12-14T14:09:26.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.483+0000 7f9ee17a1700 1 -- 172.21.15.69:0/386955602 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 msgr2=0x7f9edc0ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:26.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.483+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/386955602 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 0x7f9edc0ff910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009990 tx=0x7f9ed0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.484+0000 7f9ee17a1700 1 -- 172.21.15.69:0/386955602 shutdown_connections 2023-12-14T14:09:26.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.484+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/386955602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc10ae00 0x7f9edc10d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.484+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/386955602 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 0x7f9edc0ff910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.484+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/386955602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9edc0ffe50 0x7f9edc10a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.484+0000 7f9ee17a1700 1 -- 172.21.15.69:0/386955602 >> 172.21.15.69:0/386955602 conn(0x7f9edc074b40 msgr2=0x7f9edc074f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.484+0000 7f9ee17a1700 1 -- 172.21.15.69:0/386955602 shutdown_connections 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.484+0000 7f9ee17a1700 1 -- 172.21.15.69:0/386955602 wait complete. 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.484+0000 7f9ee17a1700 1 Processor -- start 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.484+0000 7f9ee17a1700 1 -- start start 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ee17a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 0x7f9edc1964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ee17a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9edc0ffe50 0x7f9edc1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:26.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ee17a1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc10ae00 0x7f9edc19ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:26.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ee17a1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc19b460 con 0x7f9edc0ff540 2023-12-14T14:09:26.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ee17a1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc19b5d0 con 0x7f9edc0ffe50 2023-12-14T14:09:26.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ee17a1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc19b790 con 0x7f9edc10ae00 2023-12-14T14:09:26.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 0x7f9edc1964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:26.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 0x7f9edc1964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60072/0 (socket says 172.21.15.69:60072) 2023-12-14T14:09:26.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edaffd700 1 -- 172.21.15.69:0/75475015 learned_addr learned my addr 172.21.15.69:0/75475015 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:26.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9eda7fc700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9edc0ffe50 0x7f9edc1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:26.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edb7fe700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc10ae00 0x7f9edc19ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:26.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edaffd700 1 -- 172.21.15.69:0/75475015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc10ae00 msgr2=0x7f9edc19ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edaffd700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc10ae00 0x7f9edc19ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edaffd700 1 -- 172.21.15.69:0/75475015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9edc0ffe50 msgr2=0x7f9edc1969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edaffd700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9edc0ffe50 0x7f9edc1969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edaffd700 1 -- 172.21.15.69:0/75475015 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed00095f0 con 0x7f9edc0ff540 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9eda7fc700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9edc0ffe50 0x7f9edc1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9edaffd700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 0x7f9edc1964a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed000f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ec3fff700 1 -- 172.21.15.69:0/75475015 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed001d070 con 0x7f9edc0ff540 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ec3fff700 1 -- 172.21.15.69:0/75475015 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ed000fce0 con 0x7f9edc0ff540 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ec3fff700 1 -- 172.21.15.69:0/75475015 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed00176e0 con 0x7f9edc0ff540 2023-12-14T14:09:26.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.485+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc110520 con 0x7f9edc0ff540 2023-12-14T14:09:26.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.486+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc110390 con 0x7f9edc0ff540 2023-12-14T14:09:26.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.486+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc1106b0 con 0x7f9edc0ff540 2023-12-14T14:09:26.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.488+0000 7f9ec3fff700 1 -- 172.21.15.69:0/75475015 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9ed0022470 con 0x7f9edc0ff540 2023-12-14T14:09:26.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.488+0000 7f9ec3fff700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9ec40a11e0 0x7f9ec40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:26.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.488+0000 7f9eda7fc700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9ec40a11e0 0x7f9ec40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:26.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.488+0000 7f9ec3fff700 1 -- 172.21.15.69:0/75475015 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9ed00ce1f0 con 0x7f9edc0ff540 2023-12-14T14:09:26.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.488+0000 7f9eda7fc700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9ec40a11e0 0x7f9ec40a3690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9edc197ac0 tx=0x7f9ecc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:26.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.492+0000 7f9ec3fff700 1 -- 172.21.15.69:0/75475015 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9ed0097a20 con 0x7f9edc0ff540 2023-12-14T14:09:26.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.688+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9edc105720 con 0x7f9edc0ff540 2023-12-14T14:09:26.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.689+0000 7f9ec3fff700 1 -- 172.21.15.69:0/75475015 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22096 (secure 0 0 0) 0x7f9ed009b040 con 0x7f9edc0ff540 2023-12-14T14:09:26.690 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:26.690 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":82,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:09:11.600086+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:09:26.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9ec40a11e0 msgr2=0x7f9ec40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:26.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9ec40a11e0 0x7f9ec40a3690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9edc197ac0 tx=0x7f9ecc008040 comp rx=0 tx=0).stop 2023-12-14T14:09:26.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 msgr2=0x7f9edc1964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:26.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 0x7f9edc1964a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed000f830 comp rx=0 tx=0).stop 2023-12-14T14:09:26.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 shutdown_connections 2023-12-14T14:09:26.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9ec40a11e0 0x7f9ec40a3690 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc10ae00 0x7f9edc19ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9edc0ff540 0x7f9edc1964a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 --2- 172.21.15.69:0/75475015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9edc0ffe50 0x7f9edc1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:26.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 >> 172.21.15.69:0/75475015 conn(0x7f9edc074b40 msgr2=0x7f9edc102860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:26.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 shutdown_connections 2023-12-14T14:09:26.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:26.691+0000 7f9ee17a1700 1 -- 172.21.15.69:0/75475015 wait complete. 2023-12-14T14:09:27.091 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-14T14:09:27.091 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-14T14:09:27.092 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-14T14:09:27.092 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-14T14:09:27.093 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-14T14:09:27.094 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-14T14:09:27.094 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2023-12-14T14:09:27.095 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2023-12-14T14:09:27.095 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2023-12-14T14:09:27.096 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2023-12-14T14:09:27.096 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2023-12-14T14:09:27.097 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2023-12-14T14:09:27.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:27 smithi069 ceph-mon[42034]: pgmap v230: 97 pgs: 97 active+clean; 631 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2023-12-14T14:09:27.593 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:27 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/75475015' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:27 smithi081 ceph-mon[43371]: pgmap v230: 97 pgs: 97 active+clean; 631 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2023-12-14T14:09:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:27 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/75475015' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:27.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:27 smithi119 ceph-mon[43834]: pgmap v230: 97 pgs: 97 active+clean; 631 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2023-12-14T14:09:27.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:27 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/75475015' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:28.018 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:28.879 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:29.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.164+0000 7fac4083b700 1 -- 172.21.15.69:0/1054624470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac3c100ef0 msgr2=0x7fac3c104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:29.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.164+0000 7fac4083b700 1 --2- 172.21.15.69:0/1054624470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac3c100ef0 0x7fac3c104ec0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fac300099c0 tx=0x7fac30009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:29.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.165+0000 7fac4083b700 1 -- 172.21.15.69:0/1054624470 shutdown_connections 2023-12-14T14:09:29.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.165+0000 7fac4083b700 1 --2- 172.21.15.69:0/1054624470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac3c1055f0 0x7fac3c10d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.165+0000 7fac4083b700 1 --2- 172.21.15.69:0/1054624470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac3c100550 0x7fac3c100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.165+0000 7fac4083b700 1 --2- 172.21.15.69:0/1054624470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac3c100ef0 0x7fac3c104ec0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.165+0000 7fac4083b700 1 -- 172.21.15.69:0/1054624470 >> 172.21.15.69:0/1054624470 conn(0x7fac3c0fbdb0 msgr2=0x7fac3c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.165+0000 7fac4083b700 1 -- 172.21.15.69:0/1054624470 shutdown_connections 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.165+0000 7fac4083b700 1 -- 172.21.15.69:0/1054624470 wait complete. 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.165+0000 7fac4083b700 1 Processor -- start 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.165+0000 7fac4083b700 1 -- start start 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac4083b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac3c100550 0x7fac3c196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac4083b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac3c100ef0 0x7fac3c196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac4083b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac3c1055f0 0x7fac3c19aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac4083b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c19b500 con 0x7fac3c100ef0 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac4083b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c19b670 con 0x7fac3c100550 2023-12-14T14:09:29.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac4083b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c19b830 con 0x7fac3c1055f0 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac39d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac3c100ef0 0x7fac3c196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac39d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac3c100ef0 0x7fac3c196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60092/0 (socket says 172.21.15.69:60092) 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac39d9b700 1 -- 172.21.15.69:0/3588637473 learned_addr learned my addr 172.21.15.69:0/3588637473 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac3ad9d700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac3c1055f0 0x7fac3c19aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac3a59c700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac3c100550 0x7fac3c196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac39d9b700 1 -- 172.21.15.69:0/3588637473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac3c1055f0 msgr2=0x7fac3c19aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac39d9b700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac3c1055f0 0x7fac3c19aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac39d9b700 1 -- 172.21.15.69:0/3588637473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac3c100550 msgr2=0x7fac3c196540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac39d9b700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac3c100550 0x7fac3c196540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac39d9b700 1 -- 172.21.15.69:0/3588637473 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300095f0 con 0x7fac3c100ef0 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac3ad9d700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac3c1055f0 0x7fac3c19aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:29.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac3a59c700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac3c100550 0x7fac3c196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:29.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac39d9b700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac3c100ef0 0x7fac3c196a80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fac30009990 tx=0x7fac300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:29.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac2b7fe700 1 -- 172.21.15.69:0/3588637473 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3001d070 con 0x7fac3c100ef0 2023-12-14T14:09:29.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac2b7fe700 1 -- 172.21.15.69:0/3588637473 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac300041f0 con 0x7fac3c100ef0 2023-12-14T14:09:29.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c110400 con 0x7fac3c100ef0 2023-12-14T14:09:29.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.166+0000 7fac2b7fe700 1 -- 172.21.15.69:0/3588637473 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000f460 con 0x7fac3c100ef0 2023-12-14T14:09:29.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.167+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c110270 con 0x7fac3c100ef0 2023-12-14T14:09:29.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.167+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac3c0fd1a0 con 0x7fac3c100ef0 2023-12-14T14:09:29.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.168+0000 7fac2b7fe700 1 -- 172.21.15.69:0/3588637473 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fac30022600 con 0x7fac3c100ef0 2023-12-14T14:09:29.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.169+0000 7fac2b7fe700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fac240a11e0 0x7fac240a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:29.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.169+0000 7fac3a59c700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fac240a11e0 0x7fac240a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:29.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.169+0000 7fac2b7fe700 1 -- 172.21.15.69:0/3588637473 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fac300ce2d0 con 0x7fac3c100ef0 2023-12-14T14:09:29.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.169+0000 7fac2b7fe700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] conn(0x7fac240aa9b0 0x7fac240acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:29.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.169+0000 7fac2b7fe700 1 -- 172.21.15.69:0/3588637473 --> [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac240ad470 con 0x7fac240aa9b0 2023-12-14T14:09:29.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.169+0000 7fac2b7fe700 1 -- 172.21.15.69:0/3588637473 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac300ce770 con 0x7fac3c100ef0 2023-12-14T14:09:29.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.169+0000 7fac3a59c700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fac240a11e0 0x7fac240a3690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007900 tx=0x7fac2c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:29.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.170+0000 7fac3ad9d700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] conn(0x7fac240aa9b0 0x7fac240acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:29.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.170+0000 7fac3ad9d700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] conn(0x7fac240aa9b0 0x7fac240acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:29.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.171+0000 7fac2b7fe700 1 -- 172.21.15.69:0/3588637473 <== osd.8 v2:172.21.15.119:6816/2165709611 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fac240ad470 con 0x7fac240aa9b0 2023-12-14T14:09:29.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.186+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 --> [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac3c110590 con 0x7fac240aa9b0 2023-12-14T14:09:29.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac2b7fe700 1 -- 172.21.15.69:0/3588637473 <== osd.8 v2:172.21.15.119:6816/2165709611 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fac3c110590 con 0x7fac240aa9b0 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 >> [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] conn(0x7fac240aa9b0 msgr2=0x7fac240acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] conn(0x7fac240aa9b0 0x7fac240acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fac240a11e0 msgr2=0x7fac240a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fac240a11e0 0x7fac240a3690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007900 tx=0x7fac2c008040 comp rx=0 tx=0).stop 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac3c100ef0 msgr2=0x7fac3c196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 --2- 172.21.15.69:0/3588637473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac3c100ef0 0x7fac3c196a80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fac30009990 tx=0x7fac300047c0 comp rx=0 tx=0).stop 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac3ad9d700 1 -- 172.21.15.69:0/3588637473 reap_dead start 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 shutdown_connections 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 >> 172.21.15.69:0/3588637473 conn(0x7fac3c0fbdb0 msgr2=0x7fac3c0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 shutdown_connections 2023-12-14T14:09:29.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:29.187+0000 7fac4083b700 1 -- 172.21.15.69:0/3588637473 wait complete. 2023-12-14T14:09:29.583 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:29.988 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:29 smithi069 ceph-mon[42034]: pgmap v231: 97 pgs: 97 active+clean; 631 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.6 KiB/s wr, 10 op/s 2023-12-14T14:09:30.012 INFO:teuthology.orchestra.run.smithi069.stdout:249108103192 2023-12-14T14:09:30.012 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.8 2023-12-14T14:09:30.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:29 smithi119 ceph-mon[43834]: pgmap v231: 97 pgs: 97 active+clean; 631 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.6 KiB/s wr, 10 op/s 2023-12-14T14:09:30.138 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:30.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:29 smithi081 ceph-mon[43371]: pgmap v231: 97 pgs: 97 active+clean; 631 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.6 KiB/s wr, 10 op/s 2023-12-14T14:09:30.812 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:31.045 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:31.296 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:31.549 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:31.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.990+0000 7f1ee96e5700 1 -- 172.21.15.69:0/1211347865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ee40ff480 msgr2=0x7f1ee40ff850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:31.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.990+0000 7f1ee96e5700 1 --2- 172.21.15.69:0/1211347865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ee40ff480 0x7f1ee40ff850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400b0d0 tx=0x7f1ed400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:09:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.990+0000 7f1ee96e5700 1 -- 172.21.15.69:0/1211347865 shutdown_connections 2023-12-14T14:09:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.990+0000 7f1ee96e5700 1 --2- 172.21.15.69:0/1211347865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee4104520 0x7f1ee410c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.990+0000 7f1ee96e5700 1 --2- 172.21.15.69:0/1211347865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ee40ff480 0x7f1ee40ff850 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.990+0000 7f1ee96e5700 1 --2- 172.21.15.69:0/1211347865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee40ffe20 0x7f1ee4103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.990+0000 7f1ee96e5700 1 -- 172.21.15.69:0/1211347865 >> 172.21.15.69:0/1211347865 conn(0x7f1ee40770d0 msgr2=0x7f1ee40774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.990+0000 7f1ee96e5700 1 -- 172.21.15.69:0/1211347865 shutdown_connections 2023-12-14T14:09:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.990+0000 7f1ee96e5700 1 -- 172.21.15.69:0/1211347865 wait complete. 2023-12-14T14:09:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee96e5700 1 Processor -- start 2023-12-14T14:09:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee96e5700 1 -- start start 2023-12-14T14:09:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee96e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40ff480 0x7f1ee41953c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee96e5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee40ffe20 0x7f1ee4195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee96e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ee4104520 0x7f1ee4195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee96e5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee41a4c00 con 0x7f1ee4104520 2023-12-14T14:09:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee96e5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee41a4d70 con 0x7f1ee40ff480 2023-12-14T14:09:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee96e5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee41a4f30 con 0x7f1ee40ffe20 2023-12-14T14:09:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ee4104520 0x7f1ee4195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ee4104520 0x7f1ee4195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60112/0 (socket says 172.21.15.69:60112) 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee37fe700 1 -- 172.21.15.69:0/526382828 learned_addr learned my addr 172.21.15.69:0/526382828 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee2ffd700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40ff480 0x7f1ee41953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee27fc700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee40ffe20 0x7f1ee4195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee37fe700 1 -- 172.21.15.69:0/526382828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee40ffe20 msgr2=0x7f1ee4195900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee37fe700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee40ffe20 0x7f1ee4195900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee37fe700 1 -- 172.21.15.69:0/526382828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40ff480 msgr2=0x7f1ee41953c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee37fe700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40ff480 0x7f1ee41953c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee37fe700 1 -- 172.21.15.69:0/526382828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed4009d00 con 0x7f1ee4104520 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee27fc700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee40ffe20 0x7f1ee4195900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.991+0000 7f1ee2ffd700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40ff480 0x7f1ee41953c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:31.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.992+0000 7f1ee37fe700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ee4104520 0x7f1ee4195e40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00b550 tx=0x7f1edc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:31.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.992+0000 7f1edbfff700 1 -- 172.21.15.69:0/526382828 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc011830 con 0x7f1ee4104520 2023-12-14T14:09:31.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.992+0000 7f1edbfff700 1 -- 172.21.15.69:0/526382828 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1edc011e50 con 0x7f1ee4104520 2023-12-14T14:09:31.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.992+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee410f350 con 0x7f1ee4104520 2023-12-14T14:09:31.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.992+0000 7f1edbfff700 1 -- 172.21.15.69:0/526382828 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc010e70 con 0x7f1ee4104520 2023-12-14T14:09:31.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.992+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee410f1c0 con 0x7f1ee4104520 2023-12-14T14:09:31.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.993+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ee40fd7d0 con 0x7f1ee4104520 2023-12-14T14:09:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.994+0000 7f1edbfff700 1 -- 172.21.15.69:0/526382828 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1edc010510 con 0x7f1ee4104520 2023-12-14T14:09:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.994+0000 7f1edbfff700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ed00a1260 0x7f1ed00a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.994+0000 7f1ee2ffd700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ed00a1260 0x7f1ed00a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.994+0000 7f1edbfff700 1 -- 172.21.15.69:0/526382828 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1edc0cca60 con 0x7f1ee4104520 2023-12-14T14:09:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.995+0000 7f1edbfff700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] conn(0x7f1ed00aaa30 0x7f1ed00ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.995+0000 7f1edbfff700 1 -- 172.21.15.69:0/526382828 --> [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ed00ad4f0 con 0x7f1ed00aaa30 2023-12-14T14:09:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.995+0000 7f1edbfff700 1 -- 172.21.15.69:0/526382828 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1edc0cce10 con 0x7f1ee4104520 2023-12-14T14:09:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.995+0000 7f1ee27fc700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] conn(0x7f1ed00aaa30 0x7f1ed00ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.995+0000 7f1ee2ffd700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ed00a1260 0x7f1ed00a3710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400d010 tx=0x7f1ed400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:32.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.995+0000 7f1ee27fc700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] conn(0x7f1ed00aaa30 0x7f1ed00ace40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:32.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:31.996+0000 7f1edbfff700 1 -- 172.21.15.69:0/526382828 <== osd.6 v2:172.21.15.69:6818/3585699442 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1ed00ad4f0 con 0x7f1ed00aaa30 2023-12-14T14:09:32.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.011+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 --> [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ee410f4e0 con 0x7f1ed00aaa30 2023-12-14T14:09:32.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1edbfff700 1 -- 172.21.15.69:0/526382828 <== osd.6 v2:172.21.15.69:6818/3585699442 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1ee410f4e0 con 0x7f1ed00aaa30 2023-12-14T14:09:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] conn(0x7f1ed00aaa30 msgr2=0x7f1ed00ace40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] conn(0x7f1ed00aaa30 0x7f1ed00ace40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ed00a1260 msgr2=0x7f1ed00a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1ed00a1260 0x7f1ed00a3710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400d010 tx=0x7f1ed400b040 comp rx=0 tx=0).stop 2023-12-14T14:09:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ee4104520 msgr2=0x7f1ee4195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 --2- 172.21.15.69:0/526382828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ee4104520 0x7f1ee4195e40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00b550 tx=0x7f1edc00b910 comp rx=0 tx=0).stop 2023-12-14T14:09:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee37fe700 1 -- 172.21.15.69:0/526382828 reap_dead start 2023-12-14T14:09:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 shutdown_connections 2023-12-14T14:09:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 >> 172.21.15.69:0/526382828 conn(0x7f1ee40770d0 msgr2=0x7f1ee40fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 shutdown_connections 2023-12-14T14:09:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.012+0000 7f1ee96e5700 1 -- 172.21.15.69:0/526382828 wait complete. 2023-12-14T14:09:32.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:31 smithi119 ceph-mon[43834]: pgmap v232: 97 pgs: 97 active+clean; 631 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.6 KiB/s wr, 10 op/s 2023-12-14T14:09:32.036 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:31 smithi069 ceph-mon[42034]: pgmap v232: 97 pgs: 97 active+clean; 631 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.6 KiB/s wr, 10 op/s 2023-12-14T14:09:32.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:31 smithi081 ceph-mon[43371]: pgmap v232: 97 pgs: 97 active+clean; 631 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.6 KiB/s wr, 10 op/s 2023-12-14T14:09:32.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 -- 172.21.15.69:0/2348818481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20104500 msgr2=0x7f8a2010c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:32.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 --2- 172.21.15.69:0/2348818481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20104500 0x7f8a2010c080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800b0d0 tx=0x7f8a1800b3e0 comp rx=0 tx=0).stop 2023-12-14T14:09:32.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 -- 172.21.15.69:0/2348818481 shutdown_connections 2023-12-14T14:09:32.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 --2- 172.21.15.69:0/2348818481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20104500 0x7f8a2010c080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:32.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 --2- 172.21.15.69:0/2348818481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a200ff460 0x7f8a200ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:32.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 --2- 172.21.15.69:0/2348818481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a200ffe00 0x7f8a20103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:32.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 -- 172.21.15.69:0/2348818481 >> 172.21.15.69:0/2348818481 conn(0x7f8a200770a0 msgr2=0x7f8a200774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:32.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 -- 172.21.15.69:0/2348818481 shutdown_connections 2023-12-14T14:09:32.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 -- 172.21.15.69:0/2348818481 wait complete. 2023-12-14T14:09:32.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 Processor -- start 2023-12-14T14:09:32.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 -- start start 2023-12-14T14:09:32.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a200ff460 0x7f8a201964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.199+0000 7f8a27865700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a200ffe00 0x7f8a20196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a27865700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20104500 0x7f8a2019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a27865700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2019b480 con 0x7f8a20104500 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a27865700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2019b5f0 con 0x7f8a200ff460 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a27865700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2019b7b0 con 0x7f8a200ffe00 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25e02700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20104500 0x7f8a2019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25e02700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20104500 0x7f8a2019ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60128/0 (socket says 172.21.15.69:60128) 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25e02700 1 -- 172.21.15.69:0/3393070557 learned_addr learned my addr 172.21.15.69:0/3393070557 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a24e00700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a200ffe00 0x7f8a20196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25601700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a200ff460 0x7f8a201964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25e02700 1 -- 172.21.15.69:0/3393070557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a200ffe00 msgr2=0x7f8a20196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25e02700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a200ffe00 0x7f8a20196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:32.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25e02700 1 -- 172.21.15.69:0/3393070557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a200ff460 msgr2=0x7f8a201964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25e02700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a200ff460 0x7f8a201964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25e02700 1 -- 172.21.15.69:0/3393070557 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a18009d00 con 0x7f8a20104500 2023-12-14T14:09:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a25e02700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20104500 0x7f8a2019ae70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8a18007870 tx=0x7f8a18007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a167fc700 1 -- 172.21.15.69:0/3393070557 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800e040 con 0x7f8a20104500 2023-12-14T14:09:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a167fc700 1 -- 172.21.15.69:0/3393070557 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a18003e10 con 0x7f8a20104500 2023-12-14T14:09:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2010f240 con 0x7f8a20104500 2023-12-14T14:09:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a167fc700 1 -- 172.21.15.69:0/3393070557 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18012af0 con 0x7f8a20104500 2023-12-14T14:09:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.200+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2010f0b0 con 0x7f8a20104500 2023-12-14T14:09:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.201+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a20069040 con 0x7f8a20104500 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.202+0000 7f8a167fc700 1 -- 172.21.15.69:0/3393070557 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8a180056c0 con 0x7f8a20104500 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.203+0000 7f8a167fc700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a0c0a1260 0x7f8a0c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.203+0000 7f8a25601700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a0c0a1260 0x7f8a0c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.203+0000 7f8a167fc700 1 -- 172.21.15.69:0/3393070557 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8a180ce4d0 con 0x7f8a20104500 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.203+0000 7f8a167fc700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] conn(0x7f8a0c0aa900 0x7f8a0c0acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.203+0000 7f8a167fc700 1 -- 172.21.15.69:0/3393070557 --> [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a0c0ad3c0 con 0x7f8a0c0aa900 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.203+0000 7f8a167fc700 1 -- 172.21.15.69:0/3393070557 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a180ce970 con 0x7f8a20104500 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.203+0000 7f8a24e00700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] conn(0x7f8a0c0aa900 0x7f8a0c0acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.203+0000 7f8a25601700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a0c0a1260 0x7f8a0c0a3710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009af0 tx=0x7f8a1c0094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.204+0000 7f8a24e00700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] conn(0x7f8a0c0aa900 0x7f8a0c0acd10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:32.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.204+0000 7f8a167fc700 1 -- 172.21.15.69:0/3393070557 <== osd.3 v2:172.21.15.69:6810/3681148736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8a0c0ad3c0 con 0x7f8a0c0aa900 2023-12-14T14:09:32.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.220+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 --> [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a2010f3d0 con 0x7f8a0c0aa900 2023-12-14T14:09:32.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.220+0000 7f8a167fc700 1 -- 172.21.15.69:0/3393070557 <== osd.3 v2:172.21.15.69:6810/3681148736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8a2010f3d0 con 0x7f8a0c0aa900 2023-12-14T14:09:32.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] conn(0x7f8a0c0aa900 msgr2=0x7f8a0c0acd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] conn(0x7f8a0c0aa900 0x7f8a0c0acd10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a0c0a1260 msgr2=0x7f8a0c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a0c0a1260 0x7f8a0c0a3710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009af0 tx=0x7f8a1c0094f0 comp rx=0 tx=0).stop 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20104500 msgr2=0x7f8a2019ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 --2- 172.21.15.69:0/3393070557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20104500 0x7f8a2019ae70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8a18007870 tx=0x7f8a18007950 comp rx=0 tx=0).stop 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a25e02700 1 -- 172.21.15.69:0/3393070557 reap_dead start 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 shutdown_connections 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 >> 172.21.15.69:0/3393070557 conn(0x7f8a200770a0 msgr2=0x7f8a200685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 shutdown_connections 2023-12-14T14:09:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:32.221+0000 7f8a27865700 1 -- 172.21.15.69:0/3393070557 wait complete. 2023-12-14T14:09:32.656 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:33.010 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:33.011 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:33.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.143+0000 7f5e5627c700 1 -- 172.21.15.69:0/1931950956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e50105290 msgr2=0x7f5e50105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:33.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.143+0000 7f5e5627c700 1 --2- 172.21.15.69:0/1931950956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e50105290 0x7f5e50105660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009990 tx=0x7f5e40009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:33.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.143+0000 7f5e5627c700 1 -- 172.21.15.69:0/1931950956 shutdown_connections 2023-12-14T14:09:33.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.143+0000 7f5e5627c700 1 --2- 172.21.15.69:0/1931950956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500ff1e0 0x7f5e5010d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:33.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.143+0000 7f5e5627c700 1 --2- 172.21.15.69:0/1931950956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e50105290 0x7f5e50105660 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:33.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.143+0000 7f5e5627c700 1 --2- 172.21.15.69:0/1931950956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e500fe830 0x7f5e500feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:33.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.143+0000 7f5e5627c700 1 -- 172.21.15.69:0/1931950956 >> 172.21.15.69:0/1931950956 conn(0x7f5e500758a0 msgr2=0x7f5e50075ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:33.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.143+0000 7f5e5627c700 1 -- 172.21.15.69:0/1931950956 shutdown_connections 2023-12-14T14:09:33.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.143+0000 7f5e5627c700 1 -- 172.21.15.69:0/1931950956 wait complete. 2023-12-14T14:09:33.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e5627c700 1 Processor -- start 2023-12-14T14:09:33.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e5627c700 1 -- start start 2023-12-14T14:09:33.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e5627c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e500fe830 0x7f5e500ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:33.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e5627c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e500ff1e0 0x7f5e500fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e5627c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e50105290 0x7f5e501a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e5627c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e50100840 con 0x7f5e500ff1e0 2023-12-14T14:09:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e5627c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e501a4b60 con 0x7f5e50105290 2023-12-14T14:09:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e5627c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e501a4cd0 con 0x7f5e500fe830 2023-12-14T14:09:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e4f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e500ff1e0 0x7f5e500fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e4f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e500ff1e0 0x7f5e500fff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60146/0 (socket says 172.21.15.69:60146) 2023-12-14T14:09:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e4f7fe700 1 -- 172.21.15.69:0/2184697921 learned_addr learned my addr 172.21.15.69:0/2184697921 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e54819700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e50105290 0x7f5e501a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e4ffff700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e500fe830 0x7f5e500ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e4f7fe700 1 -- 172.21.15.69:0/2184697921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e500fe830 msgr2=0x7f5e500ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e4f7fe700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e500fe830 0x7f5e500ffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e4f7fe700 1 -- 172.21.15.69:0/2184697921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e50105290 msgr2=0x7f5e501a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.144+0000 7f5e4f7fe700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e50105290 0x7f5e501a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.145+0000 7f5e4f7fe700 1 -- 172.21.15.69:0/2184697921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400095f0 con 0x7f5e500ff1e0 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.145+0000 7f5e54819700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e50105290 0x7f5e501a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.145+0000 7f5e4f7fe700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e500ff1e0 0x7f5e500fff50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400d980 tx=0x7f5e4400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.145+0000 7f5e4d7fa700 1 -- 172.21.15.69:0/2184697921 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400bb60 con 0x7f5e500ff1e0 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.145+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e50110410 con 0x7f5e500ff1e0 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.145+0000 7f5e4d7fa700 1 -- 172.21.15.69:0/2184697921 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e44007640 con 0x7f5e500ff1e0 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.145+0000 7f5e4d7fa700 1 -- 172.21.15.69:0/2184697921 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44004e90 con 0x7f5e500ff1e0 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.145+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e50110280 con 0x7f5e500ff1e0 2023-12-14T14:09:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.146+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e500fcc90 con 0x7f5e500ff1e0 2023-12-14T14:09:33.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.147+0000 7f5e4d7fa700 1 -- 172.21.15.69:0/2184697921 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5e4400bcc0 con 0x7f5e500ff1e0 2023-12-14T14:09:33.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.147+0000 7f5e4d7fa700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e380a11e0 0x7f5e380a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:33.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.147+0000 7f5e4ffff700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e380a11e0 0x7f5e380a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:33.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.147+0000 7f5e4d7fa700 1 -- 172.21.15.69:0/2184697921 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5e440cce20 con 0x7f5e500ff1e0 2023-12-14T14:09:33.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.148+0000 7f5e4d7fa700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] conn(0x7f5e380aa840 0x7f5e380acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:33.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.148+0000 7f5e4d7fa700 1 -- 172.21.15.69:0/2184697921 --> [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e380ad300 con 0x7f5e380aa840 2023-12-14T14:09:33.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.148+0000 7f5e4d7fa700 1 -- 172.21.15.69:0/2184697921 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e440cd2c0 con 0x7f5e500ff1e0 2023-12-14T14:09:33.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.148+0000 7f5e4ffff700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e380a11e0 0x7f5e380a3690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000b2e0 tx=0x7f5e40000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:33.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.148+0000 7f5e54819700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] conn(0x7f5e380aa840 0x7f5e380acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:33.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.148+0000 7f5e54819700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] conn(0x7f5e380aa840 0x7f5e380acc50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:33.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.149+0000 7f5e4d7fa700 1 -- 172.21.15.69:0/2184697921 <== osd.4 v2:172.21.15.81:6808/2435197817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5e380ad300 con 0x7f5e380aa840 2023-12-14T14:09:33.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.166+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 --> [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e501105a0 con 0x7f5e380aa840 2023-12-14T14:09:33.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.166+0000 7f5e4d7fa700 1 -- 172.21.15.69:0/2184697921 <== osd.4 v2:172.21.15.81:6808/2435197817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5e501105a0 con 0x7f5e380aa840 2023-12-14T14:09:33.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.166+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 >> [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] conn(0x7f5e380aa840 msgr2=0x7f5e380acc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:33.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.166+0000 7f5e5627c700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] conn(0x7f5e380aa840 0x7f5e380acc50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:33.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.167+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e380a11e0 msgr2=0x7f5e380a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:33.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.167+0000 7f5e5627c700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e380a11e0 0x7f5e380a3690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000b2e0 tx=0x7f5e40000bc0 comp rx=0 tx=0).stop 2023-12-14T14:09:33.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.167+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e500ff1e0 msgr2=0x7f5e500fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:33.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.167+0000 7f5e5627c700 1 --2- 172.21.15.69:0/2184697921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e500ff1e0 0x7f5e500fff50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400d980 tx=0x7f5e4400dd40 comp rx=0 tx=0).stop 2023-12-14T14:09:33.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.167+0000 7f5e54819700 1 -- 172.21.15.69:0/2184697921 reap_dead start 2023-12-14T14:09:33.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.167+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 shutdown_connections 2023-12-14T14:09:33.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.167+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 >> 172.21.15.69:0/2184697921 conn(0x7f5e500758a0 msgr2=0x7f5e500fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:33.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.167+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 shutdown_connections 2023-12-14T14:09:33.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:33.167+0000 7f5e5627c700 1 -- 172.21.15.69:0/2184697921 wait complete. 2023-12-14T14:09:33.803 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:33 smithi069 ceph-mon[42034]: pgmap v233: 97 pgs: 97 active+clean; 631 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2023-12-14T14:09:34.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:33 smithi119 ceph-mon[43834]: pgmap v233: 97 pgs: 97 active+clean; 631 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2023-12-14T14:09:34.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:33 smithi081 ceph-mon[43371]: pgmap v233: 97 pgs: 97 active+clean; 631 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2023-12-14T14:09:34.204 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:34.227 INFO:teuthology.orchestra.run.smithi069.stdout:193273528351 2023-12-14T14:09:34.227 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.6 2023-12-14T14:09:34.515 INFO:teuthology.orchestra.run.smithi069.stdout:103079215146 2023-12-14T14:09:34.515 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-14T14:09:34.929 INFO:teuthology.orchestra.run.smithi069.stdout:137438953510 2023-12-14T14:09:34.929 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-14T14:09:35.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.641+0000 7f5790964700 1 -- 172.21.15.69:0/2983163592 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f578c10a890 msgr2=0x7f578c10ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.641+0000 7f5790964700 1 --2- 172.21.15.69:0/2983163592 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f578c10a890 0x7f578c10ccd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f578400b0a0 tx=0x7f578400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.641+0000 7f5790964700 1 -- 172.21.15.69:0/2983163592 shutdown_connections 2023-12-14T14:09:35.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.641+0000 7f5790964700 1 --2- 172.21.15.69:0/2983163592 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f578c10a890 0x7f578c10ccd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.641+0000 7f5790964700 1 --2- 172.21.15.69:0/2983163592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f578c101540 0x7f578c101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.641+0000 7f5790964700 1 --2- 172.21.15.69:0/2983163592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c101e50 0x7f578c10a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.641+0000 7f5790964700 1 -- 172.21.15.69:0/2983163592 >> 172.21.15.69:0/2983163592 conn(0x7f578c0770a0 msgr2=0x7f578c0774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:35.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.641+0000 7f5790964700 1 -- 172.21.15.69:0/2983163592 shutdown_connections 2023-12-14T14:09:35.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.641+0000 7f5790964700 1 -- 172.21.15.69:0/2983163592 wait complete. 2023-12-14T14:09:35.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f5790964700 1 Processor -- start 2023-12-14T14:09:35.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f5790964700 1 -- start start 2023-12-14T14:09:35.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f5790964700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f578c101540 0x7f578c196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f5790964700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c101e50 0x7f578c196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f5790964700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f578c10a890 0x7f578c19af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f5790964700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c19b550 con 0x7f578c10a890 2023-12-14T14:09:35.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f5790964700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c19b6c0 con 0x7f578c101540 2023-12-14T14:09:35.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f5790964700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c19b880 con 0x7f578c101e50 2023-12-14T14:09:35.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f578ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f578c10a890 0x7f578c19af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f578ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f578c10a890 0x7f578c19af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60160/0 (socket says 172.21.15.69:60160) 2023-12-14T14:09:35.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f578ad9d700 1 -- 172.21.15.69:0/1154485980 learned_addr learned my addr 172.21.15.69:0/1154485980 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:35.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.642+0000 7f578a59c700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f578c101540 0x7f578c196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f5789d9b700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c101e50 0x7f578c196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f578ad9d700 1 -- 172.21.15.69:0/1154485980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c101e50 msgr2=0x7f578c196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f578ad9d700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c101e50 0x7f578c196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f578ad9d700 1 -- 172.21.15.69:0/1154485980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f578c101540 msgr2=0x7f578c196590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f578ad9d700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f578c101540 0x7f578c196590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f578ad9d700 1 -- 172.21.15.69:0/1154485980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5784009d00 con 0x7f578c10a890 2023-12-14T14:09:35.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f578ad9d700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f578c10a890 0x7f578c19af40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f57840062a0 tx=0x7f5784004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:35.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f577b7fe700 1 -- 172.21.15.69:0/1154485980 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578400e040 con 0x7f578c10a890 2023-12-14T14:09:35.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c110380 con 0x7f578c10a890 2023-12-14T14:09:35.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f577b7fe700 1 -- 172.21.15.69:0/1154485980 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5784004020 con 0x7f578c10a890 2023-12-14T14:09:35.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f577b7fe700 1 -- 172.21.15.69:0/1154485980 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578401b6b0 con 0x7f578c10a890 2023-12-14T14:09:35.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.643+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c1101f0 con 0x7f578c10a890 2023-12-14T14:09:35.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.644+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f578c0fd760 con 0x7f578c10a890 2023-12-14T14:09:35.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.645+0000 7f577b7fe700 1 -- 172.21.15.69:0/1154485980 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5784004470 con 0x7f578c10a890 2023-12-14T14:09:35.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.646+0000 7f577b7fe700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57740a11e0 0x7f57740a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.646+0000 7f578a59c700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57740a11e0 0x7f57740a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.646+0000 7f577b7fe700 1 -- 172.21.15.69:0/1154485980 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f57840cea60 con 0x7f578c10a890 2023-12-14T14:09:35.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.646+0000 7f577b7fe700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] conn(0x7f57740aa9b0 0x7f57740acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.646+0000 7f577b7fe700 1 -- 172.21.15.69:0/1154485980 --> [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57740ad470 con 0x7f57740aa9b0 2023-12-14T14:09:35.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.646+0000 7f577b7fe700 1 -- 172.21.15.69:0/1154485980 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57840cef00 con 0x7f578c10a890 2023-12-14T14:09:35.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.646+0000 7f578a59c700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57740a11e0 0x7f57740a3690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5780005fd0 tx=0x7f578000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:35.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.646+0000 7f5789d9b700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] conn(0x7f57740aa9b0 0x7f57740acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.646+0000 7f5789d9b700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] conn(0x7f57740aa9b0 0x7f57740acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:35.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.647+0000 7f577b7fe700 1 -- 172.21.15.69:0/1154485980 <== osd.2 v2:172.21.15.119:6800/715893428 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f57740ad470 con 0x7f57740aa9b0 2023-12-14T14:09:35.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.663+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 --> [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f578c110510 con 0x7f57740aa9b0 2023-12-14T14:09:35.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f577b7fe700 1 -- 172.21.15.69:0/1154485980 <== osd.2 v2:172.21.15.119:6800/715893428 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f578c110510 con 0x7f57740aa9b0 2023-12-14T14:09:35.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 >> [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] conn(0x7f57740aa9b0 msgr2=0x7f57740acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] conn(0x7f57740aa9b0 0x7f57740acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57740a11e0 msgr2=0x7f57740a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57740a11e0 0x7f57740a3690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5780005fd0 tx=0x7f578000a560 comp rx=0 tx=0).stop 2023-12-14T14:09:35.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f578c10a890 msgr2=0x7f578c19af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 --2- 172.21.15.69:0/1154485980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f578c10a890 0x7f578c19af40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f57840062a0 tx=0x7f5784004a50 comp rx=0 tx=0).stop 2023-12-14T14:09:35.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f578ad9d700 1 -- 172.21.15.69:0/1154485980 reap_dead start 2023-12-14T14:09:35.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 shutdown_connections 2023-12-14T14:09:35.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 >> 172.21.15.69:0/1154485980 conn(0x7f578c0770a0 msgr2=0x7f578c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:35.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 shutdown_connections 2023-12-14T14:09:35.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.664+0000 7f5790964700 1 -- 172.21.15.69:0/1154485980 wait complete. 2023-12-14T14:09:35.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.802+0000 7f0a75a3e700 1 -- 172.21.15.69:0/3631746137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a7010a890 msgr2=0x7f0a7010ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.802+0000 7f0a75a3e700 1 --2- 172.21.15.69:0/3631746137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a7010a890 0x7f0a7010ccd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800b0a0 tx=0x7f0a6800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.802+0000 7f0a75a3e700 1 -- 172.21.15.69:0/3631746137 shutdown_connections 2023-12-14T14:09:35.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.802+0000 7f0a75a3e700 1 --2- 172.21.15.69:0/3631746137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a7010a890 0x7f0a7010ccd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.802+0000 7f0a75a3e700 1 --2- 172.21.15.69:0/3631746137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a70101540 0x7f0a70101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.802+0000 7f0a75a3e700 1 --2- 172.21.15.69:0/3631746137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70101e50 0x7f0a7010a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.802+0000 7f0a75a3e700 1 -- 172.21.15.69:0/3631746137 >> 172.21.15.69:0/3631746137 conn(0x7f0a700770a0 msgr2=0x7f0a700774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:35.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.802+0000 7f0a75a3e700 1 -- 172.21.15.69:0/3631746137 shutdown_connections 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.802+0000 7f0a75a3e700 1 -- 172.21.15.69:0/3631746137 wait complete. 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.803+0000 7f0a75a3e700 1 Processor -- start 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a75a3e700 1 -- start start 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a75a3e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70101540 0x7f0a70196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a75a3e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a70101e50 0x7f0a70196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a75a3e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a7010a890 0x7f0a7019aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a75a3e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7019b4e0 con 0x7f0a7010a890 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a75a3e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7019b650 con 0x7f0a70101540 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a75a3e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7019b810 con 0x7f0a70101e50 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a6effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70101540 0x7f0a70196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a6effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70101540 0x7f0a70196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:45422/0 (socket says 172.21.15.69:45422) 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a6f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a7010a890 0x7f0a7019aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a6effd700 1 -- 172.21.15.69:0/1956762235 learned_addr learned my addr 172.21.15.69:0/1956762235 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a6e7fc700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a70101e50 0x7f0a70196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.804+0000 7f0a6effd700 1 -- 172.21.15.69:0/1956762235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a70101e50 msgr2=0x7f0a70196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a6effd700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a70101e50 0x7f0a70196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a6effd700 1 -- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a7010a890 msgr2=0x7f0a7019aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a6effd700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a7010a890 0x7f0a7019aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a6effd700 1 -- 172.21.15.69:0/1956762235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a68009d00 con 0x7f0a70101540 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a6f7fe700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a7010a890 0x7f0a7019aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a6effd700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70101540 0x7f0a70196520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000d950 tx=0x7f0a6000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a74a3c700 1 -- 172.21.15.69:0/1956762235 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000f890 con 0x7f0a70101540 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a70110350 con 0x7f0a70101540 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a74a3c700 1 -- 172.21.15.69:0/1956762235 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a60010460 con 0x7f0a70101540 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a74a3c700 1 -- 172.21.15.69:0/1956762235 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000e610 con 0x7f0a70101540 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.805+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a701101c0 con 0x7f0a70101540 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.806+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a5c000ff0 con 0x7f0a70101540 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.807+0000 7f0a74a3c700 1 -- 172.21.15.69:0/1956762235 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0a6000f9f0 con 0x7f0a70101540 2023-12-14T14:09:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.807+0000 7f0a74a3c700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0a580a5670 0x7f0a580a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.808+0000 7f0a6e7fc700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0a580a5670 0x7f0a580a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.808+0000 7f0a74a3c700 1 -- 172.21.15.69:0/1956762235 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0a600ccbd0 con 0x7f0a70101540 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.808+0000 7f0a74a3c700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] conn(0x7f0a580aee40 0x7f0a580b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.808+0000 7f0a74a3c700 1 -- 172.21.15.69:0/1956762235 --> [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a580b1900 con 0x7f0a580aee40 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.808+0000 7f0a74a3c700 1 -- 172.21.15.69:0/1956762235 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a600ccf80 con 0x7f0a70101540 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.808+0000 7f0a6e7fc700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0a580a5670 0x7f0a580a7b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a70197b40 tx=0x7f0a6400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.808+0000 7f0a6f7fe700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] conn(0x7f0a580aee40 0x7f0a580b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.808+0000 7f0a6f7fe700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] conn(0x7f0a580aee40 0x7f0a580b1250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.809+0000 7f0a74a3c700 1 -- 172.21.15.69:0/1956762235 <== osd.0 v2:172.21.15.69:6802/3233163239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0a580b1900 con 0x7f0a580aee40 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.825+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 --> [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a5c002d70 con 0x7f0a580aee40 2023-12-14T14:09:35.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.825+0000 7f0a74a3c700 1 -- 172.21.15.69:0/1956762235 <== osd.0 v2:172.21.15.69:6802/3233163239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a5c002d70 con 0x7f0a580aee40 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] conn(0x7f0a580aee40 msgr2=0x7f0a580b1250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] conn(0x7f0a580aee40 0x7f0a580b1250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0a580a5670 msgr2=0x7f0a580a7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f0a580a5670 0x7f0a580a7b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a70197b40 tx=0x7f0a6400b410 comp rx=0 tx=0).stop 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70101540 msgr2=0x7f0a70196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 --2- 172.21.15.69:0/1956762235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70101540 0x7f0a70196520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000d950 tx=0x7f0a6000dc60 comp rx=0 tx=0).stop 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a6f7fe700 1 -- 172.21.15.69:0/1956762235 reap_dead start 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 shutdown_connections 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 >> 172.21.15.69:0/1956762235 conn(0x7f0a700770a0 msgr2=0x7f0a700fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 shutdown_connections 2023-12-14T14:09:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.826+0000 7f0a75a3e700 1 -- 172.21.15.69:0/1956762235 wait complete. 2023-12-14T14:09:35.950 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:35 smithi069 ceph-mon[42034]: pgmap v234: 97 pgs: 97 active+clean; 631 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-12-14T14:09:36.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:35 smithi119 ceph-mon[43834]: pgmap v234: 97 pgs: 97 active+clean; 631 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-12-14T14:09:36.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:35 smithi081 ceph-mon[43371]: pgmap v234: 97 pgs: 97 active+clean; 631 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-12-14T14:09:36.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.905+0000 7f5962e39700 1 -- 172.21.15.69:0/2994407034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f595c104510 msgr2=0x7f595c10c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.905+0000 7f5962e39700 1 --2- 172.21.15.69:0/2994407034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f595c104510 0x7f595c10c090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f595400b0d0 tx=0x7f595400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.905+0000 7f5962e39700 1 -- 172.21.15.69:0/2994407034 shutdown_connections 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.905+0000 7f5962e39700 1 --2- 172.21.15.69:0/2994407034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f595c104510 0x7f595c10c090 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.905+0000 7f5962e39700 1 --2- 172.21.15.69:0/2994407034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595c0ff470 0x7f595c0ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.905+0000 7f5962e39700 1 --2- 172.21.15.69:0/2994407034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c0ffe10 0x7f595c103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.905+0000 7f5962e39700 1 -- 172.21.15.69:0/2994407034 >> 172.21.15.69:0/2994407034 conn(0x7f595c0770d0 msgr2=0x7f595c0774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.905+0000 7f5962e39700 1 -- 172.21.15.69:0/2994407034 shutdown_connections 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.905+0000 7f5962e39700 1 -- 172.21.15.69:0/2994407034 wait complete. 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f5962e39700 1 Processor -- start 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f5962e39700 1 -- start start 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f5962e39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595c0ff470 0x7f595c1953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f5962e39700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f595c0ffe10 0x7f595c195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f5962e39700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c104510 0x7f595c199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f5962e39700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c19a3a0 con 0x7f595c0ffe10 2023-12-14T14:09:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f5962e39700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c19a510 con 0x7f595c0ff470 2023-12-14T14:09:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f5962e39700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c19a6d0 con 0x7f595c104510 2023-12-14T14:09:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f595bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f595c0ffe10 0x7f595c195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f595bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f595c0ffe10 0x7f595c195920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60214/0 (socket says 172.21.15.69:60214) 2023-12-14T14:09:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f595bfff700 1 -- 172.21.15.69:0/2475169455 learned_addr learned my addr 172.21.15.69:0/2475169455 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f5960bd5700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595c0ff470 0x7f595c1953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f59613d6700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c104510 0x7f595c199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f595bfff700 1 -- 172.21.15.69:0/2475169455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c104510 msgr2=0x7f595c199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f595bfff700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c104510 0x7f595c199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f595bfff700 1 -- 172.21.15.69:0/2475169455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595c0ff470 msgr2=0x7f595c1953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f595bfff700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595c0ff470 0x7f595c1953e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f595bfff700 1 -- 172.21.15.69:0/2475169455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954009d00 con 0x7f595c0ffe10 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f59613d6700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c104510 0x7f595c199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.906+0000 7f595bfff700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f595c0ffe10 0x7f595c195920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f594800d950 tx=0x7f594800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.907+0000 7f5959ffb700 1 -- 172.21.15.69:0/2475169455 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948004a30 con 0x7f595c0ffe10 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.907+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c10f2a0 con 0x7f595c0ffe10 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.907+0000 7f5959ffb700 1 -- 172.21.15.69:0/2475169455 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59480054e0 con 0x7f595c0ffe10 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.907+0000 7f5959ffb700 1 -- 172.21.15.69:0/2475169455 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948009bf0 con 0x7f595c0ffe10 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.907+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c10f110 con 0x7f595c0ffe10 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.908+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f595c0fd6a0 con 0x7f595c0ffe10 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.909+0000 7f5959ffb700 1 -- 172.21.15.69:0/2475169455 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5948009d50 con 0x7f595c0ffe10 2023-12-14T14:09:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.909+0000 7f5959ffb700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f594c0a11e0 0x7f594c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.910+0000 7f5960bd5700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f594c0a11e0 0x7f594c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.910+0000 7f5959ffb700 1 -- 172.21.15.69:0/2475169455 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f59480cc0c0 con 0x7f595c0ffe10 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.910+0000 7f5959ffb700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] conn(0x7f594c0aa9b0 0x7f594c0acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.910+0000 7f5959ffb700 1 -- 172.21.15.69:0/2475169455 --> [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f594c0ad470 con 0x7f594c0aa9b0 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.910+0000 7f5959ffb700 1 -- 172.21.15.69:0/2475169455 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59480ce7d0 con 0x7f595c0ffe10 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.910+0000 7f5960bd5700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f594c0a11e0 0x7f594c0a3690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5950007be0 tx=0x7f59500073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.910+0000 7f59613d6700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] conn(0x7f594c0aa9b0 0x7f594c0acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.911+0000 7f59613d6700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] conn(0x7f594c0aa9b0 0x7f594c0acdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.911+0000 7f5959ffb700 1 -- 172.21.15.69:0/2475169455 <== osd.11 v2:172.21.15.119:6824/3145725966 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f594c0ad470 con 0x7f594c0aa9b0 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.927+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 --> [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f595c10f430 con 0x7f594c0aa9b0 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5959ffb700 1 -- 172.21.15.69:0/2475169455 <== osd.11 v2:172.21.15.119:6824/3145725966 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f595c10f430 con 0x7f594c0aa9b0 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 >> [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] conn(0x7f594c0aa9b0 msgr2=0x7f594c0acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] conn(0x7f594c0aa9b0 0x7f594c0acdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f594c0a11e0 msgr2=0x7f594c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f594c0a11e0 0x7f594c0a3690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5950007be0 tx=0x7f59500073d0 comp rx=0 tx=0).stop 2023-12-14T14:09:36.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f595c0ffe10 msgr2=0x7f595c195920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:36.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 --2- 172.21.15.69:0/2475169455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f595c0ffe10 0x7f595c195920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f594800d950 tx=0x7f594800dc60 comp rx=0 tx=0).stop 2023-12-14T14:09:36.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f59613d6700 1 -- 172.21.15.69:0/2475169455 reap_dead start 2023-12-14T14:09:36.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 shutdown_connections 2023-12-14T14:09:36.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 >> 172.21.15.69:0/2475169455 conn(0x7f595c0770d0 msgr2=0x7f595c0fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:36.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 shutdown_connections 2023-12-14T14:09:36.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:35.928+0000 7f5962e39700 1 -- 172.21.15.69:0/2475169455 wait complete. 2023-12-14T14:09:37.106 INFO:teuthology.orchestra.run.smithi069.stdout:77309411373 2023-12-14T14:09:37.106 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-14T14:09:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:37.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:37 smithi069 ceph-mon[42034]: pgmap v235: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T14:09:37.394 INFO:teuthology.orchestra.run.smithi069.stdout:330712481806 2023-12-14T14:09:37.395 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.11 2023-12-14T14:09:37.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:37 smithi119 ceph-mon[43834]: pgmap v235: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T14:09:37.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.540+0000 7f9d8b53d700 1 -- 172.21.15.69:0/1557137795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d84101cf0 msgr2=0x7f9d8410a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.540+0000 7f9d8b53d700 1 --2- 172.21.15.69:0/1557137795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d84101cf0 0x7f9d8410a3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009990 tx=0x7f9d74009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.540+0000 7f9d8b53d700 1 -- 172.21.15.69:0/1557137795 shutdown_connections 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.540+0000 7f9d8b53d700 1 --2- 172.21.15.69:0/1557137795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8410a900 0x7f9d8410cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.540+0000 7f9d8b53d700 1 --2- 172.21.15.69:0/1557137795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d841013e0 0x7f9d841017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.540+0000 7f9d8b53d700 1 --2- 172.21.15.69:0/1557137795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d84101cf0 0x7f9d8410a3c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.540+0000 7f9d8b53d700 1 -- 172.21.15.69:0/1557137795 >> 172.21.15.69:0/1557137795 conn(0x7f9d840770d0 msgr2=0x7f9d840774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.540+0000 7f9d8b53d700 1 -- 172.21.15.69:0/1557137795 shutdown_connections 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.540+0000 7f9d8b53d700 1 -- 172.21.15.69:0/1557137795 wait complete. 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d8b53d700 1 Processor -- start 2023-12-14T14:09:37.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d8b53d700 1 -- start start 2023-12-14T14:09:37.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d8b53d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d841013e0 0x7f9d840ff210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d8b53d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d84101cf0 0x7f9d840ff750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d8b53d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d8410a900 0x7f9d840ffcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d8b53d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d841a4830 con 0x7f9d84101cf0 2023-12-14T14:09:37.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d8b53d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d841a49a0 con 0x7f9d8410a900 2023-12-14T14:09:37.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d8b53d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d841a4b60 con 0x7f9d841013e0 2023-12-14T14:09:37.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d88ad8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d84101cf0 0x7f9d840ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d88ad8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d84101cf0 0x7f9d840ff750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51276/0 (socket says 172.21.15.69:51276) 2023-12-14T14:09:37.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d88ad8700 1 -- 172.21.15.69:0/2059348276 learned_addr learned my addr 172.21.15.69:0/2059348276 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:37.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.541+0000 7f9d89ada700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d8410a900 0x7f9d840ffcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d892d9700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d841013e0 0x7f9d840ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d88ad8700 1 -- 172.21.15.69:0/2059348276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d841013e0 msgr2=0x7f9d840ff210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d88ad8700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d841013e0 0x7f9d840ff210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d88ad8700 1 -- 172.21.15.69:0/2059348276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d8410a900 msgr2=0x7f9d840ffcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d88ad8700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d8410a900 0x7f9d840ffcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d88ad8700 1 -- 172.21.15.69:0/2059348276 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740095f0 con 0x7f9d84101cf0 2023-12-14T14:09:37.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d88ad8700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d84101cf0 0x7f9d840ff750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d74000c00 tx=0x7f9d7400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:37.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d7a7fc700 1 -- 172.21.15.69:0/2059348276 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74023ce0 con 0x7f9d84101cf0 2023-12-14T14:09:37.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d8b53d700 1 -- 172.21.15.69:0/2059348276 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d84110380 con 0x7f9d84101cf0 2023-12-14T14:09:37.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d7a7fc700 1 -- 172.21.15.69:0/2059348276 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d74023e40 con 0x7f9d84101cf0 2023-12-14T14:09:37.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d7a7fc700 1 -- 172.21.15.69:0/2059348276 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74017c50 con 0x7f9d84101cf0 2023-12-14T14:09:37.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.542+0000 7f9d8b53d700 1 -- 172.21.15.69:0/2059348276 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d841101f0 con 0x7f9d84101cf0 2023-12-14T14:09:37.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.543+0000 7f9d6ffff700 1 -- 172.21.15.69:0/2059348276 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d64000fc0 con 0x7f9d84101cf0 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.544+0000 7f9d7a7fc700 1 -- 172.21.15.69:0/2059348276 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9d74029070 con 0x7f9d84101cf0 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.545+0000 7f9d7a7fc700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d700a11e0 0x7f9d700a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.545+0000 7f9d892d9700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d700a11e0 0x7f9d700a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.545+0000 7f9d7a7fc700 1 -- 172.21.15.69:0/2059348276 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9d740d6390 con 0x7f9d84101cf0 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.545+0000 7f9d7a7fc700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] conn(0x7f9d700aa9b0 0x7f9d700acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.545+0000 7f9d7a7fc700 1 -- 172.21.15.69:0/2059348276 --> [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d700ad470 con 0x7f9d700aa9b0 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.545+0000 7f9d7a7fc700 1 -- 172.21.15.69:0/2059348276 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d740d8970 con 0x7f9d84101cf0 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.545+0000 7f9d892d9700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d700a11e0 0x7f9d700a3690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9d80005950 tx=0x7f9d8000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.546+0000 7f9d89ada700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] conn(0x7f9d700aa9b0 0x7f9d700acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.546+0000 7f9d89ada700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] conn(0x7f9d700aa9b0 0x7f9d700acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:37.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.547+0000 7f9d7a7fc700 1 -- 172.21.15.69:0/2059348276 <== osd.10 v2:172.21.15.81:6824/2804287254 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9d700ad470 con 0x7f9d700aa9b0 2023-12-14T14:09:37.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.562+0000 7f9d6ffff700 1 -- 172.21.15.69:0/2059348276 --> [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d64002d40 con 0x7f9d700aa9b0 2023-12-14T14:09:37.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.563+0000 7f9d7a7fc700 1 -- 172.21.15.69:0/2059348276 <== osd.10 v2:172.21.15.81:6824/2804287254 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9d64002d40 con 0x7f9d700aa9b0 2023-12-14T14:09:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 -- 172.21.15.69:0/2059348276 >> [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] conn(0x7f9d700aa9b0 msgr2=0x7f9d700acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] conn(0x7f9d700aa9b0 0x7f9d700acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 -- 172.21.15.69:0/2059348276 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d700a11e0 msgr2=0x7f9d700a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d700a11e0 0x7f9d700a3690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9d80005950 tx=0x7f9d8000b410 comp rx=0 tx=0).stop 2023-12-14T14:09:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 -- 172.21.15.69:0/2059348276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d84101cf0 msgr2=0x7f9d840ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 --2- 172.21.15.69:0/2059348276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d84101cf0 0x7f9d840ff750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d74000c00 tx=0x7f9d7400bf20 comp rx=0 tx=0).stop 2023-12-14T14:09:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d89ada700 1 -- 172.21.15.69:0/2059348276 reap_dead start 2023-12-14T14:09:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 -- 172.21.15.69:0/2059348276 shutdown_connections 2023-12-14T14:09:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 -- 172.21.15.69:0/2059348276 >> 172.21.15.69:0/2059348276 conn(0x7f9d840770d0 msgr2=0x7f9d84102360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 -- 172.21.15.69:0/2059348276 shutdown_connections 2023-12-14T14:09:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.564+0000 7f9d6ffff700 1 -- 172.21.15.69:0/2059348276 wait complete. 2023-12-14T14:09:37.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.638+0000 7ff33b25f700 1 -- 172.21.15.69:0/731283960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff334100540 msgr2=0x7ff334100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.638+0000 7ff33b25f700 1 --2- 172.21.15.69:0/731283960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff334100540 0x7ff334100910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3280099c0 tx=0x7ff328009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.639+0000 7ff33b25f700 1 -- 172.21.15.69:0/731283960 shutdown_connections 2023-12-14T14:09:37.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.639+0000 7ff33b25f700 1 --2- 172.21.15.69:0/731283960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3341055e0 0x7ff33410d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.639+0000 7ff33b25f700 1 --2- 172.21.15.69:0/731283960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff334100540 0x7ff334100910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.639+0000 7ff33b25f700 1 --2- 172.21.15.69:0/731283960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff334100ee0 0x7ff334104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.639+0000 7ff33b25f700 1 -- 172.21.15.69:0/731283960 >> 172.21.15.69:0/731283960 conn(0x7ff3340fbdc0 msgr2=0x7ff3340fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:37.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.639+0000 7ff33b25f700 1 -- 172.21.15.69:0/731283960 shutdown_connections 2023-12-14T14:09:37.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.639+0000 7ff33b25f700 1 -- 172.21.15.69:0/731283960 wait complete. 2023-12-14T14:09:37.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.639+0000 7ff33b25f700 1 Processor -- start 2023-12-14T14:09:37.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.639+0000 7ff33b25f700 1 -- start start 2023-12-14T14:09:37.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff33b25f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334100540 0x7ff334196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff33b25f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff334100ee0 0x7ff334196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff33b25f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3341055e0 0x7ff33419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff33b25f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33419b3e0 con 0x7ff334100ee0 2023-12-14T14:09:37.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff33b25f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33419b550 con 0x7ff334100540 2023-12-14T14:09:37.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff33b25f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33419b710 con 0x7ff3341055e0 2023-12-14T14:09:37.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff333fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff334100ee0 0x7ff334196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff333fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff334100ee0 0x7ff334196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51294/0 (socket says 172.21.15.69:51294) 2023-12-14T14:09:37.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff333fff700 1 -- 172.21.15.69:0/835350970 learned_addr learned my addr 172.21.15.69:0/835350970 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:37.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff338ffb700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334100540 0x7ff334196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff3397fc700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3341055e0 0x7ff33419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff333fff700 1 -- 172.21.15.69:0/835350970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3341055e0 msgr2=0x7ff33419add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff333fff700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3341055e0 0x7ff33419add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff333fff700 1 -- 172.21.15.69:0/835350970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334100540 msgr2=0x7ff334196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff333fff700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334100540 0x7ff334196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff333fff700 1 -- 172.21.15.69:0/835350970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3280095f0 con 0x7ff334100ee0 2023-12-14T14:09:37.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff333fff700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff334100ee0 0x7ff334196960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff32000e970 tx=0x7ff32000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:37.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff331ffb700 1 -- 172.21.15.69:0/835350970 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320009790 con 0x7ff334100ee0 2023-12-14T14:09:37.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff331ffb700 1 -- 172.21.15.69:0/835350970 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff32000c7e0 con 0x7ff334100ee0 2023-12-14T14:09:37.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff334110320 con 0x7ff334100ee0 2023-12-14T14:09:37.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.640+0000 7ff331ffb700 1 -- 172.21.15.69:0/835350970 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3200054e0 con 0x7ff334100ee0 2023-12-14T14:09:37.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.641+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff334110190 con 0x7ff334100ee0 2023-12-14T14:09:37.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.642+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff334104860 con 0x7ff334100ee0 2023-12-14T14:09:37.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.642+0000 7ff331ffb700 1 -- 172.21.15.69:0/835350970 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff32000c950 con 0x7ff334100ee0 2023-12-14T14:09:37.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.643+0000 7ff331ffb700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff3240a11e0 0x7ff3240a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.643+0000 7ff338ffb700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff3240a11e0 0x7ff3240a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.643+0000 7ff331ffb700 1 -- 172.21.15.69:0/835350970 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff320014070 con 0x7ff334100ee0 2023-12-14T14:09:37.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.644+0000 7ff331ffb700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] conn(0x7ff3240aa9b0 0x7ff3240acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:37.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.644+0000 7ff331ffb700 1 -- 172.21.15.69:0/835350970 --> [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3240ad470 con 0x7ff3240aa9b0 2023-12-14T14:09:37.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.644+0000 7ff331ffb700 1 -- 172.21.15.69:0/835350970 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3200d12a0 con 0x7ff334100ee0 2023-12-14T14:09:37.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.644+0000 7ff338ffb700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff3240a11e0 0x7ff3240a3690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff328009990 tx=0x7ff328005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:37.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.644+0000 7ff3397fc700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] conn(0x7ff3240aa9b0 0x7ff3240acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:37.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.644+0000 7ff3397fc700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] conn(0x7ff3240aa9b0 0x7ff3240acdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:37.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.645+0000 7ff331ffb700 1 -- 172.21.15.69:0/835350970 <== osd.9 v2:172.21.15.69:6826/1244156926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff3240ad470 con 0x7ff3240aa9b0 2023-12-14T14:09:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:37 smithi081 ceph-mon[43371]: pgmap v235: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T14:09:37.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.671+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 --> [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3341104b0 con 0x7ff3240aa9b0 2023-12-14T14:09:37.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.671+0000 7ff331ffb700 1 -- 172.21.15.69:0/835350970 <== osd.9 v2:172.21.15.69:6826/1244156926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff3341104b0 con 0x7ff3240aa9b0 2023-12-14T14:09:37.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] conn(0x7ff3240aa9b0 msgr2=0x7ff3240acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] conn(0x7ff3240aa9b0 0x7ff3240acdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff3240a11e0 msgr2=0x7ff3240a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff3240a11e0 0x7ff3240a3690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff328009990 tx=0x7ff328005fb0 comp rx=0 tx=0).stop 2023-12-14T14:09:37.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff334100ee0 msgr2=0x7ff334196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:37.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 --2- 172.21.15.69:0/835350970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff334100ee0 0x7ff334196960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff32000e970 tx=0x7ff32000ec80 comp rx=0 tx=0).stop 2023-12-14T14:09:37.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff3397fc700 1 -- 172.21.15.69:0/835350970 reap_dead start 2023-12-14T14:09:37.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 shutdown_connections 2023-12-14T14:09:37.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 >> 172.21.15.69:0/835350970 conn(0x7ff3340fbdc0 msgr2=0x7ff334103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:37.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 shutdown_connections 2023-12-14T14:09:37.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:37.672+0000 7ff33b25f700 1 -- 172.21.15.69:0/835350970 wait complete. 2023-12-14T14:09:38.106 INFO:teuthology.orchestra.run.smithi069.stdout:34359738422 2023-12-14T14:09:38.107 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-14T14:09:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:38.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.921+0000 7f068dd22700 1 -- 172.21.15.69:0/3223843661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0688101ca0 msgr2=0x7f068810a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:38.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.921+0000 7f068dd22700 1 --2- 172.21.15.69:0/3223843661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0688101ca0 0x7f068810a370 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f067c009990 tx=0x7f067c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:38.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.921+0000 7f068dd22700 1 -- 172.21.15.69:0/3223843661 shutdown_connections 2023-12-14T14:09:38.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.921+0000 7f068dd22700 1 --2- 172.21.15.69:0/3223843661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068810a8b0 0x7f068810ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:38.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.921+0000 7f068dd22700 1 --2- 172.21.15.69:0/3223843661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0688101390 0x7f0688101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:38.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.921+0000 7f068dd22700 1 --2- 172.21.15.69:0/3223843661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0688101ca0 0x7f068810a370 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:38.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.921+0000 7f068dd22700 1 -- 172.21.15.69:0/3223843661 >> 172.21.15.69:0/3223843661 conn(0x7f06880770a0 msgr2=0x7f06880774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:38.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.921+0000 7f068dd22700 1 -- 172.21.15.69:0/3223843661 shutdown_connections 2023-12-14T14:09:38.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.922+0000 7f068dd22700 1 -- 172.21.15.69:0/3223843661 wait complete. 2023-12-14T14:09:38.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.922+0000 7f068dd22700 1 Processor -- start 2023-12-14T14:09:38.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.922+0000 7f068dd22700 1 -- start start 2023-12-14T14:09:38.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.922+0000 7f068dd22700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0688101390 0x7f0688196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:38.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.922+0000 7f068dd22700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0688101ca0 0x7f0688196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:38.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.922+0000 7f068dd22700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f068810a8b0 0x7f068819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:38.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.922+0000 7f068dd22700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068819b370 con 0x7f068810a8b0 2023-12-14T14:09:38.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.922+0000 7f068dd22700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068819b4e0 con 0x7f0688101390 2023-12-14T14:09:38.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.922+0000 7f068dd22700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068819b6a0 con 0x7f0688101ca0 2023-12-14T14:09:38.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0687fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f068810a8b0 0x7f068819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:38.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0687fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f068810a8b0 0x7f068819ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51316/0 (socket says 172.21.15.69:51316) 2023-12-14T14:09:38.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0687fff700 1 -- 172.21.15.69:0/234197294 learned_addr learned my addr 172.21.15.69:0/234197294 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:38.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f06877fe700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0688101390 0x7f0688196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:38.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0686ffd700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0688101ca0 0x7f0688196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:38.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0687fff700 1 -- 172.21.15.69:0/234197294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0688101ca0 msgr2=0x7f0688196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:38.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0687fff700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0688101ca0 0x7f0688196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:38.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0687fff700 1 -- 172.21.15.69:0/234197294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0688101390 msgr2=0x7f0688196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0687fff700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0688101390 0x7f0688196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0687fff700 1 -- 172.21.15.69:0/234197294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c0095f0 con 0x7f068810a8b0 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0686ffd700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0688101ca0 0x7f0688196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0687fff700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f068810a8b0 0x7f068819ad60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0680007d70 tx=0x7f068000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0684ff9700 1 -- 172.21.15.69:0/234197294 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068000ad40 con 0x7f068810a8b0 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0684ff9700 1 -- 172.21.15.69:0/234197294 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06800128e0 con 0x7f068810a8b0 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06881103a0 con 0x7f068810a8b0 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f0684ff9700 1 -- 172.21.15.69:0/234197294 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800116b0 con 0x7f068810a8b0 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.923+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0688110210 con 0x7f068810a8b0 2023-12-14T14:09:38.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.924+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06880fc720 con 0x7f068810a8b0 2023-12-14T14:09:38.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.925+0000 7f0684ff9700 1 -- 172.21.15.69:0/234197294 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0680012420 con 0x7f068810a8b0 2023-12-14T14:09:38.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.926+0000 7f0684ff9700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f06700a11e0 0x7f06700a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:38.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.926+0000 7f06877fe700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f06700a11e0 0x7f06700a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:38.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.926+0000 7f0684ff9700 1 -- 172.21.15.69:0/234197294 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f06800ccd80 con 0x7f068810a8b0 2023-12-14T14:09:38.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.926+0000 7f0684ff9700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] conn(0x7f06700aa9b0 0x7f06700acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:38.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.926+0000 7f0684ff9700 1 -- 172.21.15.69:0/234197294 --> [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06700ad470 con 0x7f06700aa9b0 2023-12-14T14:09:38.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.926+0000 7f0684ff9700 1 -- 172.21.15.69:0/234197294 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06800cd0f0 con 0x7f068810a8b0 2023-12-14T14:09:38.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.926+0000 7f06877fe700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f06700a11e0 0x7f06700a3690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0678009a10 tx=0x7f0678009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:38.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.926+0000 7f0686ffd700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] conn(0x7f06700aa9b0 0x7f06700acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:38.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.927+0000 7f0686ffd700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] conn(0x7f06700aa9b0 0x7f06700acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:38.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.928+0000 7f0684ff9700 1 -- 172.21.15.69:0/234197294 <== osd.1 v2:172.21.15.81:6800/3099180120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f06700ad470 con 0x7f06700aa9b0 2023-12-14T14:09:38.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.943+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 --> [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0688110530 con 0x7f06700aa9b0 2023-12-14T14:09:38.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.944+0000 7f0684ff9700 1 -- 172.21.15.69:0/234197294 <== osd.1 v2:172.21.15.81:6800/3099180120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0688110530 con 0x7f06700aa9b0 2023-12-14T14:09:38.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 >> [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] conn(0x7f06700aa9b0 msgr2=0x7f06700acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] conn(0x7f06700aa9b0 0x7f06700acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f06700a11e0 msgr2=0x7f06700a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f06700a11e0 0x7f06700a3690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0678009a10 tx=0x7f0678009190 comp rx=0 tx=0).stop 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f068810a8b0 msgr2=0x7f068819ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 --2- 172.21.15.69:0/234197294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f068810a8b0 0x7f068819ad60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0680007d70 tx=0x7f068000a340 comp rx=0 tx=0).stop 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f0687fff700 1 -- 172.21.15.69:0/234197294 reap_dead start 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 shutdown_connections 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 >> 172.21.15.69:0/234197294 conn(0x7f06880770a0 msgr2=0x7f06880fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 shutdown_connections 2023-12-14T14:09:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:38.945+0000 7f068dd22700 1 -- 172.21.15.69:0/234197294 wait complete. 2023-12-14T14:09:39.014 INFO:teuthology.orchestra.run.smithi069.stdout:300647710739 2023-12-14T14:09:39.014 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.10 2023-12-14T14:09:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.135+0000 7f4d76f99700 1 -- 172.21.15.69:0/3352064086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d70101390 msgr2=0x7f4d70101760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.135+0000 7f4d76f99700 1 --2- 172.21.15.69:0/3352064086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d70101390 0x7f4d70101760 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009990 tx=0x7f4d64009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.136+0000 7f4d76f99700 1 -- 172.21.15.69:0/3352064086 shutdown_connections 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.136+0000 7f4d76f99700 1 --2- 172.21.15.69:0/3352064086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7010a8b0 0x7f4d7010ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.136+0000 7f4d76f99700 1 --2- 172.21.15.69:0/3352064086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d70101390 0x7f4d70101760 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.136+0000 7f4d76f99700 1 --2- 172.21.15.69:0/3352064086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70101ca0 0x7f4d7010a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.136+0000 7f4d76f99700 1 -- 172.21.15.69:0/3352064086 >> 172.21.15.69:0/3352064086 conn(0x7f4d700770a0 msgr2=0x7f4d700774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.136+0000 7f4d76f99700 1 -- 172.21.15.69:0/3352064086 shutdown_connections 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.136+0000 7f4d76f99700 1 -- 172.21.15.69:0/3352064086 wait complete. 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.136+0000 7f4d76f99700 1 Processor -- start 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.136+0000 7f4d76f99700 1 -- start start 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d76f99700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d70101390 0x7f4d70196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d76f99700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70101ca0 0x7f4d70196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d76f99700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7010a8b0 0x7f4d7019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d76f99700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7019b3d0 con 0x7f4d70101390 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d76f99700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7019b540 con 0x7f4d70101ca0 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d76f99700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7019b700 con 0x7f4d7010a8b0 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d74d35700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d70101390 0x7f4d70196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d74d35700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d70101390 0x7f4d70196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51328/0 (socket says 172.21.15.69:51328) 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d74d35700 1 -- 172.21.15.69:0/2977163400 learned_addr learned my addr 172.21.15.69:0/2977163400 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d74d35700 1 -- 172.21.15.69:0/2977163400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7010a8b0 msgr2=0x7f4d7019adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d75536700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7010a8b0 0x7f4d7019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d74d35700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7010a8b0 0x7f4d7019adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d74d35700 1 -- 172.21.15.69:0/2977163400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70101ca0 msgr2=0x7f4d70196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d6ffff700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70101ca0 0x7f4d70196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d74d35700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70101ca0 0x7f4d70196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d74d35700 1 -- 172.21.15.69:0/2977163400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640095f0 con 0x7f4d70101390 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d6ffff700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70101ca0 0x7f4d70196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.137+0000 7f4d74d35700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d70101390 0x7f4d70196410 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4d64000c00 tx=0x7f4d6400f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.138+0000 7f4d6dffb700 1 -- 172.21.15.69:0/2977163400 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6401d070 con 0x7f4d70101390 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.138+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d70110390 con 0x7f4d70101390 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.138+0000 7f4d6dffb700 1 -- 172.21.15.69:0/2977163400 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d6400fce0 con 0x7f4d70101390 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.138+0000 7f4d6dffb700 1 -- 172.21.15.69:0/2977163400 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64017770 con 0x7f4d70101390 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.138+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d70110200 con 0x7f4d70101390 2023-12-14T14:09:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.139+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d700fc6e0 con 0x7f4d70101390 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.140+0000 7f4d6dffb700 1 -- 172.21.15.69:0/2977163400 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4d640178d0 con 0x7f4d70101390 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.141+0000 7f4d6dffb700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4d600a12e0 0x7f4d600a3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.141+0000 7f4d6dffb700 1 -- 172.21.15.69:0/2977163400 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4d640ce5d0 con 0x7f4d70101390 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.141+0000 7f4d6ffff700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4d600a12e0 0x7f4d600a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.141+0000 7f4d6dffb700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] conn(0x7f4d600aaab0 0x7f4d600acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.141+0000 7f4d6dffb700 1 -- 172.21.15.69:0/2977163400 --> [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d600ad570 con 0x7f4d600aaab0 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.141+0000 7f4d6dffb700 1 -- 172.21.15.69:0/2977163400 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d640ce980 con 0x7f4d70101390 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.141+0000 7f4d6ffff700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4d600a12e0 0x7f4d600a3790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005fd0 tx=0x7f4d5c005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.141+0000 7f4d75536700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] conn(0x7f4d600aaab0 0x7f4d600acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.142+0000 7f4d75536700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] conn(0x7f4d600aaab0 0x7f4d600acec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.143+0000 7f4d6dffb700 1 -- 172.21.15.69:0/2977163400 <== osd.5 v2:172.21.15.119:6808/1604753767 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4d600ad570 con 0x7f4d600aaab0 2023-12-14T14:09:39.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.162+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 --> [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d70110520 con 0x7f4d600aaab0 2023-12-14T14:09:39.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.163+0000 7f4d6dffb700 1 -- 172.21.15.69:0/2977163400 <== osd.5 v2:172.21.15.119:6808/1604753767 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4d70110520 con 0x7f4d600aaab0 2023-12-14T14:09:39.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.163+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 >> [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] conn(0x7f4d600aaab0 msgr2=0x7f4d600acec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.163+0000 7f4d76f99700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] conn(0x7f4d600aaab0 0x7f4d600acec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.163+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4d600a12e0 msgr2=0x7f4d600a3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.163+0000 7f4d76f99700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4d600a12e0 0x7f4d600a3790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005fd0 tx=0x7f4d5c005e20 comp rx=0 tx=0).stop 2023-12-14T14:09:39.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.163+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d70101390 msgr2=0x7f4d70196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.163+0000 7f4d76f99700 1 --2- 172.21.15.69:0/2977163400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d70101390 0x7f4d70196410 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4d64000c00 tx=0x7f4d6400f830 comp rx=0 tx=0).stop 2023-12-14T14:09:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.163+0000 7f4d75536700 1 -- 172.21.15.69:0/2977163400 reap_dead start 2023-12-14T14:09:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.164+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 shutdown_connections 2023-12-14T14:09:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.164+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 >> 172.21.15.69:0/2977163400 conn(0x7f4d700770a0 msgr2=0x7f4d700fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.164+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 shutdown_connections 2023-12-14T14:09:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.164+0000 7f4d76f99700 1 -- 172.21.15.69:0/2977163400 wait complete. 2023-12-14T14:09:39.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.461+0000 7efc17efb700 1 -- 172.21.15.69:0/1165518817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc10104510 msgr2=0x7efc1010c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.461+0000 7efc17efb700 1 --2- 172.21.15.69:0/1165518817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc10104510 0x7efc1010c090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009fc0 tx=0x7efc0c00b330 comp rx=0 tx=0).stop 2023-12-14T14:09:39.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.461+0000 7efc17efb700 1 -- 172.21.15.69:0/1165518817 shutdown_connections 2023-12-14T14:09:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.461+0000 7efc17efb700 1 --2- 172.21.15.69:0/1165518817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc10104510 0x7efc1010c090 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.461+0000 7efc17efb700 1 --2- 172.21.15.69:0/1165518817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc100ff470 0x7efc100ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.461+0000 7efc17efb700 1 --2- 172.21.15.69:0/1165518817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc100ffe10 0x7efc10103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.461+0000 7efc17efb700 1 -- 172.21.15.69:0/1165518817 >> 172.21.15.69:0/1165518817 conn(0x7efc100770d0 msgr2=0x7efc100774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.461+0000 7efc17efb700 1 -- 172.21.15.69:0/1165518817 shutdown_connections 2023-12-14T14:09:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.461+0000 7efc17efb700 1 -- 172.21.15.69:0/1165518817 wait complete. 2023-12-14T14:09:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc17efb700 1 Processor -- start 2023-12-14T14:09:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc17efb700 1 -- start start 2023-12-14T14:09:39.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc17efb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc100ff470 0x7efc10195420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc17efb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc100ffe10 0x7efc10195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc17efb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc10104510 0x7efc10199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc17efb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1019a3e0 con 0x7efc100ffe10 2023-12-14T14:09:39.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc17efb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1019a550 con 0x7efc100ff470 2023-12-14T14:09:39.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc17efb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1019a710 con 0x7efc10104510 2023-12-14T14:09:39.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc15496700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc100ffe10 0x7efc10195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc15496700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc100ffe10 0x7efc10195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51348/0 (socket says 172.21.15.69:51348) 2023-12-14T14:09:39.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.462+0000 7efc15496700 1 -- 172.21.15.69:0/1476622111 learned_addr learned my addr 172.21.15.69:0/1476622111 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:39.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc16498700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc10104510 0x7efc10199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc15c97700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc100ff470 0x7efc10195420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc15496700 1 -- 172.21.15.69:0/1476622111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc10104510 msgr2=0x7efc10199dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc15496700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc10104510 0x7efc10199dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc15496700 1 -- 172.21.15.69:0/1476622111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc100ff470 msgr2=0x7efc10195420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc15496700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc100ff470 0x7efc10195420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc15496700 1 -- 172.21.15.69:0/1476622111 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c009c40 con 0x7efc100ffe10 2023-12-14T14:09:39.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc16498700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc10104510 0x7efc10199dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:39.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc15496700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc100ffe10 0x7efc10195960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efc0000eb00 tx=0x7efc0000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:39.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc06ffd700 1 -- 172.21.15.69:0/1476622111 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00013070 con 0x7efc100ffe10 2023-12-14T14:09:39.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc06ffd700 1 -- 172.21.15.69:0/1476622111 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc0000be80 con 0x7efc100ffe10 2023-12-14T14:09:39.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1010f2c0 con 0x7efc100ffe10 2023-12-14T14:09:39.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc06ffd700 1 -- 172.21.15.69:0/1476622111 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc000163b0 con 0x7efc100ffe10 2023-12-14T14:09:39.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.463+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1010f130 con 0x7efc100ffe10 2023-12-14T14:09:39.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.464+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efbf4000ff0 con 0x7efc100ffe10 2023-12-14T14:09:39.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.465+0000 7efc06ffd700 1 -- 172.21.15.69:0/1476622111 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7efc0000b9c0 con 0x7efc100ffe10 2023-12-14T14:09:39.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.465+0000 7efc06ffd700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efbfc0a1260 0x7efbfc0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.466+0000 7efc15c97700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efbfc0a1260 0x7efbfc0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.466+0000 7efc06ffd700 1 -- 172.21.15.69:0/1476622111 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efc000ce1c0 con 0x7efc100ffe10 2023-12-14T14:09:39.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.466+0000 7efc06ffd700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] conn(0x7efbfc0aaa30 0x7efbfc0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:39.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.466+0000 7efc06ffd700 1 -- 172.21.15.69:0/1476622111 --> [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbfc0ad4f0 con 0x7efbfc0aaa30 2023-12-14T14:09:39.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.466+0000 7efc06ffd700 1 -- 172.21.15.69:0/1476622111 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc000ce660 con 0x7efc100ffe10 2023-12-14T14:09:39.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.466+0000 7efc15c97700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efbfc0a1260 0x7efbfc0a3710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc08009bf0 tx=0x7efc08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:39.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.466+0000 7efc16498700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] conn(0x7efbfc0aaa30 0x7efbfc0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:39.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.467+0000 7efc16498700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] conn(0x7efbfc0aaa30 0x7efbfc0ace40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:39.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.467+0000 7efc06ffd700 1 -- 172.21.15.69:0/1476622111 <== osd.7 v2:172.21.15.81:6816/3166058431 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efbfc0ad4f0 con 0x7efbfc0aaa30 2023-12-14T14:09:39.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.483+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 --> [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efbf4002d70 con 0x7efbfc0aaa30 2023-12-14T14:09:39.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.483+0000 7efc06ffd700 1 -- 172.21.15.69:0/1476622111 <== osd.7 v2:172.21.15.81:6816/3166058431 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efbf4002d70 con 0x7efbfc0aaa30 2023-12-14T14:09:39.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 >> [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] conn(0x7efbfc0aaa30 msgr2=0x7efbfc0ace40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] conn(0x7efbfc0aaa30 0x7efbfc0ace40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efbfc0a1260 msgr2=0x7efbfc0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efbfc0a1260 0x7efbfc0a3710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc08009bf0 tx=0x7efc08009260 comp rx=0 tx=0).stop 2023-12-14T14:09:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc100ffe10 msgr2=0x7efc10195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 --2- 172.21.15.69:0/1476622111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc100ffe10 0x7efc10195960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efc0000eb00 tx=0x7efc0000eec0 comp rx=0 tx=0).stop 2023-12-14T14:09:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc16498700 1 -- 172.21.15.69:0/1476622111 reap_dead start 2023-12-14T14:09:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 shutdown_connections 2023-12-14T14:09:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 >> 172.21.15.69:0/1476622111 conn(0x7efc100770d0 msgr2=0x7efc100fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 shutdown_connections 2023-12-14T14:09:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:39.484+0000 7efc17efb700 1 -- 172.21.15.69:0/1476622111 wait complete. 2023-12-14T14:09:39.663 INFO:teuthology.orchestra.run.smithi069.stdout:279172874261 2023-12-14T14:09:39.663 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.9 2023-12-14T14:09:39.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:39 smithi069 ceph-mon[42034]: pgmap v236: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T14:09:40.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:39 smithi119 ceph-mon[43834]: pgmap v236: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T14:09:40.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:39 smithi081 ceph-mon[43371]: pgmap v236: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T14:09:40.300 INFO:teuthology.orchestra.run.smithi069.stdout:214748364829 2023-12-14T14:09:40.300 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.7 2023-12-14T14:09:40.401 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:40.425 INFO:teuthology.orchestra.run.smithi069.stdout:55834574899 2023-12-14T14:09:40.425 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-14T14:09:40.926 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:40.990 INFO:teuthology.orchestra.run.smithi069.stdout:158913789988 2023-12-14T14:09:40.990 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-14T14:09:41.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38a77fe700 1 -- 172.21.15.69:0/2927424532 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894003bc0 con 0x7f38a80ffe00 2023-12-14T14:09:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38aec7e700 1 -- 172.21.15.69:0/2927424532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 msgr2=0x7f38a8103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38aec7e700 1 --2- 172.21.15.69:0/2927424532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 0x7f38a8103dd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f38940099c0 tx=0x7f3894009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38aec7e700 1 -- 172.21.15.69:0/2927424532 shutdown_connections 2023-12-14T14:09:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38aec7e700 1 --2- 172.21.15.69:0/2927424532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a8104500 0x7f38a810c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38aec7e700 1 --2- 172.21.15.69:0/2927424532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a80ff460 0x7f38a80ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38aec7e700 1 --2- 172.21.15.69:0/2927424532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 0x7f38a8103dd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38aec7e700 1 -- 172.21.15.69:0/2927424532 >> 172.21.15.69:0/2927424532 conn(0x7f38a80770a0 msgr2=0x7f38a80774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38aec7e700 1 -- 172.21.15.69:0/2927424532 shutdown_connections 2023-12-14T14:09:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.008+0000 7f38aec7e700 1 -- 172.21.15.69:0/2927424532 wait complete. 2023-12-14T14:09:41.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38aec7e700 1 Processor -- start 2023-12-14T14:09:41.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38aec7e700 1 -- start start 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38aec7e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a80ff460 0x7f38a810dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38aec7e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 0x7f38a810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38aec7e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a8104500 0x7f38a810e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38aec7e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a81a4840 con 0x7f38a80ffe00 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38aec7e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a81a49b0 con 0x7f38a80ff460 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38aec7e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a81a4b70 con 0x7f38a8104500 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38a7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 0x7f38a810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38a7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 0x7f38a810e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51364/0 (socket says 172.21.15.69:51364) 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38a7fff700 1 -- 172.21.15.69:0/3513799713 learned_addr learned my addr 172.21.15.69:0/3513799713 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38aca1a700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a80ff460 0x7f38a810dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.009+0000 7f38ad21b700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a8104500 0x7f38a810e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38a7fff700 1 -- 172.21.15.69:0/3513799713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a8104500 msgr2=0x7f38a810e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38a7fff700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a8104500 0x7f38a810e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38a7fff700 1 -- 172.21.15.69:0/3513799713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a80ff460 msgr2=0x7f38a810dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38a7fff700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a80ff460 0x7f38a810dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38a7fff700 1 -- 172.21.15.69:0/3513799713 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940095f0 con 0x7f38a80ffe00 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38a7fff700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 0x7f38a810e190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3894009990 tx=0x7f3894004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38a5ffb700 1 -- 172.21.15.69:0/3513799713 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389401d070 con 0x7f38a80ffe00 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a8110490 con 0x7f38a80ffe00 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38a5ffb700 1 -- 172.21.15.69:0/3513799713 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3894004110 con 0x7f38a80ffe00 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38a5ffb700 1 -- 172.21.15.69:0/3513799713 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389400f460 con 0x7f38a80ffe00 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.010+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a8110300 con 0x7f38a80ffe00 2023-12-14T14:09:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.011+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a8110620 con 0x7f38a80ffe00 2023-12-14T14:09:41.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.013+0000 7f38a5ffb700 1 -- 172.21.15.69:0/3513799713 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3894022600 con 0x7f38a80ffe00 2023-12-14T14:09:41.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.013+0000 7f38a5ffb700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38980a11e0 0x7f38980a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:41.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.013+0000 7f38a5ffb700 1 -- 172.21.15.69:0/3513799713 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f38940ce1f0 con 0x7f38a80ffe00 2023-12-14T14:09:41.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.015+0000 7f38aca1a700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38980a11e0 0x7f38980a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:41.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.015+0000 7f38aca1a700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38980a11e0 0x7f38980a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f389c00ac50 tx=0x7f389c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:41.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.017+0000 7f38a5ffb700 1 -- 172.21.15.69:0/3513799713 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3894097920 con 0x7f38a80ffe00 2023-12-14T14:09:41.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.230+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f38a8066ea0 con 0x7f38a80ffe00 2023-12-14T14:09:41.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.231+0000 7f38a5ffb700 1 -- 172.21.15.69:0/3513799713 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f389409af40 con 0x7f38a80ffe00 2023-12-14T14:09:41.231 INFO:teuthology.orchestra.run.smithi069.stdout:249108103194 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38980a11e0 msgr2=0x7f38980a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38980a11e0 0x7f38980a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f389c00ac50 tx=0x7f389c00a380 comp rx=0 tx=0).stop 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 msgr2=0x7f38a810e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 0x7f38a810e190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3894009990 tx=0x7f3894004710 comp rx=0 tx=0).stop 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 shutdown_connections 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38980a11e0 0x7f38980a3690 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a8104500 0x7f38a810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a80ff460 0x7f38a810dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 --2- 172.21.15.69:0/3513799713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38a80ffe00 0x7f38a810e190 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:41.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 >> 172.21.15.69:0/3513799713 conn(0x7f38a80770a0 msgr2=0x7f38a80fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:41.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 shutdown_connections 2023-12-14T14:09:41.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:41.235+0000 7f38aec7e700 1 -- 172.21.15.69:0/3513799713 wait complete. 2023-12-14T14:09:41.810 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103192 got 249108103194 for osd.8 2023-12-14T14:09:41.811 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:41.891 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:41 smithi069 ceph-mon[42034]: pgmap v237: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-14T14:09:41.891 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:41 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3513799713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-14T14:09:42.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:41 smithi119 ceph-mon[43834]: pgmap v237: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-14T14:09:42.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:41 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3513799713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-14T14:09:42.118 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:42.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:41 smithi081 ceph-mon[43371]: pgmap v237: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-14T14:09:42.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:41 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3513799713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-14T14:09:42.225 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.394+0000 7f62f9492700 1 -- 172.21.15.69:0/1095982343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 msgr2=0x7f62f40fee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.394+0000 7f62f9492700 1 --2- 172.21.15.69:0/1095982343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 0x7f62f40fee10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009990 tx=0x7f62e8009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.394+0000 7f62f9492700 1 -- 172.21.15.69:0/1095982343 shutdown_connections 2023-12-14T14:09:42.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.394+0000 7f62f9492700 1 --2- 172.21.15.69:0/1095982343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f40ff350 0x7f62f410b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.394+0000 7f62f9492700 1 --2- 172.21.15.69:0/1095982343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62f41049a0 0x7f62f4104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.394+0000 7f62f9492700 1 --2- 172.21.15.69:0/1095982343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 0x7f62f40fee10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.394+0000 7f62f9492700 1 -- 172.21.15.69:0/1095982343 >> 172.21.15.69:0/1095982343 conn(0x7f62f40758a0 msgr2=0x7f62f4075ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:42.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.394+0000 7f62f9492700 1 -- 172.21.15.69:0/1095982343 shutdown_connections 2023-12-14T14:09:42.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.394+0000 7f62f9492700 1 -- 172.21.15.69:0/1095982343 wait complete. 2023-12-14T14:09:42.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f9492700 1 Processor -- start 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f9492700 1 -- start start 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f9492700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 0x7f62f4197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f9492700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62f40ff350 0x7f62f41976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f9492700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f41049a0 0x7f62f41a2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f9492700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f4198000 con 0x7f62f40fe9a0 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f9492700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f41a2740 con 0x7f62f41049a0 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f9492700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f41a2900 con 0x7f62f40ff350 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 0x7f62f4197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 0x7f62f4197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51372/0 (socket says 172.21.15.69:51372) 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.395+0000 7f62f2ffd700 1 -- 172.21.15.69:0/1389372743 learned_addr learned my addr 172.21.15.69:0/1389372743 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f27fc700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62f40ff350 0x7f62f41976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f37fe700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f41049a0 0x7f62f41a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:42.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f2ffd700 1 -- 172.21.15.69:0/1389372743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62f40ff350 msgr2=0x7f62f41976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f2ffd700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62f40ff350 0x7f62f41976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f2ffd700 1 -- 172.21.15.69:0/1389372743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f41049a0 msgr2=0x7f62f41a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f2ffd700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f41049a0 0x7f62f41a2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f2ffd700 1 -- 172.21.15.69:0/1389372743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80095f0 con 0x7f62f40fe9a0 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f2ffd700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 0x7f62f4197180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f62e400d980 tx=0x7f62e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62dbfff700 1 -- 172.21.15.69:0/1389372743 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e400f890 con 0x7f62f40fe9a0 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f410e9d0 con 0x7f62f40fe9a0 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62dbfff700 1 -- 172.21.15.69:0/1389372743 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62e4010460 con 0x7f62f40fe9a0 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62dbfff700 1 -- 172.21.15.69:0/1389372743 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40195c0 con 0x7f62f40fe9a0 2023-12-14T14:09:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.396+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f410e840 con 0x7f62f40fe9a0 2023-12-14T14:09:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.397+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f410eb60 con 0x7f62f40fe9a0 2023-12-14T14:09:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.398+0000 7f62dbfff700 1 -- 172.21.15.69:0/1389372743 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f62e40105d0 con 0x7f62f40fe9a0 2023-12-14T14:09:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.399+0000 7f62dbfff700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f62dc0a11e0 0x7f62dc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.399+0000 7f62f27fc700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f62dc0a11e0 0x7f62dc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.399+0000 7f62dbfff700 1 -- 172.21.15.69:0/1389372743 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f62e40ccc50 con 0x7f62f40fe9a0 2023-12-14T14:09:42.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.400+0000 7f62f27fc700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f62dc0a11e0 0x7f62dc0a3690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f62e800b5c0 tx=0x7f62e8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:42.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.403+0000 7f62dbfff700 1 -- 172.21.15.69:0/1389372743 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f62e40962f0 con 0x7f62f40fe9a0 2023-12-14T14:09:42.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.610+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f62f4066f00 con 0x7f62f40fe9a0 2023-12-14T14:09:42.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.610+0000 7f62dbfff700 1 -- 172.21.15.69:0/1389372743 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62e4016090 con 0x7f62f40fe9a0 2023-12-14T14:09:42.611 INFO:teuthology.orchestra.run.smithi069.stdout:193273528353 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.612+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f62dc0a11e0 msgr2=0x7f62dc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.612+0000 7f62f9492700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f62dc0a11e0 0x7f62dc0a3690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f62e800b5c0 tx=0x7f62e8005960 comp rx=0 tx=0).stop 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.612+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 msgr2=0x7f62f4197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.612+0000 7f62f9492700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 0x7f62f4197180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f62e400d980 tx=0x7f62e400dc90 comp rx=0 tx=0).stop 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.613+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 shutdown_connections 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.613+0000 7f62f9492700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f62dc0a11e0 0x7f62dc0a3690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.613+0000 7f62f9492700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f41049a0 0x7f62f41a2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.613+0000 7f62f9492700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f40fe9a0 0x7f62f4197180 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.613+0000 7f62f9492700 1 --2- 172.21.15.69:0/1389372743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62f40ff350 0x7f62f41976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:42.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.613+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 >> 172.21.15.69:0/1389372743 conn(0x7f62f40758a0 msgr2=0x7f62f4102d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:42.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.613+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 shutdown_connections 2023-12-14T14:09:42.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:42.613+0000 7f62f9492700 1 -- 172.21.15.69:0/1389372743 wait complete. 2023-12-14T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:42 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1389372743' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-14T14:09:43.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:42 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1389372743' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-14T14:09:43.144 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:43.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:42 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1389372743' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-14T14:09:43.310 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528351 got 193273528353 for osd.6 2023-12-14T14:09:43.311 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:43.433 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:43.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:43 smithi069 ceph-mon[42034]: pgmap v238: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-14T14:09:44.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:43 smithi119 ceph-mon[43834]: pgmap v238: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-14T14:09:44.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:43 smithi081 ceph-mon[43371]: pgmap v238: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-14T14:09:44.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.358+0000 7f321a623700 1 -- 172.21.15.69:0/2778149654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32140ff470 msgr2=0x7f32140ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:44.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.358+0000 7f321a623700 1 --2- 172.21.15.69:0/2778149654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32140ff470 0x7f32140ff840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f32040099c0 tx=0x7f3204009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.358+0000 7f321a623700 1 -- 172.21.15.69:0/2778149654 shutdown_connections 2023-12-14T14:09:44.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.358+0000 7f321a623700 1 --2- 172.21.15.69:0/2778149654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3214104510 0x7f321410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.358+0000 7f321a623700 1 --2- 172.21.15.69:0/2778149654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32140ff470 0x7f32140ff840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.358+0000 7f321a623700 1 --2- 172.21.15.69:0/2778149654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32140ffe10 0x7f3214103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.358+0000 7f321a623700 1 -- 172.21.15.69:0/2778149654 >> 172.21.15.69:0/2778149654 conn(0x7f32140770d0 msgr2=0x7f32140774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:44.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.358+0000 7f321a623700 1 -- 172.21.15.69:0/2778149654 shutdown_connections 2023-12-14T14:09:44.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.358+0000 7f321a623700 1 -- 172.21.15.69:0/2778149654 wait complete. 2023-12-14T14:09:44.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.359+0000 7f321a623700 1 Processor -- start 2023-12-14T14:09:44.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.359+0000 7f321a623700 1 -- start start 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.359+0000 7f321a623700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32140ff470 0x7f3214197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.359+0000 7f321a623700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32140ffe10 0x7f32141977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.359+0000 7f321a623700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3214104510 0x7f32141a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.359+0000 7f321a623700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32141a2840 con 0x7f3214104510 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.359+0000 7f321a623700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32141a2980 con 0x7f32140ff470 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.359+0000 7f321a623700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32141a2ac0 con 0x7f32140ffe10 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3218bc0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3214104510 0x7f32141a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3218bc0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3214104510 0x7f32141a2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51392/0 (socket says 172.21.15.69:51392) 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3218bc0700 1 -- 172.21.15.69:0/1944502297 learned_addr learned my addr 172.21.15.69:0/1944502297 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f32137fe700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32140ffe10 0x7f32141977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:44.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3213fff700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32140ff470 0x7f3214197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3218bc0700 1 -- 172.21.15.69:0/1944502297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32140ffe10 msgr2=0x7f32141977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3218bc0700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32140ffe10 0x7f32141977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3218bc0700 1 -- 172.21.15.69:0/1944502297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32140ff470 msgr2=0x7f3214197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3218bc0700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32140ff470 0x7f3214197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3218bc0700 1 -- 172.21.15.69:0/1944502297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040095f0 con 0x7f3214104510 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f32137fe700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32140ffe10 0x7f32141977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3213fff700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32140ff470 0x7f3214197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f3218bc0700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3214104510 0x7f32141a2300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f320c00b970 tx=0x7f320c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f32117fa700 1 -- 172.21.15.69:0/1944502297 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c00c9b0 con 0x7f3214104510 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f32117fa700 1 -- 172.21.15.69:0/1944502297 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f320c014440 con 0x7f3214104510 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321410f2d0 con 0x7f3214104510 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f32117fa700 1 -- 172.21.15.69:0/1944502297 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c0075d0 con 0x7f3214104510 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.360+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321410f140 con 0x7f3214104510 2023-12-14T14:09:44.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.361+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321410f460 con 0x7f3214104510 2023-12-14T14:09:44.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.362+0000 7f32117fa700 1 -- 172.21.15.69:0/1944502297 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f320c0145b0 con 0x7f3214104510 2023-12-14T14:09:44.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.363+0000 7f32117fa700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f31fc0a11e0 0x7f31fc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:44.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.363+0000 7f3213fff700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f31fc0a11e0 0x7f31fc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:44.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.363+0000 7f32117fa700 1 -- 172.21.15.69:0/1944502297 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f320c006e40 con 0x7f3214104510 2023-12-14T14:09:44.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.363+0000 7f3213fff700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f31fc0a11e0 0x7f31fc0a3690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3204006010 tx=0x7f3204000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:44.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.367+0000 7f32117fa700 1 -- 172.21.15.69:0/1944502297 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f320c04e730 con 0x7f3214104510 2023-12-14T14:09:44.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.573+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3214066ea0 con 0x7f3214104510 2023-12-14T14:09:44.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.573+0000 7f32117fa700 1 -- 172.21.15.69:0/1944502297 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f320c095800 con 0x7f3214104510 2023-12-14T14:09:44.574 INFO:teuthology.orchestra.run.smithi069.stdout:103079215148 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f31fc0a11e0 msgr2=0x7f31fc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f31fc0a11e0 0x7f31fc0a3690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3204006010 tx=0x7f3204000bc0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3214104510 msgr2=0x7f32141a2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3214104510 0x7f32141a2300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f320c00b970 tx=0x7f320c00bd30 comp rx=0 tx=0).stop 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 shutdown_connections 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f31fc0a11e0 0x7f31fc0a3690 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3214104510 0x7f32141a2300 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32140ff470 0x7f3214197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 --2- 172.21.15.69:0/1944502297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32140ffe10 0x7f32141977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 >> 172.21.15.69:0/1944502297 conn(0x7f32140770d0 msgr2=0x7f32140fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 shutdown_connections 2023-12-14T14:09:44.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:44.576+0000 7f321a623700 1 -- 172.21.15.69:0/1944502297 wait complete. 2023-12-14T14:09:44.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:44 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1944502297' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-14T14:09:45.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:44 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1944502297' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-14T14:09:45.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:44 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1944502297' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-14T14:09:45.315 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:45.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 -- 172.21.15.69:0/3848359909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d8101540 msgr2=0x7f15d8101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:45.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3848359909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d8101540 0x7f15d8101910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009990 tx=0x7f15cc009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 -- 172.21.15.69:0/3848359909 shutdown_connections 2023-12-14T14:09:45.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3848359909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d810a890 0x7f15d810ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3848359909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d8101540 0x7f15d8101910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3848359909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15d8101e50 0x7f15d810a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 -- 172.21.15.69:0/3848359909 >> 172.21.15.69:0/3848359909 conn(0x7f15d80770a0 msgr2=0x7f15d80774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:45.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 -- 172.21.15.69:0/3848359909 shutdown_connections 2023-12-14T14:09:45.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 -- 172.21.15.69:0/3848359909 wait complete. 2023-12-14T14:09:45.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.344+0000 7f15dea3e700 1 Processor -- start 2023-12-14T14:09:45.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dea3e700 1 -- start start 2023-12-14T14:09:45.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dea3e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d8101540 0x7f15d80ff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:45.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dea3e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15d8101e50 0x7f15d80ff6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:45.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dea3e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d810a890 0x7f15d80ffc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:45.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dea3e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d81a4810 con 0x7f15d810a890 2023-12-14T14:09:45.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dea3e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d81a4980 con 0x7f15d8101540 2023-12-14T14:09:45.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dea3e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d81a4b40 con 0x7f15d8101e50 2023-12-14T14:09:45.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dcfdb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d810a890 0x7f15d80ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:45.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dcfdb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d810a890 0x7f15d80ffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51410/0 (socket says 172.21.15.69:51410) 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d8101540 0x7f15d80ff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dcfdb700 1 -- 172.21.15.69:0/3068242649 learned_addr learned my addr 172.21.15.69:0/3068242649 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15d77fe700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15d8101e50 0x7f15d80ff6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dcfdb700 1 -- 172.21.15.69:0/3068242649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15d8101e50 msgr2=0x7f15d80ff6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dcfdb700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15d8101e50 0x7f15d80ff6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dcfdb700 1 -- 172.21.15.69:0/3068242649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d8101540 msgr2=0x7f15d80ff1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dcfdb700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d8101540 0x7f15d80ff1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dcfdb700 1 -- 172.21.15.69:0/3068242649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0095f0 con 0x7f15d810a890 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.345+0000 7f15dcfdb700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d810a890 0x7f15d80ffc60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f15d0007ee0 tx=0x7f15d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.346+0000 7f15d57fa700 1 -- 172.21.15.69:0/3068242649 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0017070 con 0x7f15d810a890 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.346+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d8110310 con 0x7f15d810a890 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.346+0000 7f15d57fa700 1 -- 172.21.15.69:0/3068242649 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15d000f040 con 0x7f15d810a890 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.346+0000 7f15d57fa700 1 -- 172.21.15.69:0/3068242649 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0005580 con 0x7f15d810a890 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.346+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d8110180 con 0x7f15d810a890 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.347+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d81104a0 con 0x7f15d810a890 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.348+0000 7f15d57fa700 1 -- 172.21.15.69:0/3068242649 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f15d0005760 con 0x7f15d810a890 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.348+0000 7f15d57fa700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f15c00a11e0 0x7f15c00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.348+0000 7f15d7fff700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f15c00a11e0 0x7f15c00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.348+0000 7f15d57fa700 1 -- 172.21.15.69:0/3068242649 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f15d00cbfd0 con 0x7f15d810a890 2023-12-14T14:09:45.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.349+0000 7f15d7fff700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f15c00a11e0 0x7f15c00a3690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00b2e0 tx=0x7f15cc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:45.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.353+0000 7f15d57fa700 1 -- 172.21.15.69:0/3068242649 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f15d0095770 con 0x7f15d810a890 2023-12-14T14:09:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:45.476 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215146 got 103079215148 for osd.3 2023-12-14T14:09:45.477 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:45.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.570+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f15d81006d0 con 0x7f15d810a890 2023-12-14T14:09:45.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.571+0000 7f15d57fa700 1 -- 172.21.15.69:0/3068242649 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15d0098d90 con 0x7f15d810a890 2023-12-14T14:09:45.571 INFO:teuthology.orchestra.run.smithi069.stdout:137438953512 2023-12-14T14:09:45.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f15c00a11e0 msgr2=0x7f15c00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:45.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f15c00a11e0 0x7f15c00a3690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00b2e0 tx=0x7f15cc005fd0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d810a890 msgr2=0x7f15d80ffc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:45.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d810a890 0x7f15d80ffc60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f15d0007ee0 tx=0x7f15d000d3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 shutdown_connections 2023-12-14T14:09:45.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f15c00a11e0 0x7f15c00a3690 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15d810a890 0x7f15d80ffc60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d8101540 0x7f15d80ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 --2- 172.21.15.69:0/3068242649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15d8101e50 0x7f15d80ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:45.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 >> 172.21.15.69:0/3068242649 conn(0x7f15d80770a0 msgr2=0x7f15d80fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:45.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 shutdown_connections 2023-12-14T14:09:45.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:45.573+0000 7f15dea3e700 1 -- 172.21.15.69:0/3068242649 wait complete. 2023-12-14T14:09:45.705 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:45 smithi069 ceph-mon[42034]: pgmap v239: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T14:09:45.706 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:45 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3068242649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-14T14:09:46.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:45 smithi119 ceph-mon[43834]: pgmap v239: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T14:09:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:45 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3068242649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-14T14:09:46.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.058+0000 7fe421afe700 1 -- 172.21.15.69:0/146385900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c101540 msgr2=0x7fe41c101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.058+0000 7fe421afe700 1 --2- 172.21.15.69:0/146385900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c101540 0x7fe41c101910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009990 tx=0x7fe40c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.058+0000 7fe421afe700 1 -- 172.21.15.69:0/146385900 shutdown_connections 2023-12-14T14:09:46.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.058+0000 7fe421afe700 1 --2- 172.21.15.69:0/146385900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe41c10a890 0x7fe41c10ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.058+0000 7fe421afe700 1 --2- 172.21.15.69:0/146385900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c101540 0x7fe41c101910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.058+0000 7fe421afe700 1 --2- 172.21.15.69:0/146385900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe41c101e50 0x7fe41c10a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.058+0000 7fe421afe700 1 -- 172.21.15.69:0/146385900 >> 172.21.15.69:0/146385900 conn(0x7fe41c0770a0 msgr2=0x7fe41c0774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:46.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.058+0000 7fe421afe700 1 -- 172.21.15.69:0/146385900 shutdown_connections 2023-12-14T14:09:46.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.059+0000 7fe421afe700 1 -- 172.21.15.69:0/146385900 wait complete. 2023-12-14T14:09:46.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.059+0000 7fe421afe700 1 Processor -- start 2023-12-14T14:09:46.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.059+0000 7fe421afe700 1 -- start start 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe421afe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe41c101540 0x7fe41c0ff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe421afe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe41c101e50 0x7fe41c0ff6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe421afe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c10a890 0x7fe41c0ffc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe421afe700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1a4860 con 0x7fe41c10a890 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe421afe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1a49d0 con 0x7fe41c101540 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe421afe700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1a4b90 con 0x7fe41c101e50 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c10a890 0x7fe41c0ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c10a890 0x7fe41c0ffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51446/0 (socket says 172.21.15.69:51446) 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41bfff700 1 -- 172.21.15.69:0/4027085636 learned_addr learned my addr 172.21.15.69:0/4027085636 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41b7fe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe41c101540 0x7fe41c0ff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41affd700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe41c101e50 0x7fe41c0ff6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41bfff700 1 -- 172.21.15.69:0/4027085636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe41c101e50 msgr2=0x7fe41c0ff6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41bfff700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe41c101e50 0x7fe41c0ff6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41bfff700 1 -- 172.21.15.69:0/4027085636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe41c101540 msgr2=0x7fe41c0ff1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41bfff700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe41c101540 0x7fe41c0ff1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41bfff700 1 -- 172.21.15.69:0/4027085636 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0095f0 con 0x7fe41c10a890 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41b7fe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe41c101540 0x7fe41c0ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe41bfff700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c10a890 0x7fe41c0ffc60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe414007ee0 tx=0x7fe41400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe418ff9700 1 -- 172.21.15.69:0/4027085636 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414017070 con 0x7fe41c10a890 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe418ff9700 1 -- 172.21.15.69:0/4027085636 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe41400f040 con 0x7fe41c10a890 2023-12-14T14:09:46.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe418ff9700 1 -- 172.21.15.69:0/4027085636 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414005740 con 0x7fe41c10a890 2023-12-14T14:09:46.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.060+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c110310 con 0x7fe41c10a890 2023-12-14T14:09:46.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.061+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c110180 con 0x7fe41c10a890 2023-12-14T14:09:46.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.062+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c1104a0 con 0x7fe41c10a890 2023-12-14T14:09:46.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.064+0000 7fe418ff9700 1 -- 172.21.15.69:0/4027085636 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe41400dc60 con 0x7fe41c10a890 2023-12-14T14:09:46.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.065+0000 7fe418ff9700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe4040a11e0 0x7fe4040a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.065+0000 7fe418ff9700 1 -- 172.21.15.69:0/4027085636 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe4140cbe70 con 0x7fe41c10a890 2023-12-14T14:09:46.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.066+0000 7fe41b7fe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe4040a11e0 0x7fe4040a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.066+0000 7fe41b7fe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe4040a11e0 0x7fe4040a3690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006010 tx=0x7fe40c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:46.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.067+0000 7fe418ff9700 1 -- 172.21.15.69:0/4027085636 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe414095610 con 0x7fe41c10a890 2023-12-14T14:09:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:45 smithi081 ceph-mon[43371]: pgmap v239: 97 pgs: 97 active+clean; 634 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T14:09:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:45 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3068242649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-14T14:09:46.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.163+0000 7f6709ca0700 1 -- 172.21.15.69:0/4256740083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 msgr2=0x7f6704103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.163+0000 7f6709ca0700 1 --2- 172.21.15.69:0/4256740083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 0x7f6704103de0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f66f80099c0 tx=0x7f66f8009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.163+0000 7f6709ca0700 1 -- 172.21.15.69:0/4256740083 shutdown_connections 2023-12-14T14:09:46.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.163+0000 7f6709ca0700 1 --2- 172.21.15.69:0/4256740083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704104510 0x7f670410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.163+0000 7f6709ca0700 1 --2- 172.21.15.69:0/4256740083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67040ff470 0x7f67040ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.163+0000 7f6709ca0700 1 --2- 172.21.15.69:0/4256740083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 0x7f6704103de0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.163+0000 7f6709ca0700 1 -- 172.21.15.69:0/4256740083 >> 172.21.15.69:0/4256740083 conn(0x7f67040770d0 msgr2=0x7f67040774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.163+0000 7f6709ca0700 1 -- 172.21.15.69:0/4256740083 shutdown_connections 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.163+0000 7f6709ca0700 1 -- 172.21.15.69:0/4256740083 wait complete. 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6709ca0700 1 Processor -- start 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6709ca0700 1 -- start start 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6709ca0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67040ff470 0x7f6704194160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6709ca0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 0x7f67041946a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6709ca0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704104510 0x7f67041b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6709ca0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67041b14d0 con 0x7f67040ffe10 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6709ca0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670406a510 con 0x7f67040ff470 2023-12-14T14:09:46.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6709ca0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670406a680 con 0x7f6704104510 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6702ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 0x7f67041946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6702ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 0x7f67041946a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51460/0 (socket says 172.21.15.69:51460) 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6702ffd700 1 -- 172.21.15.69:0/1393526878 learned_addr learned my addr 172.21.15.69:0/1393526878 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f67037fe700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67040ff470 0x7f6704194160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.164+0000 7f6703fff700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704104510 0x7f67041b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6702ffd700 1 -- 172.21.15.69:0/1393526878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704104510 msgr2=0x7f67041b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6702ffd700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704104510 0x7f67041b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6702ffd700 1 -- 172.21.15.69:0/1393526878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67040ff470 msgr2=0x7f6704194160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6702ffd700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67040ff470 0x7f6704194160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6702ffd700 1 -- 172.21.15.69:0/1393526878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80095f0 con 0x7f67040ffe10 2023-12-14T14:09:46.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6703fff700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704104510 0x7f67041b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f67037fe700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67040ff470 0x7f6704194160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6702ffd700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 0x7f67041946a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009fd0 tx=0x7f66f800b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6700ff9700 1 -- 172.21.15.69:0/1393526878 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f801d070 con 0x7f67040ffe10 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6700ff9700 1 -- 172.21.15.69:0/1393526878 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66f8003c70 con 0x7f67040ffe10 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6700ff9700 1 -- 172.21.15.69:0/1393526878 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800fc60 con 0x7f67040ffe10 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670410e1f0 con 0x7f67040ffe10 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.165+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670410e060 con 0x7f67040ffe10 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.167+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670410e380 con 0x7f67040ffe10 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.169+0000 7f6700ff9700 1 -- 172.21.15.69:0/1393526878 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f66f800f460 con 0x7f67040ffe10 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.169+0000 7f6700ff9700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f66ec0a1240 0x7f66ec0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.170+0000 7f6700ff9700 1 -- 172.21.15.69:0/1393526878 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f66f80cda30 con 0x7f67040ffe10 2023-12-14T14:09:46.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.170+0000 7f67037fe700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f66ec0a1240 0x7f66ec0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.170+0000 7f67037fe700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f66ec0a1240 0x7f66ec0a36f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f66f4005950 tx=0x7f66f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:46.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.176+0000 7f6700ff9700 1 -- 172.21.15.69:0/1393526878 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f66f8097260 con 0x7f67040ffe10 2023-12-14T14:09:46.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.292+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fe41c066ea0 con 0x7fe41c10a890 2023-12-14T14:09:46.306 INFO:teuthology.orchestra.run.smithi069.stdout:300647710740 2023-12-14T14:09:46.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.293+0000 7fe418ff9700 1 -- 172.21.15.69:0/4027085636 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fe414098c30 con 0x7fe41c10a890 2023-12-14T14:09:46.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe4040a11e0 msgr2=0x7fe4040a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe4040a11e0 0x7fe4040a3690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006010 tx=0x7fe40c00b260 comp rx=0 tx=0).stop 2023-12-14T14:09:46.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c10a890 msgr2=0x7fe41c0ffc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c10a890 0x7fe41c0ffc60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe414007ee0 tx=0x7fe41400d3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 shutdown_connections 2023-12-14T14:09:46.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe4040a11e0 0x7fe4040a3690 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe41c10a890 0x7fe41c0ffc60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe41c101540 0x7fe41c0ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 --2- 172.21.15.69:0/4027085636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe41c101e50 0x7fe41c0ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 >> 172.21.15.69:0/4027085636 conn(0x7fe41c0770a0 msgr2=0x7fe41c0fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:46.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 shutdown_connections 2023-12-14T14:09:46.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.295+0000 7fe421afe700 1 -- 172.21.15.69:0/4027085636 wait complete. 2023-12-14T14:09:46.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.389+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f6704066ea0 con 0x7f67040ffe10 2023-12-14T14:09:46.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.389+0000 7f6700ff9700 1 -- 172.21.15.69:0/1393526878 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f66f809a880 con 0x7f67040ffe10 2023-12-14T14:09:46.390 INFO:teuthology.orchestra.run.smithi069.stdout:330712481808 2023-12-14T14:09:46.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f66ec0a1240 msgr2=0x7f66ec0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f66ec0a1240 0x7f66ec0a36f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f66f4005950 tx=0x7f66f400b410 comp rx=0 tx=0).stop 2023-12-14T14:09:46.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 msgr2=0x7f67041946a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 0x7f67041946a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009fd0 tx=0x7f66f800b9c0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 shutdown_connections 2023-12-14T14:09:46.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f66ec0a1240 0x7f66ec0a36f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704104510 0x7f67041b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67040ff470 0x7f6704194160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 --2- 172.21.15.69:0/1393526878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67040ffe10 0x7f67041946a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.391+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 >> 172.21.15.69:0/1393526878 conn(0x7f67040770d0 msgr2=0x7f67040fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:46.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.392+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 shutdown_connections 2023-12-14T14:09:46.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.392+0000 7f6709ca0700 1 -- 172.21.15.69:0/1393526878 wait complete. 2023-12-14T14:09:46.507 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953510 got 137438953512 for osd.4 2023-12-14T14:09:46.507 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:46.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.016+0000 7f6a4bee7700 1 -- 172.21.15.69:0/3316706872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4410a890 msgr2=0x7f6a4410ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.016+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/3316706872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4410a890 0x7f6a4410ccd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00b0a0 tx=0x7f6a3c00b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.016+0000 7f6a4bee7700 1 -- 172.21.15.69:0/3316706872 shutdown_connections 2023-12-14T14:09:46.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.016+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/3316706872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4410a890 0x7f6a4410ccd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.016+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/3316706872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a44101540 0x7f6a44101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.016+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/3316706872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a44101e50 0x7f6a4410a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.016+0000 7f6a4bee7700 1 -- 172.21.15.69:0/3316706872 >> 172.21.15.69:0/3316706872 conn(0x7f6a440770a0 msgr2=0x7f6a440774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.016+0000 7f6a4bee7700 1 -- 172.21.15.69:0/3316706872 shutdown_connections 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.016+0000 7f6a4bee7700 1 -- 172.21.15.69:0/3316706872 wait complete. 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.017+0000 7f6a4bee7700 1 Processor -- start 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.017+0000 7f6a4bee7700 1 -- start start 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a4bee7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a44101540 0x7f6a44196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a4bee7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a44101e50 0x7f6a44196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a4bee7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a4410a890 0x7f6a4419aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a4bee7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4419b4e0 con 0x7f6a44101540 2023-12-14T14:09:46.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a4bee7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4419b650 con 0x7f6a4410a890 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a4bee7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4419b810 con 0x7f6a44101e50 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a49c83700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a44101540 0x7f6a44196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a49c83700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a44101540 0x7f6a44196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51434/0 (socket says 172.21.15.69:51434) 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a49c83700 1 -- 172.21.15.69:0/2813119824 learned_addr learned my addr 172.21.15.69:0/2813119824 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a49c83700 1 -- 172.21.15.69:0/2813119824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a44101e50 msgr2=0x7f6a44196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a49c83700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a44101e50 0x7f6a44196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a49c83700 1 -- 172.21.15.69:0/2813119824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a4410a890 msgr2=0x7f6a4419aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a49c83700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a4410a890 0x7f6a4419aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a49c83700 1 -- 172.21.15.69:0/2813119824 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c009d00 con 0x7f6a44101540 2023-12-14T14:09:46.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a49c83700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a44101540 0x7f6a44196520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000d950 tx=0x7f6a4000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:46.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a3affd700 1 -- 172.21.15.69:0/2813119824 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40009b40 con 0x7f6a44101540 2023-12-14T14:09:46.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a44110350 con 0x7f6a44101540 2023-12-14T14:09:46.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a3affd700 1 -- 172.21.15.69:0/2813119824 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a40009ca0 con 0x7f6a44101540 2023-12-14T14:09:46.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a3affd700 1 -- 172.21.15.69:0/2813119824 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000f620 con 0x7f6a44101540 2023-12-14T14:09:46.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.018+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a441101c0 con 0x7f6a44101540 2023-12-14T14:09:46.750 INFO:teuthology.orchestra.run.smithi069.stdout:34359738423 2023-12-14T14:09:46.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.019+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a441104e0 con 0x7f6a44101540 2023-12-14T14:09:46.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.021+0000 7f6a3affd700 1 -- 172.21.15.69:0/2813119824 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6a40010460 con 0x7f6a44101540 2023-12-14T14:09:46.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.021+0000 7f6a3affd700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a300a11e0 0x7f6a300a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.022+0000 7f6a3affd700 1 -- 172.21.15.69:0/2813119824 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6a400ccc70 con 0x7f6a44101540 2023-12-14T14:09:46.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.022+0000 7f6a49482700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a300a11e0 0x7f6a300a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.022+0000 7f6a49482700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a300a11e0 0x7f6a300a3690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6a34005fd0 tx=0x7f6a34005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:46.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.024+0000 7f6a3affd700 1 -- 172.21.15.69:0/2813119824 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6a40096410 con 0x7f6a44101540 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.249+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a441a3600 con 0x7f6a44101540 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.250+0000 7f6a3affd700 1 -- 172.21.15.69:0/2813119824 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a40016020 con 0x7f6a44101540 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a300a11e0 msgr2=0x7f6a300a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a300a11e0 0x7f6a300a3690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6a34005fd0 tx=0x7f6a34005ee0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a44101540 msgr2=0x7f6a44196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a44101540 0x7f6a44196520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000d950 tx=0x7f6a4000dd10 comp rx=0 tx=0).stop 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 shutdown_connections 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6a300a11e0 0x7f6a300a3690 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a4410a890 0x7f6a4419aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a44101540 0x7f6a44196520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 --2- 172.21.15.69:0/2813119824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a44101e50 0x7f6a44196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 >> 172.21.15.69:0/2813119824 conn(0x7f6a440770a0 msgr2=0x7f6a440fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:46.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 shutdown_connections 2023-12-14T14:09:46.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.252+0000 7f6a4bee7700 1 -- 172.21.15.69:0/2813119824 wait complete. 2023-12-14T14:09:46.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.750+0000 7fa1a50a3700 1 -- 172.21.15.69:0/1255299416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ff470 msgr2=0x7fa1a00ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.750+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/1255299416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ff470 0x7fa1a00ff840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa1900099c0 tx=0x7fa190009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.751+0000 7fa1a50a3700 1 -- 172.21.15.69:0/1255299416 shutdown_connections 2023-12-14T14:09:46.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.751+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/1255299416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a0104510 0x7fa1a010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.751+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/1255299416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ff470 0x7fa1a00ff840 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.751+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/1255299416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a00ffe10 0x7fa1a0103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.751+0000 7fa1a50a3700 1 -- 172.21.15.69:0/1255299416 >> 172.21.15.69:0/1255299416 conn(0x7fa1a00770d0 msgr2=0x7fa1a00774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:46.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.751+0000 7fa1a50a3700 1 -- 172.21.15.69:0/1255299416 shutdown_connections 2023-12-14T14:09:46.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.751+0000 7fa1a50a3700 1 -- 172.21.15.69:0/1255299416 wait complete. 2023-12-14T14:09:46.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.751+0000 7fa1a50a3700 1 Processor -- start 2023-12-14T14:09:46.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa1a50a3700 1 -- start start 2023-12-14T14:09:46.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa1a50a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00ff470 0x7fa1a01963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa1a50a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ffe10 0x7fa1a01968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa1a50a3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a0104510 0x7fa1a019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa1a50a3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a019b370 con 0x7fa1a00ffe10 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa1a50a3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a019b4e0 con 0x7fa1a00ff470 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa1a50a3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a019b6a0 con 0x7fa1a0104510 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ffe10 0x7fa1a01968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ffe10 0x7fa1a01968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55768/0 (socket says 172.21.15.69:55768) 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19e59c700 1 -- 172.21.15.69:0/2934017803 learned_addr learned my addr 172.21.15.69:0/2934017803 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19ed9d700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00ff470 0x7fa1a01963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19f59e700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a0104510 0x7fa1a019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19e59c700 1 -- 172.21.15.69:0/2934017803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a0104510 msgr2=0x7fa1a019ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19e59c700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a0104510 0x7fa1a019ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19e59c700 1 -- 172.21.15.69:0/2934017803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00ff470 msgr2=0x7fa1a01963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19e59c700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00ff470 0x7fa1a01963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19e59c700 1 -- 172.21.15.69:0/2934017803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900095f0 con 0x7fa1a00ffe10 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.752+0000 7fa19e59c700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ffe10 0x7fa1a01968f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa19400c8f0 tx=0x7fa19400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.753+0000 7fa187fff700 1 -- 172.21.15.69:0/2934017803 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940078d0 con 0x7fa1a00ffe10 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.753+0000 7fa187fff700 1 -- 172.21.15.69:0/2934017803 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa19400f450 con 0x7fa1a00ffe10 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.753+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a010f250 con 0x7fa1a00ffe10 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.753+0000 7fa187fff700 1 -- 172.21.15.69:0/2934017803 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194018660 con 0x7fa1a00ffe10 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.753+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a010f0c0 con 0x7fa1a00ffe10 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.754+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a010f3e0 con 0x7fa1a00ffe10 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.755+0000 7fa187fff700 1 -- 172.21.15.69:0/2934017803 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa19400f5c0 con 0x7fa1a00ffe10 2023-12-14T14:09:46.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.756+0000 7fa187fff700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa1880a11e0 0x7fa1880a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:46.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.756+0000 7fa19ed9d700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa1880a11e0 0x7fa1880a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:46.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.756+0000 7fa187fff700 1 -- 172.21.15.69:0/2934017803 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa1940cc8f0 con 0x7fa1a00ffe10 2023-12-14T14:09:46.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.756+0000 7fa19ed9d700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa1880a11e0 0x7fa1880a3690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa190000c00 tx=0x7fa190003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:46.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.759+0000 7fa187fff700 1 -- 172.21.15.69:0/2934017803 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa194096090 con 0x7fa1a00ffe10 2023-12-14T14:09:46.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.965+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa1a0066ea0 con 0x7fa1a00ffe10 2023-12-14T14:09:46.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.966+0000 7fa187fff700 1 -- 172.21.15.69:0/2934017803 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1940996b0 con 0x7fa1a00ffe10 2023-12-14T14:09:46.966 INFO:teuthology.orchestra.run.smithi069.stdout:77309411375 2023-12-14T14:09:46.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa1880a11e0 msgr2=0x7fa1880a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa1880a11e0 0x7fa1880a3690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa190000c00 tx=0x7fa190003680 comp rx=0 tx=0).stop 2023-12-14T14:09:46.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ffe10 msgr2=0x7fa1a01968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:46.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ffe10 0x7fa1a01968f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa19400c8f0 tx=0x7fa19400cc00 comp rx=0 tx=0).stop 2023-12-14T14:09:46.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 shutdown_connections 2023-12-14T14:09:46.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa1880a11e0 0x7fa1880a3690 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a0104510 0x7fa1a019ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00ff470 0x7fa1a01963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 --2- 172.21.15.69:0/2934017803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a00ffe10 0x7fa1a01968f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:46.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 >> 172.21.15.69:0/2934017803 conn(0x7fa1a00770d0 msgr2=0x7fa1a01030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:46.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 shutdown_connections 2023-12-14T14:09:46.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:46.968+0000 7fa1a50a3700 1 -- 172.21.15.69:0/2934017803 wait complete. 2023-12-14T14:09:47.294 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:47.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:47 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2813119824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-14T14:09:47.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:47 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4027085636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-14T14:09:47.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:47 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1393526878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-14T14:09:47.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:47 smithi069 ceph-mon[42034]: pgmap v240: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-14T14:09:47.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:47 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2934017803' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-14T14:09:47.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:47 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2813119824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-14T14:09:47.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:47 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4027085636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-14T14:09:47.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:47 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1393526878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-14T14:09:47.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:47 smithi119 ceph-mon[43834]: pgmap v240: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-14T14:09:47.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:47 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2934017803' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-14T14:09:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:47 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2813119824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-14T14:09:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:47 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4027085636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-14T14:09:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:47 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1393526878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-14T14:09:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:47 smithi081 ceph-mon[43371]: pgmap v240: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-14T14:09:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:47 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2934017803' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-14T14:09:47.652 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411373 got 77309411375 for osd.2 2023-12-14T14:09:47.653 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:47.846 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738422 got 34359738423 for osd.0 2023-12-14T14:09:47.846 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:48.308 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:48.433 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710739 got 300647710740 for osd.10 2023-12-14T14:09:48.433 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:48.812 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481806 got 330712481808 for osd.11 2023-12-14T14:09:48.813 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:48.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.830+0000 7f9e01376700 1 -- 172.21.15.69:0/3725928134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc0ff2e0 msgr2=0x7f9dfc0ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:48.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.830+0000 7f9e01376700 1 --2- 172.21.15.69:0/3725928134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc0ff2e0 0x7f9dfc0ff750 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9df00099c0 tx=0x7f9df0009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.831+0000 7f9e01376700 1 -- 172.21.15.69:0/3725928134 shutdown_connections 2023-12-14T14:09:48.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.831+0000 7f9e01376700 1 --2- 172.21.15.69:0/3725928134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0ffc90 0x7f9dfc10c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.831+0000 7f9e01376700 1 --2- 172.21.15.69:0/3725928134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc104180 0x7f9dfc104550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.831+0000 7f9e01376700 1 --2- 172.21.15.69:0/3725928134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc0ff2e0 0x7f9dfc0ff750 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.831+0000 7f9e01376700 1 -- 172.21.15.69:0/3725928134 >> 172.21.15.69:0/3725928134 conn(0x7f9dfc077290 msgr2=0x7f9dfc077690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:48.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.831+0000 7f9e01376700 1 -- 172.21.15.69:0/3725928134 shutdown_connections 2023-12-14T14:09:48.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.831+0000 7f9e01376700 1 -- 172.21.15.69:0/3725928134 wait complete. 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.831+0000 7f9e01376700 1 Processor -- start 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.831+0000 7f9e01376700 1 -- start start 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9e01376700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc0ff2e0 0x7f9dfc197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9e01376700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0ffc90 0x7f9dfc197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9e01376700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc104180 0x7f9dfc1a2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9e01376700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc198150 con 0x7f9dfc104180 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9e01376700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc1a28c0 con 0x7f9dfc0ffc90 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9e01376700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc1a2a30 con 0x7f9dfc0ff2e0 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc104180 0x7f9dfc1a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc104180 0x7f9dfc1a2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55782/0 (socket says 172.21.15.69:55782) 2023-12-14T14:09:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfb7fe700 1 -- 172.21.15.69:0/4031624996 learned_addr learned my addr 172.21.15.69:0/4031624996 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfa7fc700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0ffc90 0x7f9dfc197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfaffd700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc0ff2e0 0x7f9dfc197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfb7fe700 1 -- 172.21.15.69:0/4031624996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc0ff2e0 msgr2=0x7f9dfc197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfb7fe700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc0ff2e0 0x7f9dfc197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfb7fe700 1 -- 172.21.15.69:0/4031624996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0ffc90 msgr2=0x7f9dfc197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfb7fe700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0ffc90 0x7f9dfc197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfb7fe700 1 -- 172.21.15.69:0/4031624996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00095f0 con 0x7f9dfc104180 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfa7fc700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0ffc90 0x7f9dfc197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9dfb7fe700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc104180 0x7f9dfc1a2380 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9df400b970 tx=0x7f9df400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9de3fff700 1 -- 172.21.15.69:0/4031624996 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400c9b0 con 0x7f9dfc104180 2023-12-14T14:09:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc10f420 con 0x7f9dfc104180 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9de3fff700 1 -- 172.21.15.69:0/4031624996 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9df4014440 con 0x7f9dfc104180 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9de3fff700 1 -- 172.21.15.69:0/4031624996 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40075d0 con 0x7f9dfc104180 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.832+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc10f290 con 0x7f9dfc104180 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.833+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc10f5b0 con 0x7f9dfc104180 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.834+0000 7f9de3fff700 1 -- 172.21.15.69:0/4031624996 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9df40145b0 con 0x7f9dfc104180 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.835+0000 7f9de3fff700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9de40a11e0 0x7f9de40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.835+0000 7f9dfaffd700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9de40a11e0 0x7f9de40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.835+0000 7f9de3fff700 1 -- 172.21.15.69:0/4031624996 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9df4006e40 con 0x7f9dfc104180 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.835+0000 7f9dfaffd700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9de40a11e0 0x7f9de40a3690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006fd0 tx=0x7f9dec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:48.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.839+0000 7f9de3fff700 1 -- 172.21.15.69:0/4031624996 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9df404e730 con 0x7f9dfc104180 2023-12-14T14:09:48.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.942+0000 7fea124bd700 1 -- 172.21.15.69:0/2731386497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 msgr2=0x7fea0c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:48.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.942+0000 7fea124bd700 1 --2- 172.21.15.69:0/2731386497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 0x7fea0c104e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea000099c0 tx=0x7fea00009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.942+0000 7fea124bd700 1 -- 172.21.15.69:0/2731386497 shutdown_connections 2023-12-14T14:09:48.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.942+0000 7fea124bd700 1 --2- 172.21.15.69:0/2731386497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0c1055b0 0x7fea0c10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.942+0000 7fea124bd700 1 --2- 172.21.15.69:0/2731386497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c068810 0x7fea0c068be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.942+0000 7fea124bd700 1 --2- 172.21.15.69:0/2731386497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 0x7fea0c104e80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.942+0000 7fea124bd700 1 -- 172.21.15.69:0/2731386497 >> 172.21.15.69:0/2731386497 conn(0x7fea0c076370 msgr2=0x7fea0c076770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:48.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.942+0000 7fea124bd700 1 -- 172.21.15.69:0/2731386497 shutdown_connections 2023-12-14T14:09:48.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.942+0000 7fea124bd700 1 -- 172.21.15.69:0/2731386497 wait complete. 2023-12-14T14:09:48.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea124bd700 1 Processor -- start 2023-12-14T14:09:48.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea124bd700 1 -- start start 2023-12-14T14:09:48.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea124bd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c068810 0x7fea0c196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:48.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea124bd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 0x7fea0c196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea124bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0c1055b0 0x7fea0c19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea124bd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c19b2d0 con 0x7fea0c0691b0 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea124bd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c19b440 con 0x7fea0c1055b0 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea124bd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c19b600 con 0x7fea0c068810 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea0b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 0x7fea0c196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea0b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 0x7fea0c196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55798/0 (socket says 172.21.15.69:55798) 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea0b7fe700 1 -- 172.21.15.69:0/2228195300 learned_addr learned my addr 172.21.15.69:0/2228195300 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.943+0000 7fea0bfff700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c068810 0x7fea0c196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea10a5a700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0c1055b0 0x7fea0c19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea0b7fe700 1 -- 172.21.15.69:0/2228195300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c068810 msgr2=0x7fea0c196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea0b7fe700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c068810 0x7fea0c196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea0b7fe700 1 -- 172.21.15.69:0/2228195300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0c1055b0 msgr2=0x7fea0c19acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea0b7fe700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0c1055b0 0x7fea0c19acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea0b7fe700 1 -- 172.21.15.69:0/2228195300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000095f0 con 0x7fea0c0691b0 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea0bfff700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c068810 0x7fea0c196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea0b7fe700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 0x7fea0c196850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea0000c010 tx=0x7fea00009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea097fa700 1 -- 172.21.15.69:0/2228195300 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0001d070 con 0x7fea0c0691b0 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0c110300 con 0x7fea0c0691b0 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea097fa700 1 -- 172.21.15.69:0/2228195300 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea00005a00 con 0x7fea0c0691b0 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea097fa700 1 -- 172.21.15.69:0/2228195300 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00022c90 con 0x7fea0c0691b0 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.944+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0c110170 con 0x7fea0c0691b0 2023-12-14T14:09:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.945+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0c110490 con 0x7fea0c0691b0 2023-12-14T14:09:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.946+0000 7fea097fa700 1 -- 172.21.15.69:0/2228195300 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fea00003ad0 con 0x7fea0c0691b0 2023-12-14T14:09:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.947+0000 7fea097fa700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe9f40a1260 0x7fe9f40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.947+0000 7fea0bfff700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe9f40a1260 0x7fe9f40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.947+0000 7fea097fa700 1 -- 172.21.15.69:0/2228195300 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fea000cdcf0 con 0x7fea0c0691b0 2023-12-14T14:09:48.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.947+0000 7fea0bfff700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe9f40a1260 0x7fe9f40a3710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0104e0 tx=0x7fe9fc00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:48.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:48.951+0000 7fea097fa700 1 -- 172.21.15.69:0/2228195300 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fea00097420 con 0x7fea0c0691b0 2023-12-14T14:09:49.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.047+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9dfc066ea0 con 0x7f9dfc104180 2023-12-14T14:09:49.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.047+0000 7f9de3fff700 1 -- 172.21.15.69:0/4031624996 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9df4095800 con 0x7f9dfc104180 2023-12-14T14:09:49.047 INFO:teuthology.orchestra.run.smithi069.stdout:158913789990 2023-12-14T14:09:49.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9de40a11e0 msgr2=0x7f9de40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:49.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9de40a11e0 0x7f9de40a3690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006fd0 tx=0x7f9dec008040 comp rx=0 tx=0).stop 2023-12-14T14:09:49.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc104180 msgr2=0x7f9dfc1a2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:49.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc104180 0x7f9dfc1a2380 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9df400b970 tx=0x7f9df400bd30 comp rx=0 tx=0).stop 2023-12-14T14:09:49.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 shutdown_connections 2023-12-14T14:09:49.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9de40a11e0 0x7f9de40a3690 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:49.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dfc104180 0x7f9dfc1a2380 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:49.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc0ff2e0 0x7f9dfc197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:49.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 --2- 172.21.15.69:0/4031624996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0ffc90 0x7f9dfc197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:49.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.050+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 >> 172.21.15.69:0/4031624996 conn(0x7f9dfc077290 msgr2=0x7f9dfc0fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:49.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.052+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 shutdown_connections 2023-12-14T14:09:49.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.052+0000 7f9e01376700 1 -- 172.21.15.69:0/4031624996 wait complete. 2023-12-14T14:09:49.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.166+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fea0c1a3390 con 0x7fea0c0691b0 2023-12-14T14:09:49.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.167+0000 7fea097fa700 1 -- 172.21.15.69:0/2228195300 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea0009aa40 con 0x7fea0c0691b0 2023-12-14T14:09:49.166 INFO:teuthology.orchestra.run.smithi069.stdout:214748364831 2023-12-14T14:09:49.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe9f40a1260 msgr2=0x7fe9f40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:49.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe9f40a1260 0x7fe9f40a3710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0104e0 tx=0x7fe9fc00b3c0 comp rx=0 tx=0).stop 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 msgr2=0x7fea0c196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 0x7fea0c196850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea0000c010 tx=0x7fea00009580 comp rx=0 tx=0).stop 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 shutdown_connections 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe9f40a1260 0x7fe9f40a3710 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0c1055b0 0x7fea0c19acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c068810 0x7fea0c196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 --2- 172.21.15.69:0/2228195300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea0c0691b0 0x7fea0c196850 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 >> 172.21.15.69:0/2228195300 conn(0x7fea0c076370 msgr2=0x7fea0c0fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 shutdown_connections 2023-12-14T14:09:49.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:49.169+0000 7fea124bd700 1 -- 172.21.15.69:0/2228195300 wait complete. 2023-12-14T14:09:49.956 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:49 smithi069 ceph-mon[42034]: pgmap v241: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:09:49.957 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:49 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4031624996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-14T14:09:49.957 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:49 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2228195300' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-14T14:09:50.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:49 smithi119 ceph-mon[43834]: pgmap v241: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:09:50.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:49 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4031624996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-14T14:09:50.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:49 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2228195300' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-14T14:09:50.117 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364829 got 214748364831 for osd.7 2023-12-14T14:09:50.118 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:49 smithi081 ceph-mon[43371]: pgmap v241: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:09:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:49 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4031624996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-14T14:09:50.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:49 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2228195300' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-14T14:09:50.310 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789988 got 158913789990 for osd.5 2023-12-14T14:09:50.310 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:50.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.494+0000 7f3a8285d700 1 -- 172.21.15.69:0/1512164209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100540 msgr2=0x7f3a7c100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.494+0000 7f3a8285d700 1 --2- 172.21.15.69:0/1512164209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100540 0x7f3a7c100910 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0099c0 tx=0x7f3a6c009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.494+0000 7f3a8285d700 1 -- 172.21.15.69:0/1512164209 shutdown_connections 2023-12-14T14:09:50.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.494+0000 7f3a8285d700 1 --2- 172.21.15.69:0/1512164209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7c1055e0 0x7f3a7c10d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.494+0000 7f3a8285d700 1 --2- 172.21.15.69:0/1512164209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100540 0x7f3a7c100910 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.494+0000 7f3a8285d700 1 --2- 172.21.15.69:0/1512164209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a7c100ee0 0x7f3a7c104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.494+0000 7f3a8285d700 1 -- 172.21.15.69:0/1512164209 >> 172.21.15.69:0/1512164209 conn(0x7f3a7c0fbdc0 msgr2=0x7f3a7c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:50.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.494+0000 7f3a8285d700 1 -- 172.21.15.69:0/1512164209 shutdown_connections 2023-12-14T14:09:50.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.494+0000 7f3a8285d700 1 -- 172.21.15.69:0/1512164209 wait complete. 2023-12-14T14:09:50.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a8285d700 1 Processor -- start 2023-12-14T14:09:50.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a8285d700 1 -- start start 2023-12-14T14:09:50.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a8285d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7c100540 0x7f3a7c1964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a8285d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100ee0 0x7f3a7c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a8285d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a7c1055e0 0x7f3a7c19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a8285d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c19b3d0 con 0x7f3a7c100ee0 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a8285d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c19b540 con 0x7f3a7c100540 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a8285d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c19b700 con 0x7f3a7c1055e0 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a7b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100ee0 0x7f3a7c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a7b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100ee0 0x7f3a7c1969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55818/0 (socket says 172.21.15.69:55818) 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a7b7fe700 1 -- 172.21.15.69:0/2333083361 learned_addr learned my addr 172.21.15.69:0/2333083361 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a7bfff700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7c100540 0x7f3a7c1964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.495+0000 7f3a80dfa700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a7c1055e0 0x7f3a7c19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:50.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a7b7fe700 1 -- 172.21.15.69:0/2333083361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a7c1055e0 msgr2=0x7f3a7c19adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a7b7fe700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a7c1055e0 0x7f3a7c19adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a7b7fe700 1 -- 172.21.15.69:0/2333083361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7c100540 msgr2=0x7f3a7c1964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a7b7fe700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7c100540 0x7f3a7c1964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a7b7fe700 1 -- 172.21.15.69:0/2333083361 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c0095f0 con 0x7f3a7c100ee0 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a7bfff700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7c100540 0x7f3a7c1964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a7b7fe700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100ee0 0x7f3a7c1969f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c8f0 tx=0x7f3a7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a797fa700 1 -- 172.21.15.69:0/2333083361 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70007b00 con 0x7f3a7c100ee0 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c1103a0 con 0x7f3a7c100ee0 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a797fa700 1 -- 172.21.15.69:0/2333083361 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a70007c60 con 0x7f3a7c100ee0 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a797fa700 1 -- 172.21.15.69:0/2333083361 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70018660 con 0x7f3a7c100ee0 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.496+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c110210 con 0x7f3a7c100ee0 2023-12-14T14:09:50.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.497+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7c110530 con 0x7f3a7c100ee0 2023-12-14T14:09:50.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.498+0000 7f3a797fa700 1 -- 172.21.15.69:0/2333083361 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3a7000f450 con 0x7f3a7c100ee0 2023-12-14T14:09:50.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.498+0000 7f3a797fa700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3a640a11e0 0x7f3a640a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:50.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.499+0000 7f3a7bfff700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3a640a11e0 0x7f3a640a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:50.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.499+0000 7f3a797fa700 1 -- 172.21.15.69:0/2333083361 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3a700cc9b0 con 0x7f3a7c100ee0 2023-12-14T14:09:50.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.499+0000 7f3a7bfff700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3a640a11e0 0x7f3a640a3690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009fd0 tx=0x7f3a6c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:50.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.502+0000 7f3a797fa700 1 -- 172.21.15.69:0/2333083361 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3a70096150 con 0x7f3a7c100ee0 2023-12-14T14:09:50.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.721+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f3a7c066ea0 con 0x7f3a7c100ee0 2023-12-14T14:09:50.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.721+0000 7f3a797fa700 1 -- 172.21.15.69:0/2333083361 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a70099770 con 0x7f3a7c100ee0 2023-12-14T14:09:50.721 INFO:teuthology.orchestra.run.smithi069.stdout:279172874264 2023-12-14T14:09:50.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3a640a11e0 msgr2=0x7f3a640a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3a640a11e0 0x7f3a640a3690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009fd0 tx=0x7f3a6c005fb0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100ee0 msgr2=0x7f3a7c1969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100ee0 0x7f3a7c1969f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c8f0 tx=0x7f3a7000ccb0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 shutdown_connections 2023-12-14T14:09:50.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f3a640a11e0 0x7f3a640a3690 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a7c1055e0 0x7f3a7c19adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7c100540 0x7f3a7c1964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 --2- 172.21.15.69:0/2333083361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7c100ee0 0x7f3a7c1969f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 >> 172.21.15.69:0/2333083361 conn(0x7f3a7c0fbdc0 msgr2=0x7f3a7c0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:50.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.723+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 shutdown_connections 2023-12-14T14:09:50.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.724+0000 7f3a8285d700 1 -- 172.21.15.69:0/2333083361 wait complete. 2023-12-14T14:09:50.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 -- 172.21.15.69:0/696061934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c100ee0 msgr2=0x7f6d1c104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 --2- 172.21.15.69:0/696061934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c100ee0 0x7f6d1c104eb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0099c0 tx=0x7f6d0c009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 -- 172.21.15.69:0/696061934 shutdown_connections 2023-12-14T14:09:50.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 --2- 172.21.15.69:0/696061934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d1c1055e0 0x7f6d1c10d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 --2- 172.21.15.69:0/696061934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c100540 0x7f6d1c100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 --2- 172.21.15.69:0/696061934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c100ee0 0x7f6d1c104eb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 -- 172.21.15.69:0/696061934 >> 172.21.15.69:0/696061934 conn(0x7f6d1c0fbdc0 msgr2=0x7f6d1c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:50.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 -- 172.21.15.69:0/696061934 shutdown_connections 2023-12-14T14:09:50.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 -- 172.21.15.69:0/696061934 wait complete. 2023-12-14T14:09:50.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.760+0000 7f6d2169f700 1 Processor -- start 2023-12-14T14:09:50.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d2169f700 1 -- start start 2023-12-14T14:09:50.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d2169f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d1c100540 0x7f6d1c072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:50.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d2169f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c100ee0 0x7f6d1c073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:50.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d2169f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c1055e0 0x7f6d1c0738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:50.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d2169f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c1a4860 con 0x7f6d1c1055e0 2023-12-14T14:09:50.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d2169f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c1a49d0 con 0x7f6d1c100ee0 2023-12-14T14:09:50.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d2169f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c1a4b90 con 0x7f6d1c100540 2023-12-14T14:09:50.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c1055e0 0x7f6d1c0738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:50.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c1055e0 0x7f6d1c0738b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55824/0 (socket says 172.21.15.69:55824) 2023-12-14T14:09:50.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1b7fe700 1 -- 172.21.15.69:0/2950934643 learned_addr learned my addr 172.21.15.69:0/2950934643 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:50.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1a7fc700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c100ee0 0x7f6d1c073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:50.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1affd700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d1c100540 0x7f6d1c072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:50.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1b7fe700 1 -- 172.21.15.69:0/2950934643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d1c100540 msgr2=0x7f6d1c072df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1b7fe700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d1c100540 0x7f6d1c072df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1b7fe700 1 -- 172.21.15.69:0/2950934643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c100ee0 msgr2=0x7f6d1c073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1b7fe700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c100ee0 0x7f6d1c073330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1b7fe700 1 -- 172.21.15.69:0/2950934643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0095f0 con 0x7f6d1c1055e0 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1affd700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d1c100540 0x7f6d1c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1a7fc700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c100ee0 0x7f6d1c073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.761+0000 7f6d1b7fe700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c1055e0 0x7f6d1c0738b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6d14007ee0 tx=0x7f6d1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.762+0000 7f6d03fff700 1 -- 172.21.15.69:0/2950934643 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1400ddd0 con 0x7f6d1c1055e0 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.762+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1c110360 con 0x7f6d1c1055e0 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.762+0000 7f6d03fff700 1 -- 172.21.15.69:0/2950934643 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d1400f040 con 0x7f6d1c1055e0 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.762+0000 7f6d03fff700 1 -- 172.21.15.69:0/2950934643 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d14015400 con 0x7f6d1c1055e0 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.762+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1c1101d0 con 0x7f6d1c1055e0 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.763+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1c1104f0 con 0x7f6d1c1055e0 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.764+0000 7f6d03fff700 1 -- 172.21.15.69:0/2950934643 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6d14004020 con 0x7f6d1c1055e0 2023-12-14T14:09:50.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.764+0000 7f6d03fff700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d040a11e0 0x7f6d040a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:50.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.764+0000 7f6d1affd700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d040a11e0 0x7f6d040a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:50.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.764+0000 7f6d03fff700 1 -- 172.21.15.69:0/2950934643 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6d140cc250 con 0x7f6d1c1055e0 2023-12-14T14:09:50.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.765+0000 7f6d1affd700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d040a11e0 0x7f6d040a3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d10005fd0 tx=0x7f6d10005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:50.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.768+0000 7f6d03fff700 1 -- 172.21.15.69:0/2950934643 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6d1404e730 con 0x7f6d1c1055e0 2023-12-14T14:09:50.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.964+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6d1c1a55e0 con 0x7f6d1c1055e0 2023-12-14T14:09:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.964+0000 7f6d03fff700 1 -- 172.21.15.69:0/2950934643 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d140959f0 con 0x7f6d1c1055e0 2023-12-14T14:09:50.964 INFO:teuthology.orchestra.run.smithi069.stdout:55834574901 2023-12-14T14:09:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d040a11e0 msgr2=0x7f6d040a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d040a11e0 0x7f6d040a3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d10005fd0 tx=0x7f6d10005dc0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c1055e0 msgr2=0x7f6d1c0738b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c1055e0 0x7f6d1c0738b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6d14007ee0 tx=0x7f6d1400d3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 shutdown_connections 2023-12-14T14:09:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d040a11e0 0x7f6d040a3690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d1c1055e0 0x7f6d1c0738b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d1c100540 0x7f6d1c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 --2- 172.21.15.69:0/2950934643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c100ee0 0x7f6d1c073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.966+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 >> 172.21.15.69:0/2950934643 conn(0x7f6d1c0fbdc0 msgr2=0x7f6d1c0fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.967+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 shutdown_connections 2023-12-14T14:09:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:50.967+0000 7f6d2169f700 1 -- 172.21.15.69:0/2950934643 wait complete. 2023-12-14T14:09:51.157 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874261 got 279172874264 for osd.9 2023-12-14T14:09:51.157 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:51.493 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574899 got 55834574901 for osd.1 2023-12-14T14:09:51.494 DEBUG:teuthology.parallel:result is None 2023-12-14T14:09:51.494 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-14T14:09:51.494 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-14T14:09:51.810 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:51.920 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:51 smithi069 ceph-mon[42034]: pgmap v242: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:09:51.920 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:51 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2333083361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-14T14:09:51.920 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:51 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2950934643' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-14T14:09:52.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:51 smithi119 ceph-mon[43834]: pgmap v242: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:09:52.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:51 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2333083361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-14T14:09:52.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:51 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2950934643' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-14T14:09:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:51 smithi081 ceph-mon[43371]: pgmap v242: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:09:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:51 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2333083361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-14T14:09:52.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:51 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2950934643' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-14T14:09:52.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.807+0000 7fe377de6700 1 -- 172.21.15.69:0/3663223822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 msgr2=0x7fe3701017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:52.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.807+0000 7fe377de6700 1 --2- 172.21.15.69:0/3663223822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 0x7fe3701017b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe368009990 tx=0x7fe368009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:52.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.807+0000 7fe377de6700 1 -- 172.21.15.69:0/3663223822 shutdown_connections 2023-12-14T14:09:52.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.807+0000 7fe377de6700 1 --2- 172.21.15.69:0/3663223822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37010a900 0x7fe37010cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:52.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.807+0000 7fe377de6700 1 --2- 172.21.15.69:0/3663223822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 0x7fe3701017b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:52.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.807+0000 7fe377de6700 1 --2- 172.21.15.69:0/3663223822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe370101cf0 0x7fe37010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:52.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.807+0000 7fe377de6700 1 -- 172.21.15.69:0/3663223822 >> 172.21.15.69:0/3663223822 conn(0x7fe3700770d0 msgr2=0x7fe3700774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:52.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.807+0000 7fe377de6700 1 -- 172.21.15.69:0/3663223822 shutdown_connections 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.807+0000 7fe377de6700 1 -- 172.21.15.69:0/3663223822 wait complete. 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe377de6700 1 Processor -- start 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe377de6700 1 -- start start 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe377de6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 0x7fe3700ff210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe377de6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe370101cf0 0x7fe3700ff750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe377de6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37010a900 0x7fe3700ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe377de6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3701a8de0 con 0x7fe3701013e0 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe377de6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3701a8f20 con 0x7fe37010a900 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe377de6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3701a9060 con 0x7fe370101cf0 2023-12-14T14:09:52.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe375b82700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 0x7fe3700ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe375b82700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 0x7fe3700ff210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55848/0 (socket says 172.21.15.69:55848) 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe375b82700 1 -- 172.21.15.69:0/4258830528 learned_addr learned my addr 172.21.15.69:0/4258830528 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe375381700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe370101cf0 0x7fe3700ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.808+0000 7fe376383700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37010a900 0x7fe3700ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe375b82700 1 -- 172.21.15.69:0/4258830528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe370101cf0 msgr2=0x7fe3700ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe375b82700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe370101cf0 0x7fe3700ff750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe375b82700 1 -- 172.21.15.69:0/4258830528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37010a900 msgr2=0x7fe3700ffc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe375b82700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37010a900 0x7fe3700ffc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe375b82700 1 -- 172.21.15.69:0/4258830528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3680095f0 con 0x7fe3701013e0 2023-12-14T14:09:52.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe375b82700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 0x7fe3700ff210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3680059d0 tx=0x7fe36800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:52.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe36effd700 1 -- 172.21.15.69:0/4258830528 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36801d070 con 0x7fe3701013e0 2023-12-14T14:09:52.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe370110370 con 0x7fe3701013e0 2023-12-14T14:09:52.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe36effd700 1 -- 172.21.15.69:0/4258830528 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe368005030 con 0x7fe3701013e0 2023-12-14T14:09:52.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe36effd700 1 -- 172.21.15.69:0/4258830528 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368004a50 con 0x7fe3701013e0 2023-12-14T14:09:52.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.809+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3701101e0 con 0x7fe3701013e0 2023-12-14T14:09:52.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.810+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe370110500 con 0x7fe3701013e0 2023-12-14T14:09:52.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.811+0000 7fe36effd700 1 -- 172.21.15.69:0/4258830528 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe3680051a0 con 0x7fe3701013e0 2023-12-14T14:09:52.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.811+0000 7fe36effd700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe3580a11e0 0x7fe3580a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:52.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.811+0000 7fe375381700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe3580a11e0 0x7fe3580a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:52.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.812+0000 7fe36effd700 1 -- 172.21.15.69:0/4258830528 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe3680cdb00 con 0x7fe3701013e0 2023-12-14T14:09:52.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.812+0000 7fe375381700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe3580a11e0 0x7fe3580a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe370100a00 tx=0x7fe36400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:52.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.815+0000 7fe36effd700 1 -- 172.21.15.69:0/4258830528 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe368097330 con 0x7fe3701013e0 2023-12-14T14:09:52.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:52.998+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3700fc490 con 0x7fe3580a11e0 2023-12-14T14:09:53.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.008+0000 7fe36effd700 1 -- 172.21.15.69:0/4258830528 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341501 (secure 0 0 0) 0x7fe3700fc490 con 0x7fe3580a11e0 2023-12-14T14:09:53.013 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:53.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe3580a11e0 msgr2=0x7fe3580a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:53.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe3580a11e0 0x7fe3580a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe370100a00 tx=0x7fe36400b410 comp rx=0 tx=0).stop 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 msgr2=0x7fe3700ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 0x7fe3700ff210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3680059d0 tx=0x7fe36800f710 comp rx=0 tx=0).stop 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 shutdown_connections 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fe3580a11e0 0x7fe3580a3690 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37010a900 0x7fe3700ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3701013e0 0x7fe3700ff210 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 --2- 172.21.15.69:0/4258830528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe370101cf0 0x7fe3700ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 >> 172.21.15.69:0/4258830528 conn(0x7fe3700770d0 msgr2=0x7fe3700fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 shutdown_connections 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:53.011+0000 7fe377de6700 1 -- 172.21.15.69:0/4258830528 wait complete. 2023-12-14T14:09:53.018 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T14:09:53.353 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2023-12-14T14:09:52.613566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651149,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":375,"num_read_kb":302,"num_write":333,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":78428,"kb_used_data":10876,"kb_used_omap":0,"kb_used_meta":67456,"kb_avail":1124863396,"statfs":{"total":1151940427776,"available":1151860117504,"internally_reserved":0,"allocated":11137024,"data_stored":7033885,"data_compressed":107034,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":69074944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":40,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002798"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611392+0000","last_change":"2023-12-14T14:09:10.621884+0000","last_active":"2023-12-14T14:09:11.611392+0000","last_peered":"2023-12-14T14:09:11.611392+0000","last_clean":"2023-12-14T14:09:11.611392+0000","last_became_active":"2023-12-14T14:09:10.621605+0000","last_became_peered":"2023-12-14T14:09:10.621605+0000","last_unstale":"2023-12-14T14:09:11.611392+0000","last_undegraded":"2023-12-14T14:09:11.611392+0000","last_fullsized":"2023-12-14T14:09:11.611392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:52:34.121106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450636+0000","last_change":"2023-12-14T14:09:10.621555+0000","last_active":"2023-12-14T14:09:12.450636+0000","last_peered":"2023-12-14T14:09:12.450636+0000","last_clean":"2023-12-14T14:09:12.450636+0000","last_became_active":"2023-12-14T14:09:10.621265+0000","last_became_peered":"2023-12-14T14:09:10.621265+0000","last_unstale":"2023-12-14T14:09:12.450636+0000","last_undegraded":"2023-12-14T14:09:12.450636+0000","last_fullsized":"2023-12-14T14:09:12.450636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:46:18.920671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450457+0000","last_change":"2023-12-14T14:09:10.623575+0000","last_active":"2023-12-14T14:09:12.450457+0000","last_peered":"2023-12-14T14:09:12.450457+0000","last_clean":"2023-12-14T14:09:12.450457+0000","last_became_active":"2023-12-14T14:09:10.623289+0000","last_became_peered":"2023-12-14T14:09:10.623289+0000","last_unstale":"2023-12-14T14:09:12.450457+0000","last_undegraded":"2023-12-14T14:09:12.450457+0000","last_fullsized":"2023-12-14T14:09:12.450457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:21:24.793809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611562+0000","last_change":"2023-12-14T14:09:10.622850+0000","last_active":"2023-12-14T14:09:11.611562+0000","last_peered":"2023-12-14T14:09:11.611562+0000","last_clean":"2023-12-14T14:09:11.611562+0000","last_became_active":"2023-12-14T14:09:10.622456+0000","last_became_peered":"2023-12-14T14:09:10.622456+0000","last_unstale":"2023-12-14T14:09:11.611562+0000","last_undegraded":"2023-12-14T14:09:11.611562+0000","last_fullsized":"2023-12-14T14:09:11.611562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:33:10.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449942+0000","last_change":"2023-12-14T14:09:10.623459+0000","last_active":"2023-12-14T14:09:12.449942+0000","last_peered":"2023-12-14T14:09:12.449942+0000","last_clean":"2023-12-14T14:09:12.449942+0000","last_became_active":"2023-12-14T14:09:10.623100+0000","last_became_peered":"2023-12-14T14:09:10.623100+0000","last_unstale":"2023-12-14T14:09:12.449942+0000","last_undegraded":"2023-12-14T14:09:12.449942+0000","last_fullsized":"2023-12-14T14:09:12.449942+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:15:11.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450472+0000","last_change":"2023-12-14T14:09:10.624663+0000","last_active":"2023-12-14T14:09:12.450472+0000","last_peered":"2023-12-14T14:09:12.450472+0000","last_clean":"2023-12-14T14:09:12.450472+0000","last_became_active":"2023-12-14T14:09:10.624313+0000","last_became_peered":"2023-12-14T14:09:10.624313+0000","last_unstale":"2023-12-14T14:09:12.450472+0000","last_undegraded":"2023-12-14T14:09:12.450472+0000","last_fullsized":"2023-12-14T14:09:12.450472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:36:58.959484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626715+0000","last_change":"2023-12-14T14:09:10.622519+0000","last_active":"2023-12-14T14:09:11.626715+0000","last_peered":"2023-12-14T14:09:11.626715+0000","last_clean":"2023-12-14T14:09:11.626715+0000","last_became_active":"2023-12-14T14:09:10.622147+0000","last_became_peered":"2023-12-14T14:09:10.622147+0000","last_unstale":"2023-12-14T14:09:11.626715+0000","last_undegraded":"2023-12-14T14:09:11.626715+0000","last_fullsized":"2023-12-14T14:09:11.626715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:06:54.114410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407505+0000","last_change":"2023-12-14T14:09:10.622762+0000","last_active":"2023-12-14T14:09:12.407505+0000","last_peered":"2023-12-14T14:09:12.407505+0000","last_clean":"2023-12-14T14:09:12.407505+0000","last_became_active":"2023-12-14T14:09:10.622199+0000","last_became_peered":"2023-12-14T14:09:10.622199+0000","last_unstale":"2023-12-14T14:09:12.407505+0000","last_undegraded":"2023-12-14T14:09:12.407505+0000","last_fullsized":"2023-12-14T14:09:12.407505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:05:12.024946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450680+0000","last_change":"2023-12-14T14:09:10.625452+0000","last_active":"2023-12-14T14:09:12.450680+0000","last_peered":"2023-12-14T14:09:12.450680+0000","last_clean":"2023-12-14T14:09:12.450680+0000","last_became_active":"2023-12-14T14:09:10.620053+0000","last_became_peered":"2023-12-14T14:09:10.620053+0000","last_unstale":"2023-12-14T14:09:12.450680+0000","last_undegraded":"2023-12-14T14:09:12.450680+0000","last_fullsized":"2023-12-14T14:09:12.450680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:44:53.320690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.451174+0000","last_change":"2023-12-14T14:09:10.631871+0000","last_active":"2023-12-14T14:09:12.451174+0000","last_peered":"2023-12-14T14:09:12.451174+0000","last_clean":"2023-12-14T14:09:12.451174+0000","last_became_active":"2023-12-14T14:09:10.631549+0000","last_became_peered":"2023-12-14T14:09:10.631549+0000","last_unstale":"2023-12-14T14:09:12.451174+0000","last_undegraded":"2023-12-14T14:09:12.451174+0000","last_fullsized":"2023-12-14T14:09:12.451174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:05:03.676055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626995+0000","last_change":"2023-12-14T14:09:10.633572+0000","last_active":"2023-12-14T14:09:11.626995+0000","last_peered":"2023-12-14T14:09:11.626995+0000","last_clean":"2023-12-14T14:09:11.626995+0000","last_became_active":"2023-12-14T14:09:10.633251+0000","last_became_peered":"2023-12-14T14:09:10.633251+0000","last_unstale":"2023-12-14T14:09:11.626995+0000","last_undegraded":"2023-12-14T14:09:11.626995+0000","last_fullsized":"2023-12-14T14:09:11.626995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:12:19.816759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611430+0000","last_change":"2023-12-14T14:09:10.630621+0000","last_active":"2023-12-14T14:09:11.611430+0000","last_peered":"2023-12-14T14:09:11.611430+0000","last_clean":"2023-12-14T14:09:11.611430+0000","last_became_active":"2023-12-14T14:09:10.630196+0000","last_became_peered":"2023-12-14T14:09:10.630196+0000","last_unstale":"2023-12-14T14:09:11.611430+0000","last_undegraded":"2023-12-14T14:09:11.611430+0000","last_fullsized":"2023-12-14T14:09:11.611430+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:47:07.876989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610386+0000","last_change":"2023-12-14T14:09:10.617111+0000","last_active":"2023-12-14T14:09:11.610386+0000","last_peered":"2023-12-14T14:09:11.610386+0000","last_clean":"2023-12-14T14:09:11.610386+0000","last_became_active":"2023-12-14T14:09:10.616817+0000","last_became_peered":"2023-12-14T14:09:10.616817+0000","last_unstale":"2023-12-14T14:09:11.610386+0000","last_undegraded":"2023-12-14T14:09:11.610386+0000","last_fullsized":"2023-12-14T14:09:11.610386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:32:53.038532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450326+0000","last_change":"2023-12-14T14:09:10.620373+0000","last_active":"2023-12-14T14:09:12.450326+0000","last_peered":"2023-12-14T14:09:12.450326+0000","last_clean":"2023-12-14T14:09:12.450326+0000","last_became_active":"2023-12-14T14:09:10.620107+0000","last_became_peered":"2023-12-14T14:09:10.620107+0000","last_unstale":"2023-12-14T14:09:12.450326+0000","last_undegraded":"2023-12-14T14:09:12.450326+0000","last_fullsized":"2023-12-14T14:09:12.450326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:21:44.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450001+0000","last_change":"2023-12-14T14:09:10.624554+0000","last_active":"2023-12-14T14:09:12.450001+0000","last_peered":"2023-12-14T14:09:12.450001+0000","last_clean":"2023-12-14T14:09:12.450001+0000","last_became_active":"2023-12-14T14:09:10.624255+0000","last_became_peered":"2023-12-14T14:09:10.624255+0000","last_unstale":"2023-12-14T14:09:12.450001+0000","last_undegraded":"2023-12-14T14:09:12.450001+0000","last_fullsized":"2023-12-14T14:09:12.450001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:28:58.674883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449876+0000","last_change":"2023-12-14T14:09:10.632464+0000","last_active":"2023-12-14T14:09:12.449876+0000","last_peered":"2023-12-14T14:09:12.449876+0000","last_clean":"2023-12-14T14:09:12.449876+0000","last_became_active":"2023-12-14T14:09:10.632102+0000","last_became_peered":"2023-12-14T14:09:10.632102+0000","last_unstale":"2023-12-14T14:09:12.449876+0000","last_undegraded":"2023-12-14T14:09:12.449876+0000","last_fullsized":"2023-12-14T14:09:12.449876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:48:12.491292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611548+0000","last_change":"2023-12-14T14:09:10.619144+0000","last_active":"2023-12-14T14:09:11.611548+0000","last_peered":"2023-12-14T14:09:11.611548+0000","last_clean":"2023-12-14T14:09:11.611548+0000","last_became_active":"2023-12-14T14:09:10.618833+0000","last_became_peered":"2023-12-14T14:09:10.618833+0000","last_unstale":"2023-12-14T14:09:11.611548+0000","last_undegraded":"2023-12-14T14:09:11.611548+0000","last_fullsized":"2023-12-14T14:09:11.611548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:39:23.775221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450257+0000","last_change":"2023-12-14T14:09:10.619062+0000","last_active":"2023-12-14T14:09:12.450257+0000","last_peered":"2023-12-14T14:09:12.450257+0000","last_clean":"2023-12-14T14:09:12.450257+0000","last_became_active":"2023-12-14T14:09:10.618750+0000","last_became_peered":"2023-12-14T14:09:10.618750+0000","last_unstale":"2023-12-14T14:09:12.450257+0000","last_undegraded":"2023-12-14T14:09:12.450257+0000","last_fullsized":"2023-12-14T14:09:12.450257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:28:30.651988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450436+0000","last_change":"2023-12-14T14:09:10.621410+0000","last_active":"2023-12-14T14:09:12.450436+0000","last_peered":"2023-12-14T14:09:12.450436+0000","last_clean":"2023-12-14T14:09:12.450436+0000","last_became_active":"2023-12-14T14:09:10.621037+0000","last_became_peered":"2023-12-14T14:09:10.621037+0000","last_unstale":"2023-12-14T14:09:12.450436+0000","last_undegraded":"2023-12-14T14:09:12.450436+0000","last_fullsized":"2023-12-14T14:09:12.450436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:39:09.650960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.807814+0000","last_change":"2023-12-14T14:09:10.218180+0000","last_active":"2023-12-14T14:09:14.807814+0000","last_peered":"2023-12-14T14:09:14.807814+0000","last_clean":"2023-12-14T14:09:14.807814+0000","last_became_active":"2023-12-14T14:09:10.217856+0000","last_became_peered":"2023-12-14T14:09:10.217856+0000","last_unstale":"2023-12-14T14:09:14.807814+0000","last_undegraded":"2023-12-14T14:09:14.807814+0000","last_fullsized":"2023-12-14T14:09:14.807814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:34:17.405766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407962+0000","last_change":"2023-12-14T14:09:10.628500+0000","last_active":"2023-12-14T14:09:12.407962+0000","last_peered":"2023-12-14T14:09:12.407962+0000","last_clean":"2023-12-14T14:09:12.407962+0000","last_became_active":"2023-12-14T14:09:10.628120+0000","last_became_peered":"2023-12-14T14:09:10.628120+0000","last_unstale":"2023-12-14T14:09:12.407962+0000","last_undegraded":"2023-12-14T14:09:12.407962+0000","last_fullsized":"2023-12-14T14:09:12.407962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:34:44.660042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.408005+0000","last_change":"2023-12-14T14:09:10.218608+0000","last_active":"2023-12-14T14:09:12.408005+0000","last_peered":"2023-12-14T14:09:12.408005+0000","last_clean":"2023-12-14T14:09:12.408005+0000","last_became_active":"2023-12-14T14:09:10.218010+0000","last_became_peered":"2023-12-14T14:09:10.218010+0000","last_unstale":"2023-12-14T14:09:12.408005+0000","last_undegraded":"2023-12-14T14:09:12.408005+0000","last_fullsized":"2023-12-14T14:09:12.408005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:35:05.683768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450785+0000","last_change":"2023-12-14T14:09:10.621972+0000","last_active":"2023-12-14T14:09:12.450785+0000","last_peered":"2023-12-14T14:09:12.450785+0000","last_clean":"2023-12-14T14:09:12.450785+0000","last_became_active":"2023-12-14T14:09:10.621685+0000","last_became_peered":"2023-12-14T14:09:10.621685+0000","last_unstale":"2023-12-14T14:09:12.450785+0000","last_undegraded":"2023-12-14T14:09:12.450785+0000","last_fullsized":"2023-12-14T14:09:12.450785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:13:06.816242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.806768+0000","last_change":"2023-12-14T14:09:10.220860+0000","last_active":"2023-12-14T14:09:14.806768+0000","last_peered":"2023-12-14T14:09:14.806768+0000","last_clean":"2023-12-14T14:09:14.806768+0000","last_became_active":"2023-12-14T14:09:10.219802+0000","last_became_peered":"2023-12-14T14:09:10.219802+0000","last_unstale":"2023-12-14T14:09:14.806768+0000","last_undegraded":"2023-12-14T14:09:14.806768+0000","last_fullsized":"2023-12-14T14:09:14.806768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:01:27.246337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450032+0000","last_change":"2023-12-14T14:09:10.626807+0000","last_active":"2023-12-14T14:09:12.450032+0000","last_peered":"2023-12-14T14:09:12.450032+0000","last_clean":"2023-12-14T14:09:12.450032+0000","last_became_active":"2023-12-14T14:09:10.626450+0000","last_became_peered":"2023-12-14T14:09:10.626450+0000","last_unstale":"2023-12-14T14:09:12.450032+0000","last_undegraded":"2023-12-14T14:09:12.450032+0000","last_fullsized":"2023-12-14T14:09:12.450032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:25:06.887649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450628+0000","last_change":"2023-12-14T14:09:10.216515+0000","last_active":"2023-12-14T14:09:12.450628+0000","last_peered":"2023-12-14T14:09:12.450628+0000","last_clean":"2023-12-14T14:09:12.450628+0000","last_became_active":"2023-12-14T14:09:10.216175+0000","last_became_peered":"2023-12-14T14:09:10.216175+0000","last_unstale":"2023-12-14T14:09:12.450628+0000","last_undegraded":"2023-12-14T14:09:12.450628+0000","last_fullsized":"2023-12-14T14:09:12.450628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:52:31.006083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374755+0000","last_change":"2023-12-14T14:09:10.627664+0000","last_active":"2023-12-14T14:09:12.374755+0000","last_peered":"2023-12-14T14:09:12.374755+0000","last_clean":"2023-12-14T14:09:12.374755+0000","last_became_active":"2023-12-14T14:09:10.627376+0000","last_became_peered":"2023-12-14T14:09:10.627376+0000","last_unstale":"2023-12-14T14:09:12.374755+0000","last_undegraded":"2023-12-14T14:09:12.374755+0000","last_fullsized":"2023-12-14T14:09:12.374755+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:41:03.037811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:48.861879+0000","last_change":"2023-12-14T14:09:10.218806+0000","last_active":"2023-12-14T14:09:48.861879+0000","last_peered":"2023-12-14T14:09:48.861879+0000","last_clean":"2023-12-14T14:09:48.861879+0000","last_became_active":"2023-12-14T14:09:10.218441+0000","last_became_peered":"2023-12-14T14:09:10.218441+0000","last_unstale":"2023-12-14T14:09:48.861879+0000","last_undegraded":"2023-12-14T14:09:48.861879+0000","last_fullsized":"2023-12-14T14:09:48.861879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:50:30.949849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450206+0000","last_change":"2023-12-14T14:09:10.622903+0000","last_active":"2023-12-14T14:09:12.450206+0000","last_peered":"2023-12-14T14:09:12.450206+0000","last_clean":"2023-12-14T14:09:12.450206+0000","last_became_active":"2023-12-14T14:09:10.622261+0000","last_became_peered":"2023-12-14T14:09:10.622261+0000","last_unstale":"2023-12-14T14:09:12.450206+0000","last_undegraded":"2023-12-14T14:09:12.450206+0000","last_fullsized":"2023-12-14T14:09:12.450206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:17:13.547591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.809526+0000","last_change":"2023-12-14T14:09:10.222254+0000","last_active":"2023-12-14T14:09:14.809526+0000","last_peered":"2023-12-14T14:09:14.809526+0000","last_clean":"2023-12-14T14:09:14.809526+0000","last_became_active":"2023-12-14T14:09:10.221861+0000","last_became_peered":"2023-12-14T14:09:10.221861+0000","last_unstale":"2023-12-14T14:09:14.809526+0000","last_undegraded":"2023-12-14T14:09:14.809526+0000","last_fullsized":"2023-12-14T14:09:14.809526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:12:17.252109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374542+0000","last_change":"2023-12-14T14:09:10.625646+0000","last_active":"2023-12-14T14:09:12.374542+0000","last_peered":"2023-12-14T14:09:12.374542+0000","last_clean":"2023-12-14T14:09:12.374542+0000","last_became_active":"2023-12-14T14:09:10.625179+0000","last_became_peered":"2023-12-14T14:09:10.625179+0000","last_unstale":"2023-12-14T14:09:12.374542+0000","last_undegraded":"2023-12-14T14:09:12.374542+0000","last_fullsized":"2023-12-14T14:09:12.374542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:28:56.557023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.809587+0000","last_change":"2023-12-14T14:09:10.212885+0000","last_active":"2023-12-14T14:09:14.809587+0000","last_peered":"2023-12-14T14:09:14.809587+0000","last_clean":"2023-12-14T14:09:14.809587+0000","last_became_active":"2023-12-14T14:09:10.212311+0000","last_became_peered":"2023-12-14T14:09:10.212311+0000","last_unstale":"2023-12-14T14:09:14.809587+0000","last_undegraded":"2023-12-14T14:09:14.809587+0000","last_fullsized":"2023-12-14T14:09:14.809587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:36:02.124214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407399+0000","last_change":"2023-12-14T14:09:10.620795+0000","last_active":"2023-12-14T14:09:12.407399+0000","last_peered":"2023-12-14T14:09:12.407399+0000","last_clean":"2023-12-14T14:09:12.407399+0000","last_became_active":"2023-12-14T14:09:10.620453+0000","last_became_peered":"2023-12-14T14:09:10.620453+0000","last_unstale":"2023-12-14T14:09:12.407399+0000","last_undegraded":"2023-12-14T14:09:12.407399+0000","last_fullsized":"2023-12-14T14:09:12.407399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:54:17.454367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374266+0000","last_change":"2023-12-14T14:09:10.218969+0000","last_active":"2023-12-14T14:09:12.374266+0000","last_peered":"2023-12-14T14:09:12.374266+0000","last_clean":"2023-12-14T14:09:12.374266+0000","last_became_active":"2023-12-14T14:09:10.218624+0000","last_became_peered":"2023-12-14T14:09:10.218624+0000","last_unstale":"2023-12-14T14:09:12.374266+0000","last_undegraded":"2023-12-14T14:09:12.374266+0000","last_fullsized":"2023-12-14T14:09:12.374266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:47:39.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450113+0000","last_change":"2023-12-14T14:09:10.619202+0000","last_active":"2023-12-14T14:09:12.450113+0000","last_peered":"2023-12-14T14:09:12.450113+0000","last_clean":"2023-12-14T14:09:12.450113+0000","last_became_active":"2023-12-14T14:09:10.618944+0000","last_became_peered":"2023-12-14T14:09:10.618944+0000","last_unstale":"2023-12-14T14:09:12.450113+0000","last_undegraded":"2023-12-14T14:09:12.450113+0000","last_fullsized":"2023-12-14T14:09:12.450113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:01:48.400281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:49.862748+0000","last_change":"2023-12-14T14:09:10.214323+0000","last_active":"2023-12-14T14:09:49.862748+0000","last_peered":"2023-12-14T14:09:49.862748+0000","last_clean":"2023-12-14T14:09:49.862748+0000","last_became_active":"2023-12-14T14:09:10.213998+0000","last_became_peered":"2023-12-14T14:09:10.213998+0000","last_unstale":"2023-12-14T14:09:49.862748+0000","last_undegraded":"2023-12-14T14:09:49.862748+0000","last_fullsized":"2023-12-14T14:09:49.862748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:42:36.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450376+0000","last_change":"2023-12-14T14:09:10.626967+0000","last_active":"2023-12-14T14:09:12.450376+0000","last_peered":"2023-12-14T14:09:12.450376+0000","last_clean":"2023-12-14T14:09:12.450376+0000","last_became_active":"2023-12-14T14:09:10.626589+0000","last_became_peered":"2023-12-14T14:09:10.626589+0000","last_unstale":"2023-12-14T14:09:12.450376+0000","last_undegraded":"2023-12-14T14:09:12.450376+0000","last_fullsized":"2023-12-14T14:09:12.450376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:18:05.427208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800485+0000","last_change":"2023-12-14T14:09:10.221868+0000","last_active":"2023-12-14T14:09:13.800485+0000","last_peered":"2023-12-14T14:09:13.800485+0000","last_clean":"2023-12-14T14:09:13.800485+0000","last_became_active":"2023-12-14T14:09:10.221378+0000","last_became_peered":"2023-12-14T14:09:10.221378+0000","last_unstale":"2023-12-14T14:09:13.800485+0000","last_undegraded":"2023-12-14T14:09:13.800485+0000","last_fullsized":"2023-12-14T14:09:13.800485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:00:02.721676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450749+0000","last_change":"2023-12-14T14:09:10.630669+0000","last_active":"2023-12-14T14:09:12.450749+0000","last_peered":"2023-12-14T14:09:12.450749+0000","last_clean":"2023-12-14T14:09:12.450749+0000","last_became_active":"2023-12-14T14:09:10.630351+0000","last_became_peered":"2023-12-14T14:09:10.630351+0000","last_unstale":"2023-12-14T14:09:12.450749+0000","last_undegraded":"2023-12-14T14:09:12.450749+0000","last_fullsized":"2023-12-14T14:09:12.450749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:39:01.883621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800086+0000","last_change":"2023-12-14T14:09:10.214352+0000","last_active":"2023-12-14T14:09:13.800086+0000","last_peered":"2023-12-14T14:09:13.800086+0000","last_clean":"2023-12-14T14:09:13.800086+0000","last_became_active":"2023-12-14T14:09:10.213873+0000","last_became_peered":"2023-12-14T14:09:10.213873+0000","last_unstale":"2023-12-14T14:09:13.800086+0000","last_undegraded":"2023-12-14T14:09:13.800086+0000","last_fullsized":"2023-12-14T14:09:13.800086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:34:30.048744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450214+0000","last_change":"2023-12-14T14:09:10.631272+0000","last_active":"2023-12-14T14:09:12.450214+0000","last_peered":"2023-12-14T14:09:12.450214+0000","last_clean":"2023-12-14T14:09:12.450214+0000","last_became_active":"2023-12-14T14:09:10.630923+0000","last_became_peered":"2023-12-14T14:09:10.630923+0000","last_unstale":"2023-12-14T14:09:12.450214+0000","last_undegraded":"2023-12-14T14:09:12.450214+0000","last_fullsized":"2023-12-14T14:09:12.450214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:21:37.270983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'27","reported_seq":121,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:50.874384+0000","last_change":"2023-12-14T14:09:10.219006+0000","last_active":"2023-12-14T14:09:50.874384+0000","last_peered":"2023-12-14T14:09:50.874384+0000","last_clean":"2023-12-14T14:09:50.874384+0000","last_became_active":"2023-12-14T14:09:10.218694+0000","last_became_peered":"2023-12-14T14:09:10.218694+0000","last_unstale":"2023-12-14T14:09:50.874384+0000","last_undegraded":"2023-12-14T14:09:50.874384+0000","last_fullsized":"2023-12-14T14:09:50.874384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:24:00.199652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":93,"num_write":28,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450731+0000","last_change":"2023-12-14T14:09:10.624056+0000","last_active":"2023-12-14T14:09:12.450731+0000","last_peered":"2023-12-14T14:09:12.450731+0000","last_clean":"2023-12-14T14:09:12.450731+0000","last_became_active":"2023-12-14T14:09:10.623622+0000","last_became_peered":"2023-12-14T14:09:10.623622+0000","last_unstale":"2023-12-14T14:09:12.450731+0000","last_undegraded":"2023-12-14T14:09:12.450731+0000","last_fullsized":"2023-12-14T14:09:12.450731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:21:01.045406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.807421+0000","last_change":"2023-12-14T14:09:10.215236+0000","last_active":"2023-12-14T14:09:14.807421+0000","last_peered":"2023-12-14T14:09:14.807421+0000","last_clean":"2023-12-14T14:09:14.807421+0000","last_became_active":"2023-12-14T14:09:10.214941+0000","last_became_peered":"2023-12-14T14:09:10.214941+0000","last_unstale":"2023-12-14T14:09:14.807421+0000","last_undegraded":"2023-12-14T14:09:14.807421+0000","last_fullsized":"2023-12-14T14:09:14.807421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:56:39.026819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610145+0000","last_change":"2023-12-14T14:09:10.625352+0000","last_active":"2023-12-14T14:09:11.610145+0000","last_peered":"2023-12-14T14:09:11.610145+0000","last_clean":"2023-12-14T14:09:11.610145+0000","last_became_active":"2023-12-14T14:09:10.625037+0000","last_became_peered":"2023-12-14T14:09:10.625037+0000","last_unstale":"2023-12-14T14:09:11.610145+0000","last_undegraded":"2023-12-14T14:09:11.610145+0000","last_fullsized":"2023-12-14T14:09:11.610145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:04:20.861942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.801523+0000","last_change":"2023-12-14T14:09:10.219028+0000","last_active":"2023-12-14T14:09:13.801523+0000","last_peered":"2023-12-14T14:09:13.801523+0000","last_clean":"2023-12-14T14:09:13.801523+0000","last_became_active":"2023-12-14T14:09:10.218687+0000","last_became_peered":"2023-12-14T14:09:10.218687+0000","last_unstale":"2023-12-14T14:09:13.801523+0000","last_undegraded":"2023-12-14T14:09:13.801523+0000","last_fullsized":"2023-12-14T14:09:13.801523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:28:56.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627176+0000","last_change":"2023-12-14T14:09:10.623660+0000","last_active":"2023-12-14T14:09:11.627176+0000","last_peered":"2023-12-14T14:09:11.627176+0000","last_clean":"2023-12-14T14:09:11.627176+0000","last_became_active":"2023-12-14T14:09:10.623321+0000","last_became_peered":"2023-12-14T14:09:10.623321+0000","last_unstale":"2023-12-14T14:09:11.627176+0000","last_undegraded":"2023-12-14T14:09:11.627176+0000","last_fullsized":"2023-12-14T14:09:11.627176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:57:57.403056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:47.859794+0000","last_change":"2023-12-14T14:09:10.217849+0000","last_active":"2023-12-14T14:09:47.859794+0000","last_peered":"2023-12-14T14:09:47.859794+0000","last_clean":"2023-12-14T14:09:47.859794+0000","last_became_active":"2023-12-14T14:09:10.217501+0000","last_became_peered":"2023-12-14T14:09:10.217501+0000","last_unstale":"2023-12-14T14:09:47.859794+0000","last_undegraded":"2023-12-14T14:09:47.859794+0000","last_fullsized":"2023-12-14T14:09:47.859794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:56:37.539435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626553+0000","last_change":"2023-12-14T14:09:10.627193+0000","last_active":"2023-12-14T14:09:11.626553+0000","last_peered":"2023-12-14T14:09:11.626553+0000","last_clean":"2023-12-14T14:09:11.626553+0000","last_became_active":"2023-12-14T14:09:10.626887+0000","last_became_peered":"2023-12-14T14:09:10.626887+0000","last_unstale":"2023-12-14T14:09:11.626553+0000","last_undegraded":"2023-12-14T14:09:11.626553+0000","last_fullsized":"2023-12-14T14:09:11.626553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:48.943605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.808565+0000","last_change":"2023-12-14T14:09:10.220564+0000","last_active":"2023-12-14T14:09:14.808565+0000","last_peered":"2023-12-14T14:09:14.808565+0000","last_clean":"2023-12-14T14:09:14.808565+0000","last_became_active":"2023-12-14T14:09:10.219921+0000","last_became_peered":"2023-12-14T14:09:10.219921+0000","last_unstale":"2023-12-14T14:09:14.808565+0000","last_undegraded":"2023-12-14T14:09:14.808565+0000","last_fullsized":"2023-12-14T14:09:14.808565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:01.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374323+0000","last_change":"2023-12-14T14:09:10.625056+0000","last_active":"2023-12-14T14:09:12.374323+0000","last_peered":"2023-12-14T14:09:12.374323+0000","last_clean":"2023-12-14T14:09:12.374323+0000","last_became_active":"2023-12-14T14:09:10.624626+0000","last_became_peered":"2023-12-14T14:09:10.624626+0000","last_unstale":"2023-12-14T14:09:12.374323+0000","last_undegraded":"2023-12-14T14:09:12.374323+0000","last_fullsized":"2023-12-14T14:09:12.374323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:19:24.087342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:15.810385+0000","last_change":"2023-12-14T14:09:10.215413+0000","last_active":"2023-12-14T14:09:15.810385+0000","last_peered":"2023-12-14T14:09:15.810385+0000","last_clean":"2023-12-14T14:09:15.810385+0000","last_became_active":"2023-12-14T14:09:10.214925+0000","last_became_peered":"2023-12-14T14:09:10.214925+0000","last_unstale":"2023-12-14T14:09:15.810385+0000","last_undegraded":"2023-12-14T14:09:15.810385+0000","last_fullsized":"2023-12-14T14:09:15.810385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:29.337362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611673+0000","last_change":"2023-12-14T14:09:10.629879+0000","last_active":"2023-12-14T14:09:11.611673+0000","last_peered":"2023-12-14T14:09:11.611673+0000","last_clean":"2023-12-14T14:09:11.611673+0000","last_became_active":"2023-12-14T14:09:10.629539+0000","last_became_peered":"2023-12-14T14:09:10.629539+0000","last_unstale":"2023-12-14T14:09:11.611673+0000","last_undegraded":"2023-12-14T14:09:11.611673+0000","last_fullsized":"2023-12-14T14:09:11.611673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:39:43.910568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450107+0000","last_change":"2023-12-14T14:09:10.214875+0000","last_active":"2023-12-14T14:09:12.450107+0000","last_peered":"2023-12-14T14:09:12.450107+0000","last_clean":"2023-12-14T14:09:12.450107+0000","last_became_active":"2023-12-14T14:09:10.214518+0000","last_became_peered":"2023-12-14T14:09:10.214518+0000","last_unstale":"2023-12-14T14:09:12.450107+0000","last_undegraded":"2023-12-14T14:09:12.450107+0000","last_fullsized":"2023-12-14T14:09:12.450107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:47:45.358021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450946+0000","last_change":"2023-12-14T14:09:10.619279+0000","last_active":"2023-12-14T14:09:12.450946+0000","last_peered":"2023-12-14T14:09:12.450946+0000","last_clean":"2023-12-14T14:09:12.450946+0000","last_became_active":"2023-12-14T14:09:10.618794+0000","last_became_peered":"2023-12-14T14:09:10.618794+0000","last_unstale":"2023-12-14T14:09:12.450946+0000","last_undegraded":"2023-12-14T14:09:12.450946+0000","last_fullsized":"2023-12-14T14:09:12.450946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:26:59.987926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.879730+0000","last_change":"2023-12-14T14:09:10.222213+0000","last_active":"2023-12-14T14:09:11.879730+0000","last_peered":"2023-12-14T14:09:11.879730+0000","last_clean":"2023-12-14T14:09:11.879730+0000","last_became_active":"2023-12-14T14:09:10.221314+0000","last_became_peered":"2023-12-14T14:09:10.221314+0000","last_unstale":"2023-12-14T14:09:11.879730+0000","last_undegraded":"2023-12-14T14:09:11.879730+0000","last_fullsized":"2023-12-14T14:09:11.879730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:08:22.888160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450812+0000","last_change":"2023-12-14T14:09:10.624523+0000","last_active":"2023-12-14T14:09:12.450812+0000","last_peered":"2023-12-14T14:09:12.450812+0000","last_clean":"2023-12-14T14:09:12.450812+0000","last_became_active":"2023-12-14T14:09:10.624204+0000","last_became_peered":"2023-12-14T14:09:10.624204+0000","last_unstale":"2023-12-14T14:09:12.450812+0000","last_undegraded":"2023-12-14T14:09:12.450812+0000","last_fullsized":"2023-12-14T14:09:12.450812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:57:02.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374413+0000","last_change":"2023-12-14T14:09:10.626166+0000","last_active":"2023-12-14T14:09:12.374413+0000","last_peered":"2023-12-14T14:09:12.374413+0000","last_clean":"2023-12-14T14:09:12.374413+0000","last_became_active":"2023-12-14T14:09:10.625831+0000","last_became_peered":"2023-12-14T14:09:10.625831+0000","last_unstale":"2023-12-14T14:09:12.374413+0000","last_undegraded":"2023-12-14T14:09:12.374413+0000","last_fullsized":"2023-12-14T14:09:12.374413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:37:59.030750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:47.859190+0000","last_change":"2023-12-14T14:09:10.217759+0000","last_active":"2023-12-14T14:09:47.859190+0000","last_peered":"2023-12-14T14:09:47.859190+0000","last_clean":"2023-12-14T14:09:47.859190+0000","last_became_active":"2023-12-14T14:09:10.217454+0000","last_became_peered":"2023-12-14T14:09:10.217454+0000","last_unstale":"2023-12-14T14:09:47.859190+0000","last_undegraded":"2023-12-14T14:09:47.859190+0000","last_fullsized":"2023-12-14T14:09:47.859190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:31:22.360965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407749+0000","last_change":"2023-12-14T14:09:10.619315+0000","last_active":"2023-12-14T14:09:12.407749+0000","last_peered":"2023-12-14T14:09:12.407749+0000","last_clean":"2023-12-14T14:09:12.407749+0000","last_became_active":"2023-12-14T14:09:10.619020+0000","last_became_peered":"2023-12-14T14:09:10.619020+0000","last_unstale":"2023-12-14T14:09:12.407749+0000","last_undegraded":"2023-12-14T14:09:12.407749+0000","last_fullsized":"2023-12-14T14:09:12.407749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:29:53.925419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:15.809315+0000","last_change":"2023-12-14T14:09:10.214557+0000","last_active":"2023-12-14T14:09:15.809315+0000","last_peered":"2023-12-14T14:09:15.809315+0000","last_clean":"2023-12-14T14:09:15.809315+0000","last_became_active":"2023-12-14T14:09:10.214179+0000","last_became_peered":"2023-12-14T14:09:10.214179+0000","last_unstale":"2023-12-14T14:09:15.809315+0000","last_undegraded":"2023-12-14T14:09:15.809315+0000","last_fullsized":"2023-12-14T14:09:15.809315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:06:48.176436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626671+0000","last_change":"2023-12-14T14:08:24.268746+0000","last_active":"2023-12-14T14:09:11.626671+0000","last_peered":"2023-12-14T14:09:11.626671+0000","last_clean":"2023-12-14T14:09:11.626671+0000","last_became_active":"2023-12-14T14:08:24.268402+0000","last_became_peered":"2023-12-14T14:08:24.268402+0000","last_unstale":"2023-12-14T14:09:11.626671+0000","last_undegraded":"2023-12-14T14:09:11.626671+0000","last_fullsized":"2023-12-14T14:09:11.626671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_clean_scrub_stamp":"2023-12-14T14:05:59.057653+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:48.663897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.609978+0000","last_change":"2023-12-14T14:09:10.623899+0000","last_active":"2023-12-14T14:09:11.609978+0000","last_peered":"2023-12-14T14:09:11.609978+0000","last_clean":"2023-12-14T14:09:11.609978+0000","last_became_active":"2023-12-14T14:09:10.623585+0000","last_became_peered":"2023-12-14T14:09:10.623585+0000","last_unstale":"2023-12-14T14:09:11.609978+0000","last_undegraded":"2023-12-14T14:09:11.609978+0000","last_fullsized":"2023-12-14T14:09:11.609978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:33:27.382237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.807161+0000","last_change":"2023-12-14T14:09:10.221812+0000","last_active":"2023-12-14T14:09:14.807161+0000","last_peered":"2023-12-14T14:09:14.807161+0000","last_clean":"2023-12-14T14:09:14.807161+0000","last_became_active":"2023-12-14T14:09:10.221483+0000","last_became_peered":"2023-12-14T14:09:10.221483+0000","last_unstale":"2023-12-14T14:09:14.807161+0000","last_undegraded":"2023-12-14T14:09:14.807161+0000","last_fullsized":"2023-12-14T14:09:14.807161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:57:05.696384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.799504+0000","last_change":"2023-12-14T14:09:10.217249+0000","last_active":"2023-12-14T14:09:13.799504+0000","last_peered":"2023-12-14T14:09:13.799504+0000","last_clean":"2023-12-14T14:09:13.799504+0000","last_became_active":"2023-12-14T14:09:10.216953+0000","last_became_peered":"2023-12-14T14:09:10.216953+0000","last_unstale":"2023-12-14T14:09:13.799504+0000","last_undegraded":"2023-12-14T14:09:13.799504+0000","last_fullsized":"2023-12-14T14:09:13.799504+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:09:55.765717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610375+0000","last_change":"2023-12-14T14:09:10.616264+0000","last_active":"2023-12-14T14:09:11.610375+0000","last_peered":"2023-12-14T14:09:11.610375+0000","last_clean":"2023-12-14T14:09:11.610375+0000","last_became_active":"2023-12-14T14:09:10.615993+0000","last_became_peered":"2023-12-14T14:09:10.615993+0000","last_unstale":"2023-12-14T14:09:11.610375+0000","last_undegraded":"2023-12-14T14:09:11.610375+0000","last_fullsized":"2023-12-14T14:09:11.610375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:30:03.296839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:19.828844+0000","last_change":"2023-12-14T14:09:10.218040+0000","last_active":"2023-12-14T14:09:19.828844+0000","last_peered":"2023-12-14T14:09:19.828844+0000","last_clean":"2023-12-14T14:09:19.828844+0000","last_became_active":"2023-12-14T14:09:10.217698+0000","last_became_peered":"2023-12-14T14:09:10.217698+0000","last_unstale":"2023-12-14T14:09:19.828844+0000","last_undegraded":"2023-12-14T14:09:19.828844+0000","last_fullsized":"2023-12-14T14:09:19.828844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:35:43.055944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407899+0000","last_change":"2023-12-14T14:09:10.626705+0000","last_active":"2023-12-14T14:09:12.407899+0000","last_peered":"2023-12-14T14:09:12.407899+0000","last_clean":"2023-12-14T14:09:12.407899+0000","last_became_active":"2023-12-14T14:09:10.626390+0000","last_became_peered":"2023-12-14T14:09:10.626390+0000","last_unstale":"2023-12-14T14:09:12.407899+0000","last_undegraded":"2023-12-14T14:09:12.407899+0000","last_fullsized":"2023-12-14T14:09:12.407899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:45:08.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800616+0000","last_change":"2023-12-14T14:09:10.224068+0000","last_active":"2023-12-14T14:09:13.800616+0000","last_peered":"2023-12-14T14:09:13.800616+0000","last_clean":"2023-12-14T14:09:13.800616+0000","last_became_active":"2023-12-14T14:09:10.223709+0000","last_became_peered":"2023-12-14T14:09:10.223709+0000","last_unstale":"2023-12-14T14:09:13.800616+0000","last_undegraded":"2023-12-14T14:09:13.800616+0000","last_fullsized":"2023-12-14T14:09:13.800616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:35:58.218289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450674+0000","last_change":"2023-12-14T14:09:10.633221+0000","last_active":"2023-12-14T14:09:12.450674+0000","last_peered":"2023-12-14T14:09:12.450674+0000","last_clean":"2023-12-14T14:09:12.450674+0000","last_became_active":"2023-12-14T14:09:10.632881+0000","last_became_peered":"2023-12-14T14:09:10.632881+0000","last_unstale":"2023-12-14T14:09:12.450674+0000","last_undegraded":"2023-12-14T14:09:12.450674+0000","last_fullsized":"2023-12-14T14:09:12.450674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:08:31.873299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.801999+0000","last_change":"2023-12-14T14:09:10.219793+0000","last_active":"2023-12-14T14:09:13.801999+0000","last_peered":"2023-12-14T14:09:13.801999+0000","last_clean":"2023-12-14T14:09:13.801999+0000","last_became_active":"2023-12-14T14:09:10.219485+0000","last_became_peered":"2023-12-14T14:09:10.219485+0000","last_unstale":"2023-12-14T14:09:13.801999+0000","last_undegraded":"2023-12-14T14:09:13.801999+0000","last_fullsized":"2023-12-14T14:09:13.801999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:12:52.521261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450086+0000","last_change":"2023-12-14T14:09:10.622064+0000","last_active":"2023-12-14T14:09:12.450086+0000","last_peered":"2023-12-14T14:09:12.450086+0000","last_clean":"2023-12-14T14:09:12.450086+0000","last_became_active":"2023-12-14T14:09:10.621741+0000","last_became_peered":"2023-12-14T14:09:10.621741+0000","last_unstale":"2023-12-14T14:09:12.450086+0000","last_undegraded":"2023-12-14T14:09:12.450086+0000","last_fullsized":"2023-12-14T14:09:12.450086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:17:02.821975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800868+0000","last_change":"2023-12-14T14:09:10.209152+0000","last_active":"2023-12-14T14:09:13.800868+0000","last_peered":"2023-12-14T14:09:13.800868+0000","last_clean":"2023-12-14T14:09:13.800868+0000","last_became_active":"2023-12-14T14:09:10.208798+0000","last_became_peered":"2023-12-14T14:09:10.208798+0000","last_unstale":"2023-12-14T14:09:13.800868+0000","last_undegraded":"2023-12-14T14:09:13.800868+0000","last_fullsized":"2023-12-14T14:09:13.800868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:25:32.056408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611049+0000","last_change":"2023-12-14T14:09:10.616109+0000","last_active":"2023-12-14T14:09:11.611049+0000","last_peered":"2023-12-14T14:09:11.611049+0000","last_clean":"2023-12-14T14:09:11.611049+0000","last_became_active":"2023-12-14T14:09:10.615694+0000","last_became_peered":"2023-12-14T14:09:10.615694+0000","last_unstale":"2023-12-14T14:09:11.611049+0000","last_undegraded":"2023-12-14T14:09:11.611049+0000","last_fullsized":"2023-12-14T14:09:11.611049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:44:27.502084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.067924+0000","last_change":"2023-12-14T14:09:10.224376+0000","last_active":"2023-12-14T14:09:14.067924+0000","last_peered":"2023-12-14T14:09:14.067924+0000","last_clean":"2023-12-14T14:09:14.067924+0000","last_became_active":"2023-12-14T14:09:10.224010+0000","last_became_peered":"2023-12-14T14:09:10.224010+0000","last_unstale":"2023-12-14T14:09:14.067924+0000","last_undegraded":"2023-12-14T14:09:14.067924+0000","last_fullsized":"2023-12-14T14:09:14.067924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:35:42.162264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407641+0000","last_change":"2023-12-14T14:09:10.622490+0000","last_active":"2023-12-14T14:09:12.407641+0000","last_peered":"2023-12-14T14:09:12.407641+0000","last_clean":"2023-12-14T14:09:12.407641+0000","last_became_active":"2023-12-14T14:09:10.622154+0000","last_became_peered":"2023-12-14T14:09:10.622154+0000","last_unstale":"2023-12-14T14:09:12.407641+0000","last_undegraded":"2023-12-14T14:09:12.407641+0000","last_fullsized":"2023-12-14T14:09:12.407641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:58:24.317257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800971+0000","last_change":"2023-12-14T14:09:10.220343+0000","last_active":"2023-12-14T14:09:13.800971+0000","last_peered":"2023-12-14T14:09:13.800971+0000","last_clean":"2023-12-14T14:09:13.800971+0000","last_became_active":"2023-12-14T14:09:10.219657+0000","last_became_peered":"2023-12-14T14:09:10.219657+0000","last_unstale":"2023-12-14T14:09:13.800971+0000","last_undegraded":"2023-12-14T14:09:13.800971+0000","last_fullsized":"2023-12-14T14:09:13.800971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:07:17.459573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627001+0000","last_change":"2023-12-14T14:09:10.633980+0000","last_active":"2023-12-14T14:09:11.627001+0000","last_peered":"2023-12-14T14:09:11.627001+0000","last_clean":"2023-12-14T14:09:11.627001+0000","last_became_active":"2023-12-14T14:09:10.633541+0000","last_became_peered":"2023-12-14T14:09:10.633541+0000","last_unstale":"2023-12-14T14:09:11.627001+0000","last_undegraded":"2023-12-14T14:09:11.627001+0000","last_fullsized":"2023-12-14T14:09:11.627001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:23:06.057252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.808164+0000","last_change":"2023-12-14T14:09:10.218042+0000","last_active":"2023-12-14T14:09:14.808164+0000","last_peered":"2023-12-14T14:09:14.808164+0000","last_clean":"2023-12-14T14:09:14.808164+0000","last_became_active":"2023-12-14T14:09:10.217540+0000","last_became_peered":"2023-12-14T14:09:10.217540+0000","last_unstale":"2023-12-14T14:09:14.808164+0000","last_undegraded":"2023-12-14T14:09:14.808164+0000","last_fullsized":"2023-12-14T14:09:14.808164+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:59:44.996931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627141+0000","last_change":"2023-12-14T14:09:10.633527+0000","last_active":"2023-12-14T14:09:11.627141+0000","last_peered":"2023-12-14T14:09:11.627141+0000","last_clean":"2023-12-14T14:09:11.627141+0000","last_became_active":"2023-12-14T14:09:10.632614+0000","last_became_peered":"2023-12-14T14:09:10.632614+0000","last_unstale":"2023-12-14T14:09:11.627141+0000","last_undegraded":"2023-12-14T14:09:11.627141+0000","last_fullsized":"2023-12-14T14:09:11.627141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:11:48.151945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374713+0000","last_change":"2023-12-14T14:09:10.211731+0000","last_active":"2023-12-14T14:09:12.374713+0000","last_peered":"2023-12-14T14:09:12.374713+0000","last_clean":"2023-12-14T14:09:12.374713+0000","last_became_active":"2023-12-14T14:09:10.211366+0000","last_became_peered":"2023-12-14T14:09:10.211366+0000","last_unstale":"2023-12-14T14:09:12.374713+0000","last_undegraded":"2023-12-14T14:09:12.374713+0000","last_fullsized":"2023-12-14T14:09:12.374713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:09:57.281728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.879768+0000","last_change":"2023-12-14T14:09:10.621483+0000","last_active":"2023-12-14T14:09:11.879768+0000","last_peered":"2023-12-14T14:09:11.879768+0000","last_clean":"2023-12-14T14:09:11.879768+0000","last_became_active":"2023-12-14T14:09:10.621105+0000","last_became_peered":"2023-12-14T14:09:10.621105+0000","last_unstale":"2023-12-14T14:09:11.879768+0000","last_undegraded":"2023-12-14T14:09:11.879768+0000","last_fullsized":"2023-12-14T14:09:11.879768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:14:24.242449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610479+0000","last_change":"2023-12-14T14:09:10.218688+0000","last_active":"2023-12-14T14:09:11.610479+0000","last_peered":"2023-12-14T14:09:11.610479+0000","last_clean":"2023-12-14T14:09:11.610479+0000","last_became_active":"2023-12-14T14:09:10.218339+0000","last_became_peered":"2023-12-14T14:09:10.218339+0000","last_unstale":"2023-12-14T14:09:11.610479+0000","last_undegraded":"2023-12-14T14:09:11.610479+0000","last_fullsized":"2023-12-14T14:09:11.610479+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:14.404008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627129+0000","last_change":"2023-12-14T14:09:10.633084+0000","last_active":"2023-12-14T14:09:11.627129+0000","last_peered":"2023-12-14T14:09:11.627129+0000","last_clean":"2023-12-14T14:09:11.627129+0000","last_became_active":"2023-12-14T14:09:10.632544+0000","last_became_peered":"2023-12-14T14:09:10.632544+0000","last_unstale":"2023-12-14T14:09:11.627129+0000","last_undegraded":"2023-12-14T14:09:11.627129+0000","last_fullsized":"2023-12-14T14:09:11.627129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:28:57.465267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611142+0000","last_change":"2023-12-14T14:09:10.618373+0000","last_active":"2023-12-14T14:09:11.611142+0000","last_peered":"2023-12-14T14:09:11.611142+0000","last_clean":"2023-12-14T14:09:11.611142+0000","last_became_active":"2023-12-14T14:09:10.618028+0000","last_became_peered":"2023-12-14T14:09:10.618028+0000","last_unstale":"2023-12-14T14:09:11.611142+0000","last_undegraded":"2023-12-14T14:09:11.611142+0000","last_fullsized":"2023-12-14T14:09:11.611142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:56:41.817157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449871+0000","last_change":"2023-12-14T14:09:10.622775+0000","last_active":"2023-12-14T14:09:12.449871+0000","last_peered":"2023-12-14T14:09:12.449871+0000","last_clean":"2023-12-14T14:09:12.449871+0000","last_became_active":"2023-12-14T14:09:10.622407+0000","last_became_peered":"2023-12-14T14:09:10.622407+0000","last_unstale":"2023-12-14T14:09:12.449871+0000","last_undegraded":"2023-12-14T14:09:12.449871+0000","last_fullsized":"2023-12-14T14:09:12.449871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:58:30.740484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450305+0000","last_change":"2023-12-14T14:09:10.622137+0000","last_active":"2023-12-14T14:09:12.450305+0000","last_peered":"2023-12-14T14:09:12.450305+0000","last_clean":"2023-12-14T14:09:12.450305+0000","last_became_active":"2023-12-14T14:09:10.621829+0000","last_became_peered":"2023-12-14T14:09:10.621829+0000","last_unstale":"2023-12-14T14:09:12.450305+0000","last_undegraded":"2023-12-14T14:09:12.450305+0000","last_fullsized":"2023-12-14T14:09:12.450305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:46:53.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450718+0000","last_change":"2023-12-14T14:09:10.625511+0000","last_active":"2023-12-14T14:09:12.450718+0000","last_peered":"2023-12-14T14:09:12.450718+0000","last_clean":"2023-12-14T14:09:12.450718+0000","last_became_active":"2023-12-14T14:09:10.624863+0000","last_became_peered":"2023-12-14T14:09:10.624863+0000","last_unstale":"2023-12-14T14:09:12.450718+0000","last_undegraded":"2023-12-14T14:09:12.450718+0000","last_fullsized":"2023-12-14T14:09:12.450718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:00:15.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610492+0000","last_change":"2023-12-14T14:09:10.623824+0000","last_active":"2023-12-14T14:09:11.610492+0000","last_peered":"2023-12-14T14:09:11.610492+0000","last_clean":"2023-12-14T14:09:11.610492+0000","last_became_active":"2023-12-14T14:09:10.623482+0000","last_became_peered":"2023-12-14T14:09:10.623482+0000","last_unstale":"2023-12-14T14:09:11.610492+0000","last_undegraded":"2023-12-14T14:09:11.610492+0000","last_fullsized":"2023-12-14T14:09:11.610492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:34:46.976441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611365+0000","last_change":"2023-12-14T14:09:10.618004+0000","last_active":"2023-12-14T14:09:11.611365+0000","last_peered":"2023-12-14T14:09:11.611365+0000","last_clean":"2023-12-14T14:09:11.611365+0000","last_became_active":"2023-12-14T14:09:10.617184+0000","last_became_peered":"2023-12-14T14:09:10.617184+0000","last_unstale":"2023-12-14T14:09:11.611365+0000","last_undegraded":"2023-12-14T14:09:11.611365+0000","last_fullsized":"2023-12-14T14:09:11.611365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:11:15.687914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450821+0000","last_change":"2023-12-14T14:09:10.621183+0000","last_active":"2023-12-14T14:09:12.450821+0000","last_peered":"2023-12-14T14:09:12.450821+0000","last_clean":"2023-12-14T14:09:12.450821+0000","last_became_active":"2023-12-14T14:09:10.620474+0000","last_became_peered":"2023-12-14T14:09:10.620474+0000","last_unstale":"2023-12-14T14:09:12.450821+0000","last_undegraded":"2023-12-14T14:09:12.450821+0000","last_fullsized":"2023-12-14T14:09:12.450821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:36:42.247213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407830+0000","last_change":"2023-12-14T14:09:10.630668+0000","last_active":"2023-12-14T14:09:12.407830+0000","last_peered":"2023-12-14T14:09:12.407830+0000","last_clean":"2023-12-14T14:09:12.407830+0000","last_became_active":"2023-12-14T14:09:10.630337+0000","last_became_peered":"2023-12-14T14:09:10.630337+0000","last_unstale":"2023-12-14T14:09:12.407830+0000","last_undegraded":"2023-12-14T14:09:12.407830+0000","last_fullsized":"2023-12-14T14:09:12.407830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:04:48.631722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374293+0000","last_change":"2023-12-14T14:09:10.619550+0000","last_active":"2023-12-14T14:09:12.374293+0000","last_peered":"2023-12-14T14:09:12.374293+0000","last_clean":"2023-12-14T14:09:12.374293+0000","last_became_active":"2023-12-14T14:09:10.619029+0000","last_became_peered":"2023-12-14T14:09:10.619029+0000","last_unstale":"2023-12-14T14:09:12.374293+0000","last_undegraded":"2023-12-14T14:09:12.374293+0000","last_fullsized":"2023-12-14T14:09:12.374293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:27:15.911087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407515+0000","last_change":"2023-12-14T14:09:10.622158+0000","last_active":"2023-12-14T14:09:12.407515+0000","last_peered":"2023-12-14T14:09:12.407515+0000","last_clean":"2023-12-14T14:09:12.407515+0000","last_became_active":"2023-12-14T14:09:10.621853+0000","last_became_peered":"2023-12-14T14:09:10.621853+0000","last_unstale":"2023-12-14T14:09:12.407515+0000","last_undegraded":"2023-12-14T14:09:12.407515+0000","last_fullsized":"2023-12-14T14:09:12.407515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:24:30.913464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450085+0000","last_change":"2023-12-14T14:09:10.627728+0000","last_active":"2023-12-14T14:09:12.450085+0000","last_peered":"2023-12-14T14:09:12.450085+0000","last_clean":"2023-12-14T14:09:12.450085+0000","last_became_active":"2023-12-14T14:09:10.627352+0000","last_became_peered":"2023-12-14T14:09:10.627352+0000","last_unstale":"2023-12-14T14:09:12.450085+0000","last_undegraded":"2023-12-14T14:09:12.450085+0000","last_fullsized":"2023-12-14T14:09:12.450085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:35:42.468155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610301+0000","last_change":"2023-12-14T14:09:10.625676+0000","last_active":"2023-12-14T14:09:11.610301+0000","last_peered":"2023-12-14T14:09:11.610301+0000","last_clean":"2023-12-14T14:09:11.610301+0000","last_became_active":"2023-12-14T14:09:10.625191+0000","last_became_peered":"2023-12-14T14:09:10.625191+0000","last_unstale":"2023-12-14T14:09:11.610301+0000","last_undegraded":"2023-12-14T14:09:11.610301+0000","last_fullsized":"2023-12-14T14:09:11.610301+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:24:53.447990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611702+0000","last_change":"2023-12-14T14:09:10.624258+0000","last_active":"2023-12-14T14:09:11.611702+0000","last_peered":"2023-12-14T14:09:11.611702+0000","last_clean":"2023-12-14T14:09:11.611702+0000","last_became_active":"2023-12-14T14:09:10.623917+0000","last_became_peered":"2023-12-14T14:09:10.623917+0000","last_unstale":"2023-12-14T14:09:11.611702+0000","last_undegraded":"2023-12-14T14:09:11.611702+0000","last_fullsized":"2023-12-14T14:09:11.611702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:13:30.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60535,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":239,"num_read_kb":183,"num_write":150,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":181605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481809,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5928,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739224,"statfs":{"total":95995035648,"available":95988965376,"internally_reserved":0,"allocated":884736,"data_stored":423998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.621},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.751},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.83199999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":9,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.94399999999999995}]},{"osd":10,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.90200000000000002}]}]},{"osd":10,"up_from":70,"seq":300647710742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6392,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738760,"statfs":{"total":95995035648,"available":95988490240,"internally_reserved":0,"allocated":1032192,"data_stored":1072068,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.622}]},{"osd":6,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.60899999999999999}]},{"osd":9,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.53500000000000003}]},{"osd":11,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.71499999999999997}]}]},{"osd":9,"up_from":65,"seq":279172874264,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6072,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739080,"statfs":{"total":95995035648,"available":95988817920,"internally_reserved":0,"allocated":901120,"data_stored":424234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.308},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.371}]},{"osd":1,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.442},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.58699999999999997}]},{"osd":8,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61699999999999999}]},{"osd":10,"last update":"Thu Dec 14 14:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56699999999999995}]}]},{"osd":8,"up_from":58,"seq":249108103197,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6264,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738888,"statfs":{"total":95995035648,"available":95988621312,"internally_reserved":0,"allocated":901120,"data_stored":424154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81399999999999995,"5min":0.88,"15min":0.88},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.747},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.79700000000000004,"5min":0.875,"15min":0.875},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78700000000000003,"5min":1.411,"15min":1.411},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97299999999999998,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.34899999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90100000000000002,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.66900000000000004,"15min":0.65800000000000003},"min":{"1min":0.50900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.80500000000000005}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.77800000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.82199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":7,"up_from":50,"seq":214748364832,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6376,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738776,"statfs":{"total":95995035648,"available":95988506624,"internally_reserved":0,"allocated":950272,"data_stored":1016383,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.311}]},{"osd":1,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.436,"15min":0.44},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78700000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.628}]},{"osd":3,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66400000000000003},"min":{"1min":0.46800000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.746}]},{"osd":8,"last update":"Thu Dec 14 14:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86899999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.84499999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.877}]},{"osd":10,"last update":"Thu Dec 14 14:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":6,"up_from":45,"seq":193273528355,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738900,"statfs":{"total":95995035648,"available":95988633600,"internally_reserved":0,"allocated":888832,"data_stored":423629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.314,"5min":0.245,"15min":0.245},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.35799999999999998},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.441,"15min":0.42499999999999999},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.35999999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Dec 14 14:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65600000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":0.995,"15min":0.995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90200000000000002,"5min":1.254,"15min":1.254},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81100000000000005,"5min":1.288,"15min":1.288},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.627}]},{"osd":9,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.502}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.74299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7204,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737948,"statfs":{"total":95995035648,"available":95987658752,"internally_reserved":0,"allocated":946176,"data_stored":479657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.503,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71299999999999997,"5min":0.87,"15min":0.87},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68999999999999995,"5min":0.751,"15min":0.751},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.311,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.52800000000000002,"15min":0.505},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.40799999999999997,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.42499999999999999,"15min":0.40699999999999997},"min":{"1min":0.30199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Dec 14 14:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86099999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Dec 14 14:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52800000000000002}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67200000000000004,"15min":0.66100000000000003},"min":{"1min":0.55500000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71499999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57999999999999996}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.626},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56599999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7168,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737984,"statfs":{"total":95995035648,"available":95987695616,"internally_reserved":0,"allocated":909312,"data_stored":424894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.45800000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.54400000000000004,"15min":0.496},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.84899999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.34100000000000003},"min":{"1min":0.29899999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.38600000000000001,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.55700000000000005,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.432}]},{"osd":5,"last update":"Thu Dec 14 14:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.80800000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.36199999999999999}]},{"osd":7,"last update":"Thu Dec 14 14:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.498},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.109,"5min":5.109,"15min":5.109},"last":0.61499999999999999}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.45200000000000001}]},{"osd":10,"last update":"Thu Dec 14 14:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52800000000000002}]},{"osd":11,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.0499999999999998,"5min":5.0499999999999998,"15min":5.0499999999999998},"last":0.64500000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7352,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737800,"statfs":{"total":95995035648,"available":95987507200,"internally_reserved":0,"allocated":966656,"data_stored":481076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.33600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.49099999999999999,"15min":0.46300000000000002},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.74399999999999999,"5min":0.877,"15min":0.877},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69899999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65800000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Dec 14 14:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Dec 14 14:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78600000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81599999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.501}]},{"osd":7,"last update":"Thu Dec 14 14:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626}]},{"osd":8,"last update":"Thu Dec 14 14:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.67500000000000004}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.64600000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":3,"up_from":24,"seq":103079215150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6524,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738628,"statfs":{"total":95995035648,"available":95988355072,"internally_reserved":0,"allocated":905216,"data_stored":423946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.316},"min":{"1min":0.252,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.378},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.505,"15min":0.47999999999999998},"min":{"1min":0.44700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.433}]},{"osd":2,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.45600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.497}]},{"osd":5,"last update":"Thu Dec 14 14:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77900000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.62}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58899999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.40999999999999998}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953514,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6384,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738768,"statfs":{"total":95995035648,"available":95988498432,"internally_reserved":0,"allocated":892928,"data_stored":424402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.498}]},{"osd":1,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.32100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81100000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52700000000000002,"15min":0.51200000000000001},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78000000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.439}]},{"osd":5,"last update":"Thu Dec 14 14:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Dec 14 14:09:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83699999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.378}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72099999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.49399999999999999}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":5,"up_from":37,"seq":158913789991,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6512,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738640,"statfs":{"total":95995035648,"available":95988367360,"internally_reserved":0,"allocated":958464,"data_stored":1015444,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.505,"15min":0.495},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.438,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.503},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.432,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.38200000000000001,"15min":0.374},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.28899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.498,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.755,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.754}]},{"osd":4,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.44900000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.876}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.89800000000000002}]},{"osd":9,"last update":"Thu Dec 14 14:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.82199999999999995}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T14:09:53.358 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-14T14:09:53.670 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:53.944 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:53 smithi069 ceph-mon[42034]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-14T14:09:53.944 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:53 smithi069 ceph-mon[42034]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:53 smithi119 ceph-mon[43834]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-14T14:09:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:53 smithi119 ceph-mon[43834]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:54.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:53 smithi081 ceph-mon[43371]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-14T14:09:54.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:53 smithi081 ceph-mon[43371]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:54.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.715+0000 7f86e6375700 1 -- 172.21.15.69:0/3329164533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ffe00 msgr2=0x7f86e0103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:54.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.715+0000 7f86e6375700 1 --2- 172.21.15.69:0/3329164533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ffe00 0x7f86e0103dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f86d00099c0 tx=0x7f86d0009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.715+0000 7f86e6375700 1 -- 172.21.15.69:0/3329164533 shutdown_connections 2023-12-14T14:09:54.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.715+0000 7f86e6375700 1 --2- 172.21.15.69:0/3329164533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86e0104500 0x7f86e010c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.715+0000 7f86e6375700 1 --2- 172.21.15.69:0/3329164533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e00ff460 0x7f86e00ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.715+0000 7f86e6375700 1 --2- 172.21.15.69:0/3329164533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ffe00 0x7f86e0103dd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.715+0000 7f86e6375700 1 -- 172.21.15.69:0/3329164533 >> 172.21.15.69:0/3329164533 conn(0x7f86e00770a0 msgr2=0x7f86e00774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:54.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.715+0000 7f86e6375700 1 -- 172.21.15.69:0/3329164533 shutdown_connections 2023-12-14T14:09:54.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.715+0000 7f86e6375700 1 -- 172.21.15.69:0/3329164533 wait complete. 2023-12-14T14:09:54.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86e6375700 1 Processor -- start 2023-12-14T14:09:54.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86e6375700 1 -- start start 2023-12-14T14:09:54.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86e6375700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ff460 0x7f86e01953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:54.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86e6375700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e00ffe00 0x7f86e0195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:54.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86e6375700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86e0104500 0x7f86e0199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:54.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86e6375700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e019a390 con 0x7f86e00ff460 2023-12-14T14:09:54.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86e6375700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e019a500 con 0x7f86e00ffe00 2023-12-14T14:09:54.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86e6375700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e019a6c0 con 0x7f86e0104500 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86dffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ff460 0x7f86e01953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86dffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ff460 0x7f86e01953d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55872/0 (socket says 172.21.15.69:55872) 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.716+0000 7f86dffff700 1 -- 172.21.15.69:0/12703493 learned_addr learned my addr 172.21.15.69:0/12703493 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86e4912700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86e0104500 0x7f86e0199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86df7fe700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e00ffe00 0x7f86e0195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86dffff700 1 -- 172.21.15.69:0/12703493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86e0104500 msgr2=0x7f86e0199d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86dffff700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86e0104500 0x7f86e0199d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86dffff700 1 -- 172.21.15.69:0/12703493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e00ffe00 msgr2=0x7f86e0195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86dffff700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e00ffe00 0x7f86e0195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86dffff700 1 -- 172.21.15.69:0/12703493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d00095f0 con 0x7f86e00ff460 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86df7fe700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e00ffe00 0x7f86e0195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86dffff700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ff460 0x7f86e01953d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f86c800b530 tx=0x7f86c800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86dd7fa700 1 -- 172.21.15.69:0/12703493 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8011830 con 0x7f86e00ff460 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86dd7fa700 1 -- 172.21.15.69:0/12703493 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86c8011e50 con 0x7f86e00ff460 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e010f310 con 0x7f86e00ff460 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86dd7fa700 1 -- 172.21.15.69:0/12703493 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c800f2e0 con 0x7f86e00ff460 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.717+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e010f180 con 0x7f86e00ff460 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.718+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e010f4a0 con 0x7f86e00ff460 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.719+0000 7f86dd7fa700 1 -- 172.21.15.69:0/12703493 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f86c8010380 con 0x7f86e00ff460 2023-12-14T14:09:54.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.719+0000 7f86dd7fa700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86cc0a11e0 0x7f86cc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:54.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.720+0000 7f86df7fe700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86cc0a11e0 0x7f86cc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:54.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.720+0000 7f86dd7fa700 1 -- 172.21.15.69:0/12703493 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f86c80cc340 con 0x7f86e00ff460 2023-12-14T14:09:54.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.720+0000 7f86df7fe700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86cc0a11e0 0x7f86cc0a3690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86d0000c00 tx=0x7f86d0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:54.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.724+0000 7f86dd7fa700 1 -- 172.21.15.69:0/12703493 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f86c8095bf0 con 0x7f86e00ff460 2023-12-14T14:09:54.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.909+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86e00fd390 con 0x7f86cc0a11e0 2023-12-14T14:09:54.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.919+0000 7f86dd7fa700 1 -- 172.21.15.69:0/12703493 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341486 (secure 0 0 0) 0x7f86e00fd390 con 0x7f86cc0a11e0 2023-12-14T14:09:54.924 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:54.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86cc0a11e0 msgr2=0x7f86cc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:54.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86cc0a11e0 0x7f86cc0a3690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86d0000c00 tx=0x7f86d0005fb0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ff460 msgr2=0x7f86e01953d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:54.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ff460 0x7f86e01953d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f86c800b530 tx=0x7f86c800b840 comp rx=0 tx=0).stop 2023-12-14T14:09:54.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 shutdown_connections 2023-12-14T14:09:54.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86cc0a11e0 0x7f86cc0a3690 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86e0104500 0x7f86e0199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e00ff460 0x7f86e01953d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 --2- 172.21.15.69:0/12703493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e00ffe00 0x7f86e0195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:54.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 >> 172.21.15.69:0/12703493 conn(0x7f86e00770a0 msgr2=0x7f86e00fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:54.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 shutdown_connections 2023-12-14T14:09:54.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:54.922+0000 7f86e6375700 1 -- 172.21.15.69:0/12703493 wait complete. 2023-12-14T14:09:54.929 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T14:09:55.336 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2023-12-14T14:09:54.614028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651149,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":380,"num_read_kb":307,"num_write":333,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":78428,"kb_used_data":10876,"kb_used_omap":0,"kb_used_meta":67456,"kb_avail":1124863396,"statfs":{"total":1151940427776,"available":1151860117504,"internally_reserved":0,"allocated":11137024,"data_stored":7033885,"data_compressed":107034,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":69074944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":37,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002735"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611392+0000","last_change":"2023-12-14T14:09:10.621884+0000","last_active":"2023-12-14T14:09:11.611392+0000","last_peered":"2023-12-14T14:09:11.611392+0000","last_clean":"2023-12-14T14:09:11.611392+0000","last_became_active":"2023-12-14T14:09:10.621605+0000","last_became_peered":"2023-12-14T14:09:10.621605+0000","last_unstale":"2023-12-14T14:09:11.611392+0000","last_undegraded":"2023-12-14T14:09:11.611392+0000","last_fullsized":"2023-12-14T14:09:11.611392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:52:34.121106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450636+0000","last_change":"2023-12-14T14:09:10.621555+0000","last_active":"2023-12-14T14:09:12.450636+0000","last_peered":"2023-12-14T14:09:12.450636+0000","last_clean":"2023-12-14T14:09:12.450636+0000","last_became_active":"2023-12-14T14:09:10.621265+0000","last_became_peered":"2023-12-14T14:09:10.621265+0000","last_unstale":"2023-12-14T14:09:12.450636+0000","last_undegraded":"2023-12-14T14:09:12.450636+0000","last_fullsized":"2023-12-14T14:09:12.450636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:46:18.920671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450457+0000","last_change":"2023-12-14T14:09:10.623575+0000","last_active":"2023-12-14T14:09:12.450457+0000","last_peered":"2023-12-14T14:09:12.450457+0000","last_clean":"2023-12-14T14:09:12.450457+0000","last_became_active":"2023-12-14T14:09:10.623289+0000","last_became_peered":"2023-12-14T14:09:10.623289+0000","last_unstale":"2023-12-14T14:09:12.450457+0000","last_undegraded":"2023-12-14T14:09:12.450457+0000","last_fullsized":"2023-12-14T14:09:12.450457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:21:24.793809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611562+0000","last_change":"2023-12-14T14:09:10.622850+0000","last_active":"2023-12-14T14:09:11.611562+0000","last_peered":"2023-12-14T14:09:11.611562+0000","last_clean":"2023-12-14T14:09:11.611562+0000","last_became_active":"2023-12-14T14:09:10.622456+0000","last_became_peered":"2023-12-14T14:09:10.622456+0000","last_unstale":"2023-12-14T14:09:11.611562+0000","last_undegraded":"2023-12-14T14:09:11.611562+0000","last_fullsized":"2023-12-14T14:09:11.611562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:33:10.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449942+0000","last_change":"2023-12-14T14:09:10.623459+0000","last_active":"2023-12-14T14:09:12.449942+0000","last_peered":"2023-12-14T14:09:12.449942+0000","last_clean":"2023-12-14T14:09:12.449942+0000","last_became_active":"2023-12-14T14:09:10.623100+0000","last_became_peered":"2023-12-14T14:09:10.623100+0000","last_unstale":"2023-12-14T14:09:12.449942+0000","last_undegraded":"2023-12-14T14:09:12.449942+0000","last_fullsized":"2023-12-14T14:09:12.449942+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:15:11.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450472+0000","last_change":"2023-12-14T14:09:10.624663+0000","last_active":"2023-12-14T14:09:12.450472+0000","last_peered":"2023-12-14T14:09:12.450472+0000","last_clean":"2023-12-14T14:09:12.450472+0000","last_became_active":"2023-12-14T14:09:10.624313+0000","last_became_peered":"2023-12-14T14:09:10.624313+0000","last_unstale":"2023-12-14T14:09:12.450472+0000","last_undegraded":"2023-12-14T14:09:12.450472+0000","last_fullsized":"2023-12-14T14:09:12.450472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:36:58.959484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626715+0000","last_change":"2023-12-14T14:09:10.622519+0000","last_active":"2023-12-14T14:09:11.626715+0000","last_peered":"2023-12-14T14:09:11.626715+0000","last_clean":"2023-12-14T14:09:11.626715+0000","last_became_active":"2023-12-14T14:09:10.622147+0000","last_became_peered":"2023-12-14T14:09:10.622147+0000","last_unstale":"2023-12-14T14:09:11.626715+0000","last_undegraded":"2023-12-14T14:09:11.626715+0000","last_fullsized":"2023-12-14T14:09:11.626715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:06:54.114410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407505+0000","last_change":"2023-12-14T14:09:10.622762+0000","last_active":"2023-12-14T14:09:12.407505+0000","last_peered":"2023-12-14T14:09:12.407505+0000","last_clean":"2023-12-14T14:09:12.407505+0000","last_became_active":"2023-12-14T14:09:10.622199+0000","last_became_peered":"2023-12-14T14:09:10.622199+0000","last_unstale":"2023-12-14T14:09:12.407505+0000","last_undegraded":"2023-12-14T14:09:12.407505+0000","last_fullsized":"2023-12-14T14:09:12.407505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:05:12.024946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450680+0000","last_change":"2023-12-14T14:09:10.625452+0000","last_active":"2023-12-14T14:09:12.450680+0000","last_peered":"2023-12-14T14:09:12.450680+0000","last_clean":"2023-12-14T14:09:12.450680+0000","last_became_active":"2023-12-14T14:09:10.620053+0000","last_became_peered":"2023-12-14T14:09:10.620053+0000","last_unstale":"2023-12-14T14:09:12.450680+0000","last_undegraded":"2023-12-14T14:09:12.450680+0000","last_fullsized":"2023-12-14T14:09:12.450680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:44:53.320690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.451174+0000","last_change":"2023-12-14T14:09:10.631871+0000","last_active":"2023-12-14T14:09:12.451174+0000","last_peered":"2023-12-14T14:09:12.451174+0000","last_clean":"2023-12-14T14:09:12.451174+0000","last_became_active":"2023-12-14T14:09:10.631549+0000","last_became_peered":"2023-12-14T14:09:10.631549+0000","last_unstale":"2023-12-14T14:09:12.451174+0000","last_undegraded":"2023-12-14T14:09:12.451174+0000","last_fullsized":"2023-12-14T14:09:12.451174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:05:03.676055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626995+0000","last_change":"2023-12-14T14:09:10.633572+0000","last_active":"2023-12-14T14:09:11.626995+0000","last_peered":"2023-12-14T14:09:11.626995+0000","last_clean":"2023-12-14T14:09:11.626995+0000","last_became_active":"2023-12-14T14:09:10.633251+0000","last_became_peered":"2023-12-14T14:09:10.633251+0000","last_unstale":"2023-12-14T14:09:11.626995+0000","last_undegraded":"2023-12-14T14:09:11.626995+0000","last_fullsized":"2023-12-14T14:09:11.626995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:12:19.816759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611430+0000","last_change":"2023-12-14T14:09:10.630621+0000","last_active":"2023-12-14T14:09:11.611430+0000","last_peered":"2023-12-14T14:09:11.611430+0000","last_clean":"2023-12-14T14:09:11.611430+0000","last_became_active":"2023-12-14T14:09:10.630196+0000","last_became_peered":"2023-12-14T14:09:10.630196+0000","last_unstale":"2023-12-14T14:09:11.611430+0000","last_undegraded":"2023-12-14T14:09:11.611430+0000","last_fullsized":"2023-12-14T14:09:11.611430+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:47:07.876989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610386+0000","last_change":"2023-12-14T14:09:10.617111+0000","last_active":"2023-12-14T14:09:11.610386+0000","last_peered":"2023-12-14T14:09:11.610386+0000","last_clean":"2023-12-14T14:09:11.610386+0000","last_became_active":"2023-12-14T14:09:10.616817+0000","last_became_peered":"2023-12-14T14:09:10.616817+0000","last_unstale":"2023-12-14T14:09:11.610386+0000","last_undegraded":"2023-12-14T14:09:11.610386+0000","last_fullsized":"2023-12-14T14:09:11.610386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:32:53.038532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450326+0000","last_change":"2023-12-14T14:09:10.620373+0000","last_active":"2023-12-14T14:09:12.450326+0000","last_peered":"2023-12-14T14:09:12.450326+0000","last_clean":"2023-12-14T14:09:12.450326+0000","last_became_active":"2023-12-14T14:09:10.620107+0000","last_became_peered":"2023-12-14T14:09:10.620107+0000","last_unstale":"2023-12-14T14:09:12.450326+0000","last_undegraded":"2023-12-14T14:09:12.450326+0000","last_fullsized":"2023-12-14T14:09:12.450326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:21:44.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450001+0000","last_change":"2023-12-14T14:09:10.624554+0000","last_active":"2023-12-14T14:09:12.450001+0000","last_peered":"2023-12-14T14:09:12.450001+0000","last_clean":"2023-12-14T14:09:12.450001+0000","last_became_active":"2023-12-14T14:09:10.624255+0000","last_became_peered":"2023-12-14T14:09:10.624255+0000","last_unstale":"2023-12-14T14:09:12.450001+0000","last_undegraded":"2023-12-14T14:09:12.450001+0000","last_fullsized":"2023-12-14T14:09:12.450001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:28:58.674883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449876+0000","last_change":"2023-12-14T14:09:10.632464+0000","last_active":"2023-12-14T14:09:12.449876+0000","last_peered":"2023-12-14T14:09:12.449876+0000","last_clean":"2023-12-14T14:09:12.449876+0000","last_became_active":"2023-12-14T14:09:10.632102+0000","last_became_peered":"2023-12-14T14:09:10.632102+0000","last_unstale":"2023-12-14T14:09:12.449876+0000","last_undegraded":"2023-12-14T14:09:12.449876+0000","last_fullsized":"2023-12-14T14:09:12.449876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:48:12.491292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611548+0000","last_change":"2023-12-14T14:09:10.619144+0000","last_active":"2023-12-14T14:09:11.611548+0000","last_peered":"2023-12-14T14:09:11.611548+0000","last_clean":"2023-12-14T14:09:11.611548+0000","last_became_active":"2023-12-14T14:09:10.618833+0000","last_became_peered":"2023-12-14T14:09:10.618833+0000","last_unstale":"2023-12-14T14:09:11.611548+0000","last_undegraded":"2023-12-14T14:09:11.611548+0000","last_fullsized":"2023-12-14T14:09:11.611548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:39:23.775221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450257+0000","last_change":"2023-12-14T14:09:10.619062+0000","last_active":"2023-12-14T14:09:12.450257+0000","last_peered":"2023-12-14T14:09:12.450257+0000","last_clean":"2023-12-14T14:09:12.450257+0000","last_became_active":"2023-12-14T14:09:10.618750+0000","last_became_peered":"2023-12-14T14:09:10.618750+0000","last_unstale":"2023-12-14T14:09:12.450257+0000","last_undegraded":"2023-12-14T14:09:12.450257+0000","last_fullsized":"2023-12-14T14:09:12.450257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:28:30.651988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450436+0000","last_change":"2023-12-14T14:09:10.621410+0000","last_active":"2023-12-14T14:09:12.450436+0000","last_peered":"2023-12-14T14:09:12.450436+0000","last_clean":"2023-12-14T14:09:12.450436+0000","last_became_active":"2023-12-14T14:09:10.621037+0000","last_became_peered":"2023-12-14T14:09:10.621037+0000","last_unstale":"2023-12-14T14:09:12.450436+0000","last_undegraded":"2023-12-14T14:09:12.450436+0000","last_fullsized":"2023-12-14T14:09:12.450436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:39:09.650960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.807814+0000","last_change":"2023-12-14T14:09:10.218180+0000","last_active":"2023-12-14T14:09:14.807814+0000","last_peered":"2023-12-14T14:09:14.807814+0000","last_clean":"2023-12-14T14:09:14.807814+0000","last_became_active":"2023-12-14T14:09:10.217856+0000","last_became_peered":"2023-12-14T14:09:10.217856+0000","last_unstale":"2023-12-14T14:09:14.807814+0000","last_undegraded":"2023-12-14T14:09:14.807814+0000","last_fullsized":"2023-12-14T14:09:14.807814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:34:17.405766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407962+0000","last_change":"2023-12-14T14:09:10.628500+0000","last_active":"2023-12-14T14:09:12.407962+0000","last_peered":"2023-12-14T14:09:12.407962+0000","last_clean":"2023-12-14T14:09:12.407962+0000","last_became_active":"2023-12-14T14:09:10.628120+0000","last_became_peered":"2023-12-14T14:09:10.628120+0000","last_unstale":"2023-12-14T14:09:12.407962+0000","last_undegraded":"2023-12-14T14:09:12.407962+0000","last_fullsized":"2023-12-14T14:09:12.407962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:34:44.660042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.408005+0000","last_change":"2023-12-14T14:09:10.218608+0000","last_active":"2023-12-14T14:09:12.408005+0000","last_peered":"2023-12-14T14:09:12.408005+0000","last_clean":"2023-12-14T14:09:12.408005+0000","last_became_active":"2023-12-14T14:09:10.218010+0000","last_became_peered":"2023-12-14T14:09:10.218010+0000","last_unstale":"2023-12-14T14:09:12.408005+0000","last_undegraded":"2023-12-14T14:09:12.408005+0000","last_fullsized":"2023-12-14T14:09:12.408005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:35:05.683768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450785+0000","last_change":"2023-12-14T14:09:10.621972+0000","last_active":"2023-12-14T14:09:12.450785+0000","last_peered":"2023-12-14T14:09:12.450785+0000","last_clean":"2023-12-14T14:09:12.450785+0000","last_became_active":"2023-12-14T14:09:10.621685+0000","last_became_peered":"2023-12-14T14:09:10.621685+0000","last_unstale":"2023-12-14T14:09:12.450785+0000","last_undegraded":"2023-12-14T14:09:12.450785+0000","last_fullsized":"2023-12-14T14:09:12.450785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:13:06.816242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.806768+0000","last_change":"2023-12-14T14:09:10.220860+0000","last_active":"2023-12-14T14:09:14.806768+0000","last_peered":"2023-12-14T14:09:14.806768+0000","last_clean":"2023-12-14T14:09:14.806768+0000","last_became_active":"2023-12-14T14:09:10.219802+0000","last_became_peered":"2023-12-14T14:09:10.219802+0000","last_unstale":"2023-12-14T14:09:14.806768+0000","last_undegraded":"2023-12-14T14:09:14.806768+0000","last_fullsized":"2023-12-14T14:09:14.806768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:01:27.246337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450032+0000","last_change":"2023-12-14T14:09:10.626807+0000","last_active":"2023-12-14T14:09:12.450032+0000","last_peered":"2023-12-14T14:09:12.450032+0000","last_clean":"2023-12-14T14:09:12.450032+0000","last_became_active":"2023-12-14T14:09:10.626450+0000","last_became_peered":"2023-12-14T14:09:10.626450+0000","last_unstale":"2023-12-14T14:09:12.450032+0000","last_undegraded":"2023-12-14T14:09:12.450032+0000","last_fullsized":"2023-12-14T14:09:12.450032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:25:06.887649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450628+0000","last_change":"2023-12-14T14:09:10.216515+0000","last_active":"2023-12-14T14:09:12.450628+0000","last_peered":"2023-12-14T14:09:12.450628+0000","last_clean":"2023-12-14T14:09:12.450628+0000","last_became_active":"2023-12-14T14:09:10.216175+0000","last_became_peered":"2023-12-14T14:09:10.216175+0000","last_unstale":"2023-12-14T14:09:12.450628+0000","last_undegraded":"2023-12-14T14:09:12.450628+0000","last_fullsized":"2023-12-14T14:09:12.450628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:52:31.006083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374755+0000","last_change":"2023-12-14T14:09:10.627664+0000","last_active":"2023-12-14T14:09:12.374755+0000","last_peered":"2023-12-14T14:09:12.374755+0000","last_clean":"2023-12-14T14:09:12.374755+0000","last_became_active":"2023-12-14T14:09:10.627376+0000","last_became_peered":"2023-12-14T14:09:10.627376+0000","last_unstale":"2023-12-14T14:09:12.374755+0000","last_undegraded":"2023-12-14T14:09:12.374755+0000","last_fullsized":"2023-12-14T14:09:12.374755+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:41:03.037811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:48.861879+0000","last_change":"2023-12-14T14:09:10.218806+0000","last_active":"2023-12-14T14:09:48.861879+0000","last_peered":"2023-12-14T14:09:48.861879+0000","last_clean":"2023-12-14T14:09:48.861879+0000","last_became_active":"2023-12-14T14:09:10.218441+0000","last_became_peered":"2023-12-14T14:09:10.218441+0000","last_unstale":"2023-12-14T14:09:48.861879+0000","last_undegraded":"2023-12-14T14:09:48.861879+0000","last_fullsized":"2023-12-14T14:09:48.861879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:50:30.949849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450206+0000","last_change":"2023-12-14T14:09:10.622903+0000","last_active":"2023-12-14T14:09:12.450206+0000","last_peered":"2023-12-14T14:09:12.450206+0000","last_clean":"2023-12-14T14:09:12.450206+0000","last_became_active":"2023-12-14T14:09:10.622261+0000","last_became_peered":"2023-12-14T14:09:10.622261+0000","last_unstale":"2023-12-14T14:09:12.450206+0000","last_undegraded":"2023-12-14T14:09:12.450206+0000","last_fullsized":"2023-12-14T14:09:12.450206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:17:13.547591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.809526+0000","last_change":"2023-12-14T14:09:10.222254+0000","last_active":"2023-12-14T14:09:14.809526+0000","last_peered":"2023-12-14T14:09:14.809526+0000","last_clean":"2023-12-14T14:09:14.809526+0000","last_became_active":"2023-12-14T14:09:10.221861+0000","last_became_peered":"2023-12-14T14:09:10.221861+0000","last_unstale":"2023-12-14T14:09:14.809526+0000","last_undegraded":"2023-12-14T14:09:14.809526+0000","last_fullsized":"2023-12-14T14:09:14.809526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:12:17.252109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374542+0000","last_change":"2023-12-14T14:09:10.625646+0000","last_active":"2023-12-14T14:09:12.374542+0000","last_peered":"2023-12-14T14:09:12.374542+0000","last_clean":"2023-12-14T14:09:12.374542+0000","last_became_active":"2023-12-14T14:09:10.625179+0000","last_became_peered":"2023-12-14T14:09:10.625179+0000","last_unstale":"2023-12-14T14:09:12.374542+0000","last_undegraded":"2023-12-14T14:09:12.374542+0000","last_fullsized":"2023-12-14T14:09:12.374542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:28:56.557023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.809587+0000","last_change":"2023-12-14T14:09:10.212885+0000","last_active":"2023-12-14T14:09:14.809587+0000","last_peered":"2023-12-14T14:09:14.809587+0000","last_clean":"2023-12-14T14:09:14.809587+0000","last_became_active":"2023-12-14T14:09:10.212311+0000","last_became_peered":"2023-12-14T14:09:10.212311+0000","last_unstale":"2023-12-14T14:09:14.809587+0000","last_undegraded":"2023-12-14T14:09:14.809587+0000","last_fullsized":"2023-12-14T14:09:14.809587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:36:02.124214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407399+0000","last_change":"2023-12-14T14:09:10.620795+0000","last_active":"2023-12-14T14:09:12.407399+0000","last_peered":"2023-12-14T14:09:12.407399+0000","last_clean":"2023-12-14T14:09:12.407399+0000","last_became_active":"2023-12-14T14:09:10.620453+0000","last_became_peered":"2023-12-14T14:09:10.620453+0000","last_unstale":"2023-12-14T14:09:12.407399+0000","last_undegraded":"2023-12-14T14:09:12.407399+0000","last_fullsized":"2023-12-14T14:09:12.407399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:54:17.454367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374266+0000","last_change":"2023-12-14T14:09:10.218969+0000","last_active":"2023-12-14T14:09:12.374266+0000","last_peered":"2023-12-14T14:09:12.374266+0000","last_clean":"2023-12-14T14:09:12.374266+0000","last_became_active":"2023-12-14T14:09:10.218624+0000","last_became_peered":"2023-12-14T14:09:10.218624+0000","last_unstale":"2023-12-14T14:09:12.374266+0000","last_undegraded":"2023-12-14T14:09:12.374266+0000","last_fullsized":"2023-12-14T14:09:12.374266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:47:39.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450113+0000","last_change":"2023-12-14T14:09:10.619202+0000","last_active":"2023-12-14T14:09:12.450113+0000","last_peered":"2023-12-14T14:09:12.450113+0000","last_clean":"2023-12-14T14:09:12.450113+0000","last_became_active":"2023-12-14T14:09:10.618944+0000","last_became_peered":"2023-12-14T14:09:10.618944+0000","last_unstale":"2023-12-14T14:09:12.450113+0000","last_undegraded":"2023-12-14T14:09:12.450113+0000","last_fullsized":"2023-12-14T14:09:12.450113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:01:48.400281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:49.862748+0000","last_change":"2023-12-14T14:09:10.214323+0000","last_active":"2023-12-14T14:09:49.862748+0000","last_peered":"2023-12-14T14:09:49.862748+0000","last_clean":"2023-12-14T14:09:49.862748+0000","last_became_active":"2023-12-14T14:09:10.213998+0000","last_became_peered":"2023-12-14T14:09:10.213998+0000","last_unstale":"2023-12-14T14:09:49.862748+0000","last_undegraded":"2023-12-14T14:09:49.862748+0000","last_fullsized":"2023-12-14T14:09:49.862748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:42:36.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450376+0000","last_change":"2023-12-14T14:09:10.626967+0000","last_active":"2023-12-14T14:09:12.450376+0000","last_peered":"2023-12-14T14:09:12.450376+0000","last_clean":"2023-12-14T14:09:12.450376+0000","last_became_active":"2023-12-14T14:09:10.626589+0000","last_became_peered":"2023-12-14T14:09:10.626589+0000","last_unstale":"2023-12-14T14:09:12.450376+0000","last_undegraded":"2023-12-14T14:09:12.450376+0000","last_fullsized":"2023-12-14T14:09:12.450376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:18:05.427208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800485+0000","last_change":"2023-12-14T14:09:10.221868+0000","last_active":"2023-12-14T14:09:13.800485+0000","last_peered":"2023-12-14T14:09:13.800485+0000","last_clean":"2023-12-14T14:09:13.800485+0000","last_became_active":"2023-12-14T14:09:10.221378+0000","last_became_peered":"2023-12-14T14:09:10.221378+0000","last_unstale":"2023-12-14T14:09:13.800485+0000","last_undegraded":"2023-12-14T14:09:13.800485+0000","last_fullsized":"2023-12-14T14:09:13.800485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:00:02.721676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450749+0000","last_change":"2023-12-14T14:09:10.630669+0000","last_active":"2023-12-14T14:09:12.450749+0000","last_peered":"2023-12-14T14:09:12.450749+0000","last_clean":"2023-12-14T14:09:12.450749+0000","last_became_active":"2023-12-14T14:09:10.630351+0000","last_became_peered":"2023-12-14T14:09:10.630351+0000","last_unstale":"2023-12-14T14:09:12.450749+0000","last_undegraded":"2023-12-14T14:09:12.450749+0000","last_fullsized":"2023-12-14T14:09:12.450749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:39:01.883621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800086+0000","last_change":"2023-12-14T14:09:10.214352+0000","last_active":"2023-12-14T14:09:13.800086+0000","last_peered":"2023-12-14T14:09:13.800086+0000","last_clean":"2023-12-14T14:09:13.800086+0000","last_became_active":"2023-12-14T14:09:10.213873+0000","last_became_peered":"2023-12-14T14:09:10.213873+0000","last_unstale":"2023-12-14T14:09:13.800086+0000","last_undegraded":"2023-12-14T14:09:13.800086+0000","last_fullsized":"2023-12-14T14:09:13.800086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:34:30.048744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450214+0000","last_change":"2023-12-14T14:09:10.631272+0000","last_active":"2023-12-14T14:09:12.450214+0000","last_peered":"2023-12-14T14:09:12.450214+0000","last_clean":"2023-12-14T14:09:12.450214+0000","last_became_active":"2023-12-14T14:09:10.630923+0000","last_became_peered":"2023-12-14T14:09:10.630923+0000","last_unstale":"2023-12-14T14:09:12.450214+0000","last_undegraded":"2023-12-14T14:09:12.450214+0000","last_fullsized":"2023-12-14T14:09:12.450214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:21:37.270983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'27","reported_seq":121,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:50.874384+0000","last_change":"2023-12-14T14:09:10.219006+0000","last_active":"2023-12-14T14:09:50.874384+0000","last_peered":"2023-12-14T14:09:50.874384+0000","last_clean":"2023-12-14T14:09:50.874384+0000","last_became_active":"2023-12-14T14:09:10.218694+0000","last_became_peered":"2023-12-14T14:09:10.218694+0000","last_unstale":"2023-12-14T14:09:50.874384+0000","last_undegraded":"2023-12-14T14:09:50.874384+0000","last_fullsized":"2023-12-14T14:09:50.874384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:24:00.199652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":93,"num_write":28,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450731+0000","last_change":"2023-12-14T14:09:10.624056+0000","last_active":"2023-12-14T14:09:12.450731+0000","last_peered":"2023-12-14T14:09:12.450731+0000","last_clean":"2023-12-14T14:09:12.450731+0000","last_became_active":"2023-12-14T14:09:10.623622+0000","last_became_peered":"2023-12-14T14:09:10.623622+0000","last_unstale":"2023-12-14T14:09:12.450731+0000","last_undegraded":"2023-12-14T14:09:12.450731+0000","last_fullsized":"2023-12-14T14:09:12.450731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:21:01.045406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.807421+0000","last_change":"2023-12-14T14:09:10.215236+0000","last_active":"2023-12-14T14:09:14.807421+0000","last_peered":"2023-12-14T14:09:14.807421+0000","last_clean":"2023-12-14T14:09:14.807421+0000","last_became_active":"2023-12-14T14:09:10.214941+0000","last_became_peered":"2023-12-14T14:09:10.214941+0000","last_unstale":"2023-12-14T14:09:14.807421+0000","last_undegraded":"2023-12-14T14:09:14.807421+0000","last_fullsized":"2023-12-14T14:09:14.807421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:56:39.026819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610145+0000","last_change":"2023-12-14T14:09:10.625352+0000","last_active":"2023-12-14T14:09:11.610145+0000","last_peered":"2023-12-14T14:09:11.610145+0000","last_clean":"2023-12-14T14:09:11.610145+0000","last_became_active":"2023-12-14T14:09:10.625037+0000","last_became_peered":"2023-12-14T14:09:10.625037+0000","last_unstale":"2023-12-14T14:09:11.610145+0000","last_undegraded":"2023-12-14T14:09:11.610145+0000","last_fullsized":"2023-12-14T14:09:11.610145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:04:20.861942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.801523+0000","last_change":"2023-12-14T14:09:10.219028+0000","last_active":"2023-12-14T14:09:13.801523+0000","last_peered":"2023-12-14T14:09:13.801523+0000","last_clean":"2023-12-14T14:09:13.801523+0000","last_became_active":"2023-12-14T14:09:10.218687+0000","last_became_peered":"2023-12-14T14:09:10.218687+0000","last_unstale":"2023-12-14T14:09:13.801523+0000","last_undegraded":"2023-12-14T14:09:13.801523+0000","last_fullsized":"2023-12-14T14:09:13.801523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:28:56.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627176+0000","last_change":"2023-12-14T14:09:10.623660+0000","last_active":"2023-12-14T14:09:11.627176+0000","last_peered":"2023-12-14T14:09:11.627176+0000","last_clean":"2023-12-14T14:09:11.627176+0000","last_became_active":"2023-12-14T14:09:10.623321+0000","last_became_peered":"2023-12-14T14:09:10.623321+0000","last_unstale":"2023-12-14T14:09:11.627176+0000","last_undegraded":"2023-12-14T14:09:11.627176+0000","last_fullsized":"2023-12-14T14:09:11.627176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:57:57.403056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:47.859794+0000","last_change":"2023-12-14T14:09:10.217849+0000","last_active":"2023-12-14T14:09:47.859794+0000","last_peered":"2023-12-14T14:09:47.859794+0000","last_clean":"2023-12-14T14:09:47.859794+0000","last_became_active":"2023-12-14T14:09:10.217501+0000","last_became_peered":"2023-12-14T14:09:10.217501+0000","last_unstale":"2023-12-14T14:09:47.859794+0000","last_undegraded":"2023-12-14T14:09:47.859794+0000","last_fullsized":"2023-12-14T14:09:47.859794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:56:37.539435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626553+0000","last_change":"2023-12-14T14:09:10.627193+0000","last_active":"2023-12-14T14:09:11.626553+0000","last_peered":"2023-12-14T14:09:11.626553+0000","last_clean":"2023-12-14T14:09:11.626553+0000","last_became_active":"2023-12-14T14:09:10.626887+0000","last_became_peered":"2023-12-14T14:09:10.626887+0000","last_unstale":"2023-12-14T14:09:11.626553+0000","last_undegraded":"2023-12-14T14:09:11.626553+0000","last_fullsized":"2023-12-14T14:09:11.626553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:48.943605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.808565+0000","last_change":"2023-12-14T14:09:10.220564+0000","last_active":"2023-12-14T14:09:14.808565+0000","last_peered":"2023-12-14T14:09:14.808565+0000","last_clean":"2023-12-14T14:09:14.808565+0000","last_became_active":"2023-12-14T14:09:10.219921+0000","last_became_peered":"2023-12-14T14:09:10.219921+0000","last_unstale":"2023-12-14T14:09:14.808565+0000","last_undegraded":"2023-12-14T14:09:14.808565+0000","last_fullsized":"2023-12-14T14:09:14.808565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:01.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374323+0000","last_change":"2023-12-14T14:09:10.625056+0000","last_active":"2023-12-14T14:09:12.374323+0000","last_peered":"2023-12-14T14:09:12.374323+0000","last_clean":"2023-12-14T14:09:12.374323+0000","last_became_active":"2023-12-14T14:09:10.624626+0000","last_became_peered":"2023-12-14T14:09:10.624626+0000","last_unstale":"2023-12-14T14:09:12.374323+0000","last_undegraded":"2023-12-14T14:09:12.374323+0000","last_fullsized":"2023-12-14T14:09:12.374323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:19:24.087342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:15.810385+0000","last_change":"2023-12-14T14:09:10.215413+0000","last_active":"2023-12-14T14:09:15.810385+0000","last_peered":"2023-12-14T14:09:15.810385+0000","last_clean":"2023-12-14T14:09:15.810385+0000","last_became_active":"2023-12-14T14:09:10.214925+0000","last_became_peered":"2023-12-14T14:09:10.214925+0000","last_unstale":"2023-12-14T14:09:15.810385+0000","last_undegraded":"2023-12-14T14:09:15.810385+0000","last_fullsized":"2023-12-14T14:09:15.810385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:29.337362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611673+0000","last_change":"2023-12-14T14:09:10.629879+0000","last_active":"2023-12-14T14:09:11.611673+0000","last_peered":"2023-12-14T14:09:11.611673+0000","last_clean":"2023-12-14T14:09:11.611673+0000","last_became_active":"2023-12-14T14:09:10.629539+0000","last_became_peered":"2023-12-14T14:09:10.629539+0000","last_unstale":"2023-12-14T14:09:11.611673+0000","last_undegraded":"2023-12-14T14:09:11.611673+0000","last_fullsized":"2023-12-14T14:09:11.611673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:39:43.910568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450107+0000","last_change":"2023-12-14T14:09:10.214875+0000","last_active":"2023-12-14T14:09:12.450107+0000","last_peered":"2023-12-14T14:09:12.450107+0000","last_clean":"2023-12-14T14:09:12.450107+0000","last_became_active":"2023-12-14T14:09:10.214518+0000","last_became_peered":"2023-12-14T14:09:10.214518+0000","last_unstale":"2023-12-14T14:09:12.450107+0000","last_undegraded":"2023-12-14T14:09:12.450107+0000","last_fullsized":"2023-12-14T14:09:12.450107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:47:45.358021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450946+0000","last_change":"2023-12-14T14:09:10.619279+0000","last_active":"2023-12-14T14:09:12.450946+0000","last_peered":"2023-12-14T14:09:12.450946+0000","last_clean":"2023-12-14T14:09:12.450946+0000","last_became_active":"2023-12-14T14:09:10.618794+0000","last_became_peered":"2023-12-14T14:09:10.618794+0000","last_unstale":"2023-12-14T14:09:12.450946+0000","last_undegraded":"2023-12-14T14:09:12.450946+0000","last_fullsized":"2023-12-14T14:09:12.450946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:26:59.987926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.879730+0000","last_change":"2023-12-14T14:09:10.222213+0000","last_active":"2023-12-14T14:09:11.879730+0000","last_peered":"2023-12-14T14:09:11.879730+0000","last_clean":"2023-12-14T14:09:11.879730+0000","last_became_active":"2023-12-14T14:09:10.221314+0000","last_became_peered":"2023-12-14T14:09:10.221314+0000","last_unstale":"2023-12-14T14:09:11.879730+0000","last_undegraded":"2023-12-14T14:09:11.879730+0000","last_fullsized":"2023-12-14T14:09:11.879730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:08:22.888160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450812+0000","last_change":"2023-12-14T14:09:10.624523+0000","last_active":"2023-12-14T14:09:12.450812+0000","last_peered":"2023-12-14T14:09:12.450812+0000","last_clean":"2023-12-14T14:09:12.450812+0000","last_became_active":"2023-12-14T14:09:10.624204+0000","last_became_peered":"2023-12-14T14:09:10.624204+0000","last_unstale":"2023-12-14T14:09:12.450812+0000","last_undegraded":"2023-12-14T14:09:12.450812+0000","last_fullsized":"2023-12-14T14:09:12.450812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:57:02.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374413+0000","last_change":"2023-12-14T14:09:10.626166+0000","last_active":"2023-12-14T14:09:12.374413+0000","last_peered":"2023-12-14T14:09:12.374413+0000","last_clean":"2023-12-14T14:09:12.374413+0000","last_became_active":"2023-12-14T14:09:10.625831+0000","last_became_peered":"2023-12-14T14:09:10.625831+0000","last_unstale":"2023-12-14T14:09:12.374413+0000","last_undegraded":"2023-12-14T14:09:12.374413+0000","last_fullsized":"2023-12-14T14:09:12.374413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:37:59.030750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:52.866274+0000","last_change":"2023-12-14T14:09:10.217759+0000","last_active":"2023-12-14T14:09:52.866274+0000","last_peered":"2023-12-14T14:09:52.866274+0000","last_clean":"2023-12-14T14:09:52.866274+0000","last_became_active":"2023-12-14T14:09:10.217454+0000","last_became_peered":"2023-12-14T14:09:10.217454+0000","last_unstale":"2023-12-14T14:09:52.866274+0000","last_undegraded":"2023-12-14T14:09:52.866274+0000","last_fullsized":"2023-12-14T14:09:52.866274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:31:22.360965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407749+0000","last_change":"2023-12-14T14:09:10.619315+0000","last_active":"2023-12-14T14:09:12.407749+0000","last_peered":"2023-12-14T14:09:12.407749+0000","last_clean":"2023-12-14T14:09:12.407749+0000","last_became_active":"2023-12-14T14:09:10.619020+0000","last_became_peered":"2023-12-14T14:09:10.619020+0000","last_unstale":"2023-12-14T14:09:12.407749+0000","last_undegraded":"2023-12-14T14:09:12.407749+0000","last_fullsized":"2023-12-14T14:09:12.407749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:29:53.925419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:15.809315+0000","last_change":"2023-12-14T14:09:10.214557+0000","last_active":"2023-12-14T14:09:15.809315+0000","last_peered":"2023-12-14T14:09:15.809315+0000","last_clean":"2023-12-14T14:09:15.809315+0000","last_became_active":"2023-12-14T14:09:10.214179+0000","last_became_peered":"2023-12-14T14:09:10.214179+0000","last_unstale":"2023-12-14T14:09:15.809315+0000","last_undegraded":"2023-12-14T14:09:15.809315+0000","last_fullsized":"2023-12-14T14:09:15.809315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:06:48.176436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.626671+0000","last_change":"2023-12-14T14:08:24.268746+0000","last_active":"2023-12-14T14:09:11.626671+0000","last_peered":"2023-12-14T14:09:11.626671+0000","last_clean":"2023-12-14T14:09:11.626671+0000","last_became_active":"2023-12-14T14:08:24.268402+0000","last_became_peered":"2023-12-14T14:08:24.268402+0000","last_unstale":"2023-12-14T14:09:11.626671+0000","last_undegraded":"2023-12-14T14:09:11.626671+0000","last_fullsized":"2023-12-14T14:09:11.626671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_clean_scrub_stamp":"2023-12-14T14:05:59.057653+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:48.663897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.609978+0000","last_change":"2023-12-14T14:09:10.623899+0000","last_active":"2023-12-14T14:09:11.609978+0000","last_peered":"2023-12-14T14:09:11.609978+0000","last_clean":"2023-12-14T14:09:11.609978+0000","last_became_active":"2023-12-14T14:09:10.623585+0000","last_became_peered":"2023-12-14T14:09:10.623585+0000","last_unstale":"2023-12-14T14:09:11.609978+0000","last_undegraded":"2023-12-14T14:09:11.609978+0000","last_fullsized":"2023-12-14T14:09:11.609978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:33:27.382237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.807161+0000","last_change":"2023-12-14T14:09:10.221812+0000","last_active":"2023-12-14T14:09:14.807161+0000","last_peered":"2023-12-14T14:09:14.807161+0000","last_clean":"2023-12-14T14:09:14.807161+0000","last_became_active":"2023-12-14T14:09:10.221483+0000","last_became_peered":"2023-12-14T14:09:10.221483+0000","last_unstale":"2023-12-14T14:09:14.807161+0000","last_undegraded":"2023-12-14T14:09:14.807161+0000","last_fullsized":"2023-12-14T14:09:14.807161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:57:05.696384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.799504+0000","last_change":"2023-12-14T14:09:10.217249+0000","last_active":"2023-12-14T14:09:13.799504+0000","last_peered":"2023-12-14T14:09:13.799504+0000","last_clean":"2023-12-14T14:09:13.799504+0000","last_became_active":"2023-12-14T14:09:10.216953+0000","last_became_peered":"2023-12-14T14:09:10.216953+0000","last_unstale":"2023-12-14T14:09:13.799504+0000","last_undegraded":"2023-12-14T14:09:13.799504+0000","last_fullsized":"2023-12-14T14:09:13.799504+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:09:55.765717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610375+0000","last_change":"2023-12-14T14:09:10.616264+0000","last_active":"2023-12-14T14:09:11.610375+0000","last_peered":"2023-12-14T14:09:11.610375+0000","last_clean":"2023-12-14T14:09:11.610375+0000","last_became_active":"2023-12-14T14:09:10.615993+0000","last_became_peered":"2023-12-14T14:09:10.615993+0000","last_unstale":"2023-12-14T14:09:11.610375+0000","last_undegraded":"2023-12-14T14:09:11.610375+0000","last_fullsized":"2023-12-14T14:09:11.610375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:30:03.296839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:19.828844+0000","last_change":"2023-12-14T14:09:10.218040+0000","last_active":"2023-12-14T14:09:19.828844+0000","last_peered":"2023-12-14T14:09:19.828844+0000","last_clean":"2023-12-14T14:09:19.828844+0000","last_became_active":"2023-12-14T14:09:10.217698+0000","last_became_peered":"2023-12-14T14:09:10.217698+0000","last_unstale":"2023-12-14T14:09:19.828844+0000","last_undegraded":"2023-12-14T14:09:19.828844+0000","last_fullsized":"2023-12-14T14:09:19.828844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:35:43.055944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407899+0000","last_change":"2023-12-14T14:09:10.626705+0000","last_active":"2023-12-14T14:09:12.407899+0000","last_peered":"2023-12-14T14:09:12.407899+0000","last_clean":"2023-12-14T14:09:12.407899+0000","last_became_active":"2023-12-14T14:09:10.626390+0000","last_became_peered":"2023-12-14T14:09:10.626390+0000","last_unstale":"2023-12-14T14:09:12.407899+0000","last_undegraded":"2023-12-14T14:09:12.407899+0000","last_fullsized":"2023-12-14T14:09:12.407899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:45:08.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800616+0000","last_change":"2023-12-14T14:09:10.224068+0000","last_active":"2023-12-14T14:09:13.800616+0000","last_peered":"2023-12-14T14:09:13.800616+0000","last_clean":"2023-12-14T14:09:13.800616+0000","last_became_active":"2023-12-14T14:09:10.223709+0000","last_became_peered":"2023-12-14T14:09:10.223709+0000","last_unstale":"2023-12-14T14:09:13.800616+0000","last_undegraded":"2023-12-14T14:09:13.800616+0000","last_fullsized":"2023-12-14T14:09:13.800616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:35:58.218289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450674+0000","last_change":"2023-12-14T14:09:10.633221+0000","last_active":"2023-12-14T14:09:12.450674+0000","last_peered":"2023-12-14T14:09:12.450674+0000","last_clean":"2023-12-14T14:09:12.450674+0000","last_became_active":"2023-12-14T14:09:10.632881+0000","last_became_peered":"2023-12-14T14:09:10.632881+0000","last_unstale":"2023-12-14T14:09:12.450674+0000","last_undegraded":"2023-12-14T14:09:12.450674+0000","last_fullsized":"2023-12-14T14:09:12.450674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:08:31.873299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.801999+0000","last_change":"2023-12-14T14:09:10.219793+0000","last_active":"2023-12-14T14:09:13.801999+0000","last_peered":"2023-12-14T14:09:13.801999+0000","last_clean":"2023-12-14T14:09:13.801999+0000","last_became_active":"2023-12-14T14:09:10.219485+0000","last_became_peered":"2023-12-14T14:09:10.219485+0000","last_unstale":"2023-12-14T14:09:13.801999+0000","last_undegraded":"2023-12-14T14:09:13.801999+0000","last_fullsized":"2023-12-14T14:09:13.801999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:12:52.521261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450086+0000","last_change":"2023-12-14T14:09:10.622064+0000","last_active":"2023-12-14T14:09:12.450086+0000","last_peered":"2023-12-14T14:09:12.450086+0000","last_clean":"2023-12-14T14:09:12.450086+0000","last_became_active":"2023-12-14T14:09:10.621741+0000","last_became_peered":"2023-12-14T14:09:10.621741+0000","last_unstale":"2023-12-14T14:09:12.450086+0000","last_undegraded":"2023-12-14T14:09:12.450086+0000","last_fullsized":"2023-12-14T14:09:12.450086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:17:02.821975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800868+0000","last_change":"2023-12-14T14:09:10.209152+0000","last_active":"2023-12-14T14:09:13.800868+0000","last_peered":"2023-12-14T14:09:13.800868+0000","last_clean":"2023-12-14T14:09:13.800868+0000","last_became_active":"2023-12-14T14:09:10.208798+0000","last_became_peered":"2023-12-14T14:09:10.208798+0000","last_unstale":"2023-12-14T14:09:13.800868+0000","last_undegraded":"2023-12-14T14:09:13.800868+0000","last_fullsized":"2023-12-14T14:09:13.800868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:25:32.056408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611049+0000","last_change":"2023-12-14T14:09:10.616109+0000","last_active":"2023-12-14T14:09:11.611049+0000","last_peered":"2023-12-14T14:09:11.611049+0000","last_clean":"2023-12-14T14:09:11.611049+0000","last_became_active":"2023-12-14T14:09:10.615694+0000","last_became_peered":"2023-12-14T14:09:10.615694+0000","last_unstale":"2023-12-14T14:09:11.611049+0000","last_undegraded":"2023-12-14T14:09:11.611049+0000","last_fullsized":"2023-12-14T14:09:11.611049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:44:27.502084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.067924+0000","last_change":"2023-12-14T14:09:10.224376+0000","last_active":"2023-12-14T14:09:14.067924+0000","last_peered":"2023-12-14T14:09:14.067924+0000","last_clean":"2023-12-14T14:09:14.067924+0000","last_became_active":"2023-12-14T14:09:10.224010+0000","last_became_peered":"2023-12-14T14:09:10.224010+0000","last_unstale":"2023-12-14T14:09:14.067924+0000","last_undegraded":"2023-12-14T14:09:14.067924+0000","last_fullsized":"2023-12-14T14:09:14.067924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:35:42.162264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407641+0000","last_change":"2023-12-14T14:09:10.622490+0000","last_active":"2023-12-14T14:09:12.407641+0000","last_peered":"2023-12-14T14:09:12.407641+0000","last_clean":"2023-12-14T14:09:12.407641+0000","last_became_active":"2023-12-14T14:09:10.622154+0000","last_became_peered":"2023-12-14T14:09:10.622154+0000","last_unstale":"2023-12-14T14:09:12.407641+0000","last_undegraded":"2023-12-14T14:09:12.407641+0000","last_fullsized":"2023-12-14T14:09:12.407641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:58:24.317257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:13.800971+0000","last_change":"2023-12-14T14:09:10.220343+0000","last_active":"2023-12-14T14:09:13.800971+0000","last_peered":"2023-12-14T14:09:13.800971+0000","last_clean":"2023-12-14T14:09:13.800971+0000","last_became_active":"2023-12-14T14:09:10.219657+0000","last_became_peered":"2023-12-14T14:09:10.219657+0000","last_unstale":"2023-12-14T14:09:13.800971+0000","last_undegraded":"2023-12-14T14:09:13.800971+0000","last_fullsized":"2023-12-14T14:09:13.800971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:07:17.459573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627001+0000","last_change":"2023-12-14T14:09:10.633980+0000","last_active":"2023-12-14T14:09:11.627001+0000","last_peered":"2023-12-14T14:09:11.627001+0000","last_clean":"2023-12-14T14:09:11.627001+0000","last_became_active":"2023-12-14T14:09:10.633541+0000","last_became_peered":"2023-12-14T14:09:10.633541+0000","last_unstale":"2023-12-14T14:09:11.627001+0000","last_undegraded":"2023-12-14T14:09:11.627001+0000","last_fullsized":"2023-12-14T14:09:11.627001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:23:06.057252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:14.808164+0000","last_change":"2023-12-14T14:09:10.218042+0000","last_active":"2023-12-14T14:09:14.808164+0000","last_peered":"2023-12-14T14:09:14.808164+0000","last_clean":"2023-12-14T14:09:14.808164+0000","last_became_active":"2023-12-14T14:09:10.217540+0000","last_became_peered":"2023-12-14T14:09:10.217540+0000","last_unstale":"2023-12-14T14:09:14.808164+0000","last_undegraded":"2023-12-14T14:09:14.808164+0000","last_fullsized":"2023-12-14T14:09:14.808164+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:59:44.996931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627141+0000","last_change":"2023-12-14T14:09:10.633527+0000","last_active":"2023-12-14T14:09:11.627141+0000","last_peered":"2023-12-14T14:09:11.627141+0000","last_clean":"2023-12-14T14:09:11.627141+0000","last_became_active":"2023-12-14T14:09:10.632614+0000","last_became_peered":"2023-12-14T14:09:10.632614+0000","last_unstale":"2023-12-14T14:09:11.627141+0000","last_undegraded":"2023-12-14T14:09:11.627141+0000","last_fullsized":"2023-12-14T14:09:11.627141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:11:48.151945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374713+0000","last_change":"2023-12-14T14:09:10.211731+0000","last_active":"2023-12-14T14:09:12.374713+0000","last_peered":"2023-12-14T14:09:12.374713+0000","last_clean":"2023-12-14T14:09:12.374713+0000","last_became_active":"2023-12-14T14:09:10.211366+0000","last_became_peered":"2023-12-14T14:09:10.211366+0000","last_unstale":"2023-12-14T14:09:12.374713+0000","last_undegraded":"2023-12-14T14:09:12.374713+0000","last_fullsized":"2023-12-14T14:09:12.374713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:09:57.281728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.879768+0000","last_change":"2023-12-14T14:09:10.621483+0000","last_active":"2023-12-14T14:09:11.879768+0000","last_peered":"2023-12-14T14:09:11.879768+0000","last_clean":"2023-12-14T14:09:11.879768+0000","last_became_active":"2023-12-14T14:09:10.621105+0000","last_became_peered":"2023-12-14T14:09:10.621105+0000","last_unstale":"2023-12-14T14:09:11.879768+0000","last_undegraded":"2023-12-14T14:09:11.879768+0000","last_fullsized":"2023-12-14T14:09:11.879768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:14:24.242449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610479+0000","last_change":"2023-12-14T14:09:10.218688+0000","last_active":"2023-12-14T14:09:11.610479+0000","last_peered":"2023-12-14T14:09:11.610479+0000","last_clean":"2023-12-14T14:09:11.610479+0000","last_became_active":"2023-12-14T14:09:10.218339+0000","last_became_peered":"2023-12-14T14:09:10.218339+0000","last_unstale":"2023-12-14T14:09:11.610479+0000","last_undegraded":"2023-12-14T14:09:11.610479+0000","last_fullsized":"2023-12-14T14:09:11.610479+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:14.404008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.627129+0000","last_change":"2023-12-14T14:09:10.633084+0000","last_active":"2023-12-14T14:09:11.627129+0000","last_peered":"2023-12-14T14:09:11.627129+0000","last_clean":"2023-12-14T14:09:11.627129+0000","last_became_active":"2023-12-14T14:09:10.632544+0000","last_became_peered":"2023-12-14T14:09:10.632544+0000","last_unstale":"2023-12-14T14:09:11.627129+0000","last_undegraded":"2023-12-14T14:09:11.627129+0000","last_fullsized":"2023-12-14T14:09:11.627129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:28:57.465267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611142+0000","last_change":"2023-12-14T14:09:10.618373+0000","last_active":"2023-12-14T14:09:11.611142+0000","last_peered":"2023-12-14T14:09:11.611142+0000","last_clean":"2023-12-14T14:09:11.611142+0000","last_became_active":"2023-12-14T14:09:10.618028+0000","last_became_peered":"2023-12-14T14:09:10.618028+0000","last_unstale":"2023-12-14T14:09:11.611142+0000","last_undegraded":"2023-12-14T14:09:11.611142+0000","last_fullsized":"2023-12-14T14:09:11.611142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:56:41.817157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.449871+0000","last_change":"2023-12-14T14:09:10.622775+0000","last_active":"2023-12-14T14:09:12.449871+0000","last_peered":"2023-12-14T14:09:12.449871+0000","last_clean":"2023-12-14T14:09:12.449871+0000","last_became_active":"2023-12-14T14:09:10.622407+0000","last_became_peered":"2023-12-14T14:09:10.622407+0000","last_unstale":"2023-12-14T14:09:12.449871+0000","last_undegraded":"2023-12-14T14:09:12.449871+0000","last_fullsized":"2023-12-14T14:09:12.449871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:58:30.740484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450305+0000","last_change":"2023-12-14T14:09:10.622137+0000","last_active":"2023-12-14T14:09:12.450305+0000","last_peered":"2023-12-14T14:09:12.450305+0000","last_clean":"2023-12-14T14:09:12.450305+0000","last_became_active":"2023-12-14T14:09:10.621829+0000","last_became_peered":"2023-12-14T14:09:10.621829+0000","last_unstale":"2023-12-14T14:09:12.450305+0000","last_undegraded":"2023-12-14T14:09:12.450305+0000","last_fullsized":"2023-12-14T14:09:12.450305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:46:53.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450718+0000","last_change":"2023-12-14T14:09:10.625511+0000","last_active":"2023-12-14T14:09:12.450718+0000","last_peered":"2023-12-14T14:09:12.450718+0000","last_clean":"2023-12-14T14:09:12.450718+0000","last_became_active":"2023-12-14T14:09:10.624863+0000","last_became_peered":"2023-12-14T14:09:10.624863+0000","last_unstale":"2023-12-14T14:09:12.450718+0000","last_undegraded":"2023-12-14T14:09:12.450718+0000","last_fullsized":"2023-12-14T14:09:12.450718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:00:15.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610492+0000","last_change":"2023-12-14T14:09:10.623824+0000","last_active":"2023-12-14T14:09:11.610492+0000","last_peered":"2023-12-14T14:09:11.610492+0000","last_clean":"2023-12-14T14:09:11.610492+0000","last_became_active":"2023-12-14T14:09:10.623482+0000","last_became_peered":"2023-12-14T14:09:10.623482+0000","last_unstale":"2023-12-14T14:09:11.610492+0000","last_undegraded":"2023-12-14T14:09:11.610492+0000","last_fullsized":"2023-12-14T14:09:11.610492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:34:46.976441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611365+0000","last_change":"2023-12-14T14:09:10.618004+0000","last_active":"2023-12-14T14:09:11.611365+0000","last_peered":"2023-12-14T14:09:11.611365+0000","last_clean":"2023-12-14T14:09:11.611365+0000","last_became_active":"2023-12-14T14:09:10.617184+0000","last_became_peered":"2023-12-14T14:09:10.617184+0000","last_unstale":"2023-12-14T14:09:11.611365+0000","last_undegraded":"2023-12-14T14:09:11.611365+0000","last_fullsized":"2023-12-14T14:09:11.611365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:11:15.687914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450821+0000","last_change":"2023-12-14T14:09:10.621183+0000","last_active":"2023-12-14T14:09:12.450821+0000","last_peered":"2023-12-14T14:09:12.450821+0000","last_clean":"2023-12-14T14:09:12.450821+0000","last_became_active":"2023-12-14T14:09:10.620474+0000","last_became_peered":"2023-12-14T14:09:10.620474+0000","last_unstale":"2023-12-14T14:09:12.450821+0000","last_undegraded":"2023-12-14T14:09:12.450821+0000","last_fullsized":"2023-12-14T14:09:12.450821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:36:42.247213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407830+0000","last_change":"2023-12-14T14:09:10.630668+0000","last_active":"2023-12-14T14:09:12.407830+0000","last_peered":"2023-12-14T14:09:12.407830+0000","last_clean":"2023-12-14T14:09:12.407830+0000","last_became_active":"2023-12-14T14:09:10.630337+0000","last_became_peered":"2023-12-14T14:09:10.630337+0000","last_unstale":"2023-12-14T14:09:12.407830+0000","last_undegraded":"2023-12-14T14:09:12.407830+0000","last_fullsized":"2023-12-14T14:09:12.407830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:04:48.631722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.374293+0000","last_change":"2023-12-14T14:09:10.619550+0000","last_active":"2023-12-14T14:09:12.374293+0000","last_peered":"2023-12-14T14:09:12.374293+0000","last_clean":"2023-12-14T14:09:12.374293+0000","last_became_active":"2023-12-14T14:09:10.619029+0000","last_became_peered":"2023-12-14T14:09:10.619029+0000","last_unstale":"2023-12-14T14:09:12.374293+0000","last_undegraded":"2023-12-14T14:09:12.374293+0000","last_fullsized":"2023-12-14T14:09:12.374293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:27:15.911087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.407515+0000","last_change":"2023-12-14T14:09:10.622158+0000","last_active":"2023-12-14T14:09:12.407515+0000","last_peered":"2023-12-14T14:09:12.407515+0000","last_clean":"2023-12-14T14:09:12.407515+0000","last_became_active":"2023-12-14T14:09:10.621853+0000","last_became_peered":"2023-12-14T14:09:10.621853+0000","last_unstale":"2023-12-14T14:09:12.407515+0000","last_undegraded":"2023-12-14T14:09:12.407515+0000","last_fullsized":"2023-12-14T14:09:12.407515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:24:30.913464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:12.450085+0000","last_change":"2023-12-14T14:09:10.627728+0000","last_active":"2023-12-14T14:09:12.450085+0000","last_peered":"2023-12-14T14:09:12.450085+0000","last_clean":"2023-12-14T14:09:12.450085+0000","last_became_active":"2023-12-14T14:09:10.627352+0000","last_became_peered":"2023-12-14T14:09:10.627352+0000","last_unstale":"2023-12-14T14:09:12.450085+0000","last_undegraded":"2023-12-14T14:09:12.450085+0000","last_fullsized":"2023-12-14T14:09:12.450085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:35:42.468155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.610301+0000","last_change":"2023-12-14T14:09:10.625676+0000","last_active":"2023-12-14T14:09:11.610301+0000","last_peered":"2023-12-14T14:09:11.610301+0000","last_clean":"2023-12-14T14:09:11.610301+0000","last_became_active":"2023-12-14T14:09:10.625191+0000","last_became_peered":"2023-12-14T14:09:10.625191+0000","last_unstale":"2023-12-14T14:09:11.610301+0000","last_undegraded":"2023-12-14T14:09:11.610301+0000","last_fullsized":"2023-12-14T14:09:11.610301+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:24:53.447990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-14T14:09:11.611702+0000","last_change":"2023-12-14T14:09:10.624258+0000","last_active":"2023-12-14T14:09:11.611702+0000","last_peered":"2023-12-14T14:09:11.611702+0000","last_clean":"2023-12-14T14:09:11.611702+0000","last_became_active":"2023-12-14T14:09:10.623917+0000","last_became_peered":"2023-12-14T14:09:10.623917+0000","last_unstale":"2023-12-14T14:09:11.611702+0000","last_undegraded":"2023-12-14T14:09:11.611702+0000","last_fullsized":"2023-12-14T14:09:11.611702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:13:30.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60535,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":244,"num_read_kb":188,"num_write":150,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":181605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481810,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5928,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739224,"statfs":{"total":95995035648,"available":95988965376,"internally_reserved":0,"allocated":884736,"data_stored":423998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.432}]},{"osd":1,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.503}]},{"osd":2,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.629},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.61299999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":9,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.76300000000000001}]},{"osd":10,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.71899999999999997}]}]},{"osd":10,"up_from":70,"seq":300647710742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6392,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738760,"statfs":{"total":95995035648,"available":95988490240,"internally_reserved":0,"allocated":1032192,"data_stored":1072068,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.622}]},{"osd":6,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.60899999999999999}]},{"osd":9,"last update":"Thu Dec 14 14:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.53500000000000003}]},{"osd":11,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.71499999999999997}]}]},{"osd":9,"up_from":65,"seq":279172874265,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6072,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739080,"statfs":{"total":95995035648,"available":95988817920,"internally_reserved":0,"allocated":901120,"data_stored":424234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.502},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.375},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60699999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.47999999999999998}]}]},{"osd":8,"up_from":58,"seq":249108103197,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6264,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738888,"statfs":{"total":95995035648,"available":95988621312,"internally_reserved":0,"allocated":901120,"data_stored":424154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81399999999999995,"5min":0.88,"15min":0.88},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.747},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.79700000000000004,"5min":0.875,"15min":0.875},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78700000000000003,"5min":1.411,"15min":1.411},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97299999999999998,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.34899999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90100000000000002,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.66900000000000004,"15min":0.65800000000000003},"min":{"1min":0.50900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.80500000000000005}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.77800000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.82199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":7,"up_from":50,"seq":214748364832,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6376,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738776,"statfs":{"total":95995035648,"available":95988506624,"internally_reserved":0,"allocated":950272,"data_stored":1016383,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.311}]},{"osd":1,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.436,"15min":0.44},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78700000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.628}]},{"osd":3,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66400000000000003},"min":{"1min":0.46800000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.746}]},{"osd":8,"last update":"Thu Dec 14 14:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86899999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.84499999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.877}]},{"osd":10,"last update":"Thu Dec 14 14:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":6,"up_from":45,"seq":193273528356,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738900,"statfs":{"total":95995035648,"available":95988633600,"internally_reserved":0,"allocated":888832,"data_stored":423629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.314,"5min":0.245,"15min":0.245},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.35799999999999998},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.44}]},{"osd":1,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.441,"15min":0.42499999999999999},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.35999999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Dec 14 14:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Dec 14 14:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65600000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":0.995,"15min":0.995},"last":0.625},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90200000000000002,"5min":1.254,"15min":1.254},"last":0.71299999999999997}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81100000000000005,"5min":1.288,"15min":1.288},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57299999999999995}]},{"osd":9,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.67100000000000004}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.72799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7204,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737948,"statfs":{"total":95995035648,"available":95987658752,"internally_reserved":0,"allocated":946176,"data_stored":479657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.503,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71299999999999997,"5min":0.87,"15min":0.87},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68999999999999995,"5min":0.751,"15min":0.751},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.311,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.52800000000000002,"15min":0.505},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.40799999999999997,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.42499999999999999,"15min":0.40699999999999997},"min":{"1min":0.30199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Dec 14 14:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86099999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Dec 14 14:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52800000000000002}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67200000000000004,"15min":0.66100000000000003},"min":{"1min":0.55500000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71499999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57999999999999996}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.626},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56599999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7168,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737984,"statfs":{"total":95995035648,"available":95987695616,"internally_reserved":0,"allocated":909312,"data_stored":424894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.45800000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.54400000000000004,"15min":0.496},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.84899999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.34100000000000003},"min":{"1min":0.29899999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.38600000000000001,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.55700000000000005,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.432}]},{"osd":5,"last update":"Thu Dec 14 14:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.80800000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.36199999999999999}]},{"osd":7,"last update":"Thu Dec 14 14:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.498},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.109,"5min":5.109,"15min":5.109},"last":0.61499999999999999}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.45200000000000001}]},{"osd":10,"last update":"Thu Dec 14 14:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52800000000000002}]},{"osd":11,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.0499999999999998,"5min":5.0499999999999998,"15min":5.0499999999999998},"last":0.64500000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411377,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7352,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737800,"statfs":{"total":95995035648,"available":95987507200,"internally_reserved":0,"allocated":966656,"data_stored":481076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.33600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.49099999999999999,"15min":0.46300000000000002},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.74399999999999999,"5min":0.877,"15min":0.877},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69899999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65800000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.623}]},{"osd":4,"last update":"Thu Dec 14 14:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78600000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81599999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626}]},{"osd":8,"last update":"Thu Dec 14 14:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.504},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56299999999999994}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65700000000000003}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.71399999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":3,"up_from":24,"seq":103079215150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6524,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738628,"statfs":{"total":95995035648,"available":95988355072,"internally_reserved":0,"allocated":905216,"data_stored":423946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.316},"min":{"1min":0.252,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.378},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.505,"15min":0.47999999999999998},"min":{"1min":0.44700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.433}]},{"osd":2,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.45600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.497}]},{"osd":5,"last update":"Thu Dec 14 14:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77900000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.62}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58899999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.40999999999999998}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953514,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6384,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738768,"statfs":{"total":95995035648,"available":95988498432,"internally_reserved":0,"allocated":892928,"data_stored":424402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.498}]},{"osd":1,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.32100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81100000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52700000000000002,"15min":0.51200000000000001},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78000000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.439}]},{"osd":5,"last update":"Thu Dec 14 14:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Dec 14 14:09:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83699999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.378}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72099999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:09:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.49399999999999999}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":5,"up_from":37,"seq":158913789991,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6512,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738640,"statfs":{"total":95995035648,"available":95988367360,"internally_reserved":0,"allocated":958464,"data_stored":1015444,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.505,"15min":0.495},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.438,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.503},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.432,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.38200000000000001,"15min":0.374},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.28899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.498,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.755,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.754}]},{"osd":4,"last update":"Thu Dec 14 14:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.44900000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.876}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.89800000000000002}]},{"osd":9,"last update":"Thu Dec 14 14:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.82199999999999995}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T14:09:55.342 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-14T14:09:55.343 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-14T14:09:55.343 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-14T14:09:55.343 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph health --format=json 2023-12-14T14:09:55.656 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:09:56.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:55 smithi119 ceph-mon[43834]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:09:56.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:55 smithi119 ceph-mon[43834]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:56.025 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:55 smithi069 ceph-mon[42034]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:09:56.025 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:55 smithi069 ceph-mon[42034]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:56.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:55 smithi081 ceph-mon[43371]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:09:56.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:55 smithi081 ceph-mon[43371]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:09:56.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.746+0000 7f9d55f70700 1 -- 172.21.15.69:0/2285525425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 msgr2=0x7f9d50103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:56.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.746+0000 7f9d55f70700 1 --2- 172.21.15.69:0/2285525425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 0x7f9d50103dd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9d440099c0 tx=0x7f9d44009cd0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.746+0000 7f9d55f70700 1 -- 172.21.15.69:0/2285525425 shutdown_connections 2023-12-14T14:09:56.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.746+0000 7f9d55f70700 1 --2- 172.21.15.69:0/2285525425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d50104500 0x7f9d5010c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.746+0000 7f9d55f70700 1 --2- 172.21.15.69:0/2285525425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d500ff460 0x7f9d500ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.746+0000 7f9d55f70700 1 --2- 172.21.15.69:0/2285525425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 0x7f9d50103dd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.746+0000 7f9d55f70700 1 -- 172.21.15.69:0/2285525425 >> 172.21.15.69:0/2285525425 conn(0x7f9d500770a0 msgr2=0x7f9d500774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:56.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.746+0000 7f9d55f70700 1 -- 172.21.15.69:0/2285525425 shutdown_connections 2023-12-14T14:09:56.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.746+0000 7f9d55f70700 1 -- 172.21.15.69:0/2285525425 wait complete. 2023-12-14T14:09:56.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d55f70700 1 Processor -- start 2023-12-14T14:09:56.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d55f70700 1 -- start start 2023-12-14T14:09:56.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d55f70700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d500ff460 0x7f9d5010c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:56.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d55f70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 0x7f9d5010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:56.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d55f70700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d50104500 0x7f9d5010d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d55f70700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d501a4850 con 0x7f9d500ffe00 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d55f70700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d501a49c0 con 0x7f9d500ff460 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d55f70700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d501a4b80 con 0x7f9d50104500 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 0x7f9d5010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 0x7f9d5010ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43014/0 (socket says 172.21.15.69:43014) 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4effd700 1 -- 172.21.15.69:0/3405934900 learned_addr learned my addr 172.21.15.69:0/3405934900 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4ffff700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d50104500 0x7f9d5010d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4f7fe700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d500ff460 0x7f9d5010c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4effd700 1 -- 172.21.15.69:0/3405934900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d50104500 msgr2=0x7f9d5010d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4effd700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d50104500 0x7f9d5010d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4effd700 1 -- 172.21.15.69:0/3405934900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d500ff460 msgr2=0x7f9d5010c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4effd700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d500ff460 0x7f9d5010c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4effd700 1 -- 172.21.15.69:0/3405934900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440095f0 con 0x7f9d500ffe00 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.747+0000 7f9d4f7fe700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d500ff460 0x7f9d5010c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.748+0000 7f9d4effd700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 0x7f9d5010ced0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009990 tx=0x7f9d44005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.748+0000 7f9d4cff9700 1 -- 172.21.15.69:0/3405934900 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4401d070 con 0x7f9d500ffe00 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.748+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d501103e0 con 0x7f9d500ffe00 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.748+0000 7f9d4cff9700 1 -- 172.21.15.69:0/3405934900 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d44004090 con 0x7f9d500ffe00 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.748+0000 7f9d4cff9700 1 -- 172.21.15.69:0/3405934900 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44022d20 con 0x7f9d500ffe00 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.748+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d50110250 con 0x7f9d500ffe00 2023-12-14T14:09:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.749+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d50110570 con 0x7f9d500ffe00 2023-12-14T14:09:56.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.750+0000 7f9d4cff9700 1 -- 172.21.15.69:0/3405934900 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9d44022470 con 0x7f9d500ffe00 2023-12-14T14:09:56.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.750+0000 7f9d4cff9700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d380a11e0 0x7f9d380a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:56.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.750+0000 7f9d4f7fe700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d380a11e0 0x7f9d380a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:56.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.751+0000 7f9d4cff9700 1 -- 172.21.15.69:0/3405934900 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9d440cdf80 con 0x7f9d500ffe00 2023-12-14T14:09:56.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.751+0000 7f9d4f7fe700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d380a11e0 0x7f9d380a3690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d40005fd0 tx=0x7f9d40005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:56.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.754+0000 7f9d4cff9700 1 -- 172.21.15.69:0/3405934900 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9d440976b0 con 0x7f9d500ffe00 2023-12-14T14:09:56.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.986+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9d501a4d40 con 0x7f9d500ffe00 2023-12-14T14:09:56.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.986+0000 7f9d4cff9700 1 -- 172.21.15.69:0/3405934900 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9d4409acd0 con 0x7f9d500ffe00 2023-12-14T14:09:56.986 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:56.986 INFO:teuthology.orchestra.run.smithi069.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-14T14:09:56.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d380a11e0 msgr2=0x7f9d380a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:56.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d380a11e0 0x7f9d380a3690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d40005fd0 tx=0x7f9d40005ee0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 msgr2=0x7f9d5010ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:56.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 0x7f9d5010ced0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009990 tx=0x7f9d44005e80 comp rx=0 tx=0).stop 2023-12-14T14:09:56.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 shutdown_connections 2023-12-14T14:09:56.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d380a11e0 0x7f9d380a3690 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d50104500 0x7f9d5010d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d500ff460 0x7f9d5010c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 --2- 172.21.15.69:0/3405934900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d500ffe00 0x7f9d5010ced0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:56.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 >> 172.21.15.69:0/3405934900 conn(0x7f9d500770a0 msgr2=0x7f9d500fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:56.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 shutdown_connections 2023-12-14T14:09:56.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:56.988+0000 7f9d55f70700 1 -- 172.21.15.69:0/3405934900 wait complete. 2023-12-14T14:09:57.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:57 smithi069 ceph-mon[42034]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T14:09:57.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:57 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3405934900' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-14T14:09:57.383 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-14T14:09:57.384 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:09:57.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.511+0000 7f05f65ee700 1 -- 172.21.15.69:0/3624750230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0100ce0 msgr2=0x7f05f01030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:57.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.511+0000 7f05f65ee700 1 --2- 172.21.15.69:0/3624750230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0100ce0 0x7f05f01030c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009990 tx=0x7f05e4009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.511+0000 7f05f65ee700 1 -- 172.21.15.69:0/3624750230 shutdown_connections 2023-12-14T14:09:57.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.511+0000 7f05f65ee700 1 --2- 172.21.15.69:0/3624750230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f0105f20 0x7f05f0108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.511+0000 7f05f65ee700 1 --2- 172.21.15.69:0/3624750230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0100ce0 0x7f05f01030c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.511+0000 7f05f65ee700 1 --2- 172.21.15.69:0/3624750230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05f0103600 0x7f05f01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.511+0000 7f05f65ee700 1 -- 172.21.15.69:0/3624750230 >> 172.21.15.69:0/3624750230 conn(0x7f05f00fa780 msgr2=0x7f05f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.511+0000 7f05f65ee700 1 -- 172.21.15.69:0/3624750230 shutdown_connections 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.511+0000 7f05f65ee700 1 -- 172.21.15.69:0/3624750230 wait complete. 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f65ee700 1 Processor -- start 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f65ee700 1 -- start start 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f65ee700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f0100ce0 0x7f05f0195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f65ee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0103600 0x7f05f0196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f65ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05f0105f20 0x7f05f019d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f65ee700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f019db60 con 0x7f05f0103600 2023-12-14T14:09:57.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f65ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f019dca0 con 0x7f05f0105f20 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f65ee700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f019de30 con 0x7f05f0100ce0 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05ef7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0103600 0x7f05f0196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05ef7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0103600 0x7f05f0196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43028/0 (socket says 172.21.15.69:43028) 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05ef7fe700 1 -- 172.21.15.69:0/4194074526 learned_addr learned my addr 172.21.15.69:0/4194074526 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f4b8b700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05f0105f20 0x7f05f019d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05ef7fe700 1 -- 172.21.15.69:0/4194074526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f0100ce0 msgr2=0x7f05f0195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05effff700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f0100ce0 0x7f05f0195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05ef7fe700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f0100ce0 0x7f05f0195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05ef7fe700 1 -- 172.21.15.69:0/4194074526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05f0105f20 msgr2=0x7f05f019d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05ef7fe700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05f0105f20 0x7f05f019d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05ef7fe700 1 -- 172.21.15.69:0/4194074526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e40095f0 con 0x7f05f0103600 2023-12-14T14:09:57.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.512+0000 7f05f4b8b700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05f0105f20 0x7f05f019d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:57.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.513+0000 7f05ef7fe700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0103600 0x7f05f0196520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f05e000c920 tx=0x7f05e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:57.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.513+0000 7f05ed7fa700 1 -- 172.21.15.69:0/4194074526 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0007b00 con 0x7f05f0103600 2023-12-14T14:09:57.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.513+0000 7f05ed7fa700 1 -- 172.21.15.69:0/4194074526 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05e0004cf0 con 0x7f05f0103600 2023-12-14T14:09:57.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.513+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f010bc10 con 0x7f05f0103600 2023-12-14T14:09:57.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.513+0000 7f05ed7fa700 1 -- 172.21.15.69:0/4194074526 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0005610 con 0x7f05f0103600 2023-12-14T14:09:57.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.513+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f010ba80 con 0x7f05f0103600 2023-12-14T14:09:57.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.514+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f00fc2f0 con 0x7f05f0103600 2023-12-14T14:09:57.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.515+0000 7f05ed7fa700 1 -- 172.21.15.69:0/4194074526 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f05e0004750 con 0x7f05f0103600 2023-12-14T14:09:57.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.515+0000 7f05ed7fa700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f05d80a11e0 0x7f05d80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:57.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.515+0000 7f05ed7fa700 1 -- 172.21.15.69:0/4194074526 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f05e00cc900 con 0x7f05f0103600 2023-12-14T14:09:57.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.515+0000 7f05effff700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f05d80a11e0 0x7f05d80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:57.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.516+0000 7f05effff700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f05d80a11e0 0x7f05d80a3690 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05e4005f50 tx=0x7f05e4005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:57.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.519+0000 7f05ed7fa700 1 -- 172.21.15.69:0/4194074526 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f05e00960a0 con 0x7f05f0103600 2023-12-14T14:09:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:57 smithi119 ceph-mon[43834]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T14:09:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:57 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3405934900' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-14T14:09:57.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:57 smithi081 ceph-mon[43371]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T14:09:57.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:57 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3405934900' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-14T14:09:57.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.707+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05f002cfe0 con 0x7f05f0103600 2023-12-14T14:09:57.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.708+0000 7f05ed7fa700 1 -- 172.21.15.69:0/4194074526 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22096 (secure 0 0 0) 0x7f05e001d020 con 0x7f05f0103600 2023-12-14T14:09:57.708 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:57.708 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":82,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:09:11.600086+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:09:57.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.710+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f05d80a11e0 msgr2=0x7f05d80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:57.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.710+0000 7f05f65ee700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f05d80a11e0 0x7f05d80a3690 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05e4005f50 tx=0x7f05e4005e80 comp rx=0 tx=0).stop 2023-12-14T14:09:57.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.710+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0103600 msgr2=0x7f05f0196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:57.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.710+0000 7f05f65ee700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0103600 0x7f05f0196520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f05e000c920 tx=0x7f05e000cce0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.711+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 shutdown_connections 2023-12-14T14:09:57.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.711+0000 7f05f65ee700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f05d80a11e0 0x7f05d80a3690 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.711+0000 7f05f65ee700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05f0105f20 0x7f05f019d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.711+0000 7f05f65ee700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f0100ce0 0x7f05f0195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.711+0000 7f05f65ee700 1 --2- 172.21.15.69:0/4194074526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05f0103600 0x7f05f0196520 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.711+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 >> 172.21.15.69:0/4194074526 conn(0x7f05f00fa780 msgr2=0x7f05f0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:57.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.711+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 shutdown_connections 2023-12-14T14:09:57.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.711+0000 7f05f65ee700 1 -- 172.21.15.69:0/4194074526 wait complete. 2023-12-14T14:09:57.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T14:09:08.720147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T14:09:09.776845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:09:57.723 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:09:57.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.849+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/1152800942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ffd20 msgr2=0x7f6dc01075d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.849+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/1152800942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ffd20 0x7f6dc01075d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6db800b0a0 tx=0x7f6db800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.849+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/1152800942 shutdown_connections 2023-12-14T14:09:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.849+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/1152800942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ffd20 0x7f6dc01075d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.849+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/1152800942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc0100720 0x7f6dc0100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.849+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/1152800942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc00ff370 0x7f6dc00ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.849+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/1152800942 >> 172.21.15.69:0/1152800942 conn(0x7f6dc00f9ed0 msgr2=0x7f6dc00fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.849+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/1152800942 shutdown_connections 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.849+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/1152800942 wait complete. 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc6fd9700 1 Processor -- start 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc6fd9700 1 -- start start 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc6fd9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ff370 0x7f6dc0103120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc6fd9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc00ffd20 0x7f6dc0101760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc6fd9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0100720 0x7f6dc0101ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc6fd9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc0102440 con 0x7f6dc00ff370 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc6fd9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc01025b0 con 0x7f6dc00ffd20 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc6fd9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc01a0120 con 0x7f6dc0100720 2023-12-14T14:09:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc4d75700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ff370 0x7f6dc0103120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc4d75700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ff370 0x7f6dc0103120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43042/0 (socket says 172.21.15.69:43042) 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc4d75700 1 -- 172.21.15.69:0/3019791318 learned_addr learned my addr 172.21.15.69:0/3019791318 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dbffff700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc00ffd20 0x7f6dc0101760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc5576700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0100720 0x7f6dc0101ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc4d75700 1 -- 172.21.15.69:0/3019791318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0100720 msgr2=0x7f6dc0101ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc4d75700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0100720 0x7f6dc0101ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc4d75700 1 -- 172.21.15.69:0/3019791318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc00ffd20 msgr2=0x7f6dc0101760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc4d75700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc00ffd20 0x7f6dc0101760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc4d75700 1 -- 172.21.15.69:0/3019791318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8009d00 con 0x7f6dc00ff370 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dbffff700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc00ffd20 0x7f6dc0101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc5576700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0100720 0x7f6dc0101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:09:57.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc4d75700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ff370 0x7f6dc0103120 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c990 tx=0x7f6db400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:57.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dbdffb700 1 -- 172.21.15.69:0/3019791318 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4007b00 con 0x7f6dc00ff370 2023-12-14T14:09:57.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dbdffb700 1 -- 172.21.15.69:0/3019791318 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6db4007c60 con 0x7f6dc00ff370 2023-12-14T14:09:57.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc010aae0 con 0x7f6dc00ff370 2023-12-14T14:09:57.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.850+0000 7f6dbdffb700 1 -- 172.21.15.69:0/3019791318 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4018660 con 0x7f6dc00ff370 2023-12-14T14:09:57.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.851+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc010a950 con 0x7f6dc00ff370 2023-12-14T14:09:57.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.851+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc01a0870 con 0x7f6dc00ff370 2023-12-14T14:09:57.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.852+0000 7f6dbdffb700 1 -- 172.21.15.69:0/3019791318 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6db400f450 con 0x7f6dc00ff370 2023-12-14T14:09:57.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.853+0000 7f6dbdffb700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6db00a1260 0x7f6db00a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:57.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.853+0000 7f6dbdffb700 1 -- 172.21.15.69:0/3019791318 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6db40cc970 con 0x7f6dc00ff370 2023-12-14T14:09:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.853+0000 7f6dbffff700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6db00a1260 0x7f6db00a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.853+0000 7f6dbffff700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6db00a1260 0x7f6db00a3710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6dac005950 tx=0x7f6dac005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:57.857+0000 7f6dbdffb700 1 -- 172.21.15.69:0/3019791318 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6db4096010 con 0x7f6dc00ff370 2023-12-14T14:09:58.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.045+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6dc01a0e20 con 0x7f6dc00ff370 2023-12-14T14:09:58.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.045+0000 7f6dbdffb700 1 -- 172.21.15.69:0/3019791318 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6db4099630 con 0x7f6dc00ff370 2023-12-14T14:09:58.045 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:09:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6db00a1260 msgr2=0x7f6db00a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6db00a1260 0x7f6db00a3710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6dac005950 tx=0x7f6dac005f50 comp rx=0 tx=0).stop 2023-12-14T14:09:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ff370 msgr2=0x7f6dc0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ff370 0x7f6dc0103120 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c990 tx=0x7f6db400cd50 comp rx=0 tx=0).stop 2023-12-14T14:09:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 shutdown_connections 2023-12-14T14:09:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6db00a1260 0x7f6db00a3710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0100720 0x7f6dc0101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dc00ff370 0x7f6dc0103120 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 --2- 172.21.15.69:0/3019791318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc00ffd20 0x7f6dc0101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 >> 172.21.15.69:0/3019791318 conn(0x7f6dc00f9ed0 msgr2=0x7f6dc00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 shutdown_connections 2023-12-14T14:09:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.047+0000 7f6dc6fd9700 1 -- 172.21.15.69:0/3019791318 wait complete. 2023-12-14T14:09:58.059 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T14:09:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.185+0000 7fcef1d7b700 1 -- 172.21.15.69:0/2055783330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec100310 msgr2=0x7fceec100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.185+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/2055783330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec100310 0x7fceec100760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009990 tx=0x7fcee0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.185+0000 7fcef1d7b700 1 -- 172.21.15.69:0/2055783330 shutdown_connections 2023-12-14T14:09:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.185+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/2055783330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec100ca0 0x7fceec107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.185+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/2055783330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec0ff120 0x7fceec0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.185+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/2055783330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec100310 0x7fceec100760 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.185+0000 7fcef1d7b700 1 -- 172.21.15.69:0/2055783330 >> 172.21.15.69:0/2055783330 conn(0x7fceec0fa740 msgr2=0x7fceec0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.185+0000 7fcef1d7b700 1 -- 172.21.15.69:0/2055783330 shutdown_connections 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.185+0000 7fcef1d7b700 1 -- 172.21.15.69:0/2055783330 wait complete. 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fcef1d7b700 1 Processor -- start 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fcef1d7b700 1 -- start start 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fcef1d7b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec0ff120 0x7fceec069b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fcef1d7b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec100310 0x7fceec19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fcef1d7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec100ca0 0x7fceec19d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fcef1d7b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec19db10 con 0x7fceec0ff120 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fcef1d7b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec19dc80 con 0x7fceec100ca0 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fcef1d7b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec19de40 con 0x7fceec100310 2023-12-14T14:09:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceeb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec0ff120 0x7fceec069b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceeb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec0ff120 0x7fceec069b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43062/0 (socket says 172.21.15.69:43062) 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceeb7fe700 1 -- 172.21.15.69:0/297622048 learned_addr learned my addr 172.21.15.69:0/297622048 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceeaffd700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec100310 0x7fceec19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceebfff700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec100ca0 0x7fceec19d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceeb7fe700 1 -- 172.21.15.69:0/297622048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec100310 msgr2=0x7fceec19ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceeb7fe700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec100310 0x7fceec19ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceeb7fe700 1 -- 172.21.15.69:0/297622048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec100ca0 msgr2=0x7fceec19d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceeb7fe700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec100ca0 0x7fceec19d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceeb7fe700 1 -- 172.21.15.69:0/297622048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00095f0 con 0x7fceec0ff120 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.186+0000 7fceebfff700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec100ca0 0x7fceec19d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:09:58.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.187+0000 7fceeb7fe700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec0ff120 0x7fceec069b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcedc007f10 tx=0x7fcedc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.187+0000 7fcee8ff9700 1 -- 172.21.15.69:0/297622048 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc017070 con 0x7fceec0ff120 2023-12-14T14:09:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.187+0000 7fcee8ff9700 1 -- 172.21.15.69:0/297622048 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcedc00f040 con 0x7fceec0ff120 2023-12-14T14:09:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.187+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec10aad0 con 0x7fceec0ff120 2023-12-14T14:09:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.187+0000 7fcee8ff9700 1 -- 172.21.15.69:0/297622048 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc004630 con 0x7fceec0ff120 2023-12-14T14:09:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.187+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec10a940 con 0x7fceec0ff120 2023-12-14T14:09:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.188+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec1060a0 con 0x7fceec0ff120 2023-12-14T14:09:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.189+0000 7fcee8ff9700 1 -- 172.21.15.69:0/297622048 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fcedc004790 con 0x7fceec0ff120 2023-12-14T14:09:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.190+0000 7fcee8ff9700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fced40a11e0 0x7fced40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.190+0000 7fceeaffd700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fced40a11e0 0x7fced40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.190+0000 7fcee8ff9700 1 -- 172.21.15.69:0/297622048 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcedc0cc680 con 0x7fceec0ff120 2023-12-14T14:09:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.190+0000 7fceeaffd700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fced40a11e0 0x7fced40a3690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcee000b5c0 tx=0x7fcee0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.193+0000 7fcee8ff9700 1 -- 172.21.15.69:0/297622048 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fcedc095e20 con 0x7fceec0ff120 2023-12-14T14:09:58.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:58 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4194074526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:58.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:58 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3019791318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:09:58.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.386+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fceec0619b0 con 0x7fceec0ff120 2023-12-14T14:09:58.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.386+0000 7fcee8ff9700 1 -- 172.21.15.69:0/297622048 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcedc099440 con 0x7fceec0ff120 2023-12-14T14:09:58.386 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T14:09:58.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fced40a11e0 msgr2=0x7fced40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fced40a11e0 0x7fced40a3690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcee000b5c0 tx=0x7fcee0005fb0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec0ff120 msgr2=0x7fceec069b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec0ff120 0x7fceec069b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcedc007f10 tx=0x7fcedc00d3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 shutdown_connections 2023-12-14T14:09:58.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fced40a11e0 0x7fced40a3690 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec100ca0 0x7fceec19d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fceec0ff120 0x7fceec069b90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 --2- 172.21.15.69:0/297622048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec100310 0x7fceec19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 >> 172.21.15.69:0/297622048 conn(0x7fceec0fa740 msgr2=0x7fceec0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:58.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 shutdown_connections 2023-12-14T14:09:58.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.388+0000 7fcef1d7b700 1 -- 172.21.15.69:0/297622048 wait complete. 2023-12-14T14:09:58.400 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T14:09:58.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:58 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4194074526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:58.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:58 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3019791318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:09:58.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.527+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/1607919393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a40ff130 msgr2=0x7fb8a40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.527+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/1607919393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a40ff130 0x7fb8a40ff540 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009990 tx=0x7fb8a0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.527+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/1607919393 shutdown_connections 2023-12-14T14:09:58.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.527+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/1607919393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a4100cb0 0x7fb8a4107570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.527+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/1607919393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a40ff130 0x7fb8a40ff540 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.527+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/1607919393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4100320 0x7fb8a4100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.527+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/1607919393 >> 172.21.15.69:0/1607919393 conn(0x7fb8a40fa750 msgr2=0x7fb8a40fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:58.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.527+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/1607919393 shutdown_connections 2023-12-14T14:09:58.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/1607919393 wait complete. 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8ac5f2700 1 Processor -- start 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8ac5f2700 1 -- start start 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8ac5f2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40ff130 0x7fb8a4069af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8ac5f2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a4100320 0x7fb8a419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8ac5f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4100cb0 0x7fb8a419d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8ac5f2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a419dc40 con 0x7fb8a4100320 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8ac5f2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a419ddb0 con 0x7fb8a4100cb0 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8ac5f2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a419df70 con 0x7fb8a40ff130 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8a9b8d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a4100320 0x7fb8a419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8a9b8d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a4100320 0x7fb8a419ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43070/0 (socket says 172.21.15.69:43070) 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8a9b8d700 1 -- 172.21.15.69:0/929715990 learned_addr learned my addr 172.21.15.69:0/929715990 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.528+0000 7fb8aa38e700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40ff130 0x7fb8a4069af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb8a9b8d700 1 -- 172.21.15.69:0/929715990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40ff130 msgr2=0x7fb8a4069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb8a9b8d700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40ff130 0x7fb8a4069af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb8a9b8d700 1 -- 172.21.15.69:0/929715990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4100cb0 msgr2=0x7fb8a419d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb8aab8f700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4100cb0 0x7fb8a419d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb8a9b8d700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4100cb0 0x7fb8a419d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb8a9b8d700 1 -- 172.21.15.69:0/929715990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a00095f0 con 0x7fb8a4100320 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb8a9b8d700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a4100320 0x7fb8a419ae60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb89400b530 tx=0x7fb89400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:58.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb89b7fe700 1 -- 172.21.15.69:0/929715990 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894011830 con 0x7fb8a4100320 2023-12-14T14:09:58.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb89b7fe700 1 -- 172.21.15.69:0/929715990 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb894011e50 con 0x7fb8a4100320 2023-12-14T14:09:58.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a410ab90 con 0x7fb8a4100320 2023-12-14T14:09:58.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb89b7fe700 1 -- 172.21.15.69:0/929715990 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400f2e0 con 0x7fb8a4100320 2023-12-14T14:09:58.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.529+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a410aa00 con 0x7fb8a4100320 2023-12-14T14:09:58.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.530+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a419e740 con 0x7fb8a4100320 2023-12-14T14:09:58.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.531+0000 7fb89b7fe700 1 -- 172.21.15.69:0/929715990 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb894010380 con 0x7fb8a4100320 2023-12-14T14:09:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.532+0000 7fb89b7fe700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb8900a11e0 0x7fb8900a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.532+0000 7fb8aa38e700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb8900a11e0 0x7fb8900a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.532+0000 7fb89b7fe700 1 -- 172.21.15.69:0/929715990 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb8940cc9e0 con 0x7fb8a4100320 2023-12-14T14:09:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.532+0000 7fb8aa38e700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb8900a11e0 0x7fb8900a3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000b5c0 tx=0x7fb8a0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.536+0000 7fb89b7fe700 1 -- 172.21.15.69:0/929715990 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb894096190 con 0x7fb8a4100320 2023-12-14T14:09:58.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:58 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4194074526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:09:58.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:58 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3019791318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:09:58.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.729+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8a4106080 con 0x7fb8a4100320 2023-12-14T14:09:58.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.730+0000 7fb89b7fe700 1 -- 172.21.15.69:0/929715990 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8940997b0 con 0x7fb8a4100320 2023-12-14T14:09:58.729 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T14:09:58.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb8900a11e0 msgr2=0x7fb8900a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb8900a11e0 0x7fb8900a3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000b5c0 tx=0x7fb8a0005960 comp rx=0 tx=0).stop 2023-12-14T14:09:58.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a4100320 msgr2=0x7fb8a419ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a4100320 0x7fb8a419ae60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb89400b530 tx=0x7fb89400b840 comp rx=0 tx=0).stop 2023-12-14T14:09:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 shutdown_connections 2023-12-14T14:09:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb8900a11e0 0x7fb8900a3690 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4100cb0 0x7fb8a419d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40ff130 0x7fb8a4069af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 --2- 172.21.15.69:0/929715990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8a4100320 0x7fb8a419ae60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 >> 172.21.15.69:0/929715990 conn(0x7fb8a40fa750 msgr2=0x7fb8a40fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 shutdown_connections 2023-12-14T14:09:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.732+0000 7fb8ac5f2700 1 -- 172.21.15.69:0/929715990 wait complete. 2023-12-14T14:09:58.743 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:09:58.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 -- 172.21.15.69:0/3793899994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101de0 msgr2=0x7f46781086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 --2- 172.21.15.69:0/3793899994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101de0 0x7f46781086a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f467000b0a0 tx=0x7f467000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 -- 172.21.15.69:0/3793899994 shutdown_connections 2023-12-14T14:09:58.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 --2- 172.21.15.69:0/3793899994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101de0 0x7f46781086a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 --2- 172.21.15.69:0/3793899994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4678100260 0x7f4678100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 --2- 172.21.15.69:0/3793899994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678101450 0x7f46781018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 -- 172.21.15.69:0/3793899994 >> 172.21.15.69:0/3793899994 conn(0x7f46780fb880 msgr2=0x7f46780fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:58.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 -- 172.21.15.69:0/3793899994 shutdown_connections 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 -- 172.21.15.69:0/3793899994 wait complete. 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 Processor -- start 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 -- start start 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678100260 0x7f4678198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101450 0x7f46781987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4678101de0 0x7f467819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467819fe10 con 0x7f4678101450 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467819ff50 con 0x7f4678100260 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f467ee5d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46781a00e0 con 0x7f4678101de0 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f4677fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101450 0x7f46781987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f4677fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101450 0x7f46781987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43094/0 (socket says 172.21.15.69:43094) 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.867+0000 7f4677fff700 1 -- 172.21.15.69:0/2785607524 learned_addr learned my addr 172.21.15.69:0/2785607524 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f467cbf9700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678100260 0x7f4678198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f467d3fa700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4678101de0 0x7f467819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f4677fff700 1 -- 172.21.15.69:0/2785607524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4678101de0 msgr2=0x7f467819f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f4677fff700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4678101de0 0x7f467819f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f4677fff700 1 -- 172.21.15.69:0/2785607524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678100260 msgr2=0x7f4678198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f4677fff700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678100260 0x7f4678198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f4677fff700 1 -- 172.21.15.69:0/2785607524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670009d00 con 0x7f4678101450 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f4677fff700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101450 0x7f46781987d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f466400e9a0 tx=0x7f466400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:58.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f4675ffb700 1 -- 172.21.15.69:0/2785607524 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664009790 con 0x7f4678101450 2023-12-14T14:09:58.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f4675ffb700 1 -- 172.21.15.69:0/2785607524 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4664010430 con 0x7f4678101450 2023-12-14T14:09:58.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f4675ffb700 1 -- 172.21.15.69:0/2785607524 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664018680 con 0x7f4678101450 2023-12-14T14:09:58.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467810bbe0 con 0x7f4678101450 2023-12-14T14:09:58.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.868+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467810ba50 con 0x7f4678101450 2023-12-14T14:09:58.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.869+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46781a0780 con 0x7f4678101450 2023-12-14T14:09:58.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.870+0000 7f4675ffb700 1 -- 172.21.15.69:0/2785607524 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f46640105a0 con 0x7f4678101450 2023-12-14T14:09:58.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.871+0000 7f4675ffb700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f46680a11e0 0x7f46680a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:58.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.871+0000 7f467cbf9700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f46680a11e0 0x7f46680a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:58.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.871+0000 7f4675ffb700 1 -- 172.21.15.69:0/2785607524 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4664014070 con 0x7f4678101450 2023-12-14T14:09:58.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.871+0000 7f467cbf9700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f46680a11e0 0x7f46680a3690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f46781012b0 tx=0x7f466c007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:58.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:58.874+0000 7f4675ffb700 1 -- 172.21.15.69:0/2785607524 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4664096390 con 0x7f4678101450 2023-12-14T14:09:59.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.105+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46781a0d30 con 0x7f4678101450 2023-12-14T14:09:59.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.105+0000 7f4675ffb700 1 -- 172.21.15.69:0/2785607524 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f46640999b0 con 0x7f4678101450 2023-12-14T14:09:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:59.105 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:09:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.107+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f46680a11e0 msgr2=0x7f46680a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f46680a11e0 0x7f46680a3690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f46781012b0 tx=0x7f466c007400 comp rx=0 tx=0).stop 2023-12-14T14:09:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101450 msgr2=0x7f46781987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101450 0x7f46781987d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f466400e9a0 tx=0x7f466400ecb0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 shutdown_connections 2023-12-14T14:09:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f46680a11e0 0x7f46680a3690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4678101de0 0x7f467819f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678100260 0x7f4678198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 --2- 172.21.15.69:0/2785607524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4678101450 0x7f46781987d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 >> 172.21.15.69:0/2785607524 conn(0x7f46780fb880 msgr2=0x7f4678106c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:59.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 shutdown_connections 2023-12-14T14:09:59.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.108+0000 7f467ee5d700 1 -- 172.21.15.69:0/2785607524 wait complete. 2023-12-14T14:09:59.109 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:09:59.120 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:09:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.242+0000 7f649807e700 1 -- 172.21.15.69:0/1064401610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 msgr2=0x7f6490108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.242+0000 7f649807e700 1 --2- 172.21.15.69:0/1064401610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 0x7f6490108330 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6488009990 tx=0x7f6488009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.242+0000 7f649807e700 1 -- 172.21.15.69:0/1064401610 shutdown_connections 2023-12-14T14:09:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.242+0000 7f649807e700 1 --2- 172.21.15.69:0/1064401610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 0x7f6490108330 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.242+0000 7f649807e700 1 --2- 172.21.15.69:0/1064401610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6490100c90 0x7f6490103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.242+0000 7f649807e700 1 --2- 172.21.15.69:0/1064401610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64901035b0 0x7f6490105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.242+0000 7f649807e700 1 -- 172.21.15.69:0/1064401610 >> 172.21.15.69:0/1064401610 conn(0x7f64900fa6f0 msgr2=0x7f64900fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.242+0000 7f649807e700 1 -- 172.21.15.69:0/1064401610 shutdown_connections 2023-12-14T14:09:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.242+0000 7f649807e700 1 -- 172.21.15.69:0/1064401610 wait complete. 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649807e700 1 Processor -- start 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649807e700 1 -- start start 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649807e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6490100c90 0x7f6490100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649807e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64901035b0 0x7f64900fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649807e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 0x7f64900ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649807e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900ff920 con 0x7f6490105ed0 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649807e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900ffa90 con 0x7f64901035b0 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649807e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649019ff50 con 0x7f6490100c90 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649661b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 0x7f64900ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649661b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 0x7f64900ff180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43106/0 (socket says 172.21.15.69:43106) 2023-12-14T14:09:59.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649661b700 1 -- 172.21.15.69:0/434105531 learned_addr learned my addr 172.21.15.69:0/434105531 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f6495619700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64901035b0 0x7f64900fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f6495e1a700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6490100c90 0x7f6490100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649661b700 1 -- 172.21.15.69:0/434105531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6490100c90 msgr2=0x7f6490100600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649661b700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6490100c90 0x7f6490100600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649661b700 1 -- 172.21.15.69:0/434105531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64901035b0 msgr2=0x7f64900fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649661b700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64901035b0 0x7f64900fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649661b700 1 -- 172.21.15.69:0/434105531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880095f0 con 0x7f6490105ed0 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f649661b700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 0x7f64900ff180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6488005910 tx=0x7f648800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f6486ffd700 1 -- 172.21.15.69:0/434105531 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648801d070 con 0x7f6490105ed0 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.243+0000 7f6486ffd700 1 -- 172.21.15.69:0/434105531 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64880047e0 con 0x7f6490105ed0 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.244+0000 7f6486ffd700 1 -- 172.21.15.69:0/434105531 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488005340 con 0x7f6490105ed0 2023-12-14T14:09:59.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.244+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649010bbd0 con 0x7f6490105ed0 2023-12-14T14:09:59.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.244+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649010ba40 con 0x7f6490105ed0 2023-12-14T14:09:59.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.244+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64900fc260 con 0x7f6490105ed0 2023-12-14T14:09:59.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.246+0000 7f6486ffd700 1 -- 172.21.15.69:0/434105531 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6488004950 con 0x7f6490105ed0 2023-12-14T14:09:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.246+0000 7f6486ffd700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f647c0a1260 0x7f647c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.246+0000 7f6495e1a700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f647c0a1260 0x7f647c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.246+0000 7f6486ffd700 1 -- 172.21.15.69:0/434105531 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f64880cdd50 con 0x7f6490105ed0 2023-12-14T14:09:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.246+0000 7f6495e1a700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f647c0a1260 0x7f647c0a3710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f648c009550 tx=0x7f648c0091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.250+0000 7f6486ffd700 1 -- 172.21.15.69:0/434105531 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6488097480 con 0x7f6490105ed0 2023-12-14T14:09:59.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.439+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f649002cfe0 con 0x7f6490105ed0 2023-12-14T14:09:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.441+0000 7f6486ffd700 1 -- 172.21.15.69:0/434105531 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22096 (secure 0 0 0) 0x7f6488026090 con 0x7f6490105ed0 2023-12-14T14:09:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:09:59.441 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":82,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:09:11.600086+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:09:59.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f647c0a1260 msgr2=0x7f647c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f647c0a1260 0x7f647c0a3710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f648c009550 tx=0x7f648c0091b0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 msgr2=0x7f64900ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 0x7f64900ff180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6488005910 tx=0x7f648800f690 comp rx=0 tx=0).stop 2023-12-14T14:09:59.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 shutdown_connections 2023-12-14T14:09:59.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f647c0a1260 0x7f647c0a3710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6490105ed0 0x7f64900ff180 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6490100c90 0x7f6490100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 --2- 172.21.15.69:0/434105531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64901035b0 0x7f64900fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 >> 172.21.15.69:0/434105531 conn(0x7f64900fa6f0 msgr2=0x7f64901018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:59.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 shutdown_connections 2023-12-14T14:09:59.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.443+0000 7f649807e700 1 -- 172.21.15.69:0/434105531 wait complete. 2023-12-14T14:09:59.453 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:59 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/297622048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:09:59.453 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:59 smithi069 ceph-mon[42034]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:09:59.454 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:59 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/929715990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:09:59.454 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:09:59 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2785607524' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:59.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T14:09:08.720147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T14:09:09.776845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:09:59.455 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:09:59.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:59 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/297622048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:09:59.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:59 smithi119 ceph-mon[43834]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:09:59.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:59 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/929715990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:09:59.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:09:59 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2785607524' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:59.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 -- 172.21.15.69:0/3679258529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c1014a0 msgr2=0x7f255c1018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 --2- 172.21.15.69:0/3679258529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c1014a0 0x7f255c1018f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2550009990 tx=0x7f2550009ca0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 -- 172.21.15.69:0/3679258529 shutdown_connections 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 --2- 172.21.15.69:0/3679258529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255c101e30 0x7f255c1086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 --2- 172.21.15.69:0/3679258529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f255c0fe4d0 0x7f255c0fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 --2- 172.21.15.69:0/3679258529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c1014a0 0x7f255c1018f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 -- 172.21.15.69:0/3679258529 >> 172.21.15.69:0/3679258529 conn(0x7f255c0f9ed0 msgr2=0x7f255c0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 -- 172.21.15.69:0/3679258529 shutdown_connections 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 -- 172.21.15.69:0/3679258529 wait complete. 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 Processor -- start 2023-12-14T14:09:59.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.581+0000 7f2561663700 1 -- start start 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2561663700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c0fe4d0 0x7f255c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2561663700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255c1014a0 0x7f255c196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2561663700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f255c101e30 0x7f255c19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2561663700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c19db70 con 0x7f255c0fe4d0 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2561663700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c19dcb0 con 0x7f255c1014a0 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2561663700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c19de40 con 0x7f255c101e30 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c0fe4d0 0x7f255c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c0fe4d0 0x7f255c195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43124/0 (socket says 172.21.15.69:43124) 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255affd700 1 -- 172.21.15.69:0/2623038994 learned_addr learned my addr 172.21.15.69:0/2623038994 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255a7fc700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255c1014a0 0x7f255c196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255b7fe700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f255c101e30 0x7f255c19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255affd700 1 -- 172.21.15.69:0/2623038994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f255c101e30 msgr2=0x7f255c19d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255affd700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f255c101e30 0x7f255c19d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255affd700 1 -- 172.21.15.69:0/2623038994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255c1014a0 msgr2=0x7f255c196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255affd700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255c1014a0 0x7f255c196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255affd700 1 -- 172.21.15.69:0/2623038994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25500095f0 con 0x7f255c0fe4d0 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f255affd700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c0fe4d0 0x7f255c195ff0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f254c00c970 tx=0x7f254c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2543fff700 1 -- 172.21.15.69:0/2623038994 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c004220 con 0x7f255c0fe4d0 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2543fff700 1 -- 172.21.15.69:0/2623038994 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f254c007d60 con 0x7f255c0fe4d0 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c10bbc0 con 0x7f255c0fe4d0 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2543fff700 1 -- 172.21.15.69:0/2623038994 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c003d00 con 0x7f255c0fe4d0 2023-12-14T14:09:59.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.582+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c10ba30 con 0x7f255c0fe4d0 2023-12-14T14:09:59.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.583+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c107230 con 0x7f255c0fe4d0 2023-12-14T14:09:59.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.584+0000 7f2543fff700 1 -- 172.21.15.69:0/2623038994 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f254c004380 con 0x7f255c0fe4d0 2023-12-14T14:09:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.585+0000 7f2543fff700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25440a11e0 0x7f25440a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.585+0000 7f255a7fc700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25440a11e0 0x7f25440a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.585+0000 7f2543fff700 1 -- 172.21.15.69:0/2623038994 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f254c0cc8e0 con 0x7f255c0fe4d0 2023-12-14T14:09:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.585+0000 7f255a7fc700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25440a11e0 0x7f25440a3690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f255000b5c0 tx=0x7f2550005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.588+0000 7f2543fff700 1 -- 172.21.15.69:0/2623038994 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f254c096080 con 0x7f255c0fe4d0 2023-12-14T14:09:59.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:59 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/297622048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:09:59.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:59 smithi081 ceph-mon[43371]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:09:59.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:59 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/929715990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:09:59.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:09:59 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2785607524' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:09:59.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.776+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f255c02cfe0 con 0x7f255c0fe4d0 2023-12-14T14:09:59.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.777+0000 7f2543fff700 1 -- 172.21.15.69:0/2623038994 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f254c0996a0 con 0x7f255c0fe4d0 2023-12-14T14:09:59.776 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:09:59.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25440a11e0 msgr2=0x7f25440a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25440a11e0 0x7f25440a3690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f255000b5c0 tx=0x7f2550005fb0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c0fe4d0 msgr2=0x7f255c195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c0fe4d0 0x7f255c195ff0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f254c00c970 tx=0x7f254c00cd30 comp rx=0 tx=0).stop 2023-12-14T14:09:59.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 shutdown_connections 2023-12-14T14:09:59.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f25440a11e0 0x7f25440a3690 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f255c101e30 0x7f255c19d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f255c0fe4d0 0x7f255c195ff0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 --2- 172.21.15.69:0/2623038994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255c1014a0 0x7f255c196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 >> 172.21.15.69:0/2623038994 conn(0x7f255c0f9ed0 msgr2=0x7f255c0fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:59.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 shutdown_connections 2023-12-14T14:09:59.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.779+0000 7f2561663700 1 -- 172.21.15.69:0/2623038994 wait complete. 2023-12-14T14:09:59.791 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T14:09:59.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.916+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/4018930367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 msgr2=0x7f9ecc1075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.916+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/4018930367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 0x7f9ecc1075f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400b0a0 tx=0x7f9ec400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.916+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/4018930367 shutdown_connections 2023-12-14T14:09:59.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.916+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/4018930367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 0x7f9ecc1075f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.916+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/4018930367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc100740 0x7f9ecc100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.916+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/4018930367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc0ff390 0x7f9ecc0ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.916+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/4018930367 >> 172.21.15.69:0/4018930367 conn(0x7f9ecc0f9eb0 msgr2=0x7f9ecc0fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:09:59.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.916+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/4018930367 shutdown_connections 2023-12-14T14:09:59.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.916+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/4018930367 wait complete. 2023-12-14T14:09:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ed0e4a700 1 Processor -- start 2023-12-14T14:09:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ed0e4a700 1 -- start start 2023-12-14T14:09:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ed0e4a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc0ff390 0x7f9ecc198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ed0e4a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 0x7f9ecc1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ed0e4a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc100740 0x7f9ecc19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ed0e4a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc19fde0 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ed0e4a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc19ff20 con 0x7f9ecc0ff390 2023-12-14T14:09:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ed0e4a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1a00b0 con 0x7f9ecc100740 2023-12-14T14:09:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ec9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 0x7f9ecc1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ec9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 0x7f9ecc1987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43144/0 (socket says 172.21.15.69:43144) 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ec9d9b700 1 -- 172.21.15.69:0/3226289885 learned_addr learned my addr 172.21.15.69:0/3226289885 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9eca59c700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc0ff390 0x7f9ecc198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ecad9d700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc100740 0x7f9ecc19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ec9d9b700 1 -- 172.21.15.69:0/3226289885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc100740 msgr2=0x7f9ecc19f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ec9d9b700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc100740 0x7f9ecc19f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ec9d9b700 1 -- 172.21.15.69:0/3226289885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc0ff390 msgr2=0x7f9ecc198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ec9d9b700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc0ff390 0x7f9ecc198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ec9d9b700 1 -- 172.21.15.69:0/3226289885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009d00 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ec9d9b700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 0x7f9ecc1987a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00c9b0 tx=0x7f9ebc00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.917+0000 7f9ebb7fe700 1 -- 172.21.15.69:0/3226289885 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc007b00 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.918+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc10ab30 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.918+0000 7f9ebb7fe700 1 -- 172.21.15.69:0/3226289885 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ebc007c60 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.918+0000 7f9ebb7fe700 1 -- 172.21.15.69:0/3226289885 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc018660 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.918+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc10a9a0 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.919+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc1a0880 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.919+0000 7f9ebb7fe700 1 -- 172.21.15.69:0/3226289885 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9ebc00f450 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.920+0000 7f9ebb7fe700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9eb40a11e0 0x7f9eb40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:09:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.920+0000 7f9eca59c700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9eb40a11e0 0x7f9eb40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:09:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.920+0000 7f9ebb7fe700 1 -- 172.21.15.69:0/3226289885 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9ebc0cc8e0 con 0x7f9ecc0ffd40 2023-12-14T14:09:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.920+0000 7f9eca59c700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9eb40a11e0 0x7f9eb40a3690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc068d60 tx=0x7f9ec0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:09:59.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:09:59.924+0000 7f9ebb7fe700 1 -- 172.21.15.69:0/3226289885 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9ebc096080 con 0x7f9ecc0ffd40 2023-12-14T14:10:00.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.115+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ecc1a0e30 con 0x7f9ecc0ffd40 2023-12-14T14:10:00.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.116+0000 7f9ebb7fe700 1 -- 172.21.15.69:0/3226289885 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ebc0996a0 con 0x7f9ecc0ffd40 2023-12-14T14:10:00.115 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T14:10:00.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9eb40a11e0 msgr2=0x7f9eb40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9eb40a11e0 0x7f9eb40a3690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc068d60 tx=0x7f9ec0009190 comp rx=0 tx=0).stop 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 msgr2=0x7f9ecc1987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 0x7f9ecc1987a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00c9b0 tx=0x7f9ebc00ccc0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 shutdown_connections 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9eb40a11e0 0x7f9eb40a3690 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc100740 0x7f9ecc19f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc0ff390 0x7f9ecc198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 --2- 172.21.15.69:0/3226289885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc0ffd40 0x7f9ecc1987a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 >> 172.21.15.69:0/3226289885 conn(0x7f9ecc0f9eb0 msgr2=0x7f9ecc0fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 shutdown_connections 2023-12-14T14:10:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.118+0000 7f9ed0e4a700 1 -- 172.21.15.69:0/3226289885 wait complete. 2023-12-14T14:10:00.129 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T14:10:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.256+0000 7f9fc3707700 1 -- 172.21.15.69:0/2106001740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc0ffe20 msgr2=0x7f9fbc1076f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.256+0000 7f9fc3707700 1 --2- 172.21.15.69:0/2106001740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc0ffe20 0x7f9fbc1076f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009990 tx=0x7f9fac009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.256+0000 7f9fc3707700 1 -- 172.21.15.69:0/2106001740 shutdown_connections 2023-12-14T14:10:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.256+0000 7f9fc3707700 1 --2- 172.21.15.69:0/2106001740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc0ffe20 0x7f9fbc1076f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.256+0000 7f9fc3707700 1 --2- 172.21.15.69:0/2106001740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fbc100760 0x7f9fbc100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.256+0000 7f9fc3707700 1 --2- 172.21.15.69:0/2106001740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fbc0ff490 0x7f9fbc0ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.256+0000 7f9fc3707700 1 -- 172.21.15.69:0/2106001740 >> 172.21.15.69:0/2106001740 conn(0x7f9fbc0f9f70 msgr2=0x7f9fbc0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.256+0000 7f9fc3707700 1 -- 172.21.15.69:0/2106001740 shutdown_connections 2023-12-14T14:10:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.256+0000 7f9fc3707700 1 -- 172.21.15.69:0/2106001740 wait complete. 2023-12-14T14:10:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.257+0000 7f9fc3707700 1 Processor -- start 2023-12-14T14:10:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc3707700 1 -- start start 2023-12-14T14:10:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc3707700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fbc0ff490 0x7f9fbc0fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc3707700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fbc0ffe20 0x7f9fbc19acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc3707700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc100760 0x7f9fbc19d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc3707700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc19daf0 con 0x7f9fbc100760 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc3707700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc19dc60 con 0x7f9fbc0ffe20 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc3707700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc19de20 con 0x7f9fbc0ff490 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc1ca4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc100760 0x7f9fbc19d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc1ca4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc100760 0x7f9fbc19d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43158/0 (socket says 172.21.15.69:43158) 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc1ca4700 1 -- 172.21.15.69:0/1637174238 learned_addr learned my addr 172.21.15.69:0/1637174238 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc14a3700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fbc0ff490 0x7f9fbc0fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc0ca2700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fbc0ffe20 0x7f9fbc19acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc1ca4700 1 -- 172.21.15.69:0/1637174238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fbc0ff490 msgr2=0x7f9fbc0fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc1ca4700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fbc0ff490 0x7f9fbc0fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc1ca4700 1 -- 172.21.15.69:0/1637174238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fbc0ffe20 msgr2=0x7f9fbc19acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc1ca4700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fbc0ffe20 0x7f9fbc19acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc1ca4700 1 -- 172.21.15.69:0/1637174238 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0095f0 con 0x7f9fbc100760 2023-12-14T14:10:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc0ca2700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fbc0ffe20 0x7f9fbc19acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc1ca4700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc100760 0x7f9fbc19d320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9fac006010 tx=0x7f9fac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fba7fc700 1 -- 172.21.15.69:0/1637174238 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac01d070 con 0x7f9fbc100760 2023-12-14T14:10:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc10ab40 con 0x7f9fbc100760 2023-12-14T14:10:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fba7fc700 1 -- 172.21.15.69:0/1637174238 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fac0054f0 con 0x7f9fbc100760 2023-12-14T14:10:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fba7fc700 1 -- 172.21.15.69:0/1637174238 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac004d00 con 0x7f9fbc100760 2023-12-14T14:10:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.258+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc10a9b0 con 0x7f9fbc100760 2023-12-14T14:10:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.259+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc106850 con 0x7f9fbc100760 2023-12-14T14:10:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.260+0000 7f9fba7fc700 1 -- 172.21.15.69:0/1637174238 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9fac00fbc0 con 0x7f9fbc100760 2023-12-14T14:10:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.261+0000 7f9fba7fc700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9fa40a11e0 0x7f9fa40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.261+0000 7f9fc14a3700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9fa40a11e0 0x7f9fa40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.261+0000 7f9fba7fc700 1 -- 172.21.15.69:0/1637174238 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9fac0cde00 con 0x7f9fbc100760 2023-12-14T14:10:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.261+0000 7f9fc14a3700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9fa40a11e0 0x7f9fa40a3690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009550 tx=0x7f9fb40091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:00.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.264+0000 7f9fba7fc700 1 -- 172.21.15.69:0/1637174238 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9fac097630 con 0x7f9fbc100760 2023-12-14T14:10:00.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.452+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fbc061700 con 0x7f9fbc100760 2023-12-14T14:10:00.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.452+0000 7f9fba7fc700 1 -- 172.21.15.69:0/1637174238 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fac09ac50 con 0x7f9fbc100760 2023-12-14T14:10:00.451 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9fa40a11e0 msgr2=0x7f9fa40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9fa40a11e0 0x7f9fa40a3690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009550 tx=0x7f9fb40091b0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc100760 msgr2=0x7f9fbc19d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc100760 0x7f9fbc19d320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9fac006010 tx=0x7f9fac004730 comp rx=0 tx=0).stop 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 shutdown_connections 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9fa40a11e0 0x7f9fa40a3690 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fbc100760 0x7f9fbc19d320 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fbc0ff490 0x7f9fbc0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 --2- 172.21.15.69:0/1637174238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fbc0ffe20 0x7f9fbc19acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 >> 172.21.15.69:0/1637174238 conn(0x7f9fbc0f9f70 msgr2=0x7f9fbc103990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.454+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 shutdown_connections 2023-12-14T14:10:00.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.455+0000 7f9fc3707700 1 -- 172.21.15.69:0/1637174238 wait complete. 2023-12-14T14:10:00.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:00 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/434105531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:00.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:00 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2623038994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:00.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:00 smithi069 ceph-mon[42034]: overall HEALTH_OK 2023-12-14T14:10:00.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:00 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3226289885' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:00.465 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:10:00.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:00 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/434105531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:00.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:00 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2623038994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:00.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:00 smithi119 ceph-mon[43834]: overall HEALTH_OK 2023-12-14T14:10:00.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:00 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3226289885' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:00.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.588+0000 7fcd8f488700 1 -- 172.21.15.69:0/468999666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 msgr2=0x7fcd88103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.588+0000 7fcd8f488700 1 --2- 172.21.15.69:0/468999666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 0x7fcd88103110 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009990 tx=0x7fcd7c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.588+0000 7fcd8f488700 1 -- 172.21.15.69:0/468999666 shutdown_connections 2023-12-14T14:10:00.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.588+0000 7fcd8f488700 1 --2- 172.21.15.69:0/468999666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd88105f70 0x7fcd88108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.588+0000 7fcd8f488700 1 --2- 172.21.15.69:0/468999666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 0x7fcd88103110 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.588+0000 7fcd8f488700 1 --2- 172.21.15.69:0/468999666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd88103650 0x7fcd88105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.588+0000 7fcd8f488700 1 -- 172.21.15.69:0/468999666 >> 172.21.15.69:0/468999666 conn(0x7fcd880fa6f0 msgr2=0x7fcd880fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:00.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.588+0000 7fcd8f488700 1 -- 172.21.15.69:0/468999666 shutdown_connections 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.588+0000 7fcd8f488700 1 -- 172.21.15.69:0/468999666 wait complete. 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8f488700 1 Processor -- start 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8f488700 1 -- start start 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8f488700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 0x7fcd881006a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8f488700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd88103650 0x7fcd880fece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8f488700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd88105f70 0x7fcd880ff220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8f488700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880ff9c0 con 0x7fcd88100d30 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8f488700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880ffb30 con 0x7fcd88105f70 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8f488700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd881a00c0 con 0x7fcd88103650 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8d224700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 0x7fcd881006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8d224700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 0x7fcd881006a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43172/0 (socket says 172.21.15.69:43172) 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8d224700 1 -- 172.21.15.69:0/159724892 learned_addr learned my addr 172.21.15.69:0/159724892 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8d224700 1 -- 172.21.15.69:0/159724892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd88103650 msgr2=0x7fcd880fece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8d224700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd88103650 0x7fcd880fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8d224700 1 -- 172.21.15.69:0/159724892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd88105f70 msgr2=0x7fcd880ff220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8d224700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd88105f70 0x7fcd880ff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8d224700 1 -- 172.21.15.69:0/159724892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0095f0 con 0x7fcd88100d30 2023-12-14T14:10:00.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.589+0000 7fcd8d224700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 0x7fcd881006a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c000c00 tx=0x7fcd7c00f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:00.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.590+0000 7fcd7a7fc700 1 -- 172.21.15.69:0/159724892 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c01d070 con 0x7fcd88100d30 2023-12-14T14:10:00.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.590+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8810bc50 con 0x7fcd88100d30 2023-12-14T14:10:00.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.590+0000 7fcd7a7fc700 1 -- 172.21.15.69:0/159724892 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd7c00fce0 con 0x7fcd88100d30 2023-12-14T14:10:00.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.590+0000 7fcd7a7fc700 1 -- 172.21.15.69:0/159724892 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0176e0 con 0x7fcd88100d30 2023-12-14T14:10:00.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.590+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8810bac0 con 0x7fcd88100d30 2023-12-14T14:10:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.590+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd880fc260 con 0x7fcd88100d30 2023-12-14T14:10:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.592+0000 7fcd7a7fc700 1 -- 172.21.15.69:0/159724892 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fcd7c022470 con 0x7fcd88100d30 2023-12-14T14:10:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.592+0000 7fcd7a7fc700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fcd740a1260 0x7fcd740a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.592+0000 7fcd8ca23700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fcd740a1260 0x7fcd740a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.592+0000 7fcd7a7fc700 1 -- 172.21.15.69:0/159724892 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcd7c0ce2f0 con 0x7fcd88100d30 2023-12-14T14:10:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.593+0000 7fcd8ca23700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fcd740a1260 0x7fcd740a3710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd840097b0 tx=0x7fcd84006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.595+0000 7fcd7a7fc700 1 -- 172.21.15.69:0/159724892 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fcd7c097a20 con 0x7fcd88100d30 2023-12-14T14:10:00.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:00 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/434105531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:00.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:00 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2623038994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:00.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:00 smithi081 ceph-mon[43371]: overall HEALTH_OK 2023-12-14T14:10:00.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:00 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3226289885' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:00.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.829+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd8802cfe0 con 0x7fcd88100d30 2023-12-14T14:10:00.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.829+0000 7fcd7a7fc700 1 -- 172.21.15.69:0/159724892 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7fcd7c09b040 con 0x7fcd88100d30 2023-12-14T14:10:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:00.829 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fcd740a1260 msgr2=0x7fcd740a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fcd740a1260 0x7fcd740a3710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd840097b0 tx=0x7fcd84006d20 comp rx=0 tx=0).stop 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 msgr2=0x7fcd881006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 0x7fcd881006a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c000c00 tx=0x7fcd7c00f830 comp rx=0 tx=0).stop 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 shutdown_connections 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fcd740a1260 0x7fcd740a3710 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd88105f70 0x7fcd880ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd88100d30 0x7fcd881006a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 --2- 172.21.15.69:0/159724892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd88103650 0x7fcd880fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 >> 172.21.15.69:0/159724892 conn(0x7fcd880fa6f0 msgr2=0x7fcd88101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 shutdown_connections 2023-12-14T14:10:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.831+0000 7fcd8f488700 1 -- 172.21.15.69:0/159724892 wait complete. 2023-12-14T14:10:00.832 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:10:00.843 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:10:00.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.966+0000 7f5fc6a60700 1 -- 172.21.15.69:0/689356028 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0101de0 msgr2=0x7f5fc01086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.966+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/689356028 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0101de0 0x7f5fc01086a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800b0a0 tx=0x7f5fb800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.966+0000 7f5fc6a60700 1 -- 172.21.15.69:0/689356028 shutdown_connections 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.966+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/689356028 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0101de0 0x7f5fc01086a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.966+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/689356028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fc0100260 0x7f5fc0100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.966+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/689356028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc0101450 0x7f5fc01018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.966+0000 7f5fc6a60700 1 -- 172.21.15.69:0/689356028 >> 172.21.15.69:0/689356028 conn(0x7f5fc00fb880 msgr2=0x7f5fc00fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.966+0000 7f5fc6a60700 1 -- 172.21.15.69:0/689356028 shutdown_connections 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.966+0000 7f5fc6a60700 1 -- 172.21.15.69:0/689356028 wait complete. 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fc6a60700 1 Processor -- start 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fc6a60700 1 -- start start 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fc6a60700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0100260 0x7f5fc0196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fc6a60700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fc0101450 0x7f5fc0196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fc6a60700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc0101de0 0x7f5fc019d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fc6a60700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc019dba0 con 0x7f5fc0100260 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fc6a60700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc019dce0 con 0x7f5fc0101de0 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fc6a60700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc019de70 con 0x7f5fc0101450 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0100260 0x7f5fc0196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0100260 0x7f5fc0196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43184/0 (socket says 172.21.15.69:43184) 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbffff700 1 -- 172.21.15.69:0/188925155 learned_addr learned my addr 172.21.15.69:0/188925155 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbf7fe700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fc0101450 0x7f5fc0196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fc4ffd700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc0101de0 0x7f5fc019d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbffff700 1 -- 172.21.15.69:0/188925155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fc0101450 msgr2=0x7f5fc0196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbffff700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fc0101450 0x7f5fc0196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbffff700 1 -- 172.21.15.69:0/188925155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc0101de0 msgr2=0x7f5fc019d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbffff700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc0101de0 0x7f5fc019d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbffff700 1 -- 172.21.15.69:0/188925155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb8009d00 con 0x7f5fc0100260 2023-12-14T14:10:00.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.967+0000 7f5fbffff700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0100260 0x7f5fc0196020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c970 tx=0x7f5fb000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:00.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.968+0000 7f5fbd7fa700 1 -- 172.21.15.69:0/188925155 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0004220 con 0x7f5fc0100260 2023-12-14T14:10:00.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.968+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc010bbe0 con 0x7f5fc0100260 2023-12-14T14:10:00.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.968+0000 7f5fbd7fa700 1 -- 172.21.15.69:0/188925155 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fb0007d60 con 0x7f5fc0100260 2023-12-14T14:10:00.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.968+0000 7f5fbd7fa700 1 -- 172.21.15.69:0/188925155 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0003d00 con 0x7f5fc0100260 2023-12-14T14:10:00.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.968+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc010ba50 con 0x7f5fc0100260 2023-12-14T14:10:00.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.969+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc0107700 con 0x7f5fc0100260 2023-12-14T14:10:00.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.970+0000 7f5fbd7fa700 1 -- 172.21.15.69:0/188925155 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5fb0004380 con 0x7f5fc0100260 2023-12-14T14:10:00.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.970+0000 7f5fbd7fa700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5fa80a11e0 0x7f5fa80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:00.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.970+0000 7f5fbf7fe700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5fa80a11e0 0x7f5fa80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:00.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.970+0000 7f5fbd7fa700 1 -- 172.21.15.69:0/188925155 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5fb00cc880 con 0x7f5fc0100260 2023-12-14T14:10:00.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.971+0000 7f5fbf7fe700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5fa80a11e0 0x7f5fa80a3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4005ea0 tx=0x7f5fb4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:00.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:00.974+0000 7f5fbd7fa700 1 -- 172.21.15.69:0/188925155 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5fb0096020 con 0x7f5fc0100260 2023-12-14T14:10:01.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.166+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fc002cfe0 con 0x7f5fc0100260 2023-12-14T14:10:01.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.167+0000 7f5fbd7fa700 1 -- 172.21.15.69:0/188925155 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22096 (secure 0 0 0) 0x7f5fb001d090 con 0x7f5fc0100260 2023-12-14T14:10:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:01.167 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":82,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:09:11.600086+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:10:01.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5fa80a11e0 msgr2=0x7f5fa80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5fa80a11e0 0x7f5fa80a3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4005ea0 tx=0x7f5fb4005e30 comp rx=0 tx=0).stop 2023-12-14T14:10:01.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0100260 msgr2=0x7f5fc0196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0100260 0x7f5fc0196020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c970 tx=0x7f5fb000cd30 comp rx=0 tx=0).stop 2023-12-14T14:10:01.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 shutdown_connections 2023-12-14T14:10:01.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5fa80a11e0 0x7f5fa80a3690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc0101de0 0x7f5fc019d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0100260 0x7f5fc0196020 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 --2- 172.21.15.69:0/188925155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fc0101450 0x7f5fc0196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 >> 172.21.15.69:0/188925155 conn(0x7f5fc00fb880 msgr2=0x7f5fc0104840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 shutdown_connections 2023-12-14T14:10:01.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.169+0000 7f5fc6a60700 1 -- 172.21.15.69:0/188925155 wait complete. 2023-12-14T14:10:01.182 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:10:01.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.306+0000 7f901d10c700 1 -- 172.21.15.69:0/969773160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 msgr2=0x7f90180ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.306+0000 7f901d10c700 1 --2- 172.21.15.69:0/969773160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 0x7f90180ff520 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f900c009990 tx=0x7f900c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.306+0000 7f901d10c700 1 -- 172.21.15.69:0/969773160 shutdown_connections 2023-12-14T14:10:01.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.306+0000 7f901d10c700 1 --2- 172.21.15.69:0/969773160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9018100c90 0x7f9018107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.306+0000 7f901d10c700 1 --2- 172.21.15.69:0/969773160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 0x7f90180ff520 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.306+0000 7f901d10c700 1 --2- 172.21.15.69:0/969773160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9018100300 0x7f9018100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.306+0000 7f901d10c700 1 -- 172.21.15.69:0/969773160 >> 172.21.15.69:0/969773160 conn(0x7f90180fa6f0 msgr2=0x7f90180fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.306+0000 7f901d10c700 1 -- 172.21.15.69:0/969773160 shutdown_connections 2023-12-14T14:10:01.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.306+0000 7f901d10c700 1 -- 172.21.15.69:0/969773160 wait complete. 2023-12-14T14:10:01.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f901d10c700 1 Processor -- start 2023-12-14T14:10:01.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f901d10c700 1 -- start start 2023-12-14T14:10:01.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f901d10c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 0x7f9018196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f901d10c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9018100300 0x7f9018196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f901d10c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9018100c90 0x7f901819d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f901d10c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901819dba0 con 0x7f90180ff110 2023-12-14T14:10:01.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f901d10c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901819dce0 con 0x7f9018100300 2023-12-14T14:10:01.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f901d10c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901819de70 con 0x7f9018100c90 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f9016d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 0x7f9018196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.307+0000 7f9016d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 0x7f9018196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43210/0 (socket says 172.21.15.69:43210) 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f9016d9d700 1 -- 172.21.15.69:0/1039948116 learned_addr learned my addr 172.21.15.69:0/1039948116 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f901759e700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9018100c90 0x7f901819d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f901659c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9018100300 0x7f9018196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f9016d9d700 1 -- 172.21.15.69:0/1039948116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9018100c90 msgr2=0x7f901819d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f9016d9d700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9018100c90 0x7f901819d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f9016d9d700 1 -- 172.21.15.69:0/1039948116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9018100300 msgr2=0x7f9018196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f9016d9d700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9018100300 0x7f9018196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f9016d9d700 1 -- 172.21.15.69:0/1039948116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c0095f0 con 0x7f90180ff110 2023-12-14T14:10:01.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f901659c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9018100300 0x7f9018196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:01.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f9016d9d700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 0x7f9018196020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f900c004760 tx=0x7f900c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f8ffffff700 1 -- 172.21.15.69:0/1039948116 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c01d070 con 0x7f90180ff110 2023-12-14T14:10:01.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901810aad0 con 0x7f90180ff110 2023-12-14T14:10:01.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f8ffffff700 1 -- 172.21.15.69:0/1039948116 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f900c004cd0 con 0x7f90180ff110 2023-12-14T14:10:01.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f8ffffff700 1 -- 172.21.15.69:0/1039948116 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c005290 con 0x7f90180ff110 2023-12-14T14:10:01.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.308+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901810a940 con 0x7f90180ff110 2023-12-14T14:10:01.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.309+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901810ac60 con 0x7f90180ff110 2023-12-14T14:10:01.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.310+0000 7f8ffffff700 1 -- 172.21.15.69:0/1039948116 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f900c003b60 con 0x7f90180ff110 2023-12-14T14:10:01.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.311+0000 7f8ffffff700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f90000a11e0 0x7f90000a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.311+0000 7f8ffffff700 1 -- 172.21.15.69:0/1039948116 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f900c0cdc90 con 0x7f90180ff110 2023-12-14T14:10:01.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.311+0000 7f901659c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f90000a11e0 0x7f90000a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.311+0000 7f901659c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f90000a11e0 0x7f90000a3690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9008005fd0 tx=0x7f9008005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.314+0000 7f8ffffff700 1 -- 172.21.15.69:0/1039948116 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f900c0974c0 con 0x7f90180ff110 2023-12-14T14:10:01.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:01 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1637174238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:01.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:01 smithi119 ceph-mon[43834]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:10:01.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:01 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/159724892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:01.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:01 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/188925155' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:01.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.547+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90180679f0 con 0x7f90180ff110 2023-12-14T14:10:01.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.548+0000 7f8ffffff700 1 -- 172.21.15.69:0/1039948116 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f900c09aae0 con 0x7f90180ff110 2023-12-14T14:10:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:01.548 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:10:01.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f90000a11e0 msgr2=0x7f90000a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f90000a11e0 0x7f90000a3690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9008005fd0 tx=0x7f9008005ee0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 msgr2=0x7f9018196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 0x7f9018196020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f900c004760 tx=0x7f900c009580 comp rx=0 tx=0).stop 2023-12-14T14:10:01.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 shutdown_connections 2023-12-14T14:10:01.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f90000a11e0 0x7f90000a3690 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9018100c90 0x7f901819d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90180ff110 0x7f9018196020 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 --2- 172.21.15.69:0/1039948116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9018100300 0x7f9018196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 >> 172.21.15.69:0/1039948116 conn(0x7f90180fa6f0 msgr2=0x7f9018067e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 shutdown_connections 2023-12-14T14:10:01.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.550+0000 7f901d10c700 1 -- 172.21.15.69:0/1039948116 wait complete. 2023-12-14T14:10:01.551 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:10:01.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:01 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1637174238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:01.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:01 smithi069 ceph-mon[42034]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:10:01.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:01 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/159724892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:01.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:01 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/188925155' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:01.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-12-14T14:09:10.598197+0000', 'modified': '2023-12-14T14:09:15.801574+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24500, 'mds_1': 24469, 'mds_2': 24467}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6835/3775706969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 3775706969}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 3775706969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/594041854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 594041854}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 594041854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6837/2082956632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 2082956632}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 2082956632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.81:6837/3031029983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3031029983}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3031029983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.119:6839/1957200331', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 1957200331}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 1957200331}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24500': {'gid': 24500, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6839/2690299654', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 2690299654}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 2690299654}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-14T14:10:01.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-14T14:10:01.563 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-12-14T14:10:01.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:01 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1637174238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:01.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:01 smithi081 ceph-mon[43371]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:10:01.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:01 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/159724892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:01.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:01 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/188925155' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:01.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.687+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/1198983773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 msgr2=0x7ffb281007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.687+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/1198983773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 0x7ffb281007d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009990 tx=0x7ffb24009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.687+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/1198983773 shutdown_connections 2023-12-14T14:10:01.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.687+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/1198983773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb28100d10 0x7ffb281075b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.687+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/1198983773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb280ff650 0x7ffb280ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.687+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/1198983773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 0x7ffb281007d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.687+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/1198983773 >> 172.21.15.69:0/1198983773 conn(0x7ffb280f9eb0 msgr2=0x7ffb280fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.687+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/1198983773 shutdown_connections 2023-12-14T14:10:01.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.687+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/1198983773 wait complete. 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2fc7b700 1 Processor -- start 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2fc7b700 1 -- start start 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2fc7b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb280ff650 0x7ffb280fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2fc7b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 0x7ffb2819ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2fc7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb28100d10 0x7ffb2819d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2fc7b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2819db30 con 0x7ffb28100360 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2fc7b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2819dca0 con 0x7ffb28100d10 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2fc7b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2819de60 con 0x7ffb280ff650 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2d216700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 0x7ffb2819ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2d216700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 0x7ffb2819ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43236/0 (socket says 172.21.15.69:43236) 2023-12-14T14:10:01.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2d216700 1 -- 172.21.15.69:0/3821217850 learned_addr learned my addr 172.21.15.69:0/3821217850 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2da17700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb280ff650 0x7ffb280fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2e218700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb28100d10 0x7ffb2819d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2d216700 1 -- 172.21.15.69:0/3821217850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb280ff650 msgr2=0x7ffb280fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2d216700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb280ff650 0x7ffb280fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2d216700 1 -- 172.21.15.69:0/3821217850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb28100d10 msgr2=0x7ffb2819d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2d216700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb28100d10 0x7ffb2819d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2d216700 1 -- 172.21.15.69:0/3821217850 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240095f0 con 0x7ffb28100360 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb2d216700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 0x7ffb2819ad10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffb240095c0 tx=0x7ffb2400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.688+0000 7ffb1affd700 1 -- 172.21.15.69:0/3821217850 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2401d070 con 0x7ffb28100360 2023-12-14T14:10:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.689+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/3821217850 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2810aaa0 con 0x7ffb28100360 2023-12-14T14:10:01.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.689+0000 7ffb1affd700 1 -- 172.21.15.69:0/3821217850 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb24005030 con 0x7ffb28100360 2023-12-14T14:10:01.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.689+0000 7ffb1affd700 1 -- 172.21.15.69:0/3821217850 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004ab0 con 0x7ffb28100360 2023-12-14T14:10:01.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.689+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/3821217850 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2810a910 con 0x7ffb28100360 2023-12-14T14:10:01.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.691+0000 7ffb1affd700 1 -- 172.21.15.69:0/3821217850 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ffb24004c90 con 0x7ffb28100360 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.692+0000 7ffb1affd700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb140a11e0 0x7ffb140a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.692+0000 7ffb2da17700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb140a11e0 0x7ffb140a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.692+0000 7ffb1affd700 1 -- 172.21.15.69:0/3821217850 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ffb240cd7f0 con 0x7ffb28100360 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.692+0000 7ffb2da17700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb140a11e0 0x7ffb140a3690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb28068af0 tx=0x7ffb1c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb3be09b80 1 Processor -- start 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb3be09b80 1 -- start start 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db8e00 0x55ebe5db9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5ca1590 con 0x55ebe5db9cb0 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5d10820 con 0x55ebe5db84b0 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5d09cb0 con 0x55ebe5db8e00 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2e218700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2e218700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dba120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43250/0 (socket says 172.21.15.69:43250) 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2e218700 1 -- 172.21.15.69:0/1320972247 learned_addr learned my addr 172.21.15.69:0/1320972247 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2da17700 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2d216700 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db8e00 0x55ebe5db9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2e218700 1 -- 172.21.15.69:0/1320972247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db8e00 msgr2=0x55ebe5db9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2e218700 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db8e00 0x55ebe5db9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2e218700 1 -- 172.21.15.69:0/1320972247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 msgr2=0x55ebe5db88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2e218700 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2e218700 1 -- 172.21.15.69:0/1320972247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebe5b8b360 con 0x55ebe5db9cb0 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.693+0000 7ffb2da17700 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb2e218700 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dba120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000a730 tx=0x7ffb200078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a44c17c072f8d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb13fff700 1 -- 172.21.15.69:0/1320972247 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20018070 con 0x55ebe5db9cb0 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb13fff700 1 -- 172.21.15.69:0/1320972247 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb20010040 con 0x55ebe5db9cb0 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb13fff700 1 -- 172.21.15.69:0/1320972247 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000f050 con 0x55ebe5db9cb0 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1320972247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 msgr2=0x55ebe5dba120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dba120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000a730 tx=0x7ffb200078d0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1320972247 shutdown_connections 2023-12-14T14:10:01.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dba120 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1320972247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db8e00 0x55ebe5db9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.694+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1320972247 >> 172.21.15.69:0/1320972247 conn(0x55ebe5dadc50 msgr2=0x55ebe5db33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1320972247 shutdown_connections 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1320972247 wait complete. 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 -- start start 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 Processor -- start 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5dc2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5ca5f40 con 0x55ebe5db8e00 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5ca5be0 con 0x55ebe5db84b0 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5b8d650 con 0x55ebe5db9cb0 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb3be09b80 10 client.0 _ll_register_callbacks cb 0x55ebe5cc98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb2d216700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb2d216700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43262/0 (socket says 172.21.15.69:43262) 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb2d216700 1 -- 172.21.15.69:0/3804267457 learned_addr learned my addr 172.21.15.69:0/3804267457 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.695+0000 7ffb2e218700 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb2da17700 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5dc2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb2d216700 1 -- 172.21.15.69:0/3804267457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db9cb0 msgr2=0x55ebe5dc95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb2d216700 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb2d216700 1 -- 172.21.15.69:0/3804267457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 msgr2=0x55ebe5dc2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb2d216700 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5dc2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb2d216700 1 -- 172.21.15.69:0/3804267457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2000a410 con 0x55ebe5db8e00 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb2da17700 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5dc2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb2d216700 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc2580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb24005970 tx=0x7ffb2409b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4085632ee8d7e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb117fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb117fa700 1 -- 172.21.15.69:0/3804267457 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2409ed10 con 0x55ebe5db8e00 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb117fa700 1 -- 172.21.15.69:0/3804267457 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ffb240a30a0 con 0x55ebe5db8e00 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb3be09b80 1 -- 172.21.15.69:0/3804267457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebe5dab260 con 0x55ebe5db8e00 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb117fa700 1 -- 172.21.15.69:0/3804267457 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb240b3200 con 0x55ebe5db8e00 2023-12-14T14:10:01.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb3be09b80 10 client.15042 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb3be09b80 1 -- 172.21.15.69:0/3804267457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ebe5cd0120 con 0x55ebe5db8e00 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb117fa700 1 -- 172.21.15.69:0/3804267457 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb240c9080 con 0x55ebe5db8e00 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb117fa700 1 -- 172.21.15.69:0/3804267457 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffb2400fad0 con 0x55ebe5db8e00 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb3be09b80 10 client.15042 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb3be09b80 10 client.15042 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb3be09b80 20 client.15042 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ebe5dccf20 0x55ebe5dcc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb3be09b80 4 client.15042 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.696+0000 7ffb3be09b80 1 -- 172.21.15.69:0/3804267457 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ebe5d02c90 con 0x55ebe5dccf20 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.697+0000 7ffb2da17700 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ebe5dccf20 0x55ebe5dcc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.697+0000 7ffb117fa700 10 client.15042 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.697+0000 7ffb2da17700 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ebe5dccf20 0x55ebe5dcc4f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=156dcb1460a8890f server_cookie=efde14167a7d1a2f in_seq=0 out_seq=0 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb117fa700 1 -- 172.21.15.69:0/3804267457 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ebe5d02c90 con 0x55ebe5dccf20 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb117fa700 10 client.15042 handle_command_reply: tid=0 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 client.15042 shutdown 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 -- 172.21.15.69:0/3804267457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 msgr2=0x55ebe5dc2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc2580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb24005970 tx=0x7ffb2409b220 comp rx=0 tx=0).stop 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 -- 172.21.15.69:0/3804267457 shutdown_connections 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5dc2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ebe5dccf20 0x55ebe5dcc4f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/3804267457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc2580 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 -- 172.21.15.69:0/3804267457 >> 172.21.15.69:0/3804267457 conn(0x55ebe5dadc50 msgr2=0x55ebe5db1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb117fa700 0 client.15042 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:10:01.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 -- 172.21.15.69:0/3804267457 shutdown_connections 2023-12-14T14:10:01.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 1 -- 172.21.15.69:0/3804267457 wait complete. 2023-12-14T14:10:01.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.698+0000 7ffb3be09b80 20 client.15042 trim_cache size 0 max 16384 2023-12-14T14:10:01.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb3be09b80 1 Processor -- start 2023-12-14T14:10:01.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb3be09b80 1 -- start start 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5d02c90 con 0x55ebe5db8e00 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5d05da0 con 0x55ebe5db84b0 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5cb3580 con 0x55ebe5db9cb0 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2d216700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2d216700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43268/0 (socket says 172.21.15.69:43268) 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2d216700 1 -- 172.21.15.69:0/110282033 learned_addr learned my addr 172.21.15.69:0/110282033 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2da17700 1 --2- 172.21.15.69:0/110282033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2d216700 1 -- 172.21.15.69:0/110282033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db9cb0 msgr2=0x55ebe5dc9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2d216700 1 --2- 172.21.15.69:0/110282033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2d216700 1 -- 172.21.15.69:0/110282033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 msgr2=0x55ebe5db2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2d216700 1 --2- 172.21.15.69:0/110282033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2d216700 1 -- 172.21.15.69:0/110282033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebe5db21b0 con 0x55ebe5db8e00 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2da17700 1 --2- 172.21.15.69:0/110282033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.716+0000 7ffb2d216700 1 --2- 172.21.15.69:0/110282033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc9580 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb24005f50 tx=0x7ffb24099290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a56c477e39f858a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb18dac700 1 -- 172.21.15.69:0/110282033 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240b6e60 con 0x55ebe5db8e00 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb18dac700 1 -- 172.21.15.69:0/110282033 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ebe5dab260 con 0x55ebe5db8e00 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb18dac700 1 -- 172.21.15.69:0/110282033 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240b3460 con 0x55ebe5db8e00 2023-12-14T14:10:01.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 -- 172.21.15.69:0/110282033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 msgr2=0x55ebe5dc9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/110282033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc9580 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb24005f50 tx=0x7ffb24099290 comp rx=0 tx=0).stop 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 -- 172.21.15.69:0/110282033 shutdown_connections 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/110282033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/110282033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db84b0 0x55ebe5db2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/110282033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc9580 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 -- 172.21.15.69:0/110282033 >> 172.21.15.69:0/110282033 conn(0x55ebe5dadc50 msgr2=0x55ebe5dc0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 -- 172.21.15.69:0/110282033 shutdown_connections 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 -- 172.21.15.69:0/110282033 wait complete. 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.717+0000 7ffb3be09b80 1 -- start start 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb3be09b80 1 Processor -- start 2023-12-14T14:10:01.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db84b0 0x55ebe5dc4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb3be09b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5dc81a0 con 0x55ebe5db9cb0 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5dc8310 con 0x55ebe5db8e00 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb3be09b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe5dc84d0 con 0x55ebe5db84b0 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb3be09b80 10 client.0 _ll_register_callbacks cb 0x7ffb2409aba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2e218700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2e218700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43284/0 (socket says 172.21.15.69:43284) 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2e218700 1 -- 172.21.15.69:0/1119343793 learned_addr learned my addr 172.21.15.69:0/1119343793 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2d216700 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2e218700 1 -- 172.21.15.69:0/1119343793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db84b0 msgr2=0x55ebe5dc4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2da17700 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db84b0 0x55ebe5dc4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2e218700 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db84b0 0x55ebe5dc4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2e218700 1 -- 172.21.15.69:0/1119343793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db8e00 msgr2=0x55ebe5dc4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2e218700 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2e218700 1 -- 172.21.15.69:0/1119343793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ebe5cd0120 con 0x55ebe5db9cb0 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2d216700 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb2e218700 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc7c60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000a730 tx=0x7ffb20004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad834b12577d610 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.718+0000 7ffb117fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb117fa700 1 -- 172.21.15.69:0/1119343793 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20018040 con 0x55ebe5db9cb0 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb117fa700 1 -- 172.21.15.69:0/1119343793 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ffb20003fe0 con 0x55ebe5db9cb0 2023-12-14T14:10:01.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1119343793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb20010040 con 0x55ebe5db9cb0 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb117fa700 1 -- 172.21.15.69:0/1119343793 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb2000f020 con 0x55ebe5db9cb0 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb3be09b80 10 client.15048 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1119343793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ebe5b37b10 con 0x55ebe5db9cb0 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb117fa700 1 -- 172.21.15.69:0/1119343793 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb20010040 con 0x55ebe5db9cb0 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb117fa700 1 -- 172.21.15.69:0/1119343793 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffb20024020 con 0x55ebe5db9cb0 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb3be09b80 10 client.15048 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb3be09b80 10 client.15048 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb3be09b80 20 client.15048 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ebe5e26440 0x55ebe5e22dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb3be09b80 4 client.15048 mds_command: new command op to 24467 tid=0[{"prefix": "status"}] 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1119343793 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ebe5d029b0 con 0x55ebe5e26440 2023-12-14T14:10:01.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.719+0000 7ffb2da17700 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ebe5e26440 0x55ebe5e22dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb117fa700 10 client.15048 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb2da17700 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ebe5e26440 0x55ebe5e22dd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ab759006b8d557a server_cookie=5e049e390a4e9029 in_seq=0 out_seq=0 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb117fa700 1 -- 172.21.15.69:0/1119343793 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ebe5d029b0 con 0x55ebe5e26440 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb117fa700 10 client.15048 handle_command_reply: tid=0 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 client.15048 shutdown 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1119343793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 msgr2=0x55ebe5dc7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc7c60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000a730 tx=0x7ffb20004510 comp rx=0 tx=0).stop 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1119343793 shutdown_connections 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ebe5e26440 0x55ebe5e22dd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebe5db9cb0 0x55ebe5dc7c60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb117fa700 0 client.15048 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:10:01.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ebe5db84b0 0x55ebe5dc4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 --2- 172.21.15.69:0/1119343793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebe5db8e00 0x55ebe5dc4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1119343793 >> 172.21.15.69:0/1119343793 conn(0x55ebe5dadc50 msgr2=0x55ebe5dc0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1119343793 shutdown_connections 2023-12-14T14:10:01.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 1 -- 172.21.15.69:0/1119343793 wait complete. 2023-12-14T14:10:01.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.720+0000 7ffb3be09b80 20 client.15048 trim_cache size 0 max 16384 2023-12-14T14:10:01.730 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:10:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:10:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24467, 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 46.922181313999999, 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 82, 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 82, 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 63.894413892999999 2023-12-14T14:10:01.731 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:10:01.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb140a11e0 msgr2=0x7ffb140a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb140a11e0 0x7ffb140a3690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb28068af0 tx=0x7ffb1c00b410 comp rx=0 tx=0).stop 2023-12-14T14:10:01.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 msgr2=0x7ffb2819ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 0x7ffb2819ad10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffb240095c0 tx=0x7ffb2400f690 comp rx=0 tx=0).stop 2023-12-14T14:10:01.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/3821217850 shutdown_connections 2023-12-14T14:10:01.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ffb140a11e0 0x7ffb140a3690 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb28100d10 0x7ffb2819d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb280ff650 0x7ffb280fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 --2- 172.21.15.69:0/3821217850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb28100360 0x7ffb2819ad10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/3821217850 >> 172.21.15.69:0/3821217850 conn(0x7ffb280f9eb0 msgr2=0x7ffb280fc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/3821217850 shutdown_connections 2023-12-14T14:10:01.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.721+0000 7ffb2fc7b700 1 -- 172.21.15.69:0/3821217850 wait complete. 2023-12-14T14:10:01.734 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-12-14T14:10:01.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.858+0000 7f2293d0f700 1 -- 172.21.15.69:0/3263262958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c100cc0 msgr2=0x7f228c1030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.858+0000 7f2293d0f700 1 --2- 172.21.15.69:0/3263262958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c100cc0 0x7f228c1030a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2288009990 tx=0x7f2288009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.858+0000 7f2293d0f700 1 -- 172.21.15.69:0/3263262958 shutdown_connections 2023-12-14T14:10:01.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.858+0000 7f2293d0f700 1 --2- 172.21.15.69:0/3263262958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f228c105f00 0x7f228c108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 --2- 172.21.15.69:0/3263262958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c100cc0 0x7f228c1030a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 --2- 172.21.15.69:0/3263262958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c1035e0 0x7f228c1059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 -- 172.21.15.69:0/3263262958 >> 172.21.15.69:0/3263262958 conn(0x7f228c0fa740 msgr2=0x7f228c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 -- 172.21.15.69:0/3263262958 shutdown_connections 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 -- 172.21.15.69:0/3263262958 wait complete. 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 Processor -- start 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 -- start start 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c100cc0 0x7f228c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1035e0 0x7f228c196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f228c105f00 0x7f228c19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c19db90 con 0x7f228c1035e0 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c19dcd0 con 0x7f228c100cc0 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f2293d0f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c19de60 con 0x7f228c105f00 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f22912aa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1035e0 0x7f228c196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f22912aa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1035e0 0x7f228c196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43298/0 (socket says 172.21.15.69:43298) 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.859+0000 7f22912aa700 1 -- 172.21.15.69:0/447176266 learned_addr learned my addr 172.21.15.69:0/447176266 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f22922ac700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f228c105f00 0x7f228c19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f2291aab700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c100cc0 0x7f228c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f22912aa700 1 -- 172.21.15.69:0/447176266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f228c105f00 msgr2=0x7f228c19d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f22912aa700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f228c105f00 0x7f228c19d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f22912aa700 1 -- 172.21.15.69:0/447176266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c100cc0 msgr2=0x7f228c196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f22912aa700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c100cc0 0x7f228c196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f22912aa700 1 -- 172.21.15.69:0/447176266 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880095f0 con 0x7f228c1035e0 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f2291aab700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c100cc0 0x7f228c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f22912aa700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1035e0 0x7f228c196550 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f227c00d950 tx=0x7f227c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f2282ffd700 1 -- 172.21.15.69:0/447176266 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c009940 con 0x7f228c1035e0 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f2282ffd700 1 -- 172.21.15.69:0/447176266 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f227c010460 con 0x7f228c1035e0 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f2293d0f700 1 -- 172.21.15.69:0/447176266 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c10bc00 con 0x7f228c1035e0 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f2282ffd700 1 -- 172.21.15.69:0/447176266 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c00f620 con 0x7f228c1035e0 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.860+0000 7f2293d0f700 1 -- 172.21.15.69:0/447176266 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c10ba70 con 0x7f228c1035e0 2023-12-14T14:10:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.862+0000 7f2282ffd700 1 -- 172.21.15.69:0/447176266 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f227c0108d0 con 0x7f228c1035e0 2023-12-14T14:10:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.862+0000 7f2282ffd700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f22780a11e0 0x7f22780a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.863+0000 7f2291aab700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f22780a11e0 0x7f22780a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.863+0000 7f2282ffd700 1 -- 172.21.15.69:0/447176266 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f227c0cc760 con 0x7f228c1035e0 2023-12-14T14:10:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.863+0000 7f2291aab700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f22780a11e0 0x7f22780a3690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f228800b5c0 tx=0x7f2288005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.863+0000 7f229fe9db80 1 Processor -- start 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f229fe9db80 1 -- start start 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896db58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896db6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896db7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f229fe9db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896c9e590 con 0x55a896db5e00 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f229fe9db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896d0d820 con 0x55a896db54b0 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f229fe9db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896d06cb0 con 0x55a896db6cb0 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f22912aa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896db6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f22912aa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896db6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43312/0 (socket says 172.21.15.69:43312) 2023-12-14T14:10:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f22912aa700 1 -- 172.21.15.69:0/1001575921 learned_addr learned my addr 172.21.15.69:0/1001575921 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f2291aab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896db58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f22912aa700 1 -- 172.21.15.69:0/1001575921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 msgr2=0x55a896db7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f22912aa700 1 --2- 172.21.15.69:0/1001575921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896db7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f22912aa700 1 -- 172.21.15.69:0/1001575921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 msgr2=0x55a896db58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f22912aa700 1 --2- 172.21.15.69:0/1001575921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896db58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f22912aa700 1 -- 172.21.15.69:0/1001575921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a896b88360 con 0x55a896db5e00 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.864+0000 7f22912aa700 1 --2- 172.21.15.69:0/1001575921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896db6720 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f227c0a1ae0 tx=0x7f227c099620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a92f1c3e03f22f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f2277fff700 1 -- 172.21.15.69:0/1001575921 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a2010 con 0x55a896db5e00 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f2277fff700 1 -- 172.21.15.69:0/1001575921 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f227c099e20 con 0x55a896db5e00 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f2277fff700 1 -- 172.21.15.69:0/1001575921 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a1d80 con 0x55a896db5e00 2023-12-14T14:10:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f229fe9db80 1 -- 172.21.15.69:0/1001575921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 msgr2=0x55a896db6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f229fe9db80 1 --2- 172.21.15.69:0/1001575921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896db6720 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f227c0a1ae0 tx=0x7f227c099620 comp rx=0 tx=0).stop 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f229fe9db80 1 -- 172.21.15.69:0/1001575921 shutdown_connections 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f229fe9db80 1 --2- 172.21.15.69:0/1001575921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896db7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f229fe9db80 1 --2- 172.21.15.69:0/1001575921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896db58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f229fe9db80 1 --2- 172.21.15.69:0/1001575921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896db6720 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f229fe9db80 1 -- 172.21.15.69:0/1001575921 >> 172.21.15.69:0/1001575921 conn(0x55a896daac50 msgr2=0x55a896db03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f229fe9db80 1 -- 172.21.15.69:0/1001575921 shutdown_connections 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.865+0000 7f229fe9db80 1 -- 172.21.15.69:0/1001575921 wait complete. 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f229fe9db80 1 -- start start 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f229fe9db80 1 Processor -- start 2023-12-14T14:10:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896dbf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896dbf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896dc6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f229fe9db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896ca2f40 con 0x55a896db5e00 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f229fe9db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896ca2be0 con 0x55a896db54b0 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f229fe9db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896b8a650 con 0x55a896db6cb0 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f229fe9db80 10 client.0 _ll_register_callbacks cb 0x55a896cc68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f22912aa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896dbf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f22912aa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896dbf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43320/0 (socket says 172.21.15.69:43320) 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f22912aa700 1 -- 172.21.15.69:0/2053767921 learned_addr learned my addr 172.21.15.69:0/2053767921 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f2291aab700 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896dbf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.866+0000 7f22922ac700 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896dc6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22912aa700 1 -- 172.21.15.69:0/2053767921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 msgr2=0x55a896dc6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22912aa700 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896dc6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22912aa700 1 -- 172.21.15.69:0/2053767921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 msgr2=0x55a896dbf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22912aa700 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896dbf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22912aa700 1 -- 172.21.15.69:0/2053767921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c10ba70 con 0x55a896db5e00 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22922ac700 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896dc6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22912aa700 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896dbf6c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f227c0960c0 tx=0x7f227c09dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9d06cf3de3fed0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22757fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22757fa700 1 -- 172.21.15.69:0/2053767921 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0b2390 con 0x55a896db5e00 2023-12-14T14:10:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22757fa700 1 -- 172.21.15.69:0/2053767921 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f227c0a1b80 con 0x55a896db5e00 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f229fe9db80 1 -- 172.21.15.69:0/2053767921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a896da8260 con 0x55a896db5e00 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22757fa700 1 -- 172.21.15.69:0/2053767921 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f227c0a1d40 con 0x55a896db5e00 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f229fe9db80 10 client.15060 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f229fe9db80 1 -- 172.21.15.69:0/2053767921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55a896ccd120 con 0x55a896db5e00 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22757fa700 1 -- 172.21.15.69:0/2053767921 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f227c0c8080 con 0x55a896db5e00 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f22757fa700 1 -- 172.21.15.69:0/2053767921 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f227c009aa0 con 0x55a896db5e00 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f229fe9db80 10 client.15060 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f229fe9db80 10 client.15060 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f229fe9db80 20 client.15060 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55a896dc9fe0 0x55a896dc9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f229fe9db80 4 client.15060 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.867+0000 7f229fe9db80 1 -- 172.21.15.69:0/2053767921 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a896cffc90 con 0x55a896dc9fe0 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.868+0000 7f2291aab700 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55a896dc9fe0 0x55a896dc9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.868+0000 7f22757fa700 10 client.15060 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.868+0000 7f2291aab700 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55a896dc9fe0 0x55a896dc9630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d629aef6bc986491 server_cookie=c2bb00ec7b8aa219 in_seq=0 out_seq=0 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f22757fa700 1 -- 172.21.15.69:0/2053767921 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a896cffc90 con 0x55a896dc9fe0 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f22757fa700 10 client.15060 handle_command_reply: tid=0 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 client.15060 shutdown 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 -- 172.21.15.69:0/2053767921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 msgr2=0x55a896dbf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896dbf6c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f227c0960c0 tx=0x7f227c09dd70 comp rx=0 tx=0).stop 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 -- 172.21.15.69:0/2053767921 shutdown_connections 2023-12-14T14:10:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896dc6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896dbf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55a896dc9fe0 0x55a896dc9630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2053767921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896dbf6c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 -- 172.21.15.69:0/2053767921 >> 172.21.15.69:0/2053767921 conn(0x55a896daac50 msgr2=0x55a896daeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f22757fa700 0 client.15060 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:10:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 -- 172.21.15.69:0/2053767921 shutdown_connections 2023-12-14T14:10:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 1 -- 172.21.15.69:0/2053767921 wait complete. 2023-12-14T14:10:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.869+0000 7f229fe9db80 20 client.15060 trim_cache size 0 max 16384 2023-12-14T14:10:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f229fe9db80 1 Processor -- start 2023-12-14T14:10:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f229fe9db80 1 -- start start 2023-12-14T14:10:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896dbcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db5e00 0x55a896dbd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db6cb0 0x55a896db9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f229fe9db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896db16e0 con 0x55a896db6cb0 2023-12-14T14:10:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f229fe9db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896db50d0 con 0x55a896db54b0 2023-12-14T14:10:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f229fe9db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896cffc90 con 0x55a896db5e00 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f22922ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db6cb0 0x55a896db9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f22922ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db6cb0 0x55a896db9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43334/0 (socket says 172.21.15.69:43334) 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.887+0000 7f22922ac700 1 -- 172.21.15.69:0/2994048721 learned_addr learned my addr 172.21.15.69:0/2994048721 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f2291aab700 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896dbcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f22922ac700 1 -- 172.21.15.69:0/2994048721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db5e00 msgr2=0x55a896dbd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f22912aa700 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db5e00 0x55a896dbd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f22922ac700 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db5e00 0x55a896dbd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f22922ac700 1 -- 172.21.15.69:0/2994048721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 msgr2=0x55a896dbcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f22922ac700 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896dbcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f22922ac700 1 -- 172.21.15.69:0/2994048721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a896db7350 con 0x55a896db6cb0 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f2291aab700 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896dbcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f22922ac700 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db6cb0 0x55a896db9cf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f228400a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a649da43dd988d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f2280ff9700 1 -- 172.21.15.69:0/2994048721 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400ae90 con 0x55a896db6cb0 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f2280ff9700 1 -- 172.21.15.69:0/2994048721 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2284011040 con 0x55a896db6cb0 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f2280ff9700 1 -- 172.21.15.69:0/2994048721 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284014870 con 0x55a896db6cb0 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f229fe9db80 1 -- 172.21.15.69:0/2994048721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db6cb0 msgr2=0x55a896db9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db6cb0 0x55a896db9cf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f228400a6e0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f229fe9db80 1 -- 172.21.15.69:0/2994048721 shutdown_connections 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db6cb0 0x55a896db9cf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896dbcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.888+0000 7f229fe9db80 1 --2- 172.21.15.69:0/2994048721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db5e00 0x55a896dbd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 -- 172.21.15.69:0/2994048721 >> 172.21.15.69:0/2994048721 conn(0x55a896daac50 msgr2=0x55a896dc6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 -- 172.21.15.69:0/2994048721 shutdown_connections 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 -- 172.21.15.69:0/2994048721 wait complete. 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 -- start start 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 Processor -- start 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896e1a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896e1af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896e21f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896e22480 con 0x55a896db5e00 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896e225c0 con 0x55a896db54b0 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a896e22750 con 0x55a896db6cb0 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f229fe9db80 10 client.0 _ll_register_callbacks cb 0x7f2288005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f22912aa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896e1af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f22912aa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896e1af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43348/0 (socket says 172.21.15.69:43348) 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.889+0000 7f22912aa700 1 -- 172.21.15.69:0/498250958 learned_addr learned my addr 172.21.15.69:0/498250958 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22922ac700 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896e21f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22912aa700 1 -- 172.21.15.69:0/498250958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 msgr2=0x55a896e21f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22912aa700 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896e21f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22912aa700 1 -- 172.21.15.69:0/498250958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 msgr2=0x55a896e1a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22912aa700 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896e1a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22912aa700 1 -- 172.21.15.69:0/498250958 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2284009c10 con 0x55a896db5e00 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22912aa700 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896e1af00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f227c00b2f0 tx=0x7f227c099440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1a27c977ef7073 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22757fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22757fa700 1 -- 172.21.15.69:0/498250958 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0b2390 con 0x55a896db5e00 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22757fa700 1 -- 172.21.15.69:0/498250958 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f227c0a2010 con 0x55a896db5e00 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f229fe9db80 1 -- 172.21.15.69:0/498250958 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f227c099e20 con 0x55a896db5e00 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22757fa700 1 -- 172.21.15.69:0/498250958 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f227c0a1d90 con 0x55a896db5e00 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f229fe9db80 10 client.15066 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f229fe9db80 1 -- 172.21.15.69:0/498250958 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55a896b34b10 con 0x55a896db5e00 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22757fa700 1 -- 172.21.15.69:0/498250958 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f227c099e20 con 0x55a896db5e00 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f22757fa700 1 -- 172.21.15.69:0/498250958 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f227c098b20 con 0x55a896db5e00 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f229fe9db80 10 client.15066 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f229fe9db80 10 client.15066 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f229fe9db80 20 client.15066 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f229fe9db80 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55a896e27050 0x55a896e23960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f229fe9db80 4 client.15066 mds_command: new command op to 24469 tid=0[{"prefix": "status"}] 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.890+0000 7f229fe9db80 1 -- 172.21.15.69:0/498250958 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a896cff9b0 con 0x55a896e27050 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f2291aab700 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55a896e27050 0x55a896e23960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f22757fa700 10 client.15066 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:10:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f2291aab700 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55a896e27050 0x55a896e23960 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c2dd379f076bc955 server_cookie=c4ec3db64fe15317 in_seq=0 out_seq=0 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f22757fa700 1 -- 172.21.15.69:0/498250958 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a896cff9b0 con 0x55a896e27050 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f22757fa700 10 client.15066 handle_command_reply: tid=0 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 client.15066 shutdown 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 -- 172.21.15.69:0/498250958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 msgr2=0x55a896e1af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896e1af00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f227c00b2f0 tx=0x7f227c099440 comp rx=0 tx=0).stop 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 -- 172.21.15.69:0/498250958 shutdown_connections 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a896db6cb0 0x55a896e21f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a896db54b0 0x55a896e1a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55a896e27050 0x55a896e23960 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 --2- 172.21.15.69:0/498250958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a896db5e00 0x55a896e1af00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f22757fa700 0 client.15066 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:10:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 -- 172.21.15.69:0/498250958 >> 172.21.15.69:0/498250958 conn(0x55a896daac50 msgr2=0x55a896dbcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 -- 172.21.15.69:0/498250958 shutdown_connections 2023-12-14T14:10:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.891+0000 7f229fe9db80 1 -- 172.21.15.69:0/498250958 wait complete. 2023-12-14T14:10:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f229fe9db80 20 client.15066 trim_cache size 0 max 16384 2023-12-14T14:10:01.902 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:10:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:10:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24469, 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 48.100310010999998, 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 82, 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 82, 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 62.336007778000003 2023-12-14T14:10:01.903 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:10:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 -- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f22780a11e0 msgr2=0x7f22780a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f22780a11e0 0x7f22780a3690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f228800b5c0 tx=0x7f2288005fb0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 -- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1035e0 msgr2=0x7f228c196550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1035e0 0x7f228c196550 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f227c00d950 tx=0x7f227c00dc60 comp rx=0 tx=0).stop 2023-12-14T14:10:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 -- 172.21.15.69:0/447176266 shutdown_connections 2023-12-14T14:10:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f22780a11e0 0x7f22780a3690 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f228c105f00 0x7f228c19d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c100cc0 0x7f228c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 --2- 172.21.15.69:0/447176266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1035e0 0x7f228c196550 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 -- 172.21.15.69:0/447176266 >> 172.21.15.69:0/447176266 conn(0x7f228c0fa740 msgr2=0x7f228c101940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 -- 172.21.15.69:0/447176266 shutdown_connections 2023-12-14T14:10:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:01.892+0000 7f2293d0f700 1 -- 172.21.15.69:0/447176266 wait complete. 2023-12-14T14:10:01.906 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-14T14:10:02.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.029+0000 7f0046b2e700 1 -- 172.21.15.69:0/2249401288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040105f80 msgr2=0x7f0040108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:02.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.029+0000 7f0046b2e700 1 --2- 172.21.15.69:0/2249401288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040105f80 0x7f0040108380 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f003800b0a0 tx=0x7f003800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.029+0000 7f0046b2e700 1 -- 172.21.15.69:0/2249401288 shutdown_connections 2023-12-14T14:10:02.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.029+0000 7f0046b2e700 1 --2- 172.21.15.69:0/2249401288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040105f80 0x7f0040108380 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.029+0000 7f0046b2e700 1 --2- 172.21.15.69:0/2249401288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0040100d40 0x7f0040103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.029+0000 7f0046b2e700 1 --2- 172.21.15.69:0/2249401288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0040103660 0x7f0040105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.029+0000 7f0046b2e700 1 -- 172.21.15.69:0/2249401288 >> 172.21.15.69:0/2249401288 conn(0x7f00400fa780 msgr2=0x7f00400fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:02.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.029+0000 7f0046b2e700 1 -- 172.21.15.69:0/2249401288 shutdown_connections 2023-12-14T14:10:02.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f0046b2e700 1 -- 172.21.15.69:0/2249401288 wait complete. 2023-12-14T14:10:02.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f0046b2e700 1 Processor -- start 2023-12-14T14:10:02.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f0046b2e700 1 -- start start 2023-12-14T14:10:02.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f0046b2e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0040100d40 0x7f0040196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f0046b2e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040103660 0x7f0040196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f0046b2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0040105f80 0x7f004019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f0046b2e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004019dc90 con 0x7f0040103660 2023-12-14T14:10:02.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f0046b2e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004019ddd0 con 0x7f0040105f80 2023-12-14T14:10:02.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f0046b2e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004019df60 con 0x7f0040100d40 2023-12-14T14:10:02.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f003ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040103660 0x7f0040196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f003ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040103660 0x7f0040196650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43364/0 (socket says 172.21.15.69:43364) 2023-12-14T14:10:02.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.030+0000 7f003ffff700 1 -- 172.21.15.69:0/665214354 learned_addr learned my addr 172.21.15.69:0/665214354 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:02.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f00448ca700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0040100d40 0x7f0040196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f003ffff700 1 -- 172.21.15.69:0/665214354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0040100d40 msgr2=0x7f0040196110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:02.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f003ffff700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0040100d40 0x7f0040196110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f00450cb700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0040105f80 0x7f004019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f003ffff700 1 -- 172.21.15.69:0/665214354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0040105f80 msgr2=0x7f004019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:02.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f003ffff700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0040105f80 0x7f004019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f003ffff700 1 -- 172.21.15.69:0/665214354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009d00 con 0x7f0040103660 2023-12-14T14:10:02.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f00448ca700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0040100d40 0x7f0040196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:02.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f00450cb700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0040105f80 0x7f004019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:02.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f003ffff700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040103660 0x7f0040196650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f002c00b530 tx=0x7f002c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:02.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f003dffb700 1 -- 172.21.15.69:0/665214354 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c011830 con 0x7f0040103660 2023-12-14T14:10:02.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f003dffb700 1 -- 172.21.15.69:0/665214354 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f002c011e50 con 0x7f0040103660 2023-12-14T14:10:02.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f0046b2e700 1 -- 172.21.15.69:0/665214354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004010bc70 con 0x7f0040103660 2023-12-14T14:10:02.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f003dffb700 1 -- 172.21.15.69:0/665214354 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00f2e0 con 0x7f0040103660 2023-12-14T14:10:02.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.031+0000 7f0046b2e700 1 -- 172.21.15.69:0/665214354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004010bae0 con 0x7f0040103660 2023-12-14T14:10:02.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.033+0000 7f003dffb700 1 -- 172.21.15.69:0/665214354 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f002c010580 con 0x7f0040103660 2023-12-14T14:10:02.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.034+0000 7f003dffb700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f00300a11e0 0x7f00300a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.034+0000 7f00448ca700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f00300a11e0 0x7f00300a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.034+0000 7f003dffb700 1 -- 172.21.15.69:0/665214354 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f002c0cc410 con 0x7f0040103660 2023-12-14T14:10:02.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.034+0000 7f00448ca700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f00300a11e0 0x7f00300a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0034005fd0 tx=0x7f0034005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:02.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f0052cbcb80 1 Processor -- start 2023-12-14T14:10:02.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f0052cbcb80 1 -- start start 2023-12-14T14:10:02.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f2708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f270e00 0x55719f271720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f272120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f159590 con 0x55719f2704b0 2023-12-14T14:10:02.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f1c8820 con 0x55719f271cb0 2023-12-14T14:10:02.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f1c1cb0 con 0x55719f270e00 2023-12-14T14:10:02.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f00448ca700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f2708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f00448ca700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f2708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43370/0 (socket says 172.21.15.69:43370) 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f00448ca700 1 -- 172.21.15.69:0/4284038667 learned_addr learned my addr 172.21.15.69:0/4284038667 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f00450cb700 1 --2- 172.21.15.69:0/4284038667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f272120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f00448ca700 1 -- 172.21.15.69:0/4284038667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f270e00 msgr2=0x55719f271720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f00448ca700 1 --2- 172.21.15.69:0/4284038667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f270e00 0x55719f271720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f00448ca700 1 -- 172.21.15.69:0/4284038667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 msgr2=0x55719f272120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f00448ca700 1 --2- 172.21.15.69:0/4284038667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f272120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.035+0000 7f00448ca700 1 -- 172.21.15.69:0/4284038667 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55719f043360 con 0x55719f2704b0 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f00448ca700 1 --2- 172.21.15.69:0/4284038667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f2708c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f003400db90 tx=0x7f0034010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4aa742ed2e9ff server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f002affd700 1 -- 172.21.15.69:0/4284038667 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003400f930 con 0x55719f2704b0 2023-12-14T14:10:02.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f002affd700 1 -- 172.21.15.69:0/4284038667 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f003401c450 con 0x55719f2704b0 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f002affd700 1 -- 172.21.15.69:0/4284038667 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003401b610 con 0x55719f2704b0 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f0052cbcb80 1 -- 172.21.15.69:0/4284038667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 msgr2=0x55719f2708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/4284038667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f2708c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f003400db90 tx=0x7f0034010000 comp rx=0 tx=0).stop 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f0052cbcb80 1 -- 172.21.15.69:0/4284038667 shutdown_connections 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/4284038667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f272120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/4284038667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f2708c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/4284038667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f270e00 0x55719f271720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f0052cbcb80 1 -- 172.21.15.69:0/4284038667 >> 172.21.15.69:0/4284038667 conn(0x55719f265c50 msgr2=0x55719f26b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f0052cbcb80 1 -- 172.21.15.69:0/4284038667 shutdown_connections 2023-12-14T14:10:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.036+0000 7f0052cbcb80 1 -- 172.21.15.69:0/4284038667 wait complete. 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.037+0000 7f0052cbcb80 1 -- start start 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.037+0000 7f0052cbcb80 1 Processor -- start 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.037+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f2704b0 0x55719f27a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.037+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.037+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f271cb0 0x55719f2816e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.037+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f15df40 con 0x55719f270e00 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.037+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f15dbe0 con 0x55719f2704b0 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.037+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f045650 con 0x55719f271cb0 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.037+0000 7f0052cbcb80 10 client.0 _ll_register_callbacks cb 0x55719f1818c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:02.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f003ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f003ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43382/0 (socket says 172.21.15.69:43382) 2023-12-14T14:10:02.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f003ffff700 1 -- 172.21.15.69:0/2019570572 learned_addr learned my addr 172.21.15.69:0/2019570572 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:02.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f00450cb700 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f271cb0 0x55719f2816e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f003ffff700 1 -- 172.21.15.69:0/2019570572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f271cb0 msgr2=0x55719f2816e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:02.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f00448ca700 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f2704b0 0x55719f27a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f003ffff700 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f271cb0 0x55719f2816e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f003ffff700 1 -- 172.21.15.69:0/2019570572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f2704b0 msgr2=0x55719f27a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:02.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f003ffff700 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f2704b0 0x55719f27a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f003ffff700 1 -- 172.21.15.69:0/2019570572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003400d840 con 0x55719f270e00 2023-12-14T14:10:02.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f003ffff700 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27a6a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f002c0962f0 tx=0x7f002c010470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734c3232d1b85a41 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:02.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f001ffff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:02.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f001ffff700 1 -- 172.21.15.69:0/2019570572 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c0cc270 con 0x55719f270e00 2023-12-14T14:10:02.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f001ffff700 1 -- 172.21.15.69:0/2019570572 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f002c09d8b0 con 0x55719f270e00 2023-12-14T14:10:02.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f0052cbcb80 1 -- 172.21.15.69:0/2019570572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55719f263260 con 0x55719f270e00 2023-12-14T14:10:02.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f001ffff700 1 -- 172.21.15.69:0/2019570572 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f002c0a1cd0 con 0x55719f270e00 2023-12-14T14:10:02.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f0052cbcb80 10 client.15078 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:02.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f0052cbcb80 1 -- 172.21.15.69:0/2019570572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55719f188120 con 0x55719f270e00 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f001ffff700 1 -- 172.21.15.69:0/2019570572 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55719f263260 con 0x55719f270e00 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.038+0000 7f001ffff700 1 -- 172.21.15.69:0/2019570572 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f002c0b90b0 con 0x55719f270e00 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.039+0000 7f0052cbcb80 10 client.15078 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.039+0000 7f0052cbcb80 10 client.15078 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.039+0000 7f0052cbcb80 20 client.15078 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.039+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55719f285990 0x55719f2847f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.039+0000 7f0052cbcb80 4 client.15078 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.039+0000 7f0052cbcb80 1 -- 172.21.15.69:0/2019570572 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55719f1bac90 con 0x55719f285990 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.039+0000 7f00448ca700 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55719f285990 0x55719f2847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.039+0000 7f001ffff700 10 client.15078 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.039+0000 7f00448ca700 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55719f285990 0x55719f2847f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52674af9ad3ab3be server_cookie=24c884af3ddc909d in_seq=0 out_seq=0 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f001ffff700 1 -- 172.21.15.69:0/2019570572 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55719f1bac90 con 0x55719f285990 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f001ffff700 10 client.15078 handle_command_reply: tid=0 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 client.15078 shutdown 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 -- 172.21.15.69:0/2019570572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 msgr2=0x55719f27a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27a6a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f002c0962f0 tx=0x7f002c010470 comp rx=0 tx=0).stop 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 -- 172.21.15.69:0/2019570572 shutdown_connections 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55719f285990 0x55719f2847f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f271cb0 0x55719f2816e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f2704b0 0x55719f27a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f001ffff700 0 client.15078 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:02.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/2019570572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27a6a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 -- 172.21.15.69:0/2019570572 >> 172.21.15.69:0/2019570572 conn(0x55719f265c50 msgr2=0x55719f269ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:02.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 -- 172.21.15.69:0/2019570572 shutdown_connections 2023-12-14T14:10:02.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 1 -- 172.21.15.69:0/2019570572 wait complete. 2023-12-14T14:10:02.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.040+0000 7f0052cbcb80 20 client.15078 trim_cache size 0 max 16384 2023-12-14T14:10:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f0052cbcb80 1 Processor -- start 2023-12-14T14:10:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f0052cbcb80 1 -- start start 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f278e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f270e00 0x55719f281670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f2847f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f16b580 con 0x55719f2704b0 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f180290 con 0x55719f271cb0 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f0cdc50 con 0x55719f270e00 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f00448ca700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f278e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f00448ca700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f278e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43396/0 (socket says 172.21.15.69:43396) 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f00448ca700 1 -- 172.21.15.69:0/1165900620 learned_addr learned my addr 172.21.15.69:0/1165900620 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f00448ca700 1 -- 172.21.15.69:0/1165900620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f270e00 msgr2=0x55719f281670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f00448ca700 1 --2- 172.21.15.69:0/1165900620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f270e00 0x55719f281670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f00448ca700 1 -- 172.21.15.69:0/1165900620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 msgr2=0x55719f2847f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f00448ca700 1 --2- 172.21.15.69:0/1165900620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f2847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.058+0000 7f00448ca700 1 -- 172.21.15.69:0/1165900620 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55719f272350 con 0x55719f2704b0 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f00448ca700 1 --2- 172.21.15.69:0/1165900620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f278e90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f003400db90 tx=0x7f0034005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7cc192331e5b22 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f002b7fe700 1 -- 172.21.15.69:0/1165900620 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003401c5c0 con 0x55719f2704b0 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f002b7fe700 1 -- 172.21.15.69:0/1165900620 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f003402b040 con 0x55719f2704b0 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f002b7fe700 1 -- 172.21.15.69:0/1165900620 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034032340 con 0x55719f2704b0 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f0052cbcb80 1 -- 172.21.15.69:0/1165900620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 msgr2=0x55719f278e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/1165900620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f278e90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f003400db90 tx=0x7f0034005e30 comp rx=0 tx=0).stop 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f0052cbcb80 1 -- 172.21.15.69:0/1165900620 shutdown_connections 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/1165900620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f2847f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/1165900620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f2704b0 0x55719f278e90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/1165900620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f270e00 0x55719f281670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f0052cbcb80 1 -- 172.21.15.69:0/1165900620 >> 172.21.15.69:0/1165900620 conn(0x55719f265c50 msgr2=0x55719f2780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f0052cbcb80 1 -- 172.21.15.69:0/1165900620 shutdown_connections 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.059+0000 7f0052cbcb80 1 -- 172.21.15.69:0/1165900620 wait complete. 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f0052cbcb80 1 -- start start 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f0052cbcb80 1 Processor -- start 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f2704b0 0x55719f27be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f0052cbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f2813c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f281900 con 0x55719f270e00 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f281a70 con 0x55719f271cb0 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f0052cbcb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719f2d9200 con 0x55719f2704b0 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f0052cbcb80 10 client.0 _ll_register_callbacks cb 0x7f002c099400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f003ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f003ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43410/0 (socket says 172.21.15.69:43410) 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f003ffff700 1 -- 172.21.15.69:0/190819109 learned_addr learned my addr 172.21.15.69:0/190819109 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f00448ca700 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f2704b0 0x55719f27be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f00450cb700 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f2813c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f003ffff700 1 -- 172.21.15.69:0/190819109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f2704b0 msgr2=0x55719f27be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f003ffff700 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f2704b0 0x55719f27be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f003ffff700 1 -- 172.21.15.69:0/190819109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 msgr2=0x55719f2813c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f003ffff700 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f2813c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.060+0000 7f003ffff700 1 -- 172.21.15.69:0/190819109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55719f043360 con 0x55719f270e00 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f003ffff700 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27c390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f002c099580 tx=0x7f002c004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c8a0694015ba9d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f001ffff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f001ffff700 1 -- 172.21.15.69:0/190819109 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c0a1a40 con 0x55719f270e00 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f001ffff700 1 -- 172.21.15.69:0/190819109 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f002c0a1cd0 con 0x55719f270e00 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f0052cbcb80 1 -- 172.21.15.69:0/190819109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f003401c450 con 0x55719f270e00 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f001ffff700 1 -- 172.21.15.69:0/190819109 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f002c010380 con 0x55719f270e00 2023-12-14T14:10:02.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f0052cbcb80 10 client.15084 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f0052cbcb80 1 -- 172.21.15.69:0/190819109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55719efefb10 con 0x55719f270e00 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f001ffff700 1 -- 172.21.15.69:0/190819109 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f002c065030 con 0x55719f270e00 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f001ffff700 1 -- 172.21.15.69:0/190819109 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f002c0987e0 con 0x55719f270e00 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f0052cbcb80 10 client.15084 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f0052cbcb80 10 client.15084 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f0052cbcb80 20 client.15084 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55719f2ddb30 0x55719f2da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f0052cbcb80 4 client.15084 mds_command: new command op to 24500 tid=0[{"prefix": "status"}] 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f0052cbcb80 1 -- 172.21.15.69:0/190819109 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55719f1ba9b0 con 0x55719f2ddb30 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.061+0000 7f00448ca700 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55719f2ddb30 0x55719f2da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f001ffff700 10 client.15084 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f00448ca700 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55719f2ddb30 0x55719f2da580 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e981413223bd301b server_cookie=fdf60154cbceb835 in_seq=0 out_seq=0 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f001ffff700 1 -- 172.21.15.69:0/190819109 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55719f1ba9b0 con 0x55719f2ddb30 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f001ffff700 10 client.15084 handle_command_reply: tid=0 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 client.15084 shutdown 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 -- 172.21.15.69:0/190819109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 msgr2=0x55719f27c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27c390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f002c099580 tx=0x7f002c004860 comp rx=0 tx=0).stop 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 -- 172.21.15.69:0/190819109 shutdown_connections 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55719f2ddb30 0x55719f2da580 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55719f271cb0 0x55719f2813c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f001ffff700 0 client.15084 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:02.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55719f2704b0 0x55719f27be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 --2- 172.21.15.69:0/190819109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55719f270e00 0x55719f27c390 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 -- 172.21.15.69:0/190819109 >> 172.21.15.69:0/190819109 conn(0x55719f265c50 msgr2=0x55719f2847f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:02.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 -- 172.21.15.69:0/190819109 shutdown_connections 2023-12-14T14:10:02.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 1 -- 172.21.15.69:0/190819109 wait complete. 2023-12-14T14:10:02.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.062+0000 7f0052cbcb80 20 client.15084 trim_cache size 0 max 16384 2023-12-14T14:10:02.072 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:10:02.072 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24500, 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 51.461634001, 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 82, 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 82, 2023-12-14T14:10:02.073 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 57.237403059999998 2023-12-14T14:10:02.074 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:10:02.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 -- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f00300a11e0 msgr2=0x7f00300a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:02.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f00300a11e0 0x7f00300a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0034005fd0 tx=0x7f0034005dc0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 -- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040103660 msgr2=0x7f0040196650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040103660 0x7f0040196650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f002c00b530 tx=0x7f002c00b8f0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 -- 172.21.15.69:0/665214354 shutdown_connections 2023-12-14T14:10:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f00300a11e0 0x7f00300a3690 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0040105f80 0x7f004019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0040100d40 0x7f0040196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 --2- 172.21.15.69:0/665214354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0040103660 0x7f0040196650 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 -- 172.21.15.69:0/665214354 >> 172.21.15.69:0/665214354 conn(0x7f00400fa780 msgr2=0x7f00401019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 -- 172.21.15.69:0/665214354 shutdown_connections 2023-12-14T14:10:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:02.063+0000 7f0046b2e700 1 -- 172.21.15.69:0/665214354 wait complete. 2023-12-14T14:10:02.077 INFO:tasks.cephadm:Setup complete, yielding 2023-12-14T14:10:02.077 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-14T14:10:02.087 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T14:10:02.088 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- bash -c 'ceph orch status' 2023-12-14T14:10:02.271 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:02 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1039948116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:02.400 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:10:02.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:02 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1039948116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:02.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:02 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1039948116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:03.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.431+0000 7f9daab42700 1 -- 172.21.15.69:0/1121737892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 msgr2=0x7f9da4100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:03.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.431+0000 7f9daab42700 1 --2- 172.21.15.69:0/1121737892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 0x7f9da4100830 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009990 tx=0x7f9d90009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.431+0000 7f9daab42700 1 -- 172.21.15.69:0/1121737892 shutdown_connections 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.431+0000 7f9daab42700 1 --2- 172.21.15.69:0/1121737892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da4100d70 0x7f9da4107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.431+0000 7f9daab42700 1 --2- 172.21.15.69:0/1121737892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da40ff1e0 0x7f9da40ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.431+0000 7f9daab42700 1 --2- 172.21.15.69:0/1121737892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 0x7f9da4100830 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.431+0000 7f9daab42700 1 -- 172.21.15.69:0/1121737892 >> 172.21.15.69:0/1121737892 conn(0x7f9da40fa7f0 msgr2=0x7f9da40fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 -- 172.21.15.69:0/1121737892 shutdown_connections 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 -- 172.21.15.69:0/1121737892 wait complete. 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 Processor -- start 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 -- start start 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da40ff1e0 0x7f9da4069170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 0x7f9da419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da4100d70 0x7f9da419d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da419db80 con 0x7f9da41003e0 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da419dcf0 con 0x7f9da40ff1e0 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9daab42700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da419deb0 con 0x7f9da4100d70 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9da3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 0x7f9da419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9da3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 0x7f9da419ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43416/0 (socket says 172.21.15.69:43416) 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9da3fff700 1 -- 172.21.15.69:0/77784914 learned_addr learned my addr 172.21.15.69:0/77784914 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.432+0000 7f9da90df700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da4100d70 0x7f9da419d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da88de700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da40ff1e0 0x7f9da4069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da3fff700 1 -- 172.21.15.69:0/77784914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da4100d70 msgr2=0x7f9da419d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:03.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da3fff700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da4100d70 0x7f9da419d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da3fff700 1 -- 172.21.15.69:0/77784914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da40ff1e0 msgr2=0x7f9da4069170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:03.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da3fff700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da40ff1e0 0x7f9da4069170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da3fff700 1 -- 172.21.15.69:0/77784914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900095f0 con 0x7f9da41003e0 2023-12-14T14:10:03.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da3fff700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 0x7f9da419ad50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9d90006010 tx=0x7f9d9000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:03.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da1ffb700 1 -- 172.21.15.69:0/77784914 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9001d070 con 0x7f9da41003e0 2023-12-14T14:10:03.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da410ab50 con 0x7f9da41003e0 2023-12-14T14:10:03.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da1ffb700 1 -- 172.21.15.69:0/77784914 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d90022470 con 0x7f9da41003e0 2023-12-14T14:10:03.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9da1ffb700 1 -- 172.21.15.69:0/77784914 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90017650 con 0x7f9da41003e0 2023-12-14T14:10:03.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.433+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da410a9c0 con 0x7f9da41003e0 2023-12-14T14:10:03.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.434+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da4106820 con 0x7f9da41003e0 2023-12-14T14:10:03.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.435+0000 7f9da1ffb700 1 -- 172.21.15.69:0/77784914 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9d90022890 con 0x7f9da41003e0 2023-12-14T14:10:03.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.436+0000 7f9da1ffb700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d940a11e0 0x7f9d940a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:03.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.436+0000 7f9da88de700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d940a11e0 0x7f9d940a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:03.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.436+0000 7f9da1ffb700 1 -- 172.21.15.69:0/77784914 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9d900cd780 con 0x7f9da41003e0 2023-12-14T14:10:03.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.436+0000 7f9da88de700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d940a11e0 0x7f9d940a3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9da4100240 tx=0x7f9d9800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:03.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.440+0000 7f9da1ffb700 1 -- 172.21.15.69:0/77784914 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9d90096fb0 con 0x7f9da41003e0 2023-12-14T14:10:03.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:03 smithi069 ceph-mon[42034]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T14:10:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.646+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9da4061bc0 con 0x7f9d940a11e0 2023-12-14T14:10:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.647+0000 7f9da1ffb700 1 -- 172.21.15.69:0/77784914 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9da4061bc0 con 0x7f9d940a11e0 2023-12-14T14:10:03.647 INFO:teuthology.orchestra.run.smithi069.stdout:Backend: cephadm 2023-12-14T14:10:03.647 INFO:teuthology.orchestra.run.smithi069.stdout:Available: Yes 2023-12-14T14:10:03.647 INFO:teuthology.orchestra.run.smithi069.stdout:Paused: No 2023-12-14T14:10:03.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:03 smithi081 ceph-mon[43371]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.649+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d940a11e0 msgr2=0x7f9d940a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.649+0000 7f9daab42700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d940a11e0 0x7f9d940a3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9da4100240 tx=0x7f9d9800b410 comp rx=0 tx=0).stop 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.649+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 msgr2=0x7f9da419ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.649+0000 7f9daab42700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 0x7f9da419ad50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9d90006010 tx=0x7f9d9000f690 comp rx=0 tx=0).stop 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.650+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 shutdown_connections 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.650+0000 7f9daab42700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f9d940a11e0 0x7f9d940a3690 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.650+0000 7f9daab42700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da4100d70 0x7f9da419d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.650+0000 7f9daab42700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da40ff1e0 0x7f9da4069170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.650+0000 7f9daab42700 1 --2- 172.21.15.69:0/77784914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9da41003e0 0x7f9da419ad50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.650+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 >> 172.21.15.69:0/77784914 conn(0x7f9da40fa7f0 msgr2=0x7f9da4103960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.650+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 shutdown_connections 2023-12-14T14:10:03.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:03.650+0000 7f9daab42700 1 -- 172.21.15.69:0/77784914 wait complete. 2023-12-14T14:10:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:03 smithi119 ceph-mon[43834]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T14:10:04.026 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-14T14:10:04.338 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:10:04.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:04 smithi069 ceph-mon[42034]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:04.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:04 smithi081 ceph-mon[43371]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:04.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:04 smithi119 ceph-mon[43834]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:05.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 -- 172.21.15.69:0/208780111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401014f0 msgr2=0x7f8a40101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:05.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 --2- 172.21.15.69:0/208780111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401014f0 0x7f8a40101940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009990 tx=0x7f8a30009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 -- 172.21.15.69:0/208780111 shutdown_connections 2023-12-14T14:10:05.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 --2- 172.21.15.69:0/208780111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a40101e80 0x7f8a40108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 --2- 172.21.15.69:0/208780111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a401002f0 0x7f8a40100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 --2- 172.21.15.69:0/208780111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401014f0 0x7f8a40101940 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 -- 172.21.15.69:0/208780111 >> 172.21.15.69:0/208780111 conn(0x7f8a400fb900 msgr2=0x7f8a400fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:05.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 -- 172.21.15.69:0/208780111 shutdown_connections 2023-12-14T14:10:05.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 -- 172.21.15.69:0/208780111 wait complete. 2023-12-14T14:10:05.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.350+0000 7f8a46735700 1 Processor -- start 2023-12-14T14:10:05.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a46735700 1 -- start start 2023-12-14T14:10:05.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a46735700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401002f0 0x7f8a401960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:05.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a46735700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a401014f0 0x7f8a40196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a46735700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a40101e80 0x7f8a4019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a46735700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4019dc60 con 0x7f8a401002f0 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a46735700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4019dda0 con 0x7f8a401014f0 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a46735700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4019df30 con 0x7f8a40101e80 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401002f0 0x7f8a401960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401002f0 0x7f8a401960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43432/0 (socket says 172.21.15.69:43432) 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3ffff700 1 -- 172.21.15.69:0/562733479 learned_addr learned my addr 172.21.15.69:0/562733479 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3f7fe700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a401014f0 0x7f8a40196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3ffff700 1 -- 172.21.15.69:0/562733479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a40101e80 msgr2=0x7f8a4019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:05.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3ffff700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a40101e80 0x7f8a4019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3ffff700 1 -- 172.21.15.69:0/562733479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a401014f0 msgr2=0x7f8a40196610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3ffff700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a401014f0 0x7f8a40196610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3ffff700 1 -- 172.21.15.69:0/562733479 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300095f0 con 0x7f8a401002f0 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3f7fe700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a401014f0 0x7f8a40196610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.351+0000 7f8a3ffff700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401002f0 0x7f8a401960d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400b530 tx=0x7f8a3400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.352+0000 7f8a3d7fa700 1 -- 172.21.15.69:0/562733479 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34011830 con 0x7f8a401002f0 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.352+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4010bcf0 con 0x7f8a401002f0 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.352+0000 7f8a3d7fa700 1 -- 172.21.15.69:0/562733479 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a34011e50 con 0x7f8a401002f0 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.352+0000 7f8a3d7fa700 1 -- 172.21.15.69:0/562733479 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400f2e0 con 0x7f8a401002f0 2023-12-14T14:10:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.352+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4010bb60 con 0x7f8a401002f0 2023-12-14T14:10:05.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.353+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4019e6c0 con 0x7f8a401002f0 2023-12-14T14:10:05.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.354+0000 7f8a3d7fa700 1 -- 172.21.15.69:0/562733479 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8a34010580 con 0x7f8a401002f0 2023-12-14T14:10:05.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.354+0000 7f8a3d7fa700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a280a11e0 0x7f8a280a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:05.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.354+0000 7f8a3f7fe700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a280a11e0 0x7f8a280a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:05.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.354+0000 7f8a3d7fa700 1 -- 172.21.15.69:0/562733479 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8a340cc2b0 con 0x7f8a401002f0 2023-12-14T14:10:05.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.355+0000 7f8a3f7fe700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a280a11e0 0x7f8a280a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a30006010 tx=0x7f8a3000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:05.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.358+0000 7f8a3d7fa700 1 -- 172.21.15.69:0/562733479 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8a34095b60 con 0x7f8a401002f0 2023-12-14T14:10:05.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.556+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a4019ec70 con 0x7f8a280a11e0 2023-12-14T14:10:05.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.569+0000 7f8a3d7fa700 1 -- 172.21.15.69:0/562733479 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f8a4019ec70 con 0x7f8a280a11e0 2023-12-14T14:10:05.568 INFO:teuthology.orchestra.run.smithi069.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-14T14:10:05.568 INFO:teuthology.orchestra.run.smithi069.stdout:mds.a smithi069 running (62s) 57s ago 62s 15.7M - 18.0.0-3905-g1faa3533 0caf899250bd 0796523e3308 2023-12-14T14:10:05.569 INFO:teuthology.orchestra.run.smithi069.stdout:mds.b smithi081 running (61s) 57s ago 60s 14.3M - 18.0.0-3905-g1faa3533 0caf899250bd 7799e12db426 2023-12-14T14:10:05.569 INFO:teuthology.orchestra.run.smithi069.stdout:mds.c smithi119 running (69s) 57s ago 69s 14.2M - 18.0.0-3905-g1faa3533 0caf899250bd 53c7cc032f75 2023-12-14T14:10:05.569 INFO:teuthology.orchestra.run.smithi069.stdout:mds.d smithi069 running (74s) 57s ago 74s 14.0M - 18.0.0-3905-g1faa3533 0caf899250bd 87835d7523db 2023-12-14T14:10:05.569 INFO:teuthology.orchestra.run.smithi069.stdout:mds.e smithi081 running (73s) 57s ago 72s 16.5M - 18.0.0-3905-g1faa3533 0caf899250bd 775ed326258f 2023-12-14T14:10:05.569 INFO:teuthology.orchestra.run.smithi069.stdout:mds.f smithi119 running (71s) 57s ago 71s 16.0M - 18.0.0-3905-g1faa3533 0caf899250bd c25d661a17ee 2023-12-14T14:10:05.569 INFO:teuthology.orchestra.run.smithi069.stdout:mds.g smithi069 running (64s) 57s ago 64s 14.3M - 18.0.0-3905-g1faa3533 0caf899250bd 0555105ed5d3 2023-12-14T14:10:05.569 INFO:teuthology.orchestra.run.smithi069.stdout:mds.h smithi081 running (68s) 57s ago 67s 13.3M - 18.0.0-3905-g1faa3533 0caf899250bd f2d395c8c02e 2023-12-14T14:10:05.569 INFO:teuthology.orchestra.run.smithi069.stdout:mds.i smithi119 running (66s) 57s ago 66s 16.5M - 18.0.0-3905-g1faa3533 0caf899250bd 5e1a97376368 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:mds.j smithi069 running (76s) 57s ago 76s 15.7M - 18.0.0-3905-g1faa3533 0caf899250bd 4cce9fef205f 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:mds.k smithi081 running (78s) 57s ago 77s 13.5M - 18.0.0-3905-g1faa3533 0caf899250bd e547434a62db 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:mds.l smithi119 running (79s) 57s ago 79s 13.5M - 18.0.0-3905-g1faa3533 0caf899250bd 8c040dc1695f 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.x smithi069 *:9283,8765 running (6m) 57s ago 6m 508M - 18.0.0-3905-g1faa3533 0caf899250bd 471394603f0d 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.y smithi081 *:8443,8765 running (5m) 57s ago 5m 443M - 18.0.0-3905-g1faa3533 0caf899250bd b0db393e0886 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.z smithi119 *:8443,8765 running (5m) 57s ago 5m 446M - 18.0.0-3905-g1faa3533 0caf899250bd cb8df0c00c3c 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:mon.a smithi069 running (6m) 57s ago 6m 82.6M 2048M 18.0.0-3905-g1faa3533 0caf899250bd e8cf8c1c2003 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:mon.b smithi081 running (5m) 57s ago 5m 55.5M 2048M 18.0.0-3905-g1faa3533 0caf899250bd 21e9b1054273 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:mon.c smithi119 running (5m) 57s ago 5m 55.3M 2048M 18.0.0-3905-g1faa3533 0caf899250bd 5d4eba530f53 2023-12-14T14:10:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0 smithi069 running (4m) 57s ago 4m 58.4M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 2fc460917c61 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1 smithi081 running (4m) 57s ago 4m 60.8M 4278M 18.0.0-3905-g1faa3533 0caf899250bd f9c43ab56760 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2 smithi119 running (4m) 57s ago 4m 55.5M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 0d26372cd974 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.3 smithi069 running (3m) 57s ago 3m 49.6M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 4bce5abecd14 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.4 smithi081 running (3m) 57s ago 3m 50.6M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 5cab4ee82d36 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.5 smithi119 running (3m) 57s ago 3m 50.8M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 48df8ba0e023 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.6 smithi069 running (3m) 57s ago 3m 46.1M 4278M 18.0.0-3905-g1faa3533 0caf899250bd b4050d0f6297 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.7 smithi081 running (2m) 57s ago 2m 50.7M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 6deff1b2f1f6 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.8 smithi119 running (2m) 57s ago 2m 47.3M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 8f579965e78c 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.9 smithi069 running (2m) 57s ago 2m 47.5M 4278M 18.0.0-3905-g1faa3533 0caf899250bd a3ace00b14e5 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.10 smithi081 running (112s) 57s ago 112s 46.3M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 575b87850edc 2023-12-14T14:10:05.571 INFO:teuthology.orchestra.run.smithi069.stdout:osd.11 smithi119 running (95s) 57s ago 94s 44.9M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 20d4f7371b80 2023-12-14T14:10:05.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a280a11e0 msgr2=0x7f8a280a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:05.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a280a11e0 0x7f8a280a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a30006010 tx=0x7f8a3000b540 comp rx=0 tx=0).stop 2023-12-14T14:10:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401002f0 msgr2=0x7f8a401960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401002f0 0x7f8a401960d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400b530 tx=0x7f8a3400b8f0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 shutdown_connections 2023-12-14T14:10:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8a280a11e0 0x7f8a280a3690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a40101e80 0x7f8a4019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a401002f0 0x7f8a401960d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 --2- 172.21.15.69:0/562733479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a401014f0 0x7f8a40196610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 >> 172.21.15.69:0/562733479 conn(0x7f8a400fb900 msgr2=0x7f8a400fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 shutdown_connections 2023-12-14T14:10:05.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:05.571+0000 7f8a46735700 1 -- 172.21.15.69:0/562733479 wait complete. 2023-12-14T14:10:05.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:05 smithi069 ceph-mon[42034]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:10:05.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:05 smithi081 ceph-mon[43371]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:10:05.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:05 smithi119 ceph-mon[43834]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:10:05.934 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-14T14:10:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:10:06.551 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:06 smithi069 ceph-mon[42034]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:06.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:06 smithi081 ceph-mon[43371]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:06.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:06 smithi119 ceph-mon[43834]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:07.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.322+0000 7ff28a2cf700 1 -- 172.21.15.69:0/775838476 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 msgr2=0x7ff284108740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:07.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.322+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/775838476 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 0x7ff284108740 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00b0a0 tx=0x7ff27c00b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.322+0000 7ff28a2cf700 1 -- 172.21.15.69:0/775838476 shutdown_connections 2023-12-14T14:10:07.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.322+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/775838476 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 0x7ff284108740 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.322+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/775838476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2841002f0 0x7ff284100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.322+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/775838476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2841014f0 0x7ff284101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.322+0000 7ff28a2cf700 1 -- 172.21.15.69:0/775838476 >> 172.21.15.69:0/775838476 conn(0x7ff2840fb900 msgr2=0x7ff2840fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:07.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.322+0000 7ff28a2cf700 1 -- 172.21.15.69:0/775838476 shutdown_connections 2023-12-14T14:10:07.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.322+0000 7ff28a2cf700 1 -- 172.21.15.69:0/775838476 wait complete. 2023-12-14T14:10:07.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.323+0000 7ff28a2cf700 1 Processor -- start 2023-12-14T14:10:07.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.323+0000 7ff28a2cf700 1 -- start start 2023-12-14T14:10:07.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28a2cf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2841002f0 0x7ff284196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:07.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28a2cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2841014f0 0x7ff2841966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28a2cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 0x7ff28419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28a2cf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419dd10 con 0x7ff284101e80 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28a2cf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419de50 con 0x7ff2841014f0 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28a2cf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419dfe0 con 0x7ff2841002f0 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28886c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 0x7ff28419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28886c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 0x7ff28419d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48962/0 (socket says 172.21.15.69:48962) 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28886c700 1 -- 172.21.15.69:0/2877594012 learned_addr learned my addr 172.21.15.69:0/2877594012 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff2837fe700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2841014f0 0x7ff2841966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff283fff700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2841002f0 0x7ff284196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28886c700 1 -- 172.21.15.69:0/2877594012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2841002f0 msgr2=0x7ff284196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28886c700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2841002f0 0x7ff284196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28886c700 1 -- 172.21.15.69:0/2877594012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2841014f0 msgr2=0x7ff2841966c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28886c700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2841014f0 0x7ff2841966c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28886c700 1 -- 172.21.15.69:0/2877594012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c009d00 con 0x7ff284101e80 2023-12-14T14:10:07.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28886c700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 0x7ff28419d740 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff27c004d00 tx=0x7ff27c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:07.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff2817fa700 1 -- 172.21.15.69:0/2877594012 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00e040 con 0x7ff284101e80 2023-12-14T14:10:07.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff2817fa700 1 -- 172.21.15.69:0/2877594012 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff27c01bb20 con 0x7ff284101e80 2023-12-14T14:10:07.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28410bce0 con 0x7ff284101e80 2023-12-14T14:10:07.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff2817fa700 1 -- 172.21.15.69:0/2877594012 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0057f0 con 0x7ff284101e80 2023-12-14T14:10:07.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.324+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28410bb50 con 0x7ff284101e80 2023-12-14T14:10:07.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.325+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff284107860 con 0x7ff284101e80 2023-12-14T14:10:07.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.326+0000 7ff2817fa700 1 -- 172.21.15.69:0/2877594012 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff27c01bc90 con 0x7ff284101e80 2023-12-14T14:10:07.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.327+0000 7ff2817fa700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff2700a11e0 0x7ff2700a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:07.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.327+0000 7ff283fff700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff2700a11e0 0x7ff2700a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:07.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.327+0000 7ff2817fa700 1 -- 172.21.15.69:0/2877594012 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff27c0ce710 con 0x7ff284101e80 2023-12-14T14:10:07.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.328+0000 7ff283fff700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff2700a11e0 0x7ff2700a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff274006fd0 tx=0x7ff274008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:07.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.332+0000 7ff2817fa700 1 -- 172.21.15.69:0/2877594012 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff27c097e40 con 0x7ff284101e80 2023-12-14T14:10:07.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.527+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff284061a30 con 0x7ff2700a11e0 2023-12-14T14:10:07.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.532+0000 7ff2817fa700 1 -- 172.21.15.69:0/2877594012 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7ff284061a30 con 0x7ff2700a11e0 2023-12-14T14:10:07.532 INFO:teuthology.orchestra.run.smithi069.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-14T14:10:07.533 INFO:teuthology.orchestra.run.smithi069.stdout:mds.all 12/12 59s ago 83s smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2023-12-14T14:10:07.533 INFO:teuthology.orchestra.run.smithi069.stdout:mgr 3/3 59s ago 5m smithi069=x;smithi081=y;smithi119=z;count:3 2023-12-14T14:10:07.533 INFO:teuthology.orchestra.run.smithi069.stdout:mon 3/3 59s ago 5m smithi069:172.21.15.69=a;smithi081:172.21.15.81=b;smithi119:172.21.15.119=c;count:3 2023-12-14T14:10:07.533 INFO:teuthology.orchestra.run.smithi069.stdout:osd 12 59s ago - 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff2700a11e0 msgr2=0x7ff2700a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff2700a11e0 0x7ff2700a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff274006fd0 tx=0x7ff274008040 comp rx=0 tx=0).stop 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 msgr2=0x7ff28419d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 0x7ff28419d740 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff27c004d00 tx=0x7ff27c004d30 comp rx=0 tx=0).stop 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 shutdown_connections 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff2700a11e0 0x7ff2700a3690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff284101e80 0x7ff28419d740 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2841002f0 0x7ff284196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 --2- 172.21.15.69:0/2877594012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2841014f0 0x7ff2841966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.534+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 >> 172.21.15.69:0/2877594012 conn(0x7ff2840fb900 msgr2=0x7ff2841049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:07.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.535+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 shutdown_connections 2023-12-14T14:10:07.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:07.535+0000 7ff28a2cf700 1 -- 172.21.15.69:0/2877594012 wait complete. 2023-12-14T14:10:07.558 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:07 smithi069 ceph-mon[42034]: pgmap v250: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-12-14T14:10:07.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:07 smithi081 ceph-mon[43371]: pgmap v250: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-12-14T14:10:07.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:07 smithi119 ceph-mon[43834]: pgmap v250: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-12-14T14:10:07.932 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-14T14:10:08.243 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:10:08.554 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:08 smithi069 ceph-mon[42034]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:08.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:08 smithi081 ceph-mon[43371]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:08.659 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:08 smithi119 ceph-mon[43834]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:09.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:09 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:09.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:09 smithi069 ceph-mon[42034]: pgmap v251: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:10:09.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.600+0000 7fd6450d8700 1 -- 172.21.15.69:0/298540463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640100d70 msgr2=0x7fd640103150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:09.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.600+0000 7fd6450d8700 1 --2- 172.21.15.69:0/298540463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640100d70 0x7fd640103150 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd630009990 tx=0x7fd630009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.600+0000 7fd6450d8700 1 -- 172.21.15.69:0/298540463 shutdown_connections 2023-12-14T14:10:09.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.600+0000 7fd6450d8700 1 --2- 172.21.15.69:0/298540463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd640105fb0 0x7fd640108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.600+0000 7fd6450d8700 1 --2- 172.21.15.69:0/298540463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640100d70 0x7fd640103150 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.600+0000 7fd6450d8700 1 --2- 172.21.15.69:0/298540463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd640103690 0x7fd640105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.600+0000 7fd6450d8700 1 -- 172.21.15.69:0/298540463 >> 172.21.15.69:0/298540463 conn(0x7fd6400fa7f0 msgr2=0x7fd6400fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:09.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.600+0000 7fd6450d8700 1 -- 172.21.15.69:0/298540463 shutdown_connections 2023-12-14T14:10:09.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.600+0000 7fd6450d8700 1 -- 172.21.15.69:0/298540463 wait complete. 2023-12-14T14:10:09.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.601+0000 7fd6450d8700 1 Processor -- start 2023-12-14T14:10:09.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.601+0000 7fd6450d8700 1 -- start start 2023-12-14T14:10:09.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.601+0000 7fd6450d8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd640100d70 0x7fd640195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:09.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.601+0000 7fd6450d8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640103690 0x7fd640196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.601+0000 7fd6450d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd640105fb0 0x7fd64019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.601+0000 7fd6450d8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64019db70 con 0x7fd640103690 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.601+0000 7fd6450d8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64019dcb0 con 0x7fd640105fb0 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.601+0000 7fd6450d8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64019de40 con 0x7fd640100d70 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640103690 0x7fd640196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63ed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd640100d70 0x7fd640195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640103690 0x7fd640196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48974/0 (socket says 172.21.15.69:48974) 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63e59c700 1 -- 172.21.15.69:0/428932937 learned_addr learned my addr 172.21.15.69:0/428932937 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63f59e700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd640105fb0 0x7fd64019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63e59c700 1 -- 172.21.15.69:0/428932937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd640100d70 msgr2=0x7fd640195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63e59c700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd640100d70 0x7fd640195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63e59c700 1 -- 172.21.15.69:0/428932937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd640105fb0 msgr2=0x7fd64019d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63e59c700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd640105fb0 0x7fd64019d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63e59c700 1 -- 172.21.15.69:0/428932937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6300095f0 con 0x7fd640103690 2023-12-14T14:10:09.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63ed9d700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd640100d70 0x7fd640195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:10:09.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd63e59c700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640103690 0x7fd640196520 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e9d0 tx=0x7fd63400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:09.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd627fff700 1 -- 172.21.15.69:0/428932937 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634009790 con 0x7fd640103690 2023-12-14T14:10:09.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64010bc80 con 0x7fd640103690 2023-12-14T14:10:09.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd627fff700 1 -- 172.21.15.69:0/428932937 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd63400ee70 con 0x7fd640103690 2023-12-14T14:10:09.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd627fff700 1 -- 172.21.15.69:0/428932937 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634010ea0 con 0x7fd640103690 2023-12-14T14:10:09.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.602+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64010baf0 con 0x7fd640103690 2023-12-14T14:10:09.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.604+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64019e570 con 0x7fd640103690 2023-12-14T14:10:09.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.605+0000 7fd627fff700 1 -- 172.21.15.69:0/428932937 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd63400cbd0 con 0x7fd640103690 2023-12-14T14:10:09.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.606+0000 7fd627fff700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd6280a11e0 0x7fd6280a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:09.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.606+0000 7fd627fff700 1 -- 172.21.15.69:0/428932937 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd634014070 con 0x7fd640103690 2023-12-14T14:10:09.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.606+0000 7fd63ed9d700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd6280a11e0 0x7fd6280a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:09.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.606+0000 7fd63ed9d700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd6280a11e0 0x7fd6280a3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd63000b2e0 tx=0x7fd630005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:09.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.609+0000 7fd627fff700 1 -- 172.21.15.69:0/428932937 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd6340966f0 con 0x7fd640103690 2023-12-14T14:10:09.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:09 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:09.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:09 smithi081 ceph-mon[43371]: pgmap v251: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:10:09.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:09 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:09.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:09 smithi119 ceph-mon[43834]: pgmap v251: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:10:09.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.832+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd64019ebe0 con 0x7fd6280a11e0 2023-12-14T14:10:09.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.834+0000 7fd627fff700 1 -- 172.21.15.69:0/428932937 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fd64019ebe0 con 0x7fd6280a11e0 2023-12-14T14:10:09.834 INFO:teuthology.orchestra.run.smithi069.stdout:HOST ADDR LABELS STATUS 2023-12-14T14:10:09.834 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 172.21.15.69 2023-12-14T14:10:09.834 INFO:teuthology.orchestra.run.smithi069.stdout:smithi081 172.21.15.81 2023-12-14T14:10:09.834 INFO:teuthology.orchestra.run.smithi069.stdout:smithi119 172.21.15.119 2023-12-14T14:10:09.834 INFO:teuthology.orchestra.run.smithi069.stdout:3 hosts in cluster 2023-12-14T14:10:09.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd6280a11e0 msgr2=0x7fd6280a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:09.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd6280a11e0 0x7fd6280a3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd63000b2e0 tx=0x7fd630005fb0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640103690 msgr2=0x7fd640196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640103690 0x7fd640196520 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e9d0 tx=0x7fd63400ece0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 shutdown_connections 2023-12-14T14:10:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd6280a11e0 0x7fd6280a3690 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd640105fb0 0x7fd64019d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd640100d70 0x7fd640195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 --2- 172.21.15.69:0/428932937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd640103690 0x7fd640196520 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 >> 172.21.15.69:0/428932937 conn(0x7fd6400fa7f0 msgr2=0x7fd640102240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 shutdown_connections 2023-12-14T14:10:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:09.836+0000 7fd6450d8700 1 -- 172.21.15.69:0/428932937 wait complete. 2023-12-14T14:10:10.216 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-14T14:10:10.516 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.516 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.516 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.516 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.517 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:10.517 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.517 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.517 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:10:10.517 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:10:10.517 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:10 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.538 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:10:10.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:10.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:10:10.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:10:10.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:10 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:10.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:10.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:10:10.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:10:10.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:10 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' 2023-12-14T14:10:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.608+0000 7fecc32b3700 1 -- 172.21.15.69:0/2975604516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc1003e0 msgr2=0x7fecbc100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.608+0000 7fecc32b3700 1 --2- 172.21.15.69:0/2975604516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc1003e0 0x7fecbc100830 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009990 tx=0x7fecb8009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.608+0000 7fecc32b3700 1 -- 172.21.15.69:0/2975604516 shutdown_connections 2023-12-14T14:10:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.608+0000 7fecc32b3700 1 --2- 172.21.15.69:0/2975604516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecbc100d70 0x7fecbc107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.608+0000 7fecc32b3700 1 --2- 172.21.15.69:0/2975604516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0ff1e0 0x7fecbc0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.608+0000 7fecc32b3700 1 --2- 172.21.15.69:0/2975604516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc1003e0 0x7fecbc100830 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.608+0000 7fecc32b3700 1 -- 172.21.15.69:0/2975604516 >> 172.21.15.69:0/2975604516 conn(0x7fecbc0fa7f0 msgr2=0x7fecbc0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.608+0000 7fecc32b3700 1 -- 172.21.15.69:0/2975604516 shutdown_connections 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.608+0000 7fecc32b3700 1 -- 172.21.15.69:0/2975604516 wait complete. 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc32b3700 1 Processor -- start 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc32b3700 1 -- start start 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc32b3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc0ff1e0 0x7fecbc196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc32b3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecbc1003e0 0x7fecbc196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc32b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc100d70 0x7fecbc19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc32b3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc19dbe0 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc32b3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc19dd20 con 0x7fecbc100d70 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc32b3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc19deb0 con 0x7fecbc1003e0 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc104f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc0ff1e0 0x7fecbc196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc104f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc0ff1e0 0x7fecbc196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48988/0 (socket says 172.21.15.69:48988) 2023-12-14T14:10:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc104f700 1 -- 172.21.15.69:0/1350737858 learned_addr learned my addr 172.21.15.69:0/1350737858 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc084e700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecbc1003e0 0x7fecbc196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc1850700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc100d70 0x7fecbc19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc104f700 1 -- 172.21.15.69:0/1350737858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecbc1003e0 msgr2=0x7fecbc196590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc104f700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecbc1003e0 0x7fecbc196590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc104f700 1 -- 172.21.15.69:0/1350737858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc100d70 msgr2=0x7fecbc19d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc104f700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc100d70 0x7fecbc19d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.609+0000 7fecc104f700 1 -- 172.21.15.69:0/1350737858 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80095f0 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.610+0000 7fecc104f700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc0ff1e0 0x7fecbc196050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fecb000d9b0 tx=0x7fecb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.610+0000 7fecae7fc700 1 -- 172.21.15.69:0/1350737858 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0004020 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.610+0000 7fecae7fc700 1 -- 172.21.15.69:0/1350737858 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecb0009730 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.610+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc10ab40 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.610+0000 7fecae7fc700 1 -- 172.21.15.69:0/1350737858 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0003a30 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.610+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc10a9b0 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.611+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc066ea0 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.612+0000 7fecae7fc700 1 -- 172.21.15.69:0/1350737858 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fecb00098a0 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.613+0000 7fecae7fc700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7feca80a11e0 0x7feca80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.613+0000 7fecc084e700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7feca80a11e0 0x7feca80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.613+0000 7fecae7fc700 1 -- 172.21.15.69:0/1350737858 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fecb00ccb10 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.613+0000 7fecc084e700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7feca80a11e0 0x7feca80a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b5c0 tx=0x7fecb8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:11.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.616+0000 7fecae7fc700 1 -- 172.21.15.69:0/1350737858 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fecb0096100 con 0x7fecbc0ff1e0 2023-12-14T14:10:11.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:10:11.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:10:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:10:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:10:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-12-14T14:10:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2023-12-14T14:10:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-12-14T14:10:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-12-14T14:10:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-12-14T14:10:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-12-14T14:10:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:11 smithi119 ceph-mon[43834]: pgmap v252: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:10:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.814+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fecbc19ea10 con 0x7feca80a11e0 2023-12-14T14:10:11.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.815+0000 7fecae7fc700 1 -- 172.21.15.69:0/1350737858 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7fecbc19ea10 con 0x7feca80a11e0 2023-12-14T14:10:11.815 INFO:teuthology.orchestra.run.smithi069.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-14T14:10:11.816 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y0400BGN 372G No 2m ago LVM detected, locked 2023-12-14T14:10:11.816 INFO:teuthology.orchestra.run.smithi069.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 114s ago LVM detected, locked 2023-12-14T14:10:11.816 INFO:teuthology.orchestra.run.smithi069.stdout:smithi119 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN 372G No 96s ago LVM detected, locked 2023-12-14T14:10:11.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7feca80a11e0 msgr2=0x7feca80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7feca80a11e0 0x7feca80a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b5c0 tx=0x7fecb8005fb0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc0ff1e0 msgr2=0x7fecbc196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc0ff1e0 0x7fecbc196050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fecb000d9b0 tx=0x7fecb000dcc0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 shutdown_connections 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7feca80a11e0 0x7feca80a3690 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc100d70 0x7fecbc19d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecbc0ff1e0 0x7fecbc196050 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 --2- 172.21.15.69:0/1350737858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecbc1003e0 0x7fecbc196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.817+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 >> 172.21.15.69:0/1350737858 conn(0x7fecbc0fa7f0 msgr2=0x7fecbc068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.818+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 shutdown_connections 2023-12-14T14:10:11.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:11.818+0000 7fecc32b3700 1 -- 172.21.15.69:0/1350737858 wait complete. 2023-12-14T14:10:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:10:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:10:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:10:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:10:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-12-14T14:10:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2023-12-14T14:10:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-12-14T14:10:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-12-14T14:10:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-12-14T14:10:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-12-14T14:10:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:11 smithi069 ceph-mon[42034]: pgmap v252: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:10:11.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-12-14T14:10:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:11 smithi081 ceph-mon[43371]: pgmap v252: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:10:12.230 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-14T14:10:12.239 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T14:10:12.239 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-14T14:10:12.531 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:12 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-12-14T14:10:12.531 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:12 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2023-12-14T14:10:12.531 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:12 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-12-14T14:10:12.531 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:12 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-12-14T14:10:12.531 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:12 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-12-14T14:10:12.531 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:12 smithi069 ceph-mon[42034]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-12-14T14:10:12.531 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:12 smithi069 ceph-mon[42034]: osdmap e83: 12 total, 12 up, 12 in 2023-12-14T14:10:12.531 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:12 smithi069 ceph-mon[42034]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:12.553 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:10:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:12 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-12-14T14:10:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:12 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2023-12-14T14:10:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:12 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-12-14T14:10:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:12 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-12-14T14:10:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:12 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-12-14T14:10:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:12 smithi081 ceph-mon[43371]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-12-14T14:10:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:12 smithi081 ceph-mon[43371]: osdmap e83: 12 total, 12 up, 12 in 2023-12-14T14:10:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:12 smithi081 ceph-mon[43371]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:13.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:12 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-12-14T14:10:13.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:12 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2023-12-14T14:10:13.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:12 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-12-14T14:10:13.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:12 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-12-14T14:10:13.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:12 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-12-14T14:10:13.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:12 smithi119 ceph-mon[43834]: from='mgr.14152 172.21.15.69:0/840012020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-12-14T14:10:13.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:12 smithi119 ceph-mon[43834]: osdmap e83: 12 total, 12 up, 12 in 2023-12-14T14:10:13.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:12 smithi119 ceph-mon[43834]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:13.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.598+0000 7fdd851dd700 1 -- 172.21.15.69:0/3240878316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80100d70 msgr2=0x7fdd80107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:13.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.598+0000 7fdd851dd700 1 --2- 172.21.15.69:0/3240878316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80100d70 0x7fdd80107630 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800b0a0 tx=0x7fdd7800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.598+0000 7fdd851dd700 1 -- 172.21.15.69:0/3240878316 shutdown_connections 2023-12-14T14:10:13.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.598+0000 7fdd851dd700 1 --2- 172.21.15.69:0/3240878316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80100d70 0x7fdd80107630 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.598+0000 7fdd851dd700 1 --2- 172.21.15.69:0/3240878316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd800ff1e0 0x7fdd800ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.598+0000 7fdd851dd700 1 --2- 172.21.15.69:0/3240878316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd801003e0 0x7fdd80100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.598+0000 7fdd851dd700 1 -- 172.21.15.69:0/3240878316 >> 172.21.15.69:0/3240878316 conn(0x7fdd800fa7f0 msgr2=0x7fdd800fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:13.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.598+0000 7fdd851dd700 1 -- 172.21.15.69:0/3240878316 shutdown_connections 2023-12-14T14:10:13.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.598+0000 7fdd851dd700 1 -- 172.21.15.69:0/3240878316 wait complete. 2023-12-14T14:10:13.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd851dd700 1 Processor -- start 2023-12-14T14:10:13.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd851dd700 1 -- start start 2023-12-14T14:10:13.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd851dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd800ff1e0 0x7fdd800699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:13.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd851dd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd801003e0 0x7fdd8019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:13.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd851dd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd80100d70 0x7fdd8019d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd851dd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8019dcd0 con 0x7fdd801003e0 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd851dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8019de40 con 0x7fdd800ff1e0 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd851dd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8019e000 con 0x7fdd80100d70 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd801003e0 0x7fdd8019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd801003e0 0x7fdd8019aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49000/0 (socket says 172.21.15.69:49000) 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7e59c700 1 -- 172.21.15.69:0/2604499566 learned_addr learned my addr 172.21.15.69:0/2604499566 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7ed9d700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd800ff1e0 0x7fdd800699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7e59c700 1 -- 172.21.15.69:0/2604499566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd80100d70 msgr2=0x7fdd8019d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7e59c700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd80100d70 0x7fdd8019d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7e59c700 1 -- 172.21.15.69:0/2604499566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd800ff1e0 msgr2=0x7fdd800699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:13.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7e59c700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd800ff1e0 0x7fdd800699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7e59c700 1 -- 172.21.15.69:0/2604499566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78009d00 con 0x7fdd801003e0 2023-12-14T14:10:13.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.599+0000 7fdd7ed9d700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd800ff1e0 0x7fdd800699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:13.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.600+0000 7fdd7e59c700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd801003e0 0x7fdd8019aef0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000d980 tx=0x7fdd7000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:13.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.600+0000 7fdd67fff700 1 -- 172.21.15.69:0/2604499566 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000bb60 con 0x7fdd801003e0 2023-12-14T14:10:13.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.600+0000 7fdd67fff700 1 -- 172.21.15.69:0/2604499566 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd70007640 con 0x7fdd801003e0 2023-12-14T14:10:13.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.600+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8010abd0 con 0x7fdd801003e0 2023-12-14T14:10:13.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.600+0000 7fdd67fff700 1 -- 172.21.15.69:0/2604499566 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70004e90 con 0x7fdd801003e0 2023-12-14T14:10:13.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.600+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8010aa40 con 0x7fdd801003e0 2023-12-14T14:10:13.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.601+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd80106740 con 0x7fdd801003e0 2023-12-14T14:10:13.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.602+0000 7fdd67fff700 1 -- 172.21.15.69:0/2604499566 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fdd7000bcc0 con 0x7fdd801003e0 2023-12-14T14:10:13.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.602+0000 7fdd67fff700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdd680a11e0 0x7fdd680a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:13.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.602+0000 7fdd7ed9d700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdd680a11e0 0x7fdd680a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:13.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.602+0000 7fdd67fff700 1 -- 172.21.15.69:0/2604499566 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fdd700cc8b0 con 0x7fdd801003e0 2023-12-14T14:10:13.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.603+0000 7fdd7ed9d700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdd680a11e0 0x7fdd680a3690 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd80100240 tx=0x7fdd74008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:13.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.607+0000 7fdd67fff700 1 -- 172.21.15.69:0/2604499566 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdd70095fa0 con 0x7fdd801003e0 2023-12-14T14:10:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:13 smithi069 ceph-mon[42034]: osdmap e84: 12 total, 12 up, 12 in 2023-12-14T14:10:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:13 smithi069 ceph-mon[42034]: pgmap v255: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-12-14T14:10:13.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.842+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd8002cfe0 con 0x7fdd801003e0 2023-12-14T14:10:13.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.843+0000 7fdd67fff700 1 -- 172.21.15.69:0/2604499566 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+2895 (secure 0 0 0) 0x7fdd70016020 con 0x7fdd801003e0 2023-12-14T14:10:13.844 INFO:teuthology.orchestra.run.smithi069.stdout:e22 2023-12-14T14:10:13.844 INFO:teuthology.orchestra.run.smithi069.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-14T14:10:13.844 INFO:teuthology.orchestra.run.smithi069.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-14T14:10:13.844 INFO:teuthology.orchestra.run.smithi069.stdout:legacy client fscid: 1 2023-12-14T14:10:13.844 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:13.844 INFO:teuthology.orchestra.run.smithi069.stdout:Filesystem 'cephfs' (1) 2023-12-14T14:10:13.844 INFO:teuthology.orchestra.run.smithi069.stdout:fs_name cephfs 2023-12-14T14:10:13.844 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 22 2023-12-14T14:10:13.845 INFO:teuthology.orchestra.run.smithi069.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-14T14:10:13.845 INFO:teuthology.orchestra.run.smithi069.stdout:created 2023-12-14T14:09:10.598197+0000 2023-12-14T14:10:13.845 INFO:teuthology.orchestra.run.smithi069.stdout:modified 2023-12-14T14:09:15.801574+0000 2023-12-14T14:10:13.845 INFO:teuthology.orchestra.run.smithi069.stdout:tableserver 0 2023-12-14T14:10:13.845 INFO:teuthology.orchestra.run.smithi069.stdout:root 0 2023-12-14T14:10:13.845 INFO:teuthology.orchestra.run.smithi069.stdout:session_timeout 300 2023-12-14T14:10:13.845 INFO:teuthology.orchestra.run.smithi069.stdout:session_autoclose 300 2023-12-14T14:10:13.845 INFO:teuthology.orchestra.run.smithi069.stdout:max_file_size 1099511627776 2023-12-14T14:10:13.845 INFO:teuthology.orchestra.run.smithi069.stdout:max_xattr_size 65536 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:required_client_features {} 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:last_failure 0 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:last_failure_osd_epoch 0 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:max_mds 3 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:in 0,1,2 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:up {0=24500,1=24469,2=24467} 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:failed 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:damaged 2023-12-14T14:10:13.846 INFO:teuthology.orchestra.run.smithi069.stdout:stopped 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:data_pools [3] 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:metadata_pool 2 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:inline_data disabled 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:balancer 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:bal_rank_mask -1 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:standby_count_wanted 0 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b{0:24500} state up:active seq 3 addr [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c{0:24451} state up:standby-replay seq 1 addr [v2:172.21.15.119:6836/2082956632,v1:172.21.15.119:6837/2082956632] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.i{1:24469} state up:active seq 5 addr [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.f{1:24439} state up:standby-replay seq 1 addr [v2:172.21.15.119:6834/594041854,v1:172.21.15.119:6835/594041854] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.847 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.h{2:24467} state up:active seq 6 addr [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.e{2:24437} state up:standby-replay seq 1 addr [v2:172.21.15.81:6834/3775706969,v1:172.21.15.81:6835/3775706969] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout:Standby daemons: 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.j{-1:14553} state up:standby seq 1 addr [v2:172.21.15.69:6834/4120690062,v1:172.21.15.69:6835/4120690062] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d{-1:14565} state up:standby seq 1 addr [v2:172.21.15.69:6836/4121849780,v1:172.21.15.69:6837/4121849780] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.g{-1:14619} state up:standby seq 1 addr [v2:172.21.15.69:6838/3643556663,v1:172.21.15.69:6839/3643556663] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a{-1:14631} state up:standby seq 1 addr [v2:172.21.15.69:6840/2792118918,v1:172.21.15.69:6841/2792118918] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.l{-1:24409} state up:standby seq 1 addr [v2:172.21.15.119:6832/3794904365,v1:172.21.15.119:6833/3794904365] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.848 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.k{-1:24410} state up:standby seq 1 addr [v2:172.21.15.81:6832/2145103323,v1:172.21.15.81:6833/2145103323] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T14:10:13.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdd680a11e0 msgr2=0x7fdd680a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdd680a11e0 0x7fdd680a3690 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd80100240 tx=0x7fdd74008040 comp rx=0 tx=0).stop 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd801003e0 msgr2=0x7fdd8019aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd801003e0 0x7fdd8019aef0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000d980 tx=0x7fdd7000dd40 comp rx=0 tx=0).stop 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 shutdown_connections 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fdd680a11e0 0x7fdd680a3690 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd80100d70 0x7fdd8019d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd800ff1e0 0x7fdd800699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 --2- 172.21.15.69:0/2604499566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd801003e0 0x7fdd8019aef0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 >> 172.21.15.69:0/2604499566 conn(0x7fdd800fa7f0 msgr2=0x7fdd80103880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:13.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 shutdown_connections 2023-12-14T14:10:13.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:13.845+0000 7fdd851dd700 1 -- 172.21.15.69:0/2604499566 wait complete. 2023-12-14T14:10:13.851 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:10:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:13 smithi081 ceph-mon[43371]: osdmap e84: 12 total, 12 up, 12 in 2023-12-14T14:10:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:13 smithi081 ceph-mon[43371]: pgmap v255: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-12-14T14:10:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:13 smithi119 ceph-mon[43834]: osdmap e84: 12 total, 12 up, 12 in 2023-12-14T14:10:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:13 smithi119 ceph-mon[43834]: pgmap v255: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-12-14T14:10:14.239 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- bash -c 'ceph osd dump' 2023-12-14T14:10:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:10:14.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:14 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2604499566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-14T14:10:14.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:14 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2604499566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-14T14:10:15.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:14 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2604499566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-14T14:10:15.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 -- 172.21.15.69:0/1348605460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 msgr2=0x7f390c108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:15.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 --2- 172.21.15.69:0/1348605460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 0x7f390c108750 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f390400b0a0 tx=0x7f390400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 -- 172.21.15.69:0/1348605460 shutdown_connections 2023-12-14T14:10:15.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 --2- 172.21.15.69:0/1348605460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 0x7f390c108750 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 --2- 172.21.15.69:0/1348605460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f390c100300 0x7f390c100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 --2- 172.21.15.69:0/1348605460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f390c101500 0x7f390c101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 -- 172.21.15.69:0/1348605460 >> 172.21.15.69:0/1348605460 conn(0x7f390c0fb910 msgr2=0x7f390c0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:15.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 -- 172.21.15.69:0/1348605460 shutdown_connections 2023-12-14T14:10:15.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 -- 172.21.15.69:0/1348605460 wait complete. 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 Processor -- start 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.588+0000 7f3913144700 1 -- start start 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3913144700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f390c100300 0x7f390c196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3913144700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f390c101500 0x7f390c1965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3913144700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 0x7f390c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3913144700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c19dc20 con 0x7f390c101e90 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3913144700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c19dd60 con 0x7f390c100300 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3913144700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c19def0 con 0x7f390c101500 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f39116e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 0x7f390c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:15.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f39116e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 0x7f390c19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49016/0 (socket says 172.21.15.69:49016) 2023-12-14T14:10:15.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f39116e1700 1 -- 172.21.15.69:0/3336753694 learned_addr learned my addr 172.21.15.69:0/3336753694 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:15.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f390bfff700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f390c101500 0x7f390c1965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:15.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3910ee0700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f390c100300 0x7f390c196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:15.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f39116e1700 1 -- 172.21.15.69:0/3336753694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f390c101500 msgr2=0x7f390c1965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:15.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f39116e1700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f390c101500 0x7f390c1965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f39116e1700 1 -- 172.21.15.69:0/3336753694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f390c100300 msgr2=0x7f390c196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:15.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f39116e1700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f390c100300 0x7f390c196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f39116e1700 1 -- 172.21.15.69:0/3336753694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3904009d00 con 0x7f390c101e90 2023-12-14T14:10:15.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f390bfff700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f390c101500 0x7f390c1965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:15.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f39116e1700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 0x7f390c19d650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3904004d00 tx=0x7f3904004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:15.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3909ffb700 1 -- 172.21.15.69:0/3336753694 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390400e040 con 0x7f390c101e90 2023-12-14T14:10:15.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c10bc60 con 0x7f390c101e90 2023-12-14T14:10:15.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3909ffb700 1 -- 172.21.15.69:0/3336753694 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f390401bd20 con 0x7f390c101e90 2023-12-14T14:10:15.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.589+0000 7f3909ffb700 1 -- 172.21.15.69:0/3336753694 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904005940 con 0x7f390c101e90 2023-12-14T14:10:15.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.590+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c10bad0 con 0x7f390c101e90 2023-12-14T14:10:15.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.590+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c1077b0 con 0x7f390c101e90 2023-12-14T14:10:15.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.592+0000 7f3909ffb700 1 -- 172.21.15.69:0/3336753694 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3904005040 con 0x7f390c101e90 2023-12-14T14:10:15.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.592+0000 7f3909ffb700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38fc0a11e0 0x7f38fc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:15.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.592+0000 7f3909ffb700 1 -- 172.21.15.69:0/3336753694 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f39040ceb50 con 0x7f390c101e90 2023-12-14T14:10:15.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.592+0000 7f3910ee0700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38fc0a11e0 0x7f38fc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:15.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.593+0000 7f3910ee0700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38fc0a11e0 0x7f38fc0a3690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3900005fd0 tx=0x7f3900005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:15.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.595+0000 7f3909ffb700 1 -- 172.21.15.69:0/3336753694 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f39040982d0 con 0x7f390c101e90 2023-12-14T14:10:15.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.789+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f390c066ea0 con 0x7f390c101e90 2023-12-14T14:10:15.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.790+0000 7f3909ffb700 1 -- 172.21.15.69:0/3336753694 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) v1 ==== 56+0+5222 (secure 0 0 0) 0x7f390409b8f0 con 0x7f390c101e90 2023-12-14T14:10:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 84 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:fsid 5d58180a-9a89-11ee-95a3-87774f69a715 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:created 2023-12-14T14:03:27.637317+0000 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:modified 2023-12-14T14:10:12.522850+0000 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:crush_version 26 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:full_ratio 0.95 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:backfillfull_ratio 0.9 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:nearfull_ratio 0.85 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:require_min_compat_client luminous 2023-12-14T14:10:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:min_compat_client luminous 2023-12-14T14:10:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:require_osd_release reef 2023-12-14T14:10:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:stretch_mode_enabled false 2023-12-14T14:10:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-12-14T14:10:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-12-14T14:10:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-12-14T14:10:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:max_osd 12 2023-12-14T14:10:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6802/3233163239,v1:172.21.15.69:6803/3233163239] [v2:172.21.15.69:6804/3233163239,v1:172.21.15.69:6805/3233163239] exists,up 626f1f59-a1b9-4b5a-a8ad-3f2866697db1 2023-12-14T14:10:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6800/3099180120,v1:172.21.15.81:6801/3099180120] [v2:172.21.15.81:6802/3099180120,v1:172.21.15.81:6803/3099180120] exists,up bc3f5476-3f7e-4f95-ba27-a01e51228939 2023-12-14T14:10:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/715893428,v1:172.21.15.119:6801/715893428] [v2:172.21.15.119:6802/715893428,v1:172.21.15.119:6803/715893428] exists,up cec31ae4-c25e-460e-9522-7924fed2ec9d 2023-12-14T14:10:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:osd.3 up in weight 1 up_from 24 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6810/3681148736,v1:172.21.15.69:6811/3681148736] [v2:172.21.15.69:6812/3681148736,v1:172.21.15.69:6813/3681148736] exists,up dcee4795-1084-4049-bae8-b982198f8b00 2023-12-14T14:10:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:osd.4 up in weight 1 up_from 32 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6808/2435197817,v1:172.21.15.81:6809/2435197817] [v2:172.21.15.81:6810/2435197817,v1:172.21.15.81:6811/2435197817] exists,up f27f286d-c5ed-4fed-8624-0ec67bc590fa 2023-12-14T14:10:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:osd.5 up in weight 1 up_from 37 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/1604753767,v1:172.21.15.119:6809/1604753767] [v2:172.21.15.119:6810/1604753767,v1:172.21.15.119:6811/1604753767] exists,up 2e65ea32-885b-41d1-a325-922ff4f66117 2023-12-14T14:10:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:osd.6 up in weight 1 up_from 45 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6818/3585699442,v1:172.21.15.69:6819/3585699442] [v2:172.21.15.69:6820/3585699442,v1:172.21.15.69:6821/3585699442] exists,up edda790d-463a-4082-b2ca-c569272907ea 2023-12-14T14:10:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:osd.7 up in weight 1 up_from 50 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6816/3166058431,v1:172.21.15.81:6817/3166058431] [v2:172.21.15.81:6818/3166058431,v1:172.21.15.81:6819/3166058431] exists,up 0ef2f893-b375-4221-be5e-25e21d60006e 2023-12-14T14:10:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:osd.8 up in weight 1 up_from 58 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/2165709611,v1:172.21.15.119:6817/2165709611] [v2:172.21.15.119:6818/2165709611,v1:172.21.15.119:6819/2165709611] exists,up 4d90c4bb-61c8-4b80-b910-afcc2a88230c 2023-12-14T14:10:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:osd.9 up in weight 1 up_from 65 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6826/1244156926,v1:172.21.15.69:6827/1244156926] [v2:172.21.15.69:6828/1244156926,v1:172.21.15.69:6829/1244156926] exists,up d0b1e8ff-4f3c-43b5-88eb-e6da09577292 2023-12-14T14:10:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:osd.10 up in weight 1 up_from 70 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6824/2804287254,v1:172.21.15.81:6825/2804287254] [v2:172.21.15.81:6826/2804287254,v1:172.21.15.81:6827/2804287254] exists,up 3627e9bc-5957-42e7-866f-f085f0b28e59 2023-12-14T14:10:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:osd.11 up in weight 1 up_from 77 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6824/3145725966,v1:172.21.15.119:6825/3145725966] [v2:172.21.15.119:6826/3145725966,v1:172.21.15.119:6827/3145725966] exists,up 59f201a4-0834-4f62-9904-fc42f0fb70e1 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.4 [2,11] 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.e [2,4] 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.1d [8,11] 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.1 [4,9] 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.2 [3,9] 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.36 [4,9] 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/4026355192 expires 2023-12-15T14:04:10.545422+0000 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/3934974409 expires 2023-12-15T14:04:10.545422+0000 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6800/3548022044 expires 2023-12-15T14:03:50.725434+0000 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/1558519947 expires 2023-12-15T14:04:10.545422+0000 2023-12-14T14:10:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/2490315530 expires 2023-12-15T14:03:50.725434+0000 2023-12-14T14:10:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6801/3548022044 expires 2023-12-15T14:03:50.725434+0000 2023-12-14T14:10:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6801/1599224275 expires 2023-12-15T14:04:10.545422+0000 2023-12-14T14:10:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/1590117205 expires 2023-12-15T14:03:50.725434+0000 2023-12-14T14:10:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6800/1599224275 expires 2023-12-15T14:04:10.545422+0000 2023-12-14T14:10:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/394074805 expires 2023-12-15T14:03:50.725434+0000 2023-12-14T14:10:15.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38fc0a11e0 msgr2=0x7f38fc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:15.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38fc0a11e0 0x7f38fc0a3690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3900005fd0 tx=0x7f3900005dd0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 msgr2=0x7f390c19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:15.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 0x7f390c19d650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3904004d00 tx=0x7f3904004de0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 shutdown_connections 2023-12-14T14:10:15.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f38fc0a11e0 0x7f38fc0a3690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f390c101e90 0x7f390c19d650 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f390c100300 0x7f390c196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 --2- 172.21.15.69:0/3336753694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f390c101500 0x7f390c1965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:15.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 >> 172.21.15.69:0/3336753694 conn(0x7f390c0fb910 msgr2=0x7f390c1048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:15.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 shutdown_connections 2023-12-14T14:10:15.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:15.792+0000 7f3913144700 1 -- 172.21.15.69:0/3336753694 wait complete. 2023-12-14T14:10:15.822 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:15 smithi069 ceph-mon[42034]: pgmap v256: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:15 smithi081 ceph-mon[43371]: pgmap v256: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:15 smithi119 ceph-mon[43834]: pgmap v256: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:16.189 INFO:teuthology.run_tasks:Running task fs.ready... 2023-12-14T14:10:16.234 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:10:16.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.361+0000 7f6d598ab700 1 -- 172.21.15.69:0/585560365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 msgr2=0x7f6d54100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.361+0000 7f6d598ab700 1 --2- 172.21.15.69:0/585560365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 0x7f6d54100850 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009990 tx=0x7f6d44009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.361+0000 7f6d598ab700 1 -- 172.21.15.69:0/585560365 shutdown_connections 2023-12-14T14:10:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.361+0000 7f6d598ab700 1 --2- 172.21.15.69:0/585560365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d54100d90 0x7f6d54107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.361+0000 7f6d598ab700 1 --2- 172.21.15.69:0/585560365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d540ff150 0x7f6d540ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.361+0000 7f6d598ab700 1 --2- 172.21.15.69:0/585560365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 0x7f6d54100850 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.361+0000 7f6d598ab700 1 -- 172.21.15.69:0/585560365 >> 172.21.15.69:0/585560365 conn(0x7f6d540fa750 msgr2=0x7f6d540fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.361+0000 7f6d598ab700 1 -- 172.21.15.69:0/585560365 shutdown_connections 2023-12-14T14:10:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.361+0000 7f6d598ab700 1 -- 172.21.15.69:0/585560365 wait complete. 2023-12-14T14:10:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d598ab700 1 Processor -- start 2023-12-14T14:10:16.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d598ab700 1 -- start start 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d598ab700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d540ff150 0x7f6d54069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d598ab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 0x7f6d5419aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d598ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d54100d90 0x7f6d5419d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d598ab700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5419dad0 con 0x7f6d541003e0 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d598ab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5419dc40 con 0x7f6d54100d90 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d598ab700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5419de00 con 0x7f6d540ff150 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d527fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 0x7f6d5419aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d527fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 0x7f6d5419aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59924/0 (socket says 172.21.15.69:59924) 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d527fc700 1 -- 172.21.15.69:0/3183514913 learned_addr learned my addr 172.21.15.69:0/3183514913 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.362+0000 7f6d52ffd700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d540ff150 0x7f6d54069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d527fc700 1 -- 172.21.15.69:0/3183514913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d540ff150 msgr2=0x7f6d54069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d527fc700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d540ff150 0x7f6d54069ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d527fc700 1 -- 172.21.15.69:0/3183514913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d54100d90 msgr2=0x7f6d5419d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d537fe700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d54100d90 0x7f6d5419d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d527fc700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d54100d90 0x7f6d5419d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d527fc700 1 -- 172.21.15.69:0/3183514913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d440095f0 con 0x7f6d541003e0 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d52ffd700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d540ff150 0x7f6d54069ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d527fc700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 0x7f6d5419aca0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000c00 tx=0x7f6d4400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d588a9700 1 -- 172.21.15.69:0/3183514913 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4401d070 con 0x7f6d541003e0 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d588a9700 1 -- 172.21.15.69:0/3183514913 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d4400fc00 con 0x7f6d541003e0 2023-12-14T14:10:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5410ab50 con 0x7f6d541003e0 2023-12-14T14:10:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d588a9700 1 -- 172.21.15.69:0/3183514913 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44017650 con 0x7f6d541003e0 2023-12-14T14:10:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.363+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5410a9c0 con 0x7f6d541003e0 2023-12-14T14:10:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.364+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5419e430 con 0x7f6d541003e0 2023-12-14T14:10:16.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.365+0000 7f6d588a9700 1 -- 172.21.15.69:0/3183514913 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6d44022470 con 0x7f6d541003e0 2023-12-14T14:10:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.366+0000 7f6d588a9700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d3c0a11e0 0x7f6d3c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.366+0000 7f6d52ffd700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d3c0a11e0 0x7f6d3c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.366+0000 7f6d588a9700 1 -- 172.21.15.69:0/3183514913 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f6d440cdf90 con 0x7f6d541003e0 2023-12-14T14:10:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.366+0000 7f6d52ffd700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d3c0a11e0 0x7f6d3c0a3690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d48005fd0 tx=0x7f6d48005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.369+0000 7f6d588a9700 1 -- 172.21.15.69:0/3183514913 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6d44097710 con 0x7f6d541003e0 2023-12-14T14:10:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.569+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d54106050 con 0x7f6d541003e0 2023-12-14T14:10:16.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.570+0000 7f6d588a9700 1 -- 172.21.15.69:0/3183514913 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22434 (secure 0 0 0) 0x7f6d4409ad30 con 0x7f6d541003e0 2023-12-14T14:10:16.571 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":84,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:10:12.522850+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:10:16.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d3c0a11e0 msgr2=0x7f6d3c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d3c0a11e0 0x7f6d3c0a3690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d48005fd0 tx=0x7f6d48005ee0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 msgr2=0x7f6d5419aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 0x7f6d5419aca0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000c00 tx=0x7f6d4400f710 comp rx=0 tx=0).stop 2023-12-14T14:10:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 shutdown_connections 2023-12-14T14:10:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f6d3c0a11e0 0x7f6d3c0a3690 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d54100d90 0x7f6d5419d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d540ff150 0x7f6d54069ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 --2- 172.21.15.69:0/3183514913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d541003e0 0x7f6d5419aca0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 >> 172.21.15.69:0/3183514913 conn(0x7f6d540fa750 msgr2=0x7f6d540fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 shutdown_connections 2023-12-14T14:10:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.573+0000 7f6d598ab700 1 -- 172.21.15.69:0/3183514913 wait complete. 2023-12-14T14:10:16.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T14:09:08.720147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T14:09:09.776845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:10:16.586 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:10:16.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.711+0000 7fd402615700 1 -- 172.21.15.69:0/1350198405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc100ca0 msgr2=0x7fd3fc107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.711+0000 7fd402615700 1 --2- 172.21.15.69:0/1350198405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc100ca0 0x7fd3fc107560 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400b0a0 tx=0x7fd3f400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.711+0000 7fd402615700 1 -- 172.21.15.69:0/1350198405 shutdown_connections 2023-12-14T14:10:16.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.711+0000 7fd402615700 1 --2- 172.21.15.69:0/1350198405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc100ca0 0x7fd3fc107560 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.711+0000 7fd402615700 1 --2- 172.21.15.69:0/1350198405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3fc0ff120 0x7fd3fc0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.711+0000 7fd402615700 1 --2- 172.21.15.69:0/1350198405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3fc100310 0x7fd3fc100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.711+0000 7fd402615700 1 -- 172.21.15.69:0/1350198405 >> 172.21.15.69:0/1350198405 conn(0x7fd3fc0fa740 msgr2=0x7fd3fc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.711+0000 7fd402615700 1 -- 172.21.15.69:0/1350198405 shutdown_connections 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.711+0000 7fd402615700 1 -- 172.21.15.69:0/1350198405 wait complete. 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd402615700 1 Processor -- start 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd402615700 1 -- start start 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd402615700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc0ff120 0x7fd3fc1961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd402615700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3fc100310 0x7fd3fc196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd402615700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3fc100ca0 0x7fd3fc19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd402615700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc19dd40 con 0x7fd3fc0ff120 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd402615700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc19de80 con 0x7fd3fc100310 2023-12-14T14:10:16.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd402615700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc19e010 con 0x7fd3fc100ca0 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc0ff120 0x7fd3fc1961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc0ff120 0x7fd3fc1961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59950/0 (socket says 172.21.15.69:59950) 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fbfff700 1 -- 172.21.15.69:0/3718208783 learned_addr learned my addr 172.21.15.69:0/3718208783 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd400bb2700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3fc100ca0 0x7fd3fc19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fb7fe700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3fc100310 0x7fd3fc196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fbfff700 1 -- 172.21.15.69:0/3718208783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3fc100ca0 msgr2=0x7fd3fc19d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fbfff700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3fc100ca0 0x7fd3fc19d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fbfff700 1 -- 172.21.15.69:0/3718208783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3fc100310 msgr2=0x7fd3fc196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fbfff700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3fc100310 0x7fd3fc196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fbfff700 1 -- 172.21.15.69:0/3718208783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f4009d00 con 0x7fd3fc0ff120 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.712+0000 7fd3fbfff700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc0ff120 0x7fd3fc1961c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00b500 tx=0x7fd3ec00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.713+0000 7fd3f97fa700 1 -- 172.21.15.69:0/3718208783 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec011830 con 0x7fd3fc0ff120 2023-12-14T14:10:16.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.713+0000 7fd3f97fa700 1 -- 172.21.15.69:0/3718208783 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3ec011e50 con 0x7fd3fc0ff120 2023-12-14T14:10:16.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.713+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc10ab80 con 0x7fd3fc0ff120 2023-12-14T14:10:16.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.713+0000 7fd3f97fa700 1 -- 172.21.15.69:0/3718208783 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec010dc0 con 0x7fd3fc0ff120 2023-12-14T14:10:16.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.713+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc10a9f0 con 0x7fd3fc0ff120 2023-12-14T14:10:16.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.714+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc0679f0 con 0x7fd3fc0ff120 2023-12-14T14:10:16.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.715+0000 7fd3f97fa700 1 -- 172.21.15.69:0/3718208783 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd3ec010380 con 0x7fd3fc0ff120 2023-12-14T14:10:16.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.715+0000 7fd3f97fa700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3e40a11e0 0x7fd3e40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:16.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.715+0000 7fd3f97fa700 1 -- 172.21.15.69:0/3718208783 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fd3ec0cc280 con 0x7fd3fc0ff120 2023-12-14T14:10:16.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.715+0000 7fd3fb7fe700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3e40a11e0 0x7fd3e40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:16.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.716+0000 7fd3fb7fe700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3e40a11e0 0x7fd3e40a3690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0005950 tx=0x7fd3f000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:16.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.719+0000 7fd3f97fa700 1 -- 172.21.15.69:0/3718208783 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd3ec095a80 con 0x7fd3fc0ff120 2023-12-14T14:10:16.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:16 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3336753694' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-14T14:10:16.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:16 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3336753694' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-14T14:10:16.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.907+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3fc19eb80 con 0x7fd3fc0ff120 2023-12-14T14:10:16.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.907+0000 7fd3f97fa700 1 -- 172.21.15.69:0/3718208783 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3ec0990a0 con 0x7fd3fc0ff120 2023-12-14T14:10:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:10:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3e40a11e0 msgr2=0x7fd3e40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3e40a11e0 0x7fd3e40a3690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0005950 tx=0x7fd3f000b410 comp rx=0 tx=0).stop 2023-12-14T14:10:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc0ff120 msgr2=0x7fd3fc1961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc0ff120 0x7fd3fc1961c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00b500 tx=0x7fd3ec00b810 comp rx=0 tx=0).stop 2023-12-14T14:10:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 shutdown_connections 2023-12-14T14:10:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd3e40a11e0 0x7fd3e40a3690 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3fc100ca0 0x7fd3fc19d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3fc0ff120 0x7fd3fc1961c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 --2- 172.21.15.69:0/3718208783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3fc100310 0x7fd3fc196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.909+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 >> 172.21.15.69:0/3718208783 conn(0x7fd3fc0fa740 msgr2=0x7fd3fc067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.910+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 shutdown_connections 2023-12-14T14:10:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:16.910+0000 7fd402615700 1 -- 172.21.15.69:0/3718208783 wait complete. 2023-12-14T14:10:16.922 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T14:10:17.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:16 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3336753694' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-14T14:10:17.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.046+0000 7f613748a700 1 -- 172.21.15.69:0/2530739354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61300fe4d0 msgr2=0x7f61300fe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.046+0000 7f613748a700 1 --2- 172.21.15.69:0/2530739354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61300fe4d0 0x7f61300fe8e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f612c009990 tx=0x7f612c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 -- 172.21.15.69:0/2530739354 shutdown_connections 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 --2- 172.21.15.69:0/2530739354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6130101e30 0x7f61301086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 --2- 172.21.15.69:0/2530739354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61300fe4d0 0x7f61300fe8e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 --2- 172.21.15.69:0/2530739354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61301014a0 0x7f61301018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 -- 172.21.15.69:0/2530739354 >> 172.21.15.69:0/2530739354 conn(0x7f61300f9ed0 msgr2=0x7f61300fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 -- 172.21.15.69:0/2530739354 shutdown_connections 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 -- 172.21.15.69:0/2530739354 wait complete. 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 Processor -- start 2023-12-14T14:10:17.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 -- start start 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61300fe4d0 0x7f6130100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61301014a0 0x7f61300ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6130101e30 0x7f61300ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6130100130 con 0x7f6130101e30 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61301002a0 con 0x7f61301014a0 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f613748a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61301a0070 con 0x7f61300fe4d0 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f6135a27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6130101e30 0x7f61300ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f6135a27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6130101e30 0x7f61300ff990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59960/0 (socket says 172.21.15.69:59960) 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.047+0000 7f6135a27700 1 -- 172.21.15.69:0/3668571310 learned_addr learned my addr 172.21.15.69:0/3668571310 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:17.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f6135226700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61300fe4d0 0x7f6130100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f6134a25700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61301014a0 0x7f61300ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f6135a27700 1 -- 172.21.15.69:0/3668571310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61300fe4d0 msgr2=0x7f6130100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f6135a27700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61300fe4d0 0x7f6130100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f6135a27700 1 -- 172.21.15.69:0/3668571310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61301014a0 msgr2=0x7f61300ff450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f6135a27700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61301014a0 0x7f61300ff450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f6135a27700 1 -- 172.21.15.69:0/3668571310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c0095f0 con 0x7f6130101e30 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f6134a25700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61301014a0 0x7f61300ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f6135a27700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6130101e30 0x7f61300ff990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f612800ada0 tx=0x7f612800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f61267fc700 1 -- 172.21.15.69:0/3668571310 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612800f070 con 0x7f6130101e30 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613010bbd0 con 0x7f6130101e30 2023-12-14T14:10:17.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f61267fc700 1 -- 172.21.15.69:0/3668571310 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6128007b30 con 0x7f6130101e30 2023-12-14T14:10:17.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f61267fc700 1 -- 172.21.15.69:0/3668571310 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61280053e0 con 0x7f6130101e30 2023-12-14T14:10:17.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.048+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613010ba40 con 0x7f6130101e30 2023-12-14T14:10:17.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.049+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6130107260 con 0x7f6130101e30 2023-12-14T14:10:17.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.050+0000 7f61267fc700 1 -- 172.21.15.69:0/3668571310 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f612800c980 con 0x7f6130101e30 2023-12-14T14:10:17.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.051+0000 7f61267fc700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f611c0a11e0 0x7f611c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.051+0000 7f6135226700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f611c0a11e0 0x7f611c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.051+0000 7f61267fc700 1 -- 172.21.15.69:0/3668571310 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f61280cc5d0 con 0x7f6130101e30 2023-12-14T14:10:17.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.051+0000 7f6135226700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f611c0a11e0 0x7f611c0a3690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f612c00b5c0 tx=0x7f612c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:17.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.054+0000 7f61267fc700 1 -- 172.21.15.69:0/3668571310 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6128095d50 con 0x7f6130101e30 2023-12-14T14:10:17.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.244+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6130061900 con 0x7f6130101e30 2023-12-14T14:10:17.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.244+0000 7f61267fc700 1 -- 172.21.15.69:0/3668571310 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6128099370 con 0x7f6130101e30 2023-12-14T14:10:17.244 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f611c0a11e0 msgr2=0x7f611c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f611c0a11e0 0x7f611c0a3690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f612c00b5c0 tx=0x7f612c005fb0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6130101e30 msgr2=0x7f61300ff990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6130101e30 0x7f61300ff990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f612800ada0 tx=0x7f612800c330 comp rx=0 tx=0).stop 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 shutdown_connections 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f611c0a11e0 0x7f611c0a3690 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6130101e30 0x7f61300ff990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61300fe4d0 0x7f6130100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 --2- 172.21.15.69:0/3668571310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61301014a0 0x7f61300ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 >> 172.21.15.69:0/3668571310 conn(0x7f61300f9ed0 msgr2=0x7f61300fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:17.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 shutdown_connections 2023-12-14T14:10:17.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.246+0000 7f613748a700 1 -- 172.21.15.69:0/3668571310 wait complete. 2023-12-14T14:10:17.259 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T14:10:17.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.383+0000 7f45514a9700 1 -- 172.21.15.69:0/3200870104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c100d60 msgr2=0x7f454c103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.383+0000 7f45514a9700 1 --2- 172.21.15.69:0/3200870104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c100d60 0x7f454c103140 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f453c009990 tx=0x7f453c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.383+0000 7f45514a9700 1 -- 172.21.15.69:0/3200870104 shutdown_connections 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.383+0000 7f45514a9700 1 --2- 172.21.15.69:0/3200870104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454c105fa0 0x7f454c108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.383+0000 7f45514a9700 1 --2- 172.21.15.69:0/3200870104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c100d60 0x7f454c103140 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.383+0000 7f45514a9700 1 --2- 172.21.15.69:0/3200870104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f454c103680 0x7f454c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.383+0000 7f45514a9700 1 -- 172.21.15.69:0/3200870104 >> 172.21.15.69:0/3200870104 conn(0x7f454c0fa780 msgr2=0x7f454c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 -- 172.21.15.69:0/3200870104 shutdown_connections 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 -- 172.21.15.69:0/3200870104 wait complete. 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 Processor -- start 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 -- start start 2023-12-14T14:10:17.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f454c100d60 0x7f454c1006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454c103680 0x7f454c0fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c105fa0 0x7f454c0ff250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0ff9f0 con 0x7f454c105fa0 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0ffb60 con 0x7f454c103680 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.384+0000 7f45514a9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c1a0070 con 0x7f454c100d60 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c105fa0 0x7f454c0ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c105fa0 0x7f454c0ff250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59976/0 (socket says 172.21.15.69:59976) 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454b7fe700 1 -- 172.21.15.69:0/2036098527 learned_addr learned my addr 172.21.15.69:0/2036098527 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454affd700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f454c100d60 0x7f454c1006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454b7fe700 1 -- 172.21.15.69:0/2036098527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f454c100d60 msgr2=0x7f454c1006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454a7fc700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454c103680 0x7f454c0fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454b7fe700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f454c100d60 0x7f454c1006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454b7fe700 1 -- 172.21.15.69:0/2036098527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454c103680 msgr2=0x7f454c0fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454b7fe700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454c103680 0x7f454c0fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454b7fe700 1 -- 172.21.15.69:0/2036098527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0095f0 con 0x7f454c105fa0 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f454b7fe700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c105fa0 0x7f454c0ff250 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4544007ee0 tx=0x7f454400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f4533fff700 1 -- 172.21.15.69:0/2036098527 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544017070 con 0x7f454c105fa0 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c10bc00 con 0x7f454c105fa0 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f4533fff700 1 -- 172.21.15.69:0/2036098527 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f454400f040 con 0x7f454c105fa0 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f4533fff700 1 -- 172.21.15.69:0/2036098527 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544005740 con 0x7f454c105fa0 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.385+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c10ba70 con 0x7f454c105fa0 2023-12-14T14:10:17.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.386+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c0fc2f0 con 0x7f454c105fa0 2023-12-14T14:10:17.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.387+0000 7f4533fff700 1 -- 172.21.15.69:0/2036098527 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f454400dc60 con 0x7f454c105fa0 2023-12-14T14:10:17.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.388+0000 7f4533fff700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f45340a11e0 0x7f45340a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.388+0000 7f454affd700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f45340a11e0 0x7f45340a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.388+0000 7f4533fff700 1 -- 172.21.15.69:0/2036098527 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f45440cc7f0 con 0x7f454c105fa0 2023-12-14T14:10:17.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.388+0000 7f454affd700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f45340a11e0 0x7f45340a3690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f453c00b5c0 tx=0x7f453c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:17.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.391+0000 7f4533fff700 1 -- 172.21.15.69:0/2036098527 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4544095ee0 con 0x7f454c105fa0 2023-12-14T14:10:17.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.583+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f454c061700 con 0x7f454c105fa0 2023-12-14T14:10:17.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.583+0000 7f4533fff700 1 -- 172.21.15.69:0/2036098527 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4544099500 con 0x7f454c105fa0 2023-12-14T14:10:17.584 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T14:10:17.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f45340a11e0 msgr2=0x7f45340a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f45340a11e0 0x7f45340a3690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f453c00b5c0 tx=0x7f453c005fd0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c105fa0 msgr2=0x7f454c0ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c105fa0 0x7f454c0ff250 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4544007ee0 tx=0x7f454400d3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 shutdown_connections 2023-12-14T14:10:17.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f45340a11e0 0x7f45340a3690 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f454c105fa0 0x7f454c0ff250 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f454c100d60 0x7f454c1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 --2- 172.21.15.69:0/2036098527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454c103680 0x7f454c0fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 >> 172.21.15.69:0/2036098527 conn(0x7f454c0fa780 msgr2=0x7f454c1019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 shutdown_connections 2023-12-14T14:10:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.585+0000 7f45514a9700 1 -- 172.21.15.69:0/2036098527 wait complete. 2023-12-14T14:10:17.598 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:10:17.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.720+0000 7fde09d5e700 1 -- 172.21.15.69:0/4164819197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04100d40 msgr2=0x7fde04103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.721+0000 7fde09d5e700 1 --2- 172.21.15.69:0/4164819197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04100d40 0x7fde04103120 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009990 tx=0x7fddf8009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.721+0000 7fde09d5e700 1 -- 172.21.15.69:0/4164819197 shutdown_connections 2023-12-14T14:10:17.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.721+0000 7fde09d5e700 1 --2- 172.21.15.69:0/4164819197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde04105f80 0x7fde04108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.721+0000 7fde09d5e700 1 --2- 172.21.15.69:0/4164819197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04100d40 0x7fde04103120 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.721+0000 7fde09d5e700 1 --2- 172.21.15.69:0/4164819197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde04103660 0x7fde04105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.721+0000 7fde09d5e700 1 -- 172.21.15.69:0/4164819197 >> 172.21.15.69:0/4164819197 conn(0x7fde040fa780 msgr2=0x7fde040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:17.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.721+0000 7fde09d5e700 1 -- 172.21.15.69:0/4164819197 shutdown_connections 2023-12-14T14:10:17.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.721+0000 7fde09d5e700 1 -- 172.21.15.69:0/4164819197 wait complete. 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.721+0000 7fde09d5e700 1 Processor -- start 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde09d5e700 1 -- start start 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde09d5e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde04100d40 0x7fde041006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde09d5e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04103660 0x7fde040fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde09d5e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde04105f80 0x7fde040ff230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde09d5e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040ff9d0 con 0x7fde04103660 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde09d5e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040ffb40 con 0x7fde04100d40 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde09d5e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde041a00a0 con 0x7fde04105f80 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde02ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04103660 0x7fde040fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde02ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04103660 0x7fde040fecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59994/0 (socket says 172.21.15.69:59994) 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde02ffd700 1 -- 172.21.15.69:0/2552073843 learned_addr learned my addr 172.21.15.69:0/2552073843 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde037fe700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde04100d40 0x7fde041006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde03fff700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde04105f80 0x7fde040ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde02ffd700 1 -- 172.21.15.69:0/2552073843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde04105f80 msgr2=0x7fde040ff230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde02ffd700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde04105f80 0x7fde040ff230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde02ffd700 1 -- 172.21.15.69:0/2552073843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde04100d40 msgr2=0x7fde041006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde02ffd700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde04100d40 0x7fde041006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde02ffd700 1 -- 172.21.15.69:0/2552073843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80095f0 con 0x7fde04103660 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde03fff700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde04105f80 0x7fde040ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.722+0000 7fde02ffd700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04103660 0x7fde040fecf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fddf400b530 tx=0x7fddf400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:17.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.723+0000 7fde00ff9700 1 -- 172.21.15.69:0/2552073843 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4011830 con 0x7fde04103660 2023-12-14T14:10:17.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.723+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0410bc70 con 0x7fde04103660 2023-12-14T14:10:17.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.723+0000 7fde00ff9700 1 -- 172.21.15.69:0/2552073843 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddf4011e50 con 0x7fde04103660 2023-12-14T14:10:17.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.723+0000 7fde00ff9700 1 -- 172.21.15.69:0/2552073843 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400f2e0 con 0x7fde04103660 2023-12-14T14:10:17.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.723+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0410bae0 con 0x7fde04103660 2023-12-14T14:10:17.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.723+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde041a07f0 con 0x7fde04103660 2023-12-14T14:10:17.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.724+0000 7fde00ff9700 1 -- 172.21.15.69:0/2552073843 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fddf4010380 con 0x7fde04103660 2023-12-14T14:10:17.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.725+0000 7fde00ff9700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fddec0a1260 0x7fddec0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:17.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.725+0000 7fde037fe700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fddec0a1260 0x7fddec0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:17.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.725+0000 7fde00ff9700 1 -- 172.21.15.69:0/2552073843 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fddf40cca60 con 0x7fde04103660 2023-12-14T14:10:17.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.725+0000 7fde037fe700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fddec0a1260 0x7fddec0a3710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fddf800b5c0 tx=0x7fddf8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:17.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.728+0000 7fde00ff9700 1 -- 172.21.15.69:0/2552073843 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fddf4096160 con 0x7fde04103660 2023-12-14T14:10:17.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:17 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3183514913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:17.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:17 smithi069 ceph-mon[42034]: pgmap v257: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:17.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:17 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3718208783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:17.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:17 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3668571310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:17.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:17 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3183514913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:17.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:17 smithi081 ceph-mon[43371]: pgmap v257: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:17.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:17 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3718208783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:17.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:17 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3668571310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.959+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde041a0da0 con 0x7fde04103660 2023-12-14T14:10:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.960+0000 7fde00ff9700 1 -- 172.21.15.69:0/2552073843 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7fddf4015090 con 0x7fde04103660 2023-12-14T14:10:17.960 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:17.960 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fddec0a1260 msgr2=0x7fddec0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fddec0a1260 0x7fddec0a3710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fddf800b5c0 tx=0x7fddf8005fb0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04103660 msgr2=0x7fde040fecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04103660 0x7fde040fecf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fddf400b530 tx=0x7fddf400b840 comp rx=0 tx=0).stop 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 shutdown_connections 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fddec0a1260 0x7fddec0a3710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde04105f80 0x7fde040ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde04100d40 0x7fde041006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 --2- 172.21.15.69:0/2552073843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde04103660 0x7fde040fecf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 >> 172.21.15.69:0/2552073843 conn(0x7fde040fa780 msgr2=0x7fde041021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:17.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 shutdown_connections 2023-12-14T14:10:17.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:17.962+0000 7fde09d5e700 1 -- 172.21.15.69:0/2552073843 wait complete. 2023-12-14T14:10:17.964 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:10:17.975 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:10:18.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:17 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3183514913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:18.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:17 smithi119 ceph-mon[43834]: pgmap v257: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:18.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:17 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3718208783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:18.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:17 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3668571310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:18.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.097+0000 7fc8b4c82700 1 -- 172.21.15.69:0/1141364746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b0100730 msgr2=0x7fc8b0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.097+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/1141364746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b0100730 0x7fc8b0100b40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009990 tx=0x7fc8a0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 -- 172.21.15.69:0/1141364746 shutdown_connections 2023-12-14T14:10:18.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/1141364746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8b00ffd30 0x7fc8b01075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/1141364746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b0100730 0x7fc8b0100b40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/1141364746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b00ff380 0x7fc8b00ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 -- 172.21.15.69:0/1141364746 >> 172.21.15.69:0/1141364746 conn(0x7fc8b00f9e80 msgr2=0x7fc8b00fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:18.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 -- 172.21.15.69:0/1141364746 shutdown_connections 2023-12-14T14:10:18.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 -- 172.21.15.69:0/1141364746 wait complete. 2023-12-14T14:10:18.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 Processor -- start 2023-12-14T14:10:18.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 -- start start 2023-12-14T14:10:18.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b00ff380 0x7fc8b0103130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.098+0000 7fc8b4c82700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b00ffd30 0x7fc8b0101770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8b4c82700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8b0100730 0x7fc8b0101cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8b4c82700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0102450 con 0x7fc8b00ffd30 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8b4c82700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b01025c0 con 0x7fc8b00ff380 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8b4c82700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b01a0020 con 0x7fc8b0100730 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8add9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b00ffd30 0x7fc8b0101770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8add9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b00ffd30 0x7fc8b0101770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60008/0 (socket says 172.21.15.69:60008) 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8add9b700 1 -- 172.21.15.69:0/2335021343 learned_addr learned my addr 172.21.15.69:0/2335021343 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8ae59c700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b00ff380 0x7fc8b0103130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8aed9d700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8b0100730 0x7fc8b0101cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8add9b700 1 -- 172.21.15.69:0/2335021343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8b0100730 msgr2=0x7fc8b0101cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8add9b700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8b0100730 0x7fc8b0101cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8add9b700 1 -- 172.21.15.69:0/2335021343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b00ff380 msgr2=0x7fc8b0103130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8add9b700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b00ff380 0x7fc8b0103130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8add9b700 1 -- 172.21.15.69:0/2335021343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00095f0 con 0x7fc8b00ffd30 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8aed9d700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8b0100730 0x7fc8b0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8add9b700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b00ffd30 0x7fc8b0101770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400d980 tx=0x7fc8a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc89f7fe700 1 -- 172.21.15.69:0/2335021343 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4004220 con 0x7fc8b00ffd30 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b010aac0 con 0x7fc8b00ffd30 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc89f7fe700 1 -- 172.21.15.69:0/2335021343 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8a4007640 con 0x7fc8b00ffd30 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc89f7fe700 1 -- 172.21.15.69:0/2335021343 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4005610 con 0x7fc8b00ffd30 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.099+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b010a930 con 0x7fc8b00ffd30 2023-12-14T14:10:18.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.100+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b01a0760 con 0x7fc8b00ffd30 2023-12-14T14:10:18.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.102+0000 7fc89f7fe700 1 -- 172.21.15.69:0/2335021343 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc8a4004750 con 0x7fc8b00ffd30 2023-12-14T14:10:18.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.102+0000 7fc89f7fe700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc8980a11e0 0x7fc8980a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.103+0000 7fc8ae59c700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc8980a11e0 0x7fc8980a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.103+0000 7fc89f7fe700 1 -- 172.21.15.69:0/2335021343 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fc8a40ccd40 con 0x7fc8b00ffd30 2023-12-14T14:10:18.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.103+0000 7fc8ae59c700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc8980a11e0 0x7fc8980a3690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000b5c0 tx=0x7fc8a0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:18.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.106+0000 7fc89f7fe700 1 -- 172.21.15.69:0/2335021343 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc8a4096430 con 0x7fc8b00ffd30 2023-12-14T14:10:18.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.302+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8b01a0d10 con 0x7fc8b00ffd30 2023-12-14T14:10:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.304+0000 7fc89f7fe700 1 -- 172.21.15.69:0/2335021343 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22434 (secure 0 0 0) 0x7fc8a4016090 con 0x7fc8b00ffd30 2023-12-14T14:10:18.305 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:18.305 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":84,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:10:12.522850+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:10:18.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc8980a11e0 msgr2=0x7fc8980a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc8980a11e0 0x7fc8980a3690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000b5c0 tx=0x7fc8a0005fd0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b00ffd30 msgr2=0x7fc8b0101770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b00ffd30 0x7fc8b0101770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400d980 tx=0x7fc8a400dc90 comp rx=0 tx=0).stop 2023-12-14T14:10:18.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 shutdown_connections 2023-12-14T14:10:18.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc8980a11e0 0x7fc8980a3690 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8b0100730 0x7fc8b0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b00ff380 0x7fc8b0103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 --2- 172.21.15.69:0/2335021343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b00ffd30 0x7fc8b0101770 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 >> 172.21.15.69:0/2335021343 conn(0x7fc8b00f9e80 msgr2=0x7fc8b00fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:18.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 shutdown_connections 2023-12-14T14:10:18.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.306+0000 7fc8b4c82700 1 -- 172.21.15.69:0/2335021343 wait complete. 2023-12-14T14:10:18.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T14:09:08.720147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T14:09:09.776845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:10:18.320 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:10:18.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 -- 172.21.15.69:0/4069056902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 msgr2=0x7fb128100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 --2- 172.21.15.69:0/4069056902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 0x7fb128100770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb114009990 tx=0x7fb114009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 -- 172.21.15.69:0/4069056902 shutdown_connections 2023-12-14T14:10:18.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 --2- 172.21.15.69:0/4069056902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb128100cb0 0x7fb128107570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 --2- 172.21.15.69:0/4069056902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1280ff130 0x7fb1280ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 --2- 172.21.15.69:0/4069056902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 0x7fb128100770 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 -- 172.21.15.69:0/4069056902 >> 172.21.15.69:0/4069056902 conn(0x7fb1280fa750 msgr2=0x7fb1280fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:18.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 -- 172.21.15.69:0/4069056902 shutdown_connections 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 -- 172.21.15.69:0/4069056902 wait complete. 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.444+0000 7fb12efdd700 1 Processor -- start 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12efdd700 1 -- start start 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12efdd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1280ff130 0x7fb128196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12efdd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 0x7fb128196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12efdd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb128100cb0 0x7fb12819d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12efdd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12819db80 con 0x7fb128100320 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12efdd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12819dcc0 con 0x7fb1280ff130 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12efdd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12819de50 con 0x7fb128100cb0 2023-12-14T14:10:18.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb127fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 0x7fb128196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb127fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 0x7fb128196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60024/0 (socket says 172.21.15.69:60024) 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb127fff700 1 -- 172.21.15.69:0/951791504 learned_addr learned my addr 172.21.15.69:0/951791504 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12cd79700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1280ff130 0x7fb128196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12d57a700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb128100cb0 0x7fb12819d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb127fff700 1 -- 172.21.15.69:0/951791504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb128100cb0 msgr2=0x7fb12819d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb127fff700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb128100cb0 0x7fb12819d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb127fff700 1 -- 172.21.15.69:0/951791504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1280ff130 msgr2=0x7fb128196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb127fff700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1280ff130 0x7fb128196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb127fff700 1 -- 172.21.15.69:0/951791504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1140095f0 con 0x7fb128100320 2023-12-14T14:10:18.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb127fff700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 0x7fb128196540 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb114004760 tx=0x7fb114004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:18.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb125ffb700 1 -- 172.21.15.69:0/951791504 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11401d070 con 0x7fb128100320 2023-12-14T14:10:18.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb125ffb700 1 -- 172.21.15.69:0/951791504 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb114004cf0 con 0x7fb128100320 2023-12-14T14:10:18.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12810aa90 con 0x7fb128100320 2023-12-14T14:10:18.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.445+0000 7fb125ffb700 1 -- 172.21.15.69:0/951791504 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114003d00 con 0x7fb128100320 2023-12-14T14:10:18.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.446+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12810a900 con 0x7fb128100320 2023-12-14T14:10:18.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.446+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb128067e40 con 0x7fb128100320 2023-12-14T14:10:18.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.448+0000 7fb125ffb700 1 -- 172.21.15.69:0/951791504 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb114005000 con 0x7fb128100320 2023-12-14T14:10:18.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.448+0000 7fb125ffb700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb1180a11e0 0x7fb1180a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.448+0000 7fb12cd79700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb1180a11e0 0x7fb1180a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.448+0000 7fb125ffb700 1 -- 172.21.15.69:0/951791504 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb1140cde50 con 0x7fb128100320 2023-12-14T14:10:18.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.449+0000 7fb12cd79700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb1180a11e0 0x7fb1180a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb128100180 tx=0x7fb11c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:18.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.452+0000 7fb125ffb700 1 -- 172.21.15.69:0/951791504 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb1140975d0 con 0x7fb128100320 2023-12-14T14:10:18.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:18 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2036098527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:18.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:18 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2552073843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:18.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:18 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2335021343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:18.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.642+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb12819e8a0 con 0x7fb128100320 2023-12-14T14:10:18.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.642+0000 7fb125ffb700 1 -- 172.21.15.69:0/951791504 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb114004e60 con 0x7fb128100320 2023-12-14T14:10:18.643 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:10:18.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb1180a11e0 msgr2=0x7fb1180a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb1180a11e0 0x7fb1180a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb128100180 tx=0x7fb11c00a380 comp rx=0 tx=0).stop 2023-12-14T14:10:18.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 msgr2=0x7fb128196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 0x7fb128196540 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb114004760 tx=0x7fb114004790 comp rx=0 tx=0).stop 2023-12-14T14:10:18.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 shutdown_connections 2023-12-14T14:10:18.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fb1180a11e0 0x7fb1180a3690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb128100cb0 0x7fb12819d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1280ff130 0x7fb128196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 --2- 172.21.15.69:0/951791504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb128100320 0x7fb128196540 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.644+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 >> 172.21.15.69:0/951791504 conn(0x7fb1280fa750 msgr2=0x7fb128068fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:18.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.645+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 shutdown_connections 2023-12-14T14:10:18.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.645+0000 7fb12efdd700 1 -- 172.21.15.69:0/951791504 wait complete. 2023-12-14T14:10:18.657 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T14:10:18.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 -- 172.21.15.69:0/1106579394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ff370 msgr2=0x7f35380ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 --2- 172.21.15.69:0/1106579394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ff370 0x7f35380ff7e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3528009990 tx=0x7f3528009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 -- 172.21.15.69:0/1106579394 shutdown_connections 2023-12-14T14:10:18.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 --2- 172.21.15.69:0/1106579394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35380ffd20 0x7f35381075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 --2- 172.21.15.69:0/1106579394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3538100720 0x7f3538100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 --2- 172.21.15.69:0/1106579394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ff370 0x7f35380ff7e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 -- 172.21.15.69:0/1106579394 >> 172.21.15.69:0/1106579394 conn(0x7f35380f9ed0 msgr2=0x7f35380fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:18.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 -- 172.21.15.69:0/1106579394 shutdown_connections 2023-12-14T14:10:18.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 -- 172.21.15.69:0/1106579394 wait complete. 2023-12-14T14:10:18.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 Processor -- start 2023-12-14T14:10:18.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.782+0000 7f353ea14700 1 -- start start 2023-12-14T14:10:18.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f353ea14700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35380ff370 0x7f35380fedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f353ea14700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ffd20 0x7f353819adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f353ea14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3538100720 0x7f353819d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f353ea14700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353819db90 con 0x7f35380ffd20 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f353ea14700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353819dd00 con 0x7f3538100720 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f353ea14700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353819dec0 con 0x7f35380ff370 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35377fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ffd20 0x7f353819adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35377fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ffd20 0x7f353819adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60044/0 (socket says 172.21.15.69:60044) 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35377fe700 1 -- 172.21.15.69:0/533686979 learned_addr learned my addr 172.21.15.69:0/533686979 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f3537fff700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35380ff370 0x7f35380fedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f353cfb1700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3538100720 0x7f353819d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35377fe700 1 -- 172.21.15.69:0/533686979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35380ff370 msgr2=0x7f35380fedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35377fe700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35380ff370 0x7f35380fedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35377fe700 1 -- 172.21.15.69:0/533686979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3538100720 msgr2=0x7f353819d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35377fe700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3538100720 0x7f353819d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35377fe700 1 -- 172.21.15.69:0/533686979 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280095f0 con 0x7f35380ffd20 2023-12-14T14:10:18.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35377fe700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ffd20 0x7f353819adb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3528006010 tx=0x7f352800f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:18.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35357fa700 1 -- 172.21.15.69:0/533686979 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352801d070 con 0x7f35380ffd20 2023-12-14T14:10:18.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353810ab60 con 0x7f35380ffd20 2023-12-14T14:10:18.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35357fa700 1 -- 172.21.15.69:0/533686979 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f352800fca0 con 0x7f35380ffd20 2023-12-14T14:10:18.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f35357fa700 1 -- 172.21.15.69:0/533686979 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280176e0 con 0x7f35380ffd20 2023-12-14T14:10:18.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.783+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353810a9d0 con 0x7f35380ffd20 2023-12-14T14:10:18.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.784+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3538106110 con 0x7f35380ffd20 2023-12-14T14:10:18.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.785+0000 7f35357fa700 1 -- 172.21.15.69:0/533686979 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3528017840 con 0x7f35380ffd20 2023-12-14T14:10:18.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.786+0000 7f35357fa700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f35240a11e0 0x7f35240a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:18.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.786+0000 7f3537fff700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f35240a11e0 0x7f35240a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:18.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.786+0000 7f35357fa700 1 -- 172.21.15.69:0/533686979 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f35280ce0a0 con 0x7f35380ffd20 2023-12-14T14:10:18.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.786+0000 7f3537fff700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f35240a11e0 0x7f35240a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3520006fd0 tx=0x7f3520008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:18.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.789+0000 7f35357fa700 1 -- 172.21.15.69:0/533686979 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3528097820 con 0x7f35380ffd20 2023-12-14T14:10:18.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:18 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2036098527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:18.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:18 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2552073843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:18.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:18 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2335021343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:18.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.979+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3538061700 con 0x7f35380ffd20 2023-12-14T14:10:18.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.979+0000 7f35357fa700 1 -- 172.21.15.69:0/533686979 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f352809ae40 con 0x7f35380ffd20 2023-12-14T14:10:18.979 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T14:10:18.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f35240a11e0 msgr2=0x7f35240a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f35240a11e0 0x7f35240a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3520006fd0 tx=0x7f3520008040 comp rx=0 tx=0).stop 2023-12-14T14:10:18.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ffd20 msgr2=0x7f353819adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:18.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ffd20 0x7f353819adb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3528006010 tx=0x7f352800f7b0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 shutdown_connections 2023-12-14T14:10:18.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f35240a11e0 0x7f35240a3690 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3538100720 0x7f353819d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35380ff370 0x7f35380fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 --2- 172.21.15.69:0/533686979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35380ffd20 0x7f353819adb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:18.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 >> 172.21.15.69:0/533686979 conn(0x7f35380f9ed0 msgr2=0x7f35380fc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:18.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 shutdown_connections 2023-12-14T14:10:18.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:18.981+0000 7f353ea14700 1 -- 172.21.15.69:0/533686979 wait complete. 2023-12-14T14:10:18.994 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T14:10:19.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:18 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2036098527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:19.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:18 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2552073843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:19.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:18 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2335021343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.119+0000 7f5915e5a700 1 -- 172.21.15.69:0/1095354374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100febf0 msgr2=0x7f59101087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 --2- 172.21.15.69:0/1095354374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100febf0 0x7f59101087d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f590800b0a0 tx=0x7f590800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 -- 172.21.15.69:0/1095354374 shutdown_connections 2023-12-14T14:10:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 --2- 172.21.15.69:0/1095354374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100febf0 0x7f59101087d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 --2- 172.21.15.69:0/1095354374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59101017f0 0x7f5910101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 --2- 172.21.15.69:0/1095354374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59100fe260 0x7f59100fe6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 -- 172.21.15.69:0/1095354374 >> 172.21.15.69:0/1095354374 conn(0x7f59100f9ed0 msgr2=0x7f59100fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 -- 172.21.15.69:0/1095354374 shutdown_connections 2023-12-14T14:10:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 -- 172.21.15.69:0/1095354374 wait complete. 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 Processor -- start 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.120+0000 7f5915e5a700 1 -- start start 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f5915e5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100fe260 0x7f5910196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f5915e5a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59100febf0 0x7f5910196670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f5915e5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59101017f0 0x7f591019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f5915e5a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591019dcb0 con 0x7f59100fe260 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f5915e5a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591019ddf0 con 0x7f59101017f0 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f5915e5a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591019df80 con 0x7f59100febf0 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100fe260 0x7f5910196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100fe260 0x7f5910196130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60066/0 (socket says 172.21.15.69:60066) 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590f7fe700 1 -- 172.21.15.69:0/322932139 learned_addr learned my addr 172.21.15.69:0/322932139 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590effd700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59100febf0 0x7f5910196670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590f7fe700 1 -- 172.21.15.69:0/322932139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59100febf0 msgr2=0x7f5910196670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590f7fe700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59100febf0 0x7f5910196670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590f7fe700 1 -- 172.21.15.69:0/322932139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59101017f0 msgr2=0x7f591019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590ffff700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59101017f0 0x7f591019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590f7fe700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59101017f0 0x7f591019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590f7fe700 1 -- 172.21.15.69:0/322932139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5908009d00 con 0x7f59100fe260 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590effd700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59100febf0 0x7f5910196670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590ffff700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59101017f0 0x7f591019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590f7fe700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100fe260 0x7f5910196130 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f590000b500 tx=0x7f590000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590cff9700 1 -- 172.21.15.69:0/322932139 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900011830 con 0x7f59100fe260 2023-12-14T14:10:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591010bc50 con 0x7f59100fe260 2023-12-14T14:10:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590cff9700 1 -- 172.21.15.69:0/322932139 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5900011e50 con 0x7f59100fe260 2023-12-14T14:10:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f590cff9700 1 -- 172.21.15.69:0/322932139 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000f2e0 con 0x7f59100fe260 2023-12-14T14:10:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.121+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591010bac0 con 0x7f59100fe260 2023-12-14T14:10:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.122+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5910107220 con 0x7f59100fe260 2023-12-14T14:10:19.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.124+0000 7f590cff9700 1 -- 172.21.15.69:0/322932139 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5900010580 con 0x7f59100fe260 2023-12-14T14:10:19.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.125+0000 7f590cff9700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f58fc0a11e0 0x7f58fc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.125+0000 7f590effd700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f58fc0a11e0 0x7f58fc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.125+0000 7f590cff9700 1 -- 172.21.15.69:0/322932139 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f59000cca10 con 0x7f59100fe260 2023-12-14T14:10:19.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.125+0000 7f590effd700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f58fc0a11e0 0x7f58fc0a3690 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f58f8005fd0 tx=0x7f58f8005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:19.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.128+0000 7f590cff9700 1 -- 172.21.15.69:0/322932139 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5900096110 con 0x7f59100fe260 2023-12-14T14:10:19.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.314+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5910061970 con 0x7f59100fe260 2023-12-14T14:10:19.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.314+0000 7f590cff9700 1 -- 172.21.15.69:0/322932139 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5900015020 con 0x7f59100fe260 2023-12-14T14:10:19.316 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T14:10:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.316+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f58fc0a11e0 msgr2=0x7f58fc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.316+0000 7f5915e5a700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f58fc0a11e0 0x7f58fc0a3690 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f58f8005fd0 tx=0x7f58f8005dc0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100fe260 msgr2=0x7f5910196130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100fe260 0x7f5910196130 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f590000b500 tx=0x7f590000b8c0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 shutdown_connections 2023-12-14T14:10:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f58fc0a11e0 0x7f58fc0a3690 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59101017f0 0x7f591019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59100fe260 0x7f5910196130 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 --2- 172.21.15.69:0/322932139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59100febf0 0x7f5910196670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 >> 172.21.15.69:0/322932139 conn(0x7f59100f9ed0 msgr2=0x7f59100fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:19.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 shutdown_connections 2023-12-14T14:10:19.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.317+0000 7f5915e5a700 1 -- 172.21.15.69:0/322932139 wait complete. 2023-12-14T14:10:19.330 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:10:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 -- 172.21.15.69:0/4026541829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 msgr2=0x7f571c0ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 --2- 172.21.15.69:0/4026541829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 0x7f571c0ff530 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f570c009990 tx=0x7f570c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 -- 172.21.15.69:0/4026541829 shutdown_connections 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 --2- 172.21.15.69:0/4026541829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f571c100ca0 0x7f571c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 --2- 172.21.15.69:0/4026541829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 0x7f571c0ff530 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 --2- 172.21.15.69:0/4026541829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f571c100310 0x7f571c100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 -- 172.21.15.69:0/4026541829 >> 172.21.15.69:0/4026541829 conn(0x7f571c0fa700 msgr2=0x7f571c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 -- 172.21.15.69:0/4026541829 shutdown_connections 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 -- 172.21.15.69:0/4026541829 wait complete. 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 Processor -- start 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.451+0000 7f57236db700 1 -- start start 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57236db700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 0x7f571c194e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57236db700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f571c100310 0x7f571c1953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57236db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f571c100ca0 0x7f571c19c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57236db700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c19ca10 con 0x7f571c0ff120 2023-12-14T14:10:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57236db700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c19cb50 con 0x7f571c100ca0 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57236db700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c19cce0 con 0x7f571c100310 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721477700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 0x7f571c194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721477700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 0x7f571c194e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60096/0 (socket says 172.21.15.69:60096) 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721477700 1 -- 172.21.15.69:0/4173931318 learned_addr learned my addr 172.21.15.69:0/4173931318 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5720c76700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f571c100310 0x7f571c1953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721c78700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f571c100ca0 0x7f571c19c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721477700 1 -- 172.21.15.69:0/4173931318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f571c100310 msgr2=0x7f571c1953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721477700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f571c100310 0x7f571c1953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721477700 1 -- 172.21.15.69:0/4173931318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f571c100ca0 msgr2=0x7f571c19c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721477700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f571c100ca0 0x7f571c19c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721477700 1 -- 172.21.15.69:0/4173931318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c0095f0 con 0x7f571c0ff120 2023-12-14T14:10:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721c78700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f571c100ca0 0x7f571c19c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5720c76700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f571c100310 0x7f571c1953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f5721477700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 0x7f571c194e90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f570c000c00 tx=0x7f570c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57127fc700 1 -- 172.21.15.69:0/4173931318 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c01f070 con 0x7f571c0ff120 2023-12-14T14:10:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57127fc700 1 -- 172.21.15.69:0/4173931318 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f570c01acf0 con 0x7f571c0ff120 2023-12-14T14:10:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c10aa90 con 0x7f571c0ff120 2023-12-14T14:10:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57127fc700 1 -- 172.21.15.69:0/4173931318 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c004120 con 0x7f571c0ff120 2023-12-14T14:10:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.452+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c10a900 con 0x7f571c0ff120 2023-12-14T14:10:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.453+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c0699d0 con 0x7f571c0ff120 2023-12-14T14:10:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.454+0000 7f57127fc700 1 -- 172.21.15.69:0/4173931318 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f570c023070 con 0x7f571c0ff120 2023-12-14T14:10:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.455+0000 7f57127fc700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57080a11e0 0x7f57080a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.455+0000 7f5720c76700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57080a11e0 0x7f57080a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.455+0000 7f57127fc700 1 -- 172.21.15.69:0/4173931318 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f570c0d00e0 con 0x7f571c0ff120 2023-12-14T14:10:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.456+0000 7f5720c76700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57080a11e0 0x7f57080a3690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5718005fd0 tx=0x7f5718005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:19.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.459+0000 7f57127fc700 1 -- 172.21.15.69:0/4173931318 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f570c099760 con 0x7f571c0ff120 2023-12-14T14:10:19.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:19 smithi069 ceph-mon[42034]: pgmap v258: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:19.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:19 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/951791504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:19 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/533686979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:19 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/322932139' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:19.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.695+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f571c106500 con 0x7f571c0ff120 2023-12-14T14:10:19.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.696+0000 7f57127fc700 1 -- 172.21.15.69:0/4173931318 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f570c01ae60 con 0x7f571c0ff120 2023-12-14T14:10:19.696 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:10:19.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57080a11e0 msgr2=0x7f57080a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57080a11e0 0x7f57080a3690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5718005fd0 tx=0x7f5718005ee0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 msgr2=0x7f571c194e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 0x7f571c194e90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f570c000c00 tx=0x7f570c009f90 comp rx=0 tx=0).stop 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 shutdown_connections 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f57080a11e0 0x7f57080a3690 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f571c100ca0 0x7f571c19c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f571c0ff120 0x7f571c194e90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 --2- 172.21.15.69:0/4173931318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f571c100310 0x7f571c1953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 >> 172.21.15.69:0/4173931318 conn(0x7f571c0fa700 msgr2=0x7f571c103840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 shutdown_connections 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.698+0000 7f57236db700 1 -- 172.21.15.69:0/4173931318 wait complete. 2023-12-14T14:10:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:10:19.711 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:10:19.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.832+0000 7f4190aef700 1 -- 172.21.15.69:0/2721819966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c100ca0 msgr2=0x7f418c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.832+0000 7f4190aef700 1 --2- 172.21.15.69:0/2721819966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c100ca0 0x7f418c103080 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f417c009990 tx=0x7f417c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.832+0000 7f4190aef700 1 -- 172.21.15.69:0/2721819966 shutdown_connections 2023-12-14T14:10:19.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.832+0000 7f4190aef700 1 --2- 172.21.15.69:0/2721819966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c105ee0 0x7f418c108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.832+0000 7f4190aef700 1 --2- 172.21.15.69:0/2721819966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c100ca0 0x7f418c103080 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.832+0000 7f4190aef700 1 --2- 172.21.15.69:0/2721819966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418c1035c0 0x7f418c1059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.832+0000 7f4190aef700 1 -- 172.21.15.69:0/2721819966 >> 172.21.15.69:0/2721819966 conn(0x7f418c0fa700 msgr2=0x7f418c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:19.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.832+0000 7f4190aef700 1 -- 172.21.15.69:0/2721819966 shutdown_connections 2023-12-14T14:10:19.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.832+0000 7f4190aef700 1 -- 172.21.15.69:0/2721819966 wait complete. 2023-12-14T14:10:19.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f4190aef700 1 Processor -- start 2023-12-14T14:10:19.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f4190aef700 1 -- start start 2023-12-14T14:10:19.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f4190aef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100ca0 0x7f418c100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f4190aef700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418c1035c0 0x7f418c0fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f4190aef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c105ee0 0x7f418c0ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f4190aef700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0ff930 con 0x7f418c105ee0 2023-12-14T14:10:19.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f4190aef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0ffaa0 con 0x7f418c100ca0 2023-12-14T14:10:19.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f4190aef700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c1a0040 con 0x7f418c1035c0 2023-12-14T14:10:19.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f418ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c105ee0 0x7f418c0ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f418ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c105ee0 0x7f418c0ff190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60114/0 (socket says 172.21.15.69:60114) 2023-12-14T14:10:19.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f418ad9d700 1 -- 172.21.15.69:0/2216685353 learned_addr learned my addr 172.21.15.69:0/2216685353 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:19.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f4189d9b700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418c1035c0 0x7f418c0fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.833+0000 7f418a59c700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100ca0 0x7f418c100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f418ad9d700 1 -- 172.21.15.69:0/2216685353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418c1035c0 msgr2=0x7f418c0fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f418ad9d700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418c1035c0 0x7f418c0fec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f418ad9d700 1 -- 172.21.15.69:0/2216685353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100ca0 msgr2=0x7f418c100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f418ad9d700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100ca0 0x7f418c100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f418ad9d700 1 -- 172.21.15.69:0/2216685353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c0095f0 con 0x7f418c105ee0 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f418a59c700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100ca0 0x7f418c100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f418ad9d700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c105ee0 0x7f418c0ff190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4184007ee0 tx=0x7f418400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f417b7fe700 1 -- 172.21.15.69:0/2216685353 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184017070 con 0x7f418c105ee0 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f417b7fe700 1 -- 172.21.15.69:0/2216685353 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f418400f040 con 0x7f418c105ee0 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c10bbe0 con 0x7f418c105ee0 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f417b7fe700 1 -- 172.21.15.69:0/2216685353 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184005740 con 0x7f418c105ee0 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.834+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c10ba50 con 0x7f418c105ee0 2023-12-14T14:10:19.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.835+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c0fc270 con 0x7f418c105ee0 2023-12-14T14:10:19.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.836+0000 7f417b7fe700 1 -- 172.21.15.69:0/2216685353 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f418400dc60 con 0x7f418c105ee0 2023-12-14T14:10:19.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.836+0000 7f417b7fe700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f41740a1260 0x7f41740a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:19.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.836+0000 7f418a59c700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f41740a1260 0x7f41740a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:19.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.837+0000 7f417b7fe700 1 -- 172.21.15.69:0/2216685353 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f41840cc950 con 0x7f418c105ee0 2023-12-14T14:10:19.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.837+0000 7f418a59c700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f41740a1260 0x7f41740a3710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f417c006010 tx=0x7f417c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:19.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:19.840+0000 7f417b7fe700 1 -- 172.21.15.69:0/2216685353 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4184095f40 con 0x7f418c105ee0 2023-12-14T14:10:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:19 smithi081 ceph-mon[43371]: pgmap v258: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:19 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/951791504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:19 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/533686979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:19 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/322932139' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:20.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:19 smithi119 ceph-mon[43834]: pgmap v258: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:20.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:19 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/951791504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:20.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:19 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/533686979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:20.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:19 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/322932139' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:20.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.029+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f418c02cfe0 con 0x7f418c105ee0 2023-12-14T14:10:20.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.031+0000 7f417b7fe700 1 -- 172.21.15.69:0/2216685353 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22434 (secure 0 0 0) 0x7f4184099560 con 0x7f418c105ee0 2023-12-14T14:10:20.032 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:20.032 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":84,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:10:12.522850+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:10:20.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f41740a1260 msgr2=0x7f41740a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f41740a1260 0x7f41740a3710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f417c006010 tx=0x7f417c00b540 comp rx=0 tx=0).stop 2023-12-14T14:10:20.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c105ee0 msgr2=0x7f418c0ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c105ee0 0x7f418c0ff190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4184007ee0 tx=0x7f418400d3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 shutdown_connections 2023-12-14T14:10:20.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f41740a1260 0x7f41740a3710 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f418c105ee0 0x7f418c0ff190 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100ca0 0x7f418c100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 --2- 172.21.15.69:0/2216685353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418c1035c0 0x7f418c0fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 >> 172.21.15.69:0/2216685353 conn(0x7f418c0fa700 msgr2=0x7f418c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 shutdown_connections 2023-12-14T14:10:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.033+0000 7f4190aef700 1 -- 172.21.15.69:0/2216685353 wait complete. 2023-12-14T14:10:20.046 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-12-14T14:09:10.598197+0000', 'modified': '2023-12-14T14:09:15.801574+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24500, 'mds_1': 24469, 'mds_2': 24467}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6835/3775706969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 3775706969}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 3775706969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/594041854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 594041854}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 594041854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6837/2082956632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 2082956632}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 2082956632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.81:6837/3031029983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3031029983}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3031029983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.119:6839/1957200331', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 1957200331}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 1957200331}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24500': {'gid': 24500, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6839/2690299654', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 2690299654}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 2690299654}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-14T14:10:20.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-14T14:10:20.047 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-12-14T14:10:20.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.169+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/1486094666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b4101560 msgr2=0x7fa2b41019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.169+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/1486094666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b4101560 0x7fa2b41019b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009990 tx=0x7fa2a4009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.169+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/1486094666 shutdown_connections 2023-12-14T14:10:20.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/1486094666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b4101ef0 0x7fa2b41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/1486094666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2b40fe590 0x7fa2b40fe9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/1486094666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b4101560 0x7fa2b41019b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/1486094666 >> 172.21.15.69:0/1486094666 conn(0x7fa2b40f9f50 msgr2=0x7fa2b40fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/1486094666 shutdown_connections 2023-12-14T14:10:20.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/1486094666 wait complete. 2023-12-14T14:10:20.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 Processor -- start 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 -- start start 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b40fe590 0x7fa2b4195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b4101560 0x7fa2b4196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2b4101ef0 0x7fa2b419d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b419db50 con 0x7fa2b40fe590 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b419dc90 con 0x7fa2b4101560 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.170+0000 7fa2b9c1e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b419de20 con 0x7fa2b4101ef0 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b40fe590 0x7fa2b4195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b40fe590 0x7fa2b4195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60132/0 (socket says 172.21.15.69:60132) 2023-12-14T14:10:20.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b37fe700 1 -- 172.21.15.69:0/723220490 learned_addr learned my addr 172.21.15.69:0/723220490 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2b4101ef0 0x7fa2b419d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b37fe700 1 -- 172.21.15.69:0/723220490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2b4101ef0 msgr2=0x7fa2b419d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2b4101ef0 0x7fa2b419d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b4101560 0x7fa2b4196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b37fe700 1 -- 172.21.15.69:0/723220490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b4101560 msgr2=0x7fa2b4196510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b4101560 0x7fa2b4196510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b37fe700 1 -- 172.21.15.69:0/723220490 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a40095f0 con 0x7fa2b40fe590 2023-12-14T14:10:20.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b40fe590 0x7fa2b4195fd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800b500 tx=0x7fa2a800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b0ff9700 1 -- 172.21.15.69:0/723220490 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8011830 con 0x7fa2b40fe590 2023-12-14T14:10:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b0ff9700 1 -- 172.21.15.69:0/723220490 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2a8011e50 con 0x7fa2b40fe590 2023-12-14T14:10:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/723220490 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b410bce0 con 0x7fa2b40fe590 2023-12-14T14:10:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b0ff9700 1 -- 172.21.15.69:0/723220490 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800f2e0 con 0x7fa2b40fe590 2023-12-14T14:10:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.171+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/723220490 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b410bb50 con 0x7fa2b40fe590 2023-12-14T14:10:20.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.173+0000 7fa2b0ff9700 1 -- 172.21.15.69:0/723220490 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa2a8010580 con 0x7fa2b40fe590 2023-12-14T14:10:20.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.174+0000 7fa2b0ff9700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa29c0a1260 0x7fa29c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.174+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa29c0a1260 0x7fa29c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.174+0000 7fa2b0ff9700 1 -- 172.21.15.69:0/723220490 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa2a80cc460 con 0x7fa2b40fe590 2023-12-14T14:10:20.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.174+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa29c0a1260 0x7fa29c0a3710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40095c0 tx=0x7fa2a4009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2c5dacb80 1 Processor -- start 2023-12-14T14:10:20.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2c5dacb80 1 -- start start 2023-12-14T14:10:20.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 0x5582d315c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315ce00 0x5582d315d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d315e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d3045590 con 0x5582d315dcb0 2023-12-14T14:10:20.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d30b4820 con 0x5582d315c4b0 2023-12-14T14:10:20.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d30adcb0 con 0x5582d315ce00 2023-12-14T14:10:20.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d315e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d315e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60138/0 (socket says 172.21.15.69:60138) 2023-12-14T14:10:20.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 0x5582d315c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b3fff700 1 -- 172.21.15.69:0/1857401084 learned_addr learned my addr 172.21.15.69:0/1857401084 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/1857401084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315ce00 0x5582d315d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b3fff700 1 -- 172.21.15.69:0/1857401084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315ce00 msgr2=0x5582d315d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/1857401084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315ce00 0x5582d315d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b3fff700 1 -- 172.21.15.69:0/1857401084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 msgr2=0x5582d315c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/1857401084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 0x5582d315c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b3fff700 1 -- 172.21.15.69:0/1857401084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582d2f2f360 con 0x5582d315dcb0 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.175+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/1857401084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d315e120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00d250 tx=0x7fa2ac00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ca8851264d3164 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa299ffb700 1 -- 172.21.15.69:0/1857401084 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0123f0 con 0x5582d315dcb0 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa299ffb700 1 -- 172.21.15.69:0/1857401084 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2ac012a10 con 0x5582d315dcb0 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa299ffb700 1 -- 172.21.15.69:0/1857401084 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011960 con 0x5582d315dcb0 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1857401084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 msgr2=0x5582d315e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/1857401084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d315e120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00d250 tx=0x7fa2ac00d560 comp rx=0 tx=0).stop 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1857401084 shutdown_connections 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/1857401084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d315e120 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/1857401084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 0x5582d315c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/1857401084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315ce00 0x5582d315d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1857401084 >> 172.21.15.69:0/1857401084 conn(0x5582d3151c50 msgr2=0x5582d31573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1857401084 shutdown_connections 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.176+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1857401084 wait complete. 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2c5dacb80 1 -- start start 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2c5dacb80 1 Processor -- start 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 0x5582d31660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315ce00 0x5582d3166620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315dcb0 0x5582d316d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d3049f40 con 0x5582d315ce00 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d3049be0 con 0x5582d315c4b0 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d2f31650 con 0x5582d315dcb0 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2c5dacb80 10 client.0 _ll_register_callbacks cb 0x5582d306d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2b2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315ce00 0x5582d3166620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2b2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315ce00 0x5582d3166620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60144/0 (socket says 172.21.15.69:60144) 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.177+0000 7fa2b2ffd700 1 -- 172.21.15.69:0/2346007870 learned_addr learned my addr 172.21.15.69:0/2346007870 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 0x5582d31660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315dcb0 0x5582d316d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2b2ffd700 1 -- 172.21.15.69:0/2346007870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315dcb0 msgr2=0x5582d316d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315dcb0 0x5582d316d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2b2ffd700 1 -- 172.21.15.69:0/2346007870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 msgr2=0x5582d31660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 0x5582d31660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2b2ffd700 1 -- 172.21.15.69:0/2346007870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac007d20 con 0x5582d315ce00 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315ce00 0x5582d3166620 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4015000 tx=0x7fa2a4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729bd10fdd075c6e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa292ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa292ffd700 1 -- 172.21.15.69:0/2346007870 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a402f630 con 0x5582d315ce00 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa292ffd700 1 -- 172.21.15.69:0/2346007870 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa2a402f790 con 0x5582d315ce00 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/2346007870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582d314f260 con 0x5582d315ce00 2023-12-14T14:10:20.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa292ffd700 1 -- 172.21.15.69:0/2346007870 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2a402f990 con 0x5582d315ce00 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2c5dacb80 10 client.15204 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/2346007870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5582d3074120 con 0x5582d315ce00 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa292ffd700 1 -- 172.21.15.69:0/2346007870 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5582d314f260 con 0x5582d315ce00 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa292ffd700 1 -- 172.21.15.69:0/2346007870 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa2a4023bd0 con 0x5582d315ce00 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2c5dacb80 10 client.15204 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.178+0000 7fa2c5dacb80 10 client.15204 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.179+0000 7fa2c5dacb80 20 client.15204 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.179+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5582d3171360 0x5582d3170760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.179+0000 7fa2c5dacb80 4 client.15204 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.179+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/2346007870 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582d30a6c90 con 0x5582d3171360 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.179+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5582d3171360 0x5582d3170760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.179+0000 7fa292ffd700 10 client.15204 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.179+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5582d3171360 0x5582d3170760 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ba14cbc66e5f82a server_cookie=7fccfaa8d586bb30 in_seq=0 out_seq=0 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa292ffd700 1 -- 172.21.15.69:0/2346007870 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5582d30a6c90 con 0x5582d3171360 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa292ffd700 10 client.15204 handle_command_reply: tid=0 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 client.15204 shutdown 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/2346007870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315ce00 msgr2=0x5582d3166620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315ce00 0x5582d3166620 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4015000 tx=0x7fa2a4009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/2346007870 shutdown_connections 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315dcb0 0x5582d316d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315c4b0 0x5582d31660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5582d3171360 0x5582d3170760 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/2346007870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315ce00 0x5582d3166620 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/2346007870 >> 172.21.15.69:0/2346007870 conn(0x5582d3151c50 msgr2=0x5582d3155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa292ffd700 0 client.15204 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:10:20.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/2346007870 shutdown_connections 2023-12-14T14:10:20.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/2346007870 wait complete. 2023-12-14T14:10:20.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.180+0000 7fa2c5dacb80 20 client.15204 trim_cache size 0 max 16384 2023-12-14T14:10:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2c5dacb80 1 Processor -- start 2023-12-14T14:10:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2c5dacb80 1 -- start start 2023-12-14T14:10:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 0x5582d316de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 0x5582d3164000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d3164540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d2fb9c50 con 0x5582d315dcb0 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d30a9da0 con 0x5582d315ce00 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d3151a60 con 0x5582d315c4b0 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d3164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d3164540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60148/0 (socket says 172.21.15.69:60148) 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b3fff700 1 -- 172.21.15.69:0/1991534263 learned_addr learned my addr 172.21.15.69:0/1991534263 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/1991534263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 0x5582d3164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/1991534263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 0x5582d316de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b3fff700 1 -- 172.21.15.69:0/1991534263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 msgr2=0x5582d316de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/1991534263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 0x5582d316de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b3fff700 1 -- 172.21.15.69:0/1991534263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 msgr2=0x5582d3164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/1991534263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 0x5582d3164000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b3fff700 1 -- 172.21.15.69:0/1991534263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582d3073e70 con 0x5582d315dcb0 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/1991534263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d3164540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac017000 tx=0x7fa2ac007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c65181110af87d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.198+0000 7fa29a7fc700 1 -- 172.21.15.69:0/1991534263 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac012d80 con 0x5582d315dcb0 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa29a7fc700 1 -- 172.21.15.69:0/1991534263 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2ac00dea0 con 0x5582d315dcb0 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa29a7fc700 1 -- 172.21.15.69:0/1991534263 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0117f0 con 0x5582d315dcb0 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1991534263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 msgr2=0x5582d3164540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/1991534263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d3164540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac017000 tx=0x7fa2ac007c00 comp rx=0 tx=0).stop 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1991534263 shutdown_connections 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/1991534263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d3164540 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/1991534263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 0x5582d316de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/1991534263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 0x5582d3164000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1991534263 >> 172.21.15.69:0/1991534263 conn(0x5582d3151c50 msgr2=0x5582d317a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1991534263 shutdown_connections 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/1991534263 wait complete. 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.199+0000 7fa2c5dacb80 1 -- start start 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2c5dacb80 1 Processor -- start 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 0x5582d31687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 0x5582d3168d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2c5dacb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d31c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d31c9b00 con 0x5582d315dcb0 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d31c9c40 con 0x5582d315ce00 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2c5dacb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d31c9dd0 con 0x5582d315c4b0 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2c5dacb80 10 client.0 _ll_register_callbacks cb 0x7fa2a400f460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:20.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d31c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d31c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60156/0 (socket says 172.21.15.69:60156) 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b3fff700 1 -- 172.21.15.69:0/311180045 learned_addr learned my addr 172.21.15.69:0/311180045 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 0x5582d31687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 0x5582d3168d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b3fff700 1 -- 172.21.15.69:0/311180045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 msgr2=0x5582d31687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 0x5582d31687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b3fff700 1 -- 172.21.15.69:0/311180045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 msgr2=0x5582d3168d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 0x5582d3168d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b3fff700 1 -- 172.21.15.69:0/311180045 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582d2f2f360 con 0x5582d315dcb0 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.200+0000 7fa2b2ffd700 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 0x5582d3168d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:20.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2b3fff700 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d31c95c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00d170 tx=0x7fa2ac012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f478f953129157e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa292ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa292ffd700 1 -- 172.21.15.69:0/311180045 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac004e60 con 0x5582d315dcb0 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa292ffd700 1 -- 172.21.15.69:0/311180045 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa2ac011590 con 0x5582d315dcb0 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/311180045 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2ac012a10 con 0x5582d315dcb0 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa292ffd700 1 -- 172.21.15.69:0/311180045 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2ac011750 con 0x5582d315dcb0 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2c5dacb80 10 client.15210 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/311180045 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5582d305a950 con 0x5582d315dcb0 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa292ffd700 1 -- 172.21.15.69:0/311180045 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2ac03d020 con 0x5582d315dcb0 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa292ffd700 1 -- 172.21.15.69:0/311180045 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa2ac005530 con 0x5582d315dcb0 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2c5dacb80 10 client.15210 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:20.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2c5dacb80 10 client.15210 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2c5dacb80 20 client.15210 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5582d31ce720 0x5582d31cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2c5dacb80 4 client.15210 mds_command: new command op to 24467 tid=0[{"prefix": "status"}] 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.201+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/311180045 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5582d30a69b0 con 0x5582d31ce720 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5582d31ce720 0x5582d31cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2b37fe700 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5582d31ce720 0x5582d31cb070 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e464836af4517a57 server_cookie=6e5555000f2b4b6b in_seq=0 out_seq=0 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa292ffd700 10 client.15210 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa292ffd700 1 -- 172.21.15.69:0/311180045 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5582d30a69b0 con 0x5582d31ce720 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa292ffd700 10 client.15210 handle_command_reply: tid=0 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 client.15210 shutdown 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/311180045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 msgr2=0x5582d31c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d31c95c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00d170 tx=0x7fa2ac012690 comp rx=0 tx=0).stop 2023-12-14T14:10:20.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/311180045 shutdown_connections 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5582d31ce720 0x5582d31cb070 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582d315dcb0 0x5582d31c95c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582d315c4b0 0x5582d31687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa292ffd700 0 client.15210 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 --2- 172.21.15.69:0/311180045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d315ce00 0x5582d3168d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/311180045 >> 172.21.15.69:0/311180045 conn(0x5582d3151c50 msgr2=0x5582d316de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/311180045 shutdown_connections 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 1 -- 172.21.15.69:0/311180045 wait complete. 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.202+0000 7fa2c5dacb80 20 client.15210 trim_cache size 0 max 16384 2023-12-14T14:10:20.212 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24467, 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 65.405267873, 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 84, 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 82, 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 82.377499169000004 2023-12-14T14:10:20.213 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:10:20.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa29c0a1260 msgr2=0x7fa29c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa29c0a1260 0x7fa29c0a3710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40095c0 tx=0x7fa2a4009530 comp rx=0 tx=0).stop 2023-12-14T14:10:20.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b40fe590 msgr2=0x7fa2b4195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b40fe590 0x7fa2b4195fd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800b500 tx=0x7fa2a800b8c0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/723220490 shutdown_connections 2023-12-14T14:10:20.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa29c0a1260 0x7fa29c0a3710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2b4101ef0 0x7fa2b419d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2b40fe590 0x7fa2b4195fd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 --2- 172.21.15.69:0/723220490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b4101560 0x7fa2b4196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/723220490 >> 172.21.15.69:0/723220490 conn(0x7fa2b40f9f50 msgr2=0x7fa2b40fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/723220490 shutdown_connections 2023-12-14T14:10:20.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.203+0000 7fa2b9c1e700 1 -- 172.21.15.69:0/723220490 wait complete. 2023-12-14T14:10:20.216 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-12-14T14:10:20.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.338+0000 7f132d2a5700 1 -- 172.21.15.69:0/925399907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1328100d80 msgr2=0x7f1328103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.338+0000 7f132d2a5700 1 --2- 172.21.15.69:0/925399907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1328100d80 0x7f1328103160 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1318009990 tx=0x7f1318009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.338+0000 7f132d2a5700 1 -- 172.21.15.69:0/925399907 shutdown_connections 2023-12-14T14:10:20.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.338+0000 7f132d2a5700 1 --2- 172.21.15.69:0/925399907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1328105fc0 0x7f13281083a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.338+0000 7f132d2a5700 1 --2- 172.21.15.69:0/925399907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1328100d80 0x7f1328103160 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.338+0000 7f132d2a5700 1 --2- 172.21.15.69:0/925399907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13281036a0 0x7f1328105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.338+0000 7f132d2a5700 1 -- 172.21.15.69:0/925399907 >> 172.21.15.69:0/925399907 conn(0x7f13280fa780 msgr2=0x7f13280fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.338+0000 7f132d2a5700 1 -- 172.21.15.69:0/925399907 shutdown_connections 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.338+0000 7f132d2a5700 1 -- 172.21.15.69:0/925399907 wait complete. 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f132d2a5700 1 Processor -- start 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f132d2a5700 1 -- start start 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f132d2a5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1328100d80 0x7f1328195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f132d2a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13281036a0 0x7f13281964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f132d2a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328105fc0 0x7f132819d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f132d2a5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132819db00 con 0x7f13281036a0 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f132d2a5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132819dc40 con 0x7f1328105fc0 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f132d2a5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132819ddd0 con 0x7f1328100d80 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f13267fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13281036a0 0x7f13281964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f13267fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13281036a0 0x7f13281964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60184/0 (socket says 172.21.15.69:60184) 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f13267fc700 1 -- 172.21.15.69:0/664676847 learned_addr learned my addr 172.21.15.69:0/664676847 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f1326ffd700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1328100d80 0x7f1328195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f13277fe700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328105fc0 0x7f132819d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f13267fc700 1 -- 172.21.15.69:0/664676847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1328100d80 msgr2=0x7f1328195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f13267fc700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1328100d80 0x7f1328195f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f13267fc700 1 -- 172.21.15.69:0/664676847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328105fc0 msgr2=0x7f132819d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f13267fc700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328105fc0 0x7f132819d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.339+0000 7f13267fc700 1 -- 172.21.15.69:0/664676847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180095f0 con 0x7f13281036a0 2023-12-14T14:10:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.340+0000 7f13267fc700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13281036a0 0x7f13281964c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c920 tx=0x7f131c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.340+0000 7f130ffff700 1 -- 172.21.15.69:0/664676847 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c004a30 con 0x7f13281036a0 2023-12-14T14:10:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.340+0000 7f132d2a5700 1 -- 172.21.15.69:0/664676847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132810bbc0 con 0x7f13281036a0 2023-12-14T14:10:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.340+0000 7f130ffff700 1 -- 172.21.15.69:0/664676847 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f131c0054e0 con 0x7f13281036a0 2023-12-14T14:10:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.340+0000 7f130ffff700 1 -- 172.21.15.69:0/664676847 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c007c10 con 0x7f13281036a0 2023-12-14T14:10:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.340+0000 7f132d2a5700 1 -- 172.21.15.69:0/664676847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132810ba30 con 0x7f13281036a0 2023-12-14T14:10:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.342+0000 7f130ffff700 1 -- 172.21.15.69:0/664676847 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f131c005000 con 0x7f13281036a0 2023-12-14T14:10:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.343+0000 7f130ffff700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f13100a11e0 0x7f13100a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.343+0000 7f1326ffd700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f13100a11e0 0x7f13100a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.343+0000 7f130ffff700 1 -- 172.21.15.69:0/664676847 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f131c0cc950 con 0x7f13281036a0 2023-12-14T14:10:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.343+0000 7f1326ffd700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f13100a11e0 0x7f13100a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f131800b5c0 tx=0x7f1318005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f1339433b80 1 Processor -- start 2023-12-14T14:10:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f1339433b80 1 -- start start 2023-12-14T14:10:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f1339433b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b5508c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f1339433b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 0x56102b551720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f1339433b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b552120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f1339433b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b439590 con 0x56102b551cb0 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f1339433b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b4a8820 con 0x56102b550e00 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f1339433b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b4a1cb0 con 0x56102b5504b0 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13277fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b552120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13277fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b552120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60196/0 (socket says 172.21.15.69:60196) 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13277fe700 1 -- 172.21.15.69:0/3794538879 learned_addr learned my addr 172.21.15.69:0/3794538879 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13267fc700 1 --2- 172.21.15.69:0/3794538879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 0x56102b551720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f1326ffd700 1 --2- 172.21.15.69:0/3794538879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b5508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13277fe700 1 -- 172.21.15.69:0/3794538879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 msgr2=0x56102b5508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13277fe700 1 --2- 172.21.15.69:0/3794538879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b5508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13277fe700 1 -- 172.21.15.69:0/3794538879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 msgr2=0x56102b551720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13277fe700 1 --2- 172.21.15.69:0/3794538879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 0x56102b551720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13277fe700 1 -- 172.21.15.69:0/3794538879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56102b323360 con 0x56102b551cb0 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f13277fe700 1 --2- 172.21.15.69:0/3794538879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b552120 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f13200098f0 tx=0x7f1320009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34a53665c2d5ad2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.344+0000 7f130d7fa700 1 -- 172.21.15.69:0/3794538879 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320019070 con 0x56102b551cb0 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f130d7fa700 1 -- 172.21.15.69:0/3794538879 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f132000f040 con 0x56102b551cb0 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f130d7fa700 1 -- 172.21.15.69:0/3794538879 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320007bc0 con 0x56102b551cb0 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f1339433b80 1 -- 172.21.15.69:0/3794538879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 msgr2=0x56102b552120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f1339433b80 1 --2- 172.21.15.69:0/3794538879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b552120 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f13200098f0 tx=0x7f1320009c00 comp rx=0 tx=0).stop 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f1339433b80 1 -- 172.21.15.69:0/3794538879 shutdown_connections 2023-12-14T14:10:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f1339433b80 1 --2- 172.21.15.69:0/3794538879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b552120 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f1339433b80 1 --2- 172.21.15.69:0/3794538879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b5508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f1339433b80 1 --2- 172.21.15.69:0/3794538879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 0x56102b551720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f1339433b80 1 -- 172.21.15.69:0/3794538879 >> 172.21.15.69:0/3794538879 conn(0x56102b545c50 msgr2=0x56102b54b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f1339433b80 1 -- 172.21.15.69:0/3794538879 shutdown_connections 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.345+0000 7f1339433b80 1 -- 172.21.15.69:0/3794538879 wait complete. 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1339433b80 1 -- start start 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1339433b80 1 Processor -- start 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1339433b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b55a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1339433b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 0x56102b55a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1339433b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b561610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1339433b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b43df40 con 0x56102b551cb0 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1339433b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b43dbe0 con 0x56102b550e00 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1339433b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b325650 con 0x56102b5504b0 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1339433b80 10 client.0 _ll_register_callbacks cb 0x56102b4618c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13277fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b561610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13277fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b561610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60202/0 (socket says 172.21.15.69:60202) 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13277fe700 1 -- 172.21.15.69:0/183229630 learned_addr learned my addr 172.21.15.69:0/183229630 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13267fc700 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 0x56102b55a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1326ffd700 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b55a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13277fe700 1 -- 172.21.15.69:0/183229630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 msgr2=0x56102b55a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13277fe700 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b55a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13277fe700 1 -- 172.21.15.69:0/183229630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 msgr2=0x56102b55a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13277fe700 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 0x56102b55a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13277fe700 1 -- 172.21.15.69:0/183229630 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1320003c50 con 0x56102b551cb0 2023-12-14T14:10:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f1326ffd700 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b55a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f13277fe700 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b561610 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1320003bf0 tx=0x7f1320007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3fa06c977f9bff server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f130aff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.346+0000 7f130aff5700 1 -- 172.21.15.69:0/183229630 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320019070 con 0x56102b551cb0 2023-12-14T14:10:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1339433b80 1 -- 172.21.15.69:0/183229630 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56102b543260 con 0x56102b551cb0 2023-12-14T14:10:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f130aff5700 1 -- 172.21.15.69:0/183229630 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1320009460 con 0x56102b551cb0 2023-12-14T14:10:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f130aff5700 1 -- 172.21.15.69:0/183229630 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1320007e90 con 0x56102b551cb0 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1339433b80 10 client.15222 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1339433b80 1 -- 172.21.15.69:0/183229630 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56102b468120 con 0x56102b551cb0 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f130aff5700 1 -- 172.21.15.69:0/183229630 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f132002d020 con 0x56102b551cb0 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f130aff5700 1 -- 172.21.15.69:0/183229630 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f132001e590 con 0x56102b551cb0 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1339433b80 10 client.15222 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1339433b80 10 client.15222 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1339433b80 20 client.15222 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1339433b80 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56102b565250 0x56102b564660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1339433b80 4 client.15222 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1339433b80 1 -- 172.21.15.69:0/183229630 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56102b49ac90 con 0x56102b565250 2023-12-14T14:10:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.347+0000 7f1326ffd700 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56102b565250 0x56102b564660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.348+0000 7f1326ffd700 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56102b565250 0x56102b564660 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7aae4ca5279c9e6d server_cookie=3b32b97a91940cee in_seq=0 out_seq=0 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.348+0000 7f130aff5700 10 client.15222 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.348+0000 7f130aff5700 1 -- 172.21.15.69:0/183229630 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56102b49ac90 con 0x56102b565250 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.348+0000 7f130aff5700 10 client.15222 handle_command_reply: tid=0 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.348+0000 7f1339433b80 1 client.15222 shutdown 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 -- 172.21.15.69:0/183229630 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 msgr2=0x56102b561610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b561610 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1320003bf0 tx=0x7f1320007bf0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 -- 172.21.15.69:0/183229630 shutdown_connections 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56102b565250 0x56102b564660 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b551cb0 0x56102b561610 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b55a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f130aff5700 0 client.15222 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:10:20.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 --2- 172.21.15.69:0/183229630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b550e00 0x56102b55a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 -- 172.21.15.69:0/183229630 >> 172.21.15.69:0/183229630 conn(0x56102b545c50 msgr2=0x56102b549ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 -- 172.21.15.69:0/183229630 shutdown_connections 2023-12-14T14:10:20.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 1 -- 172.21.15.69:0/183229630 wait complete. 2023-12-14T14:10:20.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.349+0000 7f1339433b80 20 client.15222 trim_cache size 0 max 16384 2023-12-14T14:10:20.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1339433b80 1 Processor -- start 2023-12-14T14:10:20.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1339433b80 1 -- start start 2023-12-14T14:10:20.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1339433b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b5504b0 0x56102b54a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1339433b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b550e00 0x56102b561e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1339433b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 0x56102b564660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1339433b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b470a50 con 0x56102b5504b0 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1339433b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b44b580 con 0x56102b551cb0 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1339433b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b3adc50 con 0x56102b550e00 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1326ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b5504b0 0x56102b54a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.366+0000 7f1326ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b5504b0 0x56102b54a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60216/0 (socket says 172.21.15.69:60216) 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f1326ffd700 1 -- 172.21.15.69:0/1790572126 learned_addr learned my addr 172.21.15.69:0/1790572126 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f13267fc700 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b550e00 0x56102b561e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f13277fe700 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 0x56102b564660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f1326ffd700 1 -- 172.21.15.69:0/1790572126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b550e00 msgr2=0x56102b561e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f1326ffd700 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b550e00 0x56102b561e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f1326ffd700 1 -- 172.21.15.69:0/1790572126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 msgr2=0x56102b564660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f1326ffd700 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 0x56102b564660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f1326ffd700 1 -- 172.21.15.69:0/1790572126 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56102b467e70 con 0x56102b5504b0 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f13267fc700 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b550e00 0x56102b561e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f1326ffd700 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b5504b0 0x56102b54a980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f13180098e0 tx=0x7f1318005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3fa5da9c4822a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f130dffb700 1 -- 172.21.15.69:0/1790572126 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318031d80 con 0x56102b5504b0 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f130dffb700 1 -- 172.21.15.69:0/1790572126 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f131801e040 con 0x56102b5504b0 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f130dffb700 1 -- 172.21.15.69:0/1790572126 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318031620 con 0x56102b5504b0 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f1339433b80 1 -- 172.21.15.69:0/1790572126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b5504b0 msgr2=0x56102b54a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.367+0000 7f1339433b80 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b5504b0 0x56102b54a980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f13180098e0 tx=0x7f1318005000 comp rx=0 tx=0).stop 2023-12-14T14:10:20.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 -- 172.21.15.69:0/1790572126 shutdown_connections 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 0x56102b564660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b5504b0 0x56102b54a980 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 --2- 172.21.15.69:0/1790572126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b550e00 0x56102b561e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 -- 172.21.15.69:0/1790572126 >> 172.21.15.69:0/1790572126 conn(0x56102b545c50 msgr2=0x56102b54b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 -- 172.21.15.69:0/1790572126 shutdown_connections 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 -- 172.21.15.69:0/1790572126 wait complete. 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 -- start start 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 Processor -- start 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b55c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b550e00 0x56102b55cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 0x56102b5bd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b55d400 con 0x56102b550e00 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b5bd660 con 0x56102b551cb0 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56102b5bd820 con 0x56102b5504b0 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f1339433b80 10 client.0 _ll_register_callbacks cb 0x7f1320003e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f13267fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b550e00 0x56102b55cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f13267fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b550e00 0x56102b55cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60218/0 (socket says 172.21.15.69:60218) 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.368+0000 7f13267fc700 1 -- 172.21.15.69:0/1291069591 learned_addr learned my addr 172.21.15.69:0/1291069591 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1326ffd700 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b55c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f13277fe700 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 0x56102b5bd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f13267fc700 1 -- 172.21.15.69:0/1291069591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 msgr2=0x56102b55c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f13267fc700 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b55c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f13267fc700 1 -- 172.21.15.69:0/1291069591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 msgr2=0x56102b5bd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f13267fc700 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 0x56102b5bd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f13267fc700 1 -- 172.21.15.69:0/1291069591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131802b040 con 0x56102b550e00 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f13277fe700 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 0x56102b5bd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f13267fc700 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b550e00 0x56102b55cce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f131c004f10 tx=0x7f131c09dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e338505eff6b93ab server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f130aff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f130aff5700 1 -- 172.21.15.69:0/1291069591 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c004b90 con 0x56102b550e00 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f130aff5700 1 -- 172.21.15.69:0/1291069591 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f131c0b22b0 con 0x56102b550e00 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1339433b80 1 -- 172.21.15.69:0/1291069591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f132000f040 con 0x56102b550e00 2023-12-14T14:10:20.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f130aff5700 1 -- 172.21.15.69:0/1291069591 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f131c0ca550 con 0x56102b550e00 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1339433b80 10 client.15228 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1339433b80 1 -- 172.21.15.69:0/1291069591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56102b44e950 con 0x56102b550e00 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f130aff5700 1 -- 172.21.15.69:0/1291069591 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f131c063080 con 0x56102b550e00 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f130aff5700 1 -- 172.21.15.69:0/1291069591 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f131c0990f0 con 0x56102b550e00 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1339433b80 10 client.15228 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1339433b80 10 client.15228 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1339433b80 20 client.15228 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1339433b80 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56102b5c2480 0x56102b5bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1339433b80 4 client.15228 mds_command: new command op to 24469 tid=0[{"prefix": "status"}] 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.369+0000 7f1339433b80 1 -- 172.21.15.69:0/1291069591 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56102b49a9b0 con 0x56102b5c2480 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1326ffd700 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56102b5c2480 0x56102b5bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f130aff5700 10 client.15228 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1326ffd700 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56102b5c2480 0x56102b5bedd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e27f17a401d97bdf server_cookie=16a1b14148721a4d in_seq=0 out_seq=0 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f130aff5700 1 -- 172.21.15.69:0/1291069591 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x56102b49a9b0 con 0x56102b5c2480 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f130aff5700 10 client.15228 handle_command_reply: tid=0 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 client.15228 shutdown 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 -- 172.21.15.69:0/1291069591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b550e00 msgr2=0x56102b55cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b550e00 0x56102b55cce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f131c004f10 tx=0x7f131c09dc30 comp rx=0 tx=0).stop 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 -- 172.21.15.69:0/1291069591 shutdown_connections 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56102b551cb0 0x56102b5bd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56102b5504b0 0x56102b55c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56102b5c2480 0x56102b5bedd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 --2- 172.21.15.69:0/1291069591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56102b550e00 0x56102b55cce0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 -- 172.21.15.69:0/1291069591 >> 172.21.15.69:0/1291069591 conn(0x56102b545c50 msgr2=0x56102b564660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f130aff5700 0 client.15228 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:10:20.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 -- 172.21.15.69:0/1291069591 shutdown_connections 2023-12-14T14:10:20.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.370+0000 7f1339433b80 1 -- 172.21.15.69:0/1291069591 wait complete. 2023-12-14T14:10:20.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f1339433b80 20 client.15228 trim_cache size 0 max 16384 2023-12-14T14:10:20.381 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:10:20.381 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:10:20.381 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2023-12-14T14:10:20.381 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24469, 2023-12-14T14:10:20.382 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T14:10:20.382 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T14:10:20.382 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T14:10:20.382 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 66.580319785, 2023-12-14T14:10:20.382 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T14:10:20.382 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 84, 2023-12-14T14:10:20.382 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 82, 2023-12-14T14:10:20.382 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 80.816013634000001 2023-12-14T14:10:20.382 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 -- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f13100a11e0 msgr2=0x7f13100a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f13100a11e0 0x7f13100a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f131800b5c0 tx=0x7f1318005fd0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 -- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13281036a0 msgr2=0x7f13281964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13281036a0 0x7f13281964c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c920 tx=0x7f131c00cc30 comp rx=0 tx=0).stop 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 -- 172.21.15.69:0/664676847 shutdown_connections 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f13100a11e0 0x7f13100a3690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328105fc0 0x7f132819d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1328100d80 0x7f1328195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 --2- 172.21.15.69:0/664676847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13281036a0 0x7f13281964c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 -- 172.21.15.69:0/664676847 >> 172.21.15.69:0/664676847 conn(0x7f13280fa780 msgr2=0x7f13281021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 -- 172.21.15.69:0/664676847 shutdown_connections 2023-12-14T14:10:20.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.371+0000 7f132d2a5700 1 -- 172.21.15.69:0/664676847 wait complete. 2023-12-14T14:10:20.385 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-14T14:10:20.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.507+0000 7f6463594700 1 -- 172.21.15.69:0/469776932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 msgr2=0x7f645c0feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.507+0000 7f6463594700 1 --2- 172.21.15.69:0/469776932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 0x7f645c0feca0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f644c009990 tx=0x7f644c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.507+0000 7f6463594700 1 -- 172.21.15.69:0/469776932 shutdown_connections 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.507+0000 7f6463594700 1 --2- 172.21.15.69:0/469776932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c100410 0x7f645c106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.507+0000 7f6463594700 1 --2- 172.21.15.69:0/469776932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 0x7f645c0feca0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.507+0000 7f6463594700 1 --2- 172.21.15.69:0/469776932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c0ffa80 0x7f645c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.507+0000 7f6463594700 1 -- 172.21.15.69:0/469776932 >> 172.21.15.69:0/469776932 conn(0x7f645c0f9ed0 msgr2=0x7f645c0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.507+0000 7f6463594700 1 -- 172.21.15.69:0/469776932 shutdown_connections 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.507+0000 7f6463594700 1 -- 172.21.15.69:0/469776932 wait complete. 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6463594700 1 Processor -- start 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6463594700 1 -- start start 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6463594700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 0x7f645c195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6463594700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c0ffa80 0x7f645c196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6463594700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c100410 0x7f645c19d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6463594700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c19dad0 con 0x7f645c0fe890 2023-12-14T14:10:20.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6463594700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c19dc10 con 0x7f645c0ffa80 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6463594700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c19dda0 con 0x7f645c100410 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461330700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 0x7f645c195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461330700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 0x7f645c195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60240/0 (socket says 172.21.15.69:60240) 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461330700 1 -- 172.21.15.69:0/565231260 learned_addr learned my addr 172.21.15.69:0/565231260 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6460b2f700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c0ffa80 0x7f645c196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461330700 1 -- 172.21.15.69:0/565231260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c100410 msgr2=0x7f645c19d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461b31700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c100410 0x7f645c19d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461330700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c100410 0x7f645c19d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461330700 1 -- 172.21.15.69:0/565231260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c0ffa80 msgr2=0x7f645c196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461330700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c0ffa80 0x7f645c196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461330700 1 -- 172.21.15.69:0/565231260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c0095f0 con 0x7f645c0fe890 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.508+0000 7f6461330700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 0x7f645c195f50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f644c0095c0 tx=0x7f644c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.509+0000 7f64527fc700 1 -- 172.21.15.69:0/565231260 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c01d070 con 0x7f645c0fe890 2023-12-14T14:10:20.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.509+0000 7f64527fc700 1 -- 172.21.15.69:0/565231260 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f644c004830 con 0x7f645c0fe890 2023-12-14T14:10:20.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.509+0000 7f64527fc700 1 -- 172.21.15.69:0/565231260 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c005420 con 0x7f645c0fe890 2023-12-14T14:10:20.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.509+0000 7f6463594700 1 -- 172.21.15.69:0/565231260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c10bc40 con 0x7f645c0fe890 2023-12-14T14:10:20.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.509+0000 7f6463594700 1 -- 172.21.15.69:0/565231260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c10bab0 con 0x7f645c0fe890 2023-12-14T14:10:20.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.511+0000 7f64527fc700 1 -- 172.21.15.69:0/565231260 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f644c0055c0 con 0x7f645c0fe890 2023-12-14T14:10:20.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.511+0000 7f64527fc700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64480a11e0 0x7f64480a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.511+0000 7f64527fc700 1 -- 172.21.15.69:0/565231260 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f644c0cdbd0 con 0x7f645c0fe890 2023-12-14T14:10:20.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.511+0000 7f6460b2f700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64480a11e0 0x7f64480a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f6460b2f700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64480a11e0 0x7f64480a3690 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6458005950 tx=0x7f645800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f646f722b80 1 Processor -- start 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f646f722b80 1 -- start start 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f646f722b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4c4b0 0x5602d9b4c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f646f722b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4ce00 0x5602d9b4d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f646f722b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4dcb0 0x5602d9b4e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f646f722b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9a35590 con 0x5602d9b4ce00 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f646f722b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9aa4820 con 0x5602d9b4c4b0 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f646f722b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9a9dcb0 con 0x5602d9b4dcb0 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.512+0000 7f6460b2f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4ce00 0x5602d9b4d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6460b2f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4ce00 0x5602d9b4d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60242/0 (socket says 172.21.15.69:60242) 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6460b2f700 1 -- 172.21.15.69:0/3846528343 learned_addr learned my addr 172.21.15.69:0/3846528343 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6461b31700 1 --2- 172.21.15.69:0/3846528343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4dcb0 0x5602d9b4e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6460b2f700 1 -- 172.21.15.69:0/3846528343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4dcb0 msgr2=0x5602d9b4e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6460b2f700 1 --2- 172.21.15.69:0/3846528343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4dcb0 0x5602d9b4e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6460b2f700 1 -- 172.21.15.69:0/3846528343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4c4b0 msgr2=0x5602d9b4c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6461330700 1 --2- 172.21.15.69:0/3846528343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4c4b0 0x5602d9b4c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6460b2f700 1 --2- 172.21.15.69:0/3846528343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4c4b0 0x5602d9b4c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6460b2f700 1 -- 172.21.15.69:0/3846528343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602d991f360 con 0x5602d9b4ce00 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f6460b2f700 1 --2- 172.21.15.69:0/3846528343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4ce00 0x5602d9b4d720 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6458010fa0 tx=0x7f6458013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee62ea8786b809e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f64477fe700 1 -- 172.21.15.69:0/3846528343 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645801e620 con 0x5602d9b4ce00 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f64477fe700 1 -- 172.21.15.69:0/3846528343 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6458015070 con 0x5602d9b4ce00 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.513+0000 7f64477fe700 1 -- 172.21.15.69:0/3846528343 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645801c9e0 con 0x5602d9b4ce00 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 -- 172.21.15.69:0/3846528343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4ce00 msgr2=0x5602d9b4d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 --2- 172.21.15.69:0/3846528343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4ce00 0x5602d9b4d720 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6458010fa0 tx=0x7f6458013000 comp rx=0 tx=0).stop 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 -- 172.21.15.69:0/3846528343 shutdown_connections 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 --2- 172.21.15.69:0/3846528343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4dcb0 0x5602d9b4e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 --2- 172.21.15.69:0/3846528343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4c4b0 0x5602d9b4c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 --2- 172.21.15.69:0/3846528343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4ce00 0x5602d9b4d720 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 -- 172.21.15.69:0/3846528343 >> 172.21.15.69:0/3846528343 conn(0x5602d9b41c50 msgr2=0x5602d9b473e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 -- 172.21.15.69:0/3846528343 shutdown_connections 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 -- 172.21.15.69:0/3846528343 wait complete. 2023-12-14T14:10:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 -- start start 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.514+0000 7f646f722b80 1 Processor -- start 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b5d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9a39f40 con 0x5602d9b4c4b0 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9a39be0 con 0x5602d9b4dcb0 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9921650 con 0x5602d9b4ce00 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 10 client.0 _ll_register_callbacks cb 0x5602d9a5d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461330700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461330700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60252/0 (socket says 172.21.15.69:60252) 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461330700 1 -- 172.21.15.69:0/3603534084 learned_addr learned my addr 172.21.15.69:0/3603534084 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6460b2f700 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461b31700 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b5d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461330700 1 -- 172.21.15.69:0/3603534084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 msgr2=0x5602d9b566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461330700 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461330700 1 -- 172.21.15.69:0/3603534084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 msgr2=0x5602d9b5d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461330700 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b5d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461330700 1 -- 172.21.15.69:0/3603534084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6458010c50 con 0x5602d9b4c4b0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461b31700 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b5d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6461330700 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b561a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f644c005f50 tx=0x7f644c09b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e41bec8c3a31653 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6444ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6444ff9700 1 -- 172.21.15.69:0/3603534084 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c0a33d0 con 0x5602d9b4c4b0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6444ff9700 1 -- 172.21.15.69:0/3603534084 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f644c0a2f40 con 0x5602d9b4c4b0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 1 -- 172.21.15.69:0/3603534084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602d9b3f260 con 0x5602d9b4c4b0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f6444ff9700 1 -- 172.21.15.69:0/3603534084 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f644c0a3100 con 0x5602d9b4c4b0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 10 client.15240 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.515+0000 7f646f722b80 1 -- 172.21.15.69:0/3603534084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5602d9a64120 con 0x5602d9b4c4b0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f6444ff9700 1 -- 172.21.15.69:0/3603534084 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5602d9b3f260 con 0x5602d9b4c4b0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f6444ff9700 1 -- 172.21.15.69:0/3603534084 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f644c09a090 con 0x5602d9b4c4b0 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f646f722b80 10 client.15240 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f646f722b80 10 client.15240 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f646f722b80 20 client.15240 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f646f722b80 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5602d9b61560 0x5602d9b60650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f646f722b80 4 client.15240 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f646f722b80 1 -- 172.21.15.69:0/3603534084 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602d9a96c90 con 0x5602d9b61560 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f6460b2f700 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5602d9b61560 0x5602d9b60650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f6444ff9700 10 client.15240 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.516+0000 7f6460b2f700 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5602d9b61560 0x5602d9b60650 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94982e6253bc33f0 server_cookie=a584366d0014397a in_seq=0 out_seq=0 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f6444ff9700 1 -- 172.21.15.69:0/3603534084 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5602d9a96c90 con 0x5602d9b61560 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f6444ff9700 10 client.15240 handle_command_reply: tid=0 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 client.15240 shutdown 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 -- 172.21.15.69:0/3603534084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 msgr2=0x5602d9b561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b561a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f644c005f50 tx=0x7f644c09b010 comp rx=0 tx=0).stop 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 -- 172.21.15.69:0/3603534084 shutdown_connections 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5602d9b61560 0x5602d9b60650 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b5d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b561a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f6444ff9700 0 client.15240 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:20.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 --2- 172.21.15.69:0/3603534084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 -- 172.21.15.69:0/3603534084 >> 172.21.15.69:0/3603534084 conn(0x5602d9b41c50 msgr2=0x5602d9b45ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 -- 172.21.15.69:0/3603534084 shutdown_connections 2023-12-14T14:10:20.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 1 -- 172.21.15.69:0/3603534084 wait complete. 2023-12-14T14:10:20.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.517+0000 7f646f722b80 20 client.15240 trim_cache size 0 max 16384 2023-12-14T14:10:20.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f646f722b80 1 Processor -- start 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f646f722b80 1 -- start start 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f646f722b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b60650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f646f722b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b5d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f646f722b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b54e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f646f722b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9b62250 con 0x5602d9b4c4b0 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f646f722b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9a96c90 con 0x5602d9b4dcb0 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f646f722b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9a99da0 con 0x5602d9b4ce00 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f6461330700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b60650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f6461330700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b60650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60266/0 (socket says 172.21.15.69:60266) 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.535+0000 7f6461330700 1 -- 172.21.15.69:0/3252020532 learned_addr learned my addr 172.21.15.69:0/3252020532 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6460b2f700 1 --2- 172.21.15.69:0/3252020532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b5d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6461330700 1 -- 172.21.15.69:0/3252020532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 msgr2=0x5602d9b5d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6461330700 1 --2- 172.21.15.69:0/3252020532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b5d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6461330700 1 -- 172.21.15.69:0/3252020532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 msgr2=0x5602d9b54e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6461330700 1 --2- 172.21.15.69:0/3252020532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b54e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6461330700 1 -- 172.21.15.69:0/3252020532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602d9b4e350 con 0x5602d9b4c4b0 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6460b2f700 1 --2- 172.21.15.69:0/3252020532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b5d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6461330700 1 --2- 172.21.15.69:0/3252020532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b60650 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f644c09ad10 tx=0x7f644c09f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b520f32137f3332b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6447fff700 1 -- 172.21.15.69:0/3252020532 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c0b90e0 con 0x5602d9b4c4b0 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6447fff700 1 -- 172.21.15.69:0/3252020532 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f644c09ade0 con 0x5602d9b4c4b0 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.536+0000 7f6447fff700 1 -- 172.21.15.69:0/3252020532 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c09a1d0 con 0x5602d9b4c4b0 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 -- 172.21.15.69:0/3252020532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 msgr2=0x5602d9b60650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 --2- 172.21.15.69:0/3252020532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b60650 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f644c09ad10 tx=0x7f644c09f1c0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 -- 172.21.15.69:0/3252020532 shutdown_connections 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 --2- 172.21.15.69:0/3252020532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b54e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 --2- 172.21.15.69:0/3252020532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b60650 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 --2- 172.21.15.69:0/3252020532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b5d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 -- 172.21.15.69:0/3252020532 >> 172.21.15.69:0/3252020532 conn(0x5602d9b41c50 msgr2=0x5602d9b47230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 -- 172.21.15.69:0/3252020532 shutdown_connections 2023-12-14T14:10:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 -- 172.21.15.69:0/3252020532 wait complete. 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 -- start start 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 Processor -- start 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b57bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b58110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b5cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9b5d4f0 con 0x5602d9b4c4b0 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9b5d660 con 0x5602d9b4dcb0 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d9b5d820 con 0x5602d9b4ce00 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f646f722b80 10 client.0 _ll_register_callbacks cb 0x7f644c09a970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f6461330700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b57bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f6461330700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b57bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60276/0 (socket says 172.21.15.69:60276) 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.537+0000 7f6461330700 1 -- 172.21.15.69:0/2814642706 learned_addr learned my addr 172.21.15.69:0/2814642706 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6460b2f700 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b58110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6461b31700 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b5cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6461330700 1 -- 172.21.15.69:0/2814642706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 msgr2=0x5602d9b58110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6461330700 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b58110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6461330700 1 -- 172.21.15.69:0/2814642706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 msgr2=0x5602d9b5cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6461330700 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b5cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6461330700 1 -- 172.21.15.69:0/2814642706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602d9a64120 con 0x5602d9b4c4b0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6461330700 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b57bd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f644c09b1d0 tx=0x7f644c09b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c555cc987282887d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6444ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6444ff9700 1 -- 172.21.15.69:0/2814642706 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c00fcc0 con 0x5602d9b4c4b0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6444ff9700 1 -- 172.21.15.69:0/2814642706 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f644c0a33d0 con 0x5602d9b4c4b0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f646f722b80 1 -- 172.21.15.69:0/2814642706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6458015070 con 0x5602d9b4c4b0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6444ff9700 1 -- 172.21.15.69:0/2814642706 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f644c00fe20 con 0x5602d9b4c4b0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f646f722b80 10 client.15246 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f646f722b80 1 -- 172.21.15.69:0/2814642706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5602d98cbb10 con 0x5602d9b4c4b0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6444ff9700 1 -- 172.21.15.69:0/2814642706 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6458015070 con 0x5602d9b4c4b0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f6444ff9700 1 -- 172.21.15.69:0/2814642706 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f644c09b710 con 0x5602d9b4c4b0 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f646f722b80 10 client.15246 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:20.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f646f722b80 10 client.15246 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.538+0000 7f646f722b80 20 client.15246 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.539+0000 7f646f722b80 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5602d9b61560 0x5602d9bb5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.539+0000 7f646f722b80 4 client.15246 mds_command: new command op to 24500 tid=0[{"prefix": "status"}] 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.539+0000 7f646f722b80 1 -- 172.21.15.69:0/2814642706 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5602d9a969b0 con 0x5602d9b61560 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.539+0000 7f6460b2f700 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5602d9b61560 0x5602d9bb5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.539+0000 7f6444ff9700 10 client.15246 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.539+0000 7f6460b2f700 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5602d9b61560 0x5602d9bb5c20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d545af384ed3436 server_cookie=e97dbd1fd6238b3e in_seq=0 out_seq=0 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.539+0000 7f6444ff9700 1 -- 172.21.15.69:0/2814642706 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5602d9a969b0 con 0x5602d9b61560 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.539+0000 7f6444ff9700 10 client.15246 handle_command_reply: tid=0 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.539+0000 7f646f722b80 1 client.15246 shutdown 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 -- 172.21.15.69:0/2814642706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 msgr2=0x5602d9b57bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b57bd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f644c09b1d0 tx=0x7f644c09b010 comp rx=0 tx=0).stop 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 -- 172.21.15.69:0/2814642706 shutdown_connections 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5602d9b61560 0x5602d9bb5c20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602d9b4dcb0 0x5602d9b5cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6444ff9700 0 client.15246 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602d9b4c4b0 0x5602d9b57bd0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 --2- 172.21.15.69:0/2814642706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602d9b4ce00 0x5602d9b58110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 -- 172.21.15.69:0/2814642706 >> 172.21.15.69:0/2814642706 conn(0x5602d9b41c50 msgr2=0x5602d9b54e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 -- 172.21.15.69:0/2814642706 shutdown_connections 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 1 -- 172.21.15.69:0/2814642706 wait complete. 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f646f722b80 20 client.15246 trim_cache size 0 max 16384 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "5d58180a-9a89-11ee-95a3-87774f69a715", 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24500, 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T14:10:20.546 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T14:10:20.547 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 69.939977278000001, 2023-12-14T14:10:20.547 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T14:10:20.547 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 84, 2023-12-14T14:10:20.547 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 82, 2023-12-14T14:10:20.547 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 75.715745851999998 2023-12-14T14:10:20.547 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:10:20.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 -- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64480a11e0 msgr2=0x7f64480a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64480a11e0 0x7f64480a3690 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6458005950 tx=0x7f645800b410 comp rx=0 tx=0).stop 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 -- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 msgr2=0x7f645c195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 0x7f645c195f50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f644c0095c0 tx=0x7f644c00f690 comp rx=0 tx=0).stop 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 -- 172.21.15.69:0/565231260 shutdown_connections 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f64480a11e0 0x7f64480a3690 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c100410 0x7f645c19d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645c0fe890 0x7f645c195f50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 --2- 172.21.15.69:0/565231260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c0ffa80 0x7f645c196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 -- 172.21.15.69:0/565231260 >> 172.21.15.69:0/565231260 conn(0x7f645c0f9ed0 msgr2=0x7f645c0fc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 -- 172.21.15.69:0/565231260 shutdown_connections 2023-12-14T14:10:20.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:20.540+0000 7f6463594700 1 -- 172.21.15.69:0/565231260 wait complete. 2023-12-14T14:10:20.552 INFO:teuthology.run_tasks:Running task kclient... 2023-12-14T14:10:20.607 INFO:tasks.kclient:Mounting kernel clients... 2023-12-14T14:10:20.607 INFO:tasks.kclient:config is {'client.0': {}} 2023-12-14T14:10:20.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:20.607 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-12-14T14:10:20.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:20.624 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-12-14T14:10:20.687 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:20 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4173931318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:20.687 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:20 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2216685353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:20.693 INFO:teuthology.orchestra.run.smithi069.stderr:Cannot find device "ceph-brx" 2023-12-14T14:10:20.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T14:10:20.694 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2023-12-14T14:10:20.694 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-14T14:10:20.695 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-14T14:10:20.695 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph fs ls 2023-12-14T14:10:20.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:20 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4173931318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:20.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:20 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2216685353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:21.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:20 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4173931318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:21.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:20 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2216685353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:21.044 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:10:21.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:21 smithi069 ceph-mon[42034]: pgmap v259: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:21 smithi081 ceph-mon[43371]: pgmap v259: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:22.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:21 smithi119 ceph-mon[43834]: pgmap v259: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-14T14:10:22.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.101+0000 7fa737f72700 1 -- 172.21.15.69:0/440563828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 msgr2=0x7fa73010cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:22.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.101+0000 7fa737f72700 1 --2- 172.21.15.69:0/440563828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 0x7fa73010cda0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa72800b0a0 tx=0x7fa72800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.101+0000 7fa737f72700 1 -- 172.21.15.69:0/440563828 shutdown_connections 2023-12-14T14:10:22.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.101+0000 7fa737f72700 1 --2- 172.21.15.69:0/440563828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 0x7fa73010cda0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.101+0000 7fa737f72700 1 --2- 172.21.15.69:0/440563828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7301015f0 0x7fa7301019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.101+0000 7fa737f72700 1 --2- 172.21.15.69:0/440563828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa730101f00 0x7fa73010a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.101+0000 7fa737f72700 1 -- 172.21.15.69:0/440563828 >> 172.21.15.69:0/440563828 conn(0x7fa7300760d0 msgr2=0x7fa7300764d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:22.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.102+0000 7fa737f72700 1 -- 172.21.15.69:0/440563828 shutdown_connections 2023-12-14T14:10:22.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.102+0000 7fa737f72700 1 -- 172.21.15.69:0/440563828 wait complete. 2023-12-14T14:10:22.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.102+0000 7fa737f72700 1 Processor -- start 2023-12-14T14:10:22.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.102+0000 7fa737f72700 1 -- start start 2023-12-14T14:10:22.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa737f72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7301015f0 0x7fa730196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:22.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa737f72700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa730101f00 0x7fa730196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa737f72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 0x7fa73019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa737f72700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73019b410 con 0x7fa73010a940 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa737f72700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73019b580 con 0x7fa7301015f0 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa737f72700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73019b740 con 0x7fa730101f00 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73650f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 0x7fa73019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73650f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 0x7fa73019ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60294/0 (socket says 172.21.15.69:60294) 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73650f700 1 -- 172.21.15.69:0/1342054221 learned_addr learned my addr 172.21.15.69:0/1342054221 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa735d0e700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7301015f0 0x7fa730196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73550d700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa730101f00 0x7fa730196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73650f700 1 -- 172.21.15.69:0/1342054221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa730101f00 msgr2=0x7fa730196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73650f700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa730101f00 0x7fa730196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73650f700 1 -- 172.21.15.69:0/1342054221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7301015f0 msgr2=0x7fa730196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73650f700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7301015f0 0x7fa730196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73650f700 1 -- 172.21.15.69:0/1342054221 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728009d00 con 0x7fa73010a940 2023-12-14T14:10:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73550d700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa730101f00 0x7fa730196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa735d0e700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7301015f0 0x7fa730196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa73650f700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 0x7fa73019ae00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa7280062a0 tx=0x7fa728004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa726ffd700 1 -- 172.21.15.69:0/1342054221 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800e040 con 0x7fa73010a940 2023-12-14T14:10:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7301103d0 con 0x7fa73010a940 2023-12-14T14:10:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa726ffd700 1 -- 172.21.15.69:0/1342054221 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa728004020 con 0x7fa73010a940 2023-12-14T14:10:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.103+0000 7fa726ffd700 1 -- 172.21.15.69:0/1342054221 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72801b670 con 0x7fa73010a940 2023-12-14T14:10:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.104+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa730110240 con 0x7fa73010a940 2023-12-14T14:10:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.104+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa730110560 con 0x7fa73010a940 2023-12-14T14:10:22.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.106+0000 7fa726ffd700 1 -- 172.21.15.69:0/1342054221 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa728003a00 con 0x7fa73010a940 2023-12-14T14:10:22.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.106+0000 7fa726ffd700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa71c0a11e0 0x7fa71c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:22.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.106+0000 7fa735d0e700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa71c0a11e0 0x7fa71c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:22.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.106+0000 7fa726ffd700 1 -- 172.21.15.69:0/1342054221 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa7280ce7c0 con 0x7fa73010a940 2023-12-14T14:10:22.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.106+0000 7fa735d0e700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa71c0a11e0 0x7fa71c0a3690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa72c005950 tx=0x7fa72c005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:22.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.109+0000 7fa726ffd700 1 -- 172.21.15.69:0/1342054221 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa728097e40 con 0x7fa73010a940 2023-12-14T14:10:22.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.347+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa730066ea0 con 0x7fa73010a940 2023-12-14T14:10:22.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.347+0000 7fa726ffd700 1 -- 172.21.15.69:0/1342054221 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa72809b460 con 0x7fa73010a940 2023-12-14T14:10:22.347 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-14T14:10:22.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa71c0a11e0 msgr2=0x7fa71c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:22.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa71c0a11e0 0x7fa71c0a3690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa72c005950 tx=0x7fa72c005f50 comp rx=0 tx=0).stop 2023-12-14T14:10:22.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 msgr2=0x7fa73019ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:22.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 0x7fa73019ae00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa7280062a0 tx=0x7fa728004a50 comp rx=0 tx=0).stop 2023-12-14T14:10:22.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 shutdown_connections 2023-12-14T14:10:22.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa71c0a11e0 0x7fa71c0a3690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa73010a940 0x7fa73019ae00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7301015f0 0x7fa730196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 --2- 172.21.15.69:0/1342054221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa730101f00 0x7fa730196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:22.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 >> 172.21.15.69:0/1342054221 conn(0x7fa7300760d0 msgr2=0x7fa730104420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:22.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 shutdown_connections 2023-12-14T14:10:22.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:22.349+0000 7fa737f72700 1 -- 172.21.15.69:0/1342054221 wait complete. 2023-12-14T14:10:22.628 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:22 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1342054221' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-14T14:10:22.738 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-14T14:10:22.739 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-14T14:10:22.739 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-12-14T14:10:22.739 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-14T14:10:22.739 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-14T14:10:22.739 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-14T14:10:22.739 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-14T14:10:22.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-14T14:10:22.739 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-14T14:10:22.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:22.739 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-12-14T14:10:22.758 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-14T14:10:22.758 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-14T14:10:22.758 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-12-14T14:10:22.758 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-12-14T14:10:22.758 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-14T14:10:22.759 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42094sec preferred_lft 42094sec 2023-12-14T14:10:22.760 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::1d34:72f5:1e53:57c0/64 scope link noprefixroute 2023-12-14T14:10:22.760 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-12-14T14:10:22.760 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-14T14:10:22.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:22.760 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T14:10:22.760 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T14:10:22.760 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2023-12-14T14:10:22.761 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2023-12-14T14:10:22.761 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2023-12-14T14:10:22.761 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-14T14:10:22.761 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T14:10:22.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:22 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1342054221' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-14T14:10:22.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:22.971 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-14T14:10:22.999 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-12-14T14:10:23.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:23.001 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-12-14T14:10:23.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:22 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1342054221' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-14T14:10:23.071 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-12-14T14:10:23.071 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-14T14:10:23.071 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-14T14:10:23.071 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-14T14:10:23.071 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-14T14:10:23.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:23.072 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T14:10:23.072 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T14:10:23.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-14T14:10:23.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-14T14:10:23.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-14T14:10:23.072 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T14:10:23.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:23.340 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-12-14T14:10:23.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:23.357 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2023-12-14T14:10:23.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:23.414 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T14:10:23.414 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T14:10:23.414 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-14T14:10:23.414 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-14T14:10:23.414 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T14:10:23.509 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-14T14:10:23.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:23.509 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T14:10:23.509 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T14:10:23.509 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-14T14:10:23.509 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-14T14:10:23.509 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-14T14:10:23.510 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-14T14:10:23.510 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-14T14:10:23.510 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T14:10:23.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:23.717 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T14:10:23.717 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T14:10:23.718 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2023-12-14T14:10:23.718 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2023-12-14T14:10:23.718 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T14:10:23.756 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:23 smithi069 ceph-mon[42034]: pgmap v260: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-12-14T14:10:23.816 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-14T14:10:23.816 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-14T14:10:23.873 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-14T14:10:23.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-14T14:10:23.873 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-14T14:10:23.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:23 smithi081 ceph-mon[43371]: pgmap v260: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-12-14T14:10:23.930 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-12-14T14:10:23.930 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-12-14T14:10:23.930 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/59bb03c0-a245-4660-a310-b0f548fdcdde 2023-12-14T14:10:23.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:23.931 DEBUG:teuthology.orchestra.run.smithi069:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/59bb03c0-a245-4660-a310-b0f548fdcdde /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2023-12-14T14:10:24.016 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2023-12-14T14:10:24.016 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2023-12-14T14:10:24.016 INFO:teuthology.orchestra.run.smithi069.stdout:invalid new device string format 2023-12-14T14:10:24.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:23 smithi119 ceph-mon[43834]: pgmap v260: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-12-14T14:10:24.107 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2023-12-14T14:10:24.107 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2023-12-14T14:10:24.107 INFO:teuthology.orchestra.run.smithi069.stdout:invalid new device string format 2023-12-14T14:10:24.107 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:6789,172.21.15.81:6789,172.21.15.119:6789" 2023-12-14T14:10:24.107 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.69:6789,172.21.15.81:6789,172.21.15.119:6789:/volumes/_nogroup/sv_1/59bb03c0-a245-4660-a310-b0f548fdcdde 2023-12-14T14:10:24.107 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=5d58180a-9a89-11ee-95a3-87774f69a715" will pass to kernel 2023-12-14T14:10:24.110 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-14T14:10:24.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:24.110 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-14T14:10:24.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:24.140 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-14T14:10:24.230 INFO:teuthology.orchestra.run.smithi069.stdout:client24863 2023-12-14T14:10:24.231 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:10:24.231 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-14T14:10:24.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:24.249 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-14T14:10:24.340 INFO:teuthology.orchestra.run.smithi069.stdout:client24863 2023-12-14T14:10:24.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:24.341 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-14T14:10:24.390 INFO:teuthology.orchestra.run.smithi069.stdout:client24863 2023-12-14T14:10:24.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:10:24.391 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5d58180a-9a89-11ee-95a3-87774f69a715.client24863/status') 2023-12-14T14:10:24.446 INFO:teuthology.orchestra.run.smithi069.stdout:instance: client.24863 (3)172.21.15.69:0/3820607147 2023-12-14T14:10:24.446 INFO:teuthology.orchestra.run.smithi069.stdout:blocklisted: false 2023-12-14T14:10:24.446 INFO:teuthology.orchestra.run.smithi069.stderr:0+1 records in 2023-12-14T14:10:24.447 INFO:teuthology.orchestra.run.smithi069.stderr:0+1 records out 2023-12-14T14:10:24.447 INFO:teuthology.orchestra.run.smithi069.stderr:71 bytes copied, 2.0619e-05 s, 3.4 MB/s 2023-12-14T14:10:24.448 INFO:teuthology.run_tasks:Running task check-counter... 2023-12-14T14:10:24.466 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-12-14T14:10:24.502 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:10:24.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.625+0000 7fc2625b8700 1 -- 172.21.15.69:0/2209662663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 msgr2=0x7fc25c103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.625+0000 7fc2625b8700 1 --2- 172.21.15.69:0/2209662663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 0x7fc25c103160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc250009990 tx=0x7fc250009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.625+0000 7fc2625b8700 1 -- 172.21.15.69:0/2209662663 shutdown_connections 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.625+0000 7fc2625b8700 1 --2- 172.21.15.69:0/2209662663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc25c105fc0 0x7fc25c1083a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.625+0000 7fc2625b8700 1 --2- 172.21.15.69:0/2209662663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 0x7fc25c103160 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.625+0000 7fc2625b8700 1 --2- 172.21.15.69:0/2209662663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c1036a0 0x7fc25c105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.625+0000 7fc2625b8700 1 -- 172.21.15.69:0/2209662663 >> 172.21.15.69:0/2209662663 conn(0x7fc25c0fa780 msgr2=0x7fc25c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.625+0000 7fc2625b8700 1 -- 172.21.15.69:0/2209662663 shutdown_connections 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.625+0000 7fc2625b8700 1 -- 172.21.15.69:0/2209662663 wait complete. 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc2625b8700 1 Processor -- start 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc2625b8700 1 -- start start 2023-12-14T14:10:24.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc2625b8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 0x7fc25c1006f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc2625b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c1036a0 0x7fc25c0fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc2625b8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc25c105fc0 0x7fc25c0ff270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc2625b8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0ffa10 con 0x7fc25c100d80 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc2625b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0ffb80 con 0x7fc25c1036a0 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc2625b8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c1a0050 con 0x7fc25c105fc0 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc25bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 0x7fc25c1006f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc25bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 0x7fc25c1006f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60318/0 (socket says 172.21.15.69:60318) 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc25bfff700 1 -- 172.21.15.69:0/3972751135 learned_addr learned my addr 172.21.15.69:0/3972751135 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc25b7fe700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c1036a0 0x7fc25c0fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc25bfff700 1 -- 172.21.15.69:0/3972751135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc25c105fc0 msgr2=0x7fc25c0ff270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc25bfff700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc25c105fc0 0x7fc25c0ff270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc25bfff700 1 -- 172.21.15.69:0/3972751135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c1036a0 msgr2=0x7fc25c0fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:24.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc25bfff700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c1036a0 0x7fc25c0fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.626+0000 7fc25bfff700 1 -- 172.21.15.69:0/3972751135 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2500095f0 con 0x7fc25c100d80 2023-12-14T14:10:24.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.627+0000 7fc25bfff700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 0x7fc25c1006f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc250000c00 tx=0x7fc25000f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:24.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.627+0000 7fc2597fa700 1 -- 172.21.15.69:0/3972751135 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25001d070 con 0x7fc25c100d80 2023-12-14T14:10:24.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.627+0000 7fc2597fa700 1 -- 172.21.15.69:0/3972751135 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc25000fb50 con 0x7fc25c100d80 2023-12-14T14:10:24.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.627+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25c10bc20 con 0x7fc25c100d80 2023-12-14T14:10:24.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.627+0000 7fc2597fa700 1 -- 172.21.15.69:0/3972751135 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250017650 con 0x7fc25c100d80 2023-12-14T14:10:24.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.627+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25c10ba90 con 0x7fc25c100d80 2023-12-14T14:10:24.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.628+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25c0fc2f0 con 0x7fc25c100d80 2023-12-14T14:10:24.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.629+0000 7fc2597fa700 1 -- 172.21.15.69:0/3972751135 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc25000fcc0 con 0x7fc25c100d80 2023-12-14T14:10:24.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.629+0000 7fc2597fa700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2440a11e0 0x7fc2440a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:24.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.629+0000 7fc25b7fe700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2440a11e0 0x7fc2440a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:24.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.629+0000 7fc2597fa700 1 -- 172.21.15.69:0/3972751135 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fc2500cdd80 con 0x7fc25c100d80 2023-12-14T14:10:24.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.630+0000 7fc25b7fe700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2440a11e0 0x7fc2440a3690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc24c005950 tx=0x7fc24c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:24.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.633+0000 7fc2597fa700 1 -- 172.21.15.69:0/3972751135 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc250097500 con 0x7fc25c100d80 2023-12-14T14:10:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.824+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc25c061700 con 0x7fc25c100d80 2023-12-14T14:10:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.825+0000 7fc2597fa700 1 -- 172.21.15.69:0/3972751135 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22434 (secure 0 0 0) 0x7fc25009ab20 con 0x7fc25c100d80 2023-12-14T14:10:24.826 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:24.826 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":84,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:10:12.522850+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:10:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2440a11e0 msgr2=0x7fc2440a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2440a11e0 0x7fc2440a3690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc24c005950 tx=0x7fc24c00b410 comp rx=0 tx=0).stop 2023-12-14T14:10:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 msgr2=0x7fc25c1006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 0x7fc25c1006f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc250000c00 tx=0x7fc25000f710 comp rx=0 tx=0).stop 2023-12-14T14:10:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 shutdown_connections 2023-12-14T14:10:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc2440a11e0 0x7fc2440a3690 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc25c105fc0 0x7fc25c0ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc25c100d80 0x7fc25c1006f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 --2- 172.21.15.69:0/3972751135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c1036a0 0x7fc25c0fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 >> 172.21.15.69:0/3972751135 conn(0x7fc25c0fa780 msgr2=0x7fc25c1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 shutdown_connections 2023-12-14T14:10:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.827+0000 7fc2625b8700 1 -- 172.21.15.69:0/3972751135 wait complete. 2023-12-14T14:10:24.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T14:09:08.720147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T14:09:09.776845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:10:24.841 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:10:24.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 -- 172.21.15.69:0/1946784121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc100310 msgr2=0x7f63cc100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:24.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 --2- 172.21.15.69:0/1946784121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc100310 0x7f63cc100760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009990 tx=0x7f63bc009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 -- 172.21.15.69:0/1946784121 shutdown_connections 2023-12-14T14:10:24.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 --2- 172.21.15.69:0/1946784121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63cc100ca0 0x7f63cc107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 --2- 172.21.15.69:0/1946784121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc0ff120 0x7f63cc0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 --2- 172.21.15.69:0/1946784121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc100310 0x7f63cc100760 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 -- 172.21.15.69:0/1946784121 >> 172.21.15.69:0/1946784121 conn(0x7f63cc0fa740 msgr2=0x7f63cc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:24.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 -- 172.21.15.69:0/1946784121 shutdown_connections 2023-12-14T14:10:24.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 -- 172.21.15.69:0/1946784121 wait complete. 2023-12-14T14:10:24.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.966+0000 7f63d11e7700 1 Processor -- start 2023-12-14T14:10:24.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63d11e7700 1 -- start start 2023-12-14T14:10:24.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63d11e7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc0ff120 0x7f63cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:24.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63d11e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63cc100310 0x7f63cc19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63d11e7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc100ca0 0x7f63cc19d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63d11e7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc19da80 con 0x7f63cc0ff120 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63d11e7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc19dbf0 con 0x7f63cc100310 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63d11e7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc19ddb0 con 0x7f63cc100ca0 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc0ff120 0x7f63cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc0ff120 0x7f63cc068960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60342/0 (socket says 172.21.15.69:60342) 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cad9d700 1 -- 172.21.15.69:0/4117829308 learned_addr learned my addr 172.21.15.69:0/4117829308 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63ca59c700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63cc100310 0x7f63cc19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cb59e700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc100ca0 0x7f63cc19d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:24.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cad9d700 1 -- 172.21.15.69:0/4117829308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc100ca0 msgr2=0x7f63cc19d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cad9d700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc100ca0 0x7f63cc19d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cad9d700 1 -- 172.21.15.69:0/4117829308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63cc100310 msgr2=0x7f63cc19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cad9d700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63cc100310 0x7f63cc19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cad9d700 1 -- 172.21.15.69:0/4117829308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc0095f0 con 0x7f63cc0ff120 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cb59e700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc100ca0 0x7f63cc19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63cad9d700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc0ff120 0x7f63cc068960 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c990 tx=0x7f63c000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.967+0000 7f63b3fff700 1 -- 172.21.15.69:0/4117829308 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0007b00 con 0x7f63cc0ff120 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.968+0000 7f63b3fff700 1 -- 172.21.15.69:0/4117829308 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63c0007c60 con 0x7f63cc0ff120 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.968+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63cc10aad0 con 0x7f63cc0ff120 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.968+0000 7f63b3fff700 1 -- 172.21.15.69:0/4117829308 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0018660 con 0x7f63cc0ff120 2023-12-14T14:10:24.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.968+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63cc10a940 con 0x7f63cc0ff120 2023-12-14T14:10:24.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.968+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63cc19e500 con 0x7f63cc0ff120 2023-12-14T14:10:24.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.969+0000 7f63b3fff700 1 -- 172.21.15.69:0/4117829308 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f63c000f450 con 0x7f63cc0ff120 2023-12-14T14:10:24.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.970+0000 7f63b3fff700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63b40a11e0 0x7f63b40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:24.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.970+0000 7f63ca59c700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63b40a11e0 0x7f63b40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:24.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.970+0000 7f63b3fff700 1 -- 172.21.15.69:0/4117829308 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f63c00cc9c0 con 0x7f63cc0ff120 2023-12-14T14:10:24.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.970+0000 7f63ca59c700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63b40a11e0 0x7f63b40a3690 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00b2e0 tx=0x7f63bc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:24.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:24.974+0000 7f63b3fff700 1 -- 172.21.15.69:0/4117829308 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f63c00960b0 con 0x7f63cc0ff120 2023-12-14T14:10:25.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.165+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63cc105fb0 con 0x7f63cc0ff120 2023-12-14T14:10:25.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.165+0000 7f63b3fff700 1 -- 172.21.15.69:0/4117829308 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63c00996d0 con 0x7f63cc0ff120 2023-12-14T14:10:25.166 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:10:25.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63b40a11e0 msgr2=0x7f63b40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63b40a11e0 0x7f63b40a3690 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00b2e0 tx=0x7f63bc005fb0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc0ff120 msgr2=0x7f63cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc0ff120 0x7f63cc068960 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c990 tx=0x7f63c000cd50 comp rx=0 tx=0).stop 2023-12-14T14:10:25.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 shutdown_connections 2023-12-14T14:10:25.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63b40a11e0 0x7f63b40a3690 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc100ca0 0x7f63cc19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63cc0ff120 0x7f63cc068960 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 --2- 172.21.15.69:0/4117829308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63cc100310 0x7f63cc19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 >> 172.21.15.69:0/4117829308 conn(0x7f63cc0fa740 msgr2=0x7f63cc0fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:25.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 shutdown_connections 2023-12-14T14:10:25.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.167+0000 7f63d11e7700 1 -- 172.21.15.69:0/4117829308 wait complete. 2023-12-14T14:10:25.180 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T14:10:25.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.306+0000 7ff04a61f700 1 -- 172.21.15.69:0/1736363393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 msgr2=0x7ff0440ff870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.306+0000 7ff04a61f700 1 --2- 172.21.15.69:0/1736363393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 0x7ff0440ff870 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff038009990 tx=0x7ff038009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.306+0000 7ff04a61f700 1 -- 172.21.15.69:0/1736363393 shutdown_connections 2023-12-14T14:10:25.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.306+0000 7ff04a61f700 1 --2- 172.21.15.69:0/1736363393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0440ffdb0 0x7ff044100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.306+0000 7ff04a61f700 1 --2- 172.21.15.69:0/1736363393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440feab0 0x7ff0440feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.306+0000 7ff04a61f700 1 --2- 172.21.15.69:0/1736363393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 0x7ff0440ff870 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.306+0000 7ff04a61f700 1 -- 172.21.15.69:0/1736363393 >> 172.21.15.69:0/1736363393 conn(0x7ff0440fa740 msgr2=0x7ff0440fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.306+0000 7ff04a61f700 1 -- 172.21.15.69:0/1736363393 shutdown_connections 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.306+0000 7ff04a61f700 1 -- 172.21.15.69:0/1736363393 wait complete. 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff04a61f700 1 Processor -- start 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff04a61f700 1 -- start start 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff04a61f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0440feab0 0x7ff044198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff04a61f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 0x7ff0441986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff04a61f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440ffdb0 0x7ff04419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff04a61f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04419fce0 con 0x7ff0440ff400 2023-12-14T14:10:25.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff04a61f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04419fe20 con 0x7ff0440ffdb0 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff04a61f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04419ffb0 con 0x7ff0440feab0 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff0437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 0x7ff0441986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff0437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 0x7ff0441986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60372/0 (socket says 172.21.15.69:60372) 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff0437fe700 1 -- 172.21.15.69:0/3610663633 learned_addr learned my addr 172.21.15.69:0/3610663633 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff043fff700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0440feab0 0x7ff044198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff048bbc700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440ffdb0 0x7ff04419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff0437fe700 1 -- 172.21.15.69:0/3610663633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0440feab0 msgr2=0x7ff044198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff0437fe700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0440feab0 0x7ff044198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff0437fe700 1 -- 172.21.15.69:0/3610663633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440ffdb0 msgr2=0x7ff04419f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff0437fe700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440ffdb0 0x7ff04419f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff0437fe700 1 -- 172.21.15.69:0/3610663633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0380095f0 con 0x7ff0440ff400 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.307+0000 7ff048bbc700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440ffdb0 0x7ff04419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.308+0000 7ff0437fe700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 0x7ff0441986a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff038000c00 tx=0x7ff03800f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.308+0000 7ff0417fa700 1 -- 172.21.15.69:0/3610663633 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03801d070 con 0x7ff0440ff400 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.308+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04410de00 con 0x7ff0440ff400 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.308+0000 7ff0417fa700 1 -- 172.21.15.69:0/3610663633 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff03800fc30 con 0x7ff0440ff400 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.308+0000 7ff0417fa700 1 -- 172.21.15.69:0/3610663633 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038017650 con 0x7ff0440ff400 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.308+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04410dc70 con 0x7ff0440ff400 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.309+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff044109890 con 0x7ff0440ff400 2023-12-14T14:10:25.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.310+0000 7ff0417fa700 1 -- 172.21.15.69:0/3610663633 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff038022470 con 0x7ff0440ff400 2023-12-14T14:10:25.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.310+0000 7ff0417fa700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff02c0a11e0 0x7ff02c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.310+0000 7ff0417fa700 1 -- 172.21.15.69:0/3610663633 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff0380cdd70 con 0x7ff0440ff400 2023-12-14T14:10:25.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.310+0000 7ff043fff700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff02c0a11e0 0x7ff02c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.311+0000 7ff043fff700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff02c0a11e0 0x7ff02c0a3690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff034005950 tx=0x7ff03400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:25.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.314+0000 7ff0417fa700 1 -- 172.21.15.69:0/3610663633 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff03805c730 con 0x7ff0440ff400 2023-12-14T14:10:25.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.504+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff044061700 con 0x7ff0440ff400 2023-12-14T14:10:25.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.505+0000 7ff0417fa700 1 -- 172.21.15.69:0/3610663633 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff0380974f0 con 0x7ff0440ff400 2023-12-14T14:10:25.505 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T14:10:25.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff02c0a11e0 msgr2=0x7ff02c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff02c0a11e0 0x7ff02c0a3690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff034005950 tx=0x7ff03400a300 comp rx=0 tx=0).stop 2023-12-14T14:10:25.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 msgr2=0x7ff0441986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 0x7ff0441986a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff038000c00 tx=0x7ff03800f780 comp rx=0 tx=0).stop 2023-12-14T14:10:25.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 shutdown_connections 2023-12-14T14:10:25.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7ff02c0a11e0 0x7ff02c0a3690 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440ffdb0 0x7ff04419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0440feab0 0x7ff044198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 --2- 172.21.15.69:0/3610663633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0440ff400 0x7ff0441986a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 >> 172.21.15.69:0/3610663633 conn(0x7ff0440fa740 msgr2=0x7ff0440fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:25.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 shutdown_connections 2023-12-14T14:10:25.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.507+0000 7ff04a61f700 1 -- 172.21.15.69:0/3610663633 wait complete. 2023-12-14T14:10:25.520 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T14:10:25.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.644+0000 7f77160b5700 1 -- 172.21.15.69:0/847037944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77100ff120 msgr2=0x7f77100ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.644+0000 7f77160b5700 1 --2- 172.21.15.69:0/847037944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77100ff120 0x7f77100ff530 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7700009990 tx=0x7f7700009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.644+0000 7f77160b5700 1 -- 172.21.15.69:0/847037944 shutdown_connections 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.644+0000 7f77160b5700 1 --2- 172.21.15.69:0/847037944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7710100ca0 0x7f7710107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.644+0000 7f77160b5700 1 --2- 172.21.15.69:0/847037944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77100ff120 0x7f77100ff530 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.644+0000 7f77160b5700 1 --2- 172.21.15.69:0/847037944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7710100310 0x7f7710100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.644+0000 7f77160b5700 1 -- 172.21.15.69:0/847037944 >> 172.21.15.69:0/847037944 conn(0x7f77100fa740 msgr2=0x7f77100fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.644+0000 7f77160b5700 1 -- 172.21.15.69:0/847037944 shutdown_connections 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.644+0000 7f77160b5700 1 -- 172.21.15.69:0/847037944 wait complete. 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f77160b5700 1 Processor -- start 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f77160b5700 1 -- start start 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f77160b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77100ff120 0x7f7710194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f77160b5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7710100310 0x7f7710195420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f77160b5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7710100ca0 0x7f771019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f77160b5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771019ca60 con 0x7f7710100ca0 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f77160b5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771019cba0 con 0x7f77100ff120 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f77160b5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771019cd30 con 0x7f7710100310 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f770ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7710100ca0 0x7f771019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f770ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7710100ca0 0x7f771019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60394/0 (socket says 172.21.15.69:60394) 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f770ffff700 1 -- 172.21.15.69:0/3837747881 learned_addr learned my addr 172.21.15.69:0/3837747881 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f770f7fe700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77100ff120 0x7f7710194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f770ffff700 1 -- 172.21.15.69:0/3837747881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7710100310 msgr2=0x7f7710195420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f770ffff700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7710100310 0x7f7710195420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f770ffff700 1 -- 172.21.15.69:0/3837747881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77100ff120 msgr2=0x7f7710194ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.645+0000 7f770ffff700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77100ff120 0x7f7710194ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.646+0000 7f770ffff700 1 -- 172.21.15.69:0/3837747881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000095f0 con 0x7f7710100ca0 2023-12-14T14:10:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.646+0000 7f770ffff700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7710100ca0 0x7f771019c490 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7708007ee0 tx=0x7f770800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.646+0000 7f770cff9700 1 -- 172.21.15.69:0/3837747881 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708017070 con 0x7f7710100ca0 2023-12-14T14:10:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.646+0000 7f770cff9700 1 -- 172.21.15.69:0/3837747881 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f770800f040 con 0x7f7710100ca0 2023-12-14T14:10:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.646+0000 7f770cff9700 1 -- 172.21.15.69:0/3837747881 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708005740 con 0x7f7710100ca0 2023-12-14T14:10:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.646+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771010aae0 con 0x7f7710100ca0 2023-12-14T14:10:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.646+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771010a950 con 0x7f7710100ca0 2023-12-14T14:10:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.647+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77101060a0 con 0x7f7710100ca0 2023-12-14T14:10:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.648+0000 7f770cff9700 1 -- 172.21.15.69:0/3837747881 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f77080058a0 con 0x7f7710100ca0 2023-12-14T14:10:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.648+0000 7f770cff9700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76f80a1260 0x7f76f80a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.649+0000 7f770f7fe700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76f80a1260 0x7f76f80a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.649+0000 7f770cff9700 1 -- 172.21.15.69:0/3837747881 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f77080cc960 con 0x7f7710100ca0 2023-12-14T14:10:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.649+0000 7f770f7fe700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76f80a1260 0x7f76f80a3710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f770000b5c0 tx=0x7f7700005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.652+0000 7f770cff9700 1 -- 172.21.15.69:0/3837747881 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7708095f50 con 0x7f7710100ca0 2023-12-14T14:10:25.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:25 smithi069 ceph-mon[42034]: pgmap v261: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-12-14T14:10:25.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:25 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3972751135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:25 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4117829308' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:25 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3610663633' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:25.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.843+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7710061700 con 0x7f7710100ca0 2023-12-14T14:10:25.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.844+0000 7f770cff9700 1 -- 172.21.15.69:0/3837747881 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7708099570 con 0x7f7710100ca0 2023-12-14T14:10:25.844 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T14:10:25.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.845+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76f80a1260 msgr2=0x7f76f80a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76f80a1260 0x7f76f80a3710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f770000b5c0 tx=0x7f7700005fb0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7710100ca0 msgr2=0x7f771019c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7710100ca0 0x7f771019c490 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7708007ee0 tx=0x7f770800d3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 shutdown_connections 2023-12-14T14:10:25.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f76f80a1260 0x7f76f80a3710 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7710100ca0 0x7f771019c490 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77100ff120 0x7f7710194ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 --2- 172.21.15.69:0/3837747881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7710100310 0x7f7710195420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 >> 172.21.15.69:0/3837747881 conn(0x7f77100fa740 msgr2=0x7f77100fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:25.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 shutdown_connections 2023-12-14T14:10:25.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.846+0000 7f77160b5700 1 -- 172.21.15.69:0/3837747881 wait complete. 2023-12-14T14:10:25.859 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:10:25.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 -- 172.21.15.69:0/3645836010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 msgr2=0x7f1f38100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/3645836010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 0x7f1f38100650 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009990 tx=0x7f1f28009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 -- 172.21.15.69:0/3645836010 shutdown_connections 2023-12-14T14:10:25.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/3645836010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f38101dc0 0x7f1f38108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/3645836010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 0x7f1f38100650 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/3645836010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38101430 0x7f1f38101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 -- 172.21.15.69:0/3645836010 >> 172.21.15.69:0/3645836010 conn(0x7f1f380fb820 msgr2=0x7f1f380fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 -- 172.21.15.69:0/3645836010 shutdown_connections 2023-12-14T14:10:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 -- 172.21.15.69:0/3645836010 wait complete. 2023-12-14T14:10:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 Processor -- start 2023-12-14T14:10:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.980+0000 7f1f3f82c700 1 -- start start 2023-12-14T14:10:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3f82c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 0x7f1f38195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3f82c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f38101430 0x7f1f38196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3f82c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38101dc0 0x7f1f3819d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3f82c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3819da60 con 0x7f1f38100240 2023-12-14T14:10:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3f82c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3819dba0 con 0x7f1f38101dc0 2023-12-14T14:10:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3f82c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3819dd30 con 0x7f1f38101430 2023-12-14T14:10:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3d5c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 0x7f1f38195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3d5c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 0x7f1f38195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60412/0 (socket says 172.21.15.69:60412) 2023-12-14T14:10:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3d5c8700 1 -- 172.21.15.69:0/2112872870 learned_addr learned my addr 172.21.15.69:0/2112872870 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3cdc7700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f38101430 0x7f1f38196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3d5c8700 1 -- 172.21.15.69:0/2112872870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f38101430 msgr2=0x7f1f38196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3d5c8700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f38101430 0x7f1f38196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3ddc9700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38101dc0 0x7f1f3819d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3d5c8700 1 -- 172.21.15.69:0/2112872870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38101dc0 msgr2=0x7f1f3819d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3d5c8700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38101dc0 0x7f1f3819d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3d5c8700 1 -- 172.21.15.69:0/2112872870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f280095f0 con 0x7f1f38100240 2023-12-14T14:10:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3d5c8700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 0x7f1f38195ee0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1f28000c00 tx=0x7f1f28003940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f2e7fc700 1 -- 172.21.15.69:0/2112872870 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2801d070 con 0x7f1f38100240 2023-12-14T14:10:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3810bbb0 con 0x7f1f38100240 2023-12-14T14:10:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f2e7fc700 1 -- 172.21.15.69:0/2112872870 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f28022470 con 0x7f1f38100240 2023-12-14T14:10:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f2e7fc700 1 -- 172.21.15.69:0/2112872870 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2800f6c0 con 0x7f1f38100240 2023-12-14T14:10:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.981+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3810ba20 con 0x7f1f38100240 2023-12-14T14:10:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.982+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f38107730 con 0x7f1f38100240 2023-12-14T14:10:25.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.983+0000 7f1f2e7fc700 1 -- 172.21.15.69:0/2112872870 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1f280225e0 con 0x7f1f38100240 2023-12-14T14:10:25.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.984+0000 7f1f2e7fc700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1f240a11e0 0x7f1f240a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:25.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.984+0000 7f1f3cdc7700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1f240a11e0 0x7f1f240a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:25.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.984+0000 7f1f2e7fc700 1 -- 172.21.15.69:0/2112872870 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1f280ce580 con 0x7f1f38100240 2023-12-14T14:10:25.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.984+0000 7f1f3cdc7700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1f240a11e0 0x7f1f240a3690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400ba60 tx=0x7f1f34005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:25.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:25.987+0000 7f1f2e7fc700 1 -- 172.21.15.69:0/2112872870 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1f28097d00 con 0x7f1f38100240 2023-12-14T14:10:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:25 smithi119 ceph-mon[43834]: pgmap v261: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-12-14T14:10:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:25 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3972751135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:26.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:25 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4117829308' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:26.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:25 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3610663633' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:26.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:25 smithi081 ceph-mon[43371]: pgmap v261: 97 pgs: 97 active+clean; 636 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-12-14T14:10:26.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:25 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3972751135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:26.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:25 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4117829308' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:26.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:25 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3610663633' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:26.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.178+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f38061810 con 0x7f1f38100240 2023-12-14T14:10:26.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.179+0000 7f1f2e7fc700 1 -- 172.21.15.69:0/2112872870 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22434 (secure 0 0 0) 0x7f1f2809b320 con 0x7f1f38100240 2023-12-14T14:10:26.180 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:26.180 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":84,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:10:12.522850+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:10:26.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1f240a11e0 msgr2=0x7f1f240a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1f240a11e0 0x7f1f240a3690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400ba60 tx=0x7f1f34005d50 comp rx=0 tx=0).stop 2023-12-14T14:10:26.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 msgr2=0x7f1f38195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 0x7f1f38195ee0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1f28000c00 tx=0x7f1f28003940 comp rx=0 tx=0).stop 2023-12-14T14:10:26.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 shutdown_connections 2023-12-14T14:10:26.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1f240a11e0 0x7f1f240a3690 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38101dc0 0x7f1f3819d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f38100240 0x7f1f38195ee0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 --2- 172.21.15.69:0/2112872870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f38101430 0x7f1f38196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 >> 172.21.15.69:0/2112872870 conn(0x7f1f380fb820 msgr2=0x7f1f38104870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:26.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 shutdown_connections 2023-12-14T14:10:26.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.182+0000 7f1f3f82c700 1 -- 172.21.15.69:0/2112872870 wait complete. 2023-12-14T14:10:26.195 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T14:09:08.720147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T14:09:09.776845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:10:26.195 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:10:26.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 -- 172.21.15.69:0/1850163493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 msgr2=0x7f8624106cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 --2- 172.21.15.69:0/1850163493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 0x7f8624106cf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c210 tx=0x7f861c00c520 comp rx=0 tx=0).stop 2023-12-14T14:10:26.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 -- 172.21.15.69:0/1850163493 shutdown_connections 2023-12-14T14:10:26.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 --2- 172.21.15.69:0/1850163493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 0x7f8624106cf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 --2- 172.21.15.69:0/1850163493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240fe8b0 0x7f86240fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 --2- 172.21.15.69:0/1850163493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86240ffaa0 0x7f86240ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 -- 172.21.15.69:0/1850163493 >> 172.21.15.69:0/1850163493 conn(0x7f86240f9eb0 msgr2=0x7f86240fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:26.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 -- 172.21.15.69:0/1850163493 shutdown_connections 2023-12-14T14:10:26.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 -- 172.21.15.69:0/1850163493 wait complete. 2023-12-14T14:10:26.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.321+0000 7f862b0de700 1 Processor -- start 2023-12-14T14:10:26.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862b0de700 1 -- start start 2023-12-14T14:10:26.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862b0de700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86240fe8b0 0x7f8624196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862b0de700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240ffaa0 0x7f86241965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862b0de700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 0x7f862419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862b0de700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862419dc00 con 0x7f8624100430 2023-12-14T14:10:26.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862b0de700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862419dd40 con 0x7f86240fe8b0 2023-12-14T14:10:26.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862b0de700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862419ded0 con 0x7f86240ffaa0 2023-12-14T14:10:26.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862967b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 0x7f862419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:26.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862967b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 0x7f862419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54366/0 (socket says 172.21.15.69:54366) 2023-12-14T14:10:26.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862967b700 1 -- 172.21.15.69:0/1520678638 learned_addr learned my addr 172.21.15.69:0/1520678638 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:26.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f8628e7a700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86240fe8b0 0x7f8624196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f8623fff700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240ffaa0 0x7f86241965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862967b700 1 -- 172.21.15.69:0/1520678638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240ffaa0 msgr2=0x7f86241965c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862967b700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240ffaa0 0x7f86241965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862967b700 1 -- 172.21.15.69:0/1520678638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86240fe8b0 msgr2=0x7f8624196080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862967b700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86240fe8b0 0x7f8624196080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862967b700 1 -- 172.21.15.69:0/1520678638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c00ae10 con 0x7f8624100430 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862967b700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 0x7f862419d630 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c9a0 tx=0x7f861c009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f8621ffb700 1 -- 172.21.15.69:0/1520678638 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00f040 con 0x7f8624100430 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8624109a30 con 0x7f8624100430 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f8621ffb700 1 -- 172.21.15.69:0/1520678638 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f861c004c30 con 0x7f8624100430 2023-12-14T14:10:26.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.322+0000 7f8621ffb700 1 -- 172.21.15.69:0/1520678638 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c007700 con 0x7f8624100430 2023-12-14T14:10:26.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.323+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86241098a0 con 0x7f8624100430 2023-12-14T14:10:26.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.324+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8624067e40 con 0x7f8624100430 2023-12-14T14:10:26.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.325+0000 7f8621ffb700 1 -- 172.21.15.69:0/1520678638 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f861c005050 con 0x7f8624100430 2023-12-14T14:10:26.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.325+0000 7f8621ffb700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86140a11e0 0x7f86140a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.325+0000 7f8621ffb700 1 -- 172.21.15.69:0/1520678638 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f861c0ce770 con 0x7f8624100430 2023-12-14T14:10:26.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.325+0000 7f8628e7a700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86140a11e0 0x7f86140a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:26.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.326+0000 7f8628e7a700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86140a11e0 0x7f86140a3690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8618006fd0 tx=0x7f8618008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:26.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.329+0000 7f8621ffb700 1 -- 172.21.15.69:0/1520678638 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f861c097ef0 con 0x7f8624100430 2023-12-14T14:10:26.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.515+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f862419ea20 con 0x7f8624100430 2023-12-14T14:10:26.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.516+0000 7f8621ffb700 1 -- 172.21.15.69:0/1520678638 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f861c09b510 con 0x7f8624100430 2023-12-14T14:10:26.516 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:10:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86140a11e0 msgr2=0x7f86140a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86140a11e0 0x7f86140a3690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8618006fd0 tx=0x7f8618008040 comp rx=0 tx=0).stop 2023-12-14T14:10:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 msgr2=0x7f862419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 0x7f862419d630 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c9a0 tx=0x7f861c009f80 comp rx=0 tx=0).stop 2023-12-14T14:10:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 shutdown_connections 2023-12-14T14:10:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86140a11e0 0x7f86140a3690 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8624100430 0x7f862419d630 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86240fe8b0 0x7f8624196080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 --2- 172.21.15.69:0/1520678638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240ffaa0 0x7f86241965c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 >> 172.21.15.69:0/1520678638 conn(0x7f86240f9eb0 msgr2=0x7f8624105040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:26.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 shutdown_connections 2023-12-14T14:10:26.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.518+0000 7f862b0de700 1 -- 172.21.15.69:0/1520678638 wait complete. 2023-12-14T14:10:26.531 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T14:10:26.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.655+0000 7fc0b89ce700 1 -- 172.21.15.69:0/308048752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b40ff140 msgr2=0x7fc0b40ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.655+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/308048752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b40ff140 0x7fc0b40ff550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009990 tx=0x7fc0a4009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.655+0000 7fc0b89ce700 1 -- 172.21.15.69:0/308048752 shutdown_connections 2023-12-14T14:10:26.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.655+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/308048752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0b4100cc0 0x7fc0b4107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.655+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/308048752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b40ff140 0x7fc0b40ff550 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.655+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/308048752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b4100330 0x7fc0b4100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.655+0000 7fc0b89ce700 1 -- 172.21.15.69:0/308048752 >> 172.21.15.69:0/308048752 conn(0x7fc0b40fa740 msgr2=0x7fc0b40fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:26.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.655+0000 7fc0b89ce700 1 -- 172.21.15.69:0/308048752 shutdown_connections 2023-12-14T14:10:26.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.655+0000 7fc0b89ce700 1 -- 172.21.15.69:0/308048752 wait complete. 2023-12-14T14:10:26.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.656+0000 7fc0b89ce700 1 Processor -- start 2023-12-14T14:10:26.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.656+0000 7fc0b89ce700 1 -- start start 2023-12-14T14:10:26.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b89ce700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0b40ff140 0x7fc0b4194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b89ce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b4100330 0x7fc0b41954c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b89ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b4100cc0 0x7fc0b419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b89ce700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b419cb00 con 0x7fc0b4100cc0 2023-12-14T14:10:26.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b89ce700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b419cc40 con 0x7fc0b4100330 2023-12-14T14:10:26.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b89ce700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b419cdd0 con 0x7fc0b40ff140 2023-12-14T14:10:26.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b4100cc0 0x7fc0b419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:26.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b4100cc0 0x7fc0b419c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54384/0 (socket says 172.21.15.69:54384) 2023-12-14T14:10:26.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b2d9d700 1 -- 172.21.15.69:0/125711982 learned_addr learned my addr 172.21.15.69:0/125711982 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b259c700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0b40ff140 0x7fc0b4194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b1d9b700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b4100330 0x7fc0b41954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b2d9d700 1 -- 172.21.15.69:0/125711982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0b40ff140 msgr2=0x7fc0b4194f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b2d9d700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0b40ff140 0x7fc0b4194f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b2d9d700 1 -- 172.21.15.69:0/125711982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b4100330 msgr2=0x7fc0b41954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b2d9d700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b4100330 0x7fc0b41954c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b2d9d700 1 -- 172.21.15.69:0/125711982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40095f0 con 0x7fc0b4100cc0 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b2d9d700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b4100cc0 0x7fc0b419c530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00db90 tx=0x7fc0ac00dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0a37fe700 1 -- 172.21.15.69:0/125711982 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00e6a0 con 0x7fc0b4100cc0 2023-12-14T14:10:26.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b410ab30 con 0x7fc0b4100cc0 2023-12-14T14:10:26.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0a37fe700 1 -- 172.21.15.69:0/125711982 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0ac00bac0 con 0x7fc0b4100cc0 2023-12-14T14:10:26.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0a37fe700 1 -- 172.21.15.69:0/125711982 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac009e00 con 0x7fc0b4100cc0 2023-12-14T14:10:26.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.657+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b410a9a0 con 0x7fc0b4100cc0 2023-12-14T14:10:26.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.658+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b40699e0 con 0x7fc0b4100cc0 2023-12-14T14:10:26.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.660+0000 7fc0a37fe700 1 -- 172.21.15.69:0/125711982 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc0ac00e800 con 0x7fc0b4100cc0 2023-12-14T14:10:26.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.660+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc09c0a11e0 0x7fc09c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.660+0000 7fc0b259c700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc09c0a11e0 0x7fc09c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:26.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.660+0000 7fc0a37fe700 1 -- 172.21.15.69:0/125711982 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fc0ac006e40 con 0x7fc0b4100cc0 2023-12-14T14:10:26.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.661+0000 7fc0b259c700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc09c0a11e0 0x7fc09c0a3690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400b5c0 tx=0x7fc0a4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:26.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.664+0000 7fc0a37fe700 1 -- 172.21.15.69:0/125711982 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc0ac095bf0 con 0x7fc0b4100cc0 2023-12-14T14:10:26.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:26 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3837747881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:26.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:26 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2112872870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:26.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:26 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1520678638' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:26.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.854+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0b4069b70 con 0x7fc0b4100cc0 2023-12-14T14:10:26.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.855+0000 7fc0a37fe700 1 -- 172.21.15.69:0/125711982 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0ac099210 con 0x7fc0b4100cc0 2023-12-14T14:10:26.855 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T14:10:26.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.856+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc09c0a11e0 msgr2=0x7fc09c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.856+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc09c0a11e0 0x7fc09c0a3690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400b5c0 tx=0x7fc0a4005960 comp rx=0 tx=0).stop 2023-12-14T14:10:26.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.856+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b4100cc0 msgr2=0x7fc0b419c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.856+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b4100cc0 0x7fc0b419c530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00db90 tx=0x7fc0ac00dea0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.857+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 shutdown_connections 2023-12-14T14:10:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.857+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fc09c0a11e0 0x7fc09c0a3690 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.857+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0b4100cc0 0x7fc0b419c530 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.857+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0b40ff140 0x7fc0b4194f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.857+0000 7fc0b89ce700 1 --2- 172.21.15.69:0/125711982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b4100330 0x7fc0b41954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.857+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 >> 172.21.15.69:0/125711982 conn(0x7fc0b40fa740 msgr2=0x7fc0b4103820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.857+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 shutdown_connections 2023-12-14T14:10:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.857+0000 7fc0b89ce700 1 -- 172.21.15.69:0/125711982 wait complete. 2023-12-14T14:10:26.869 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T14:10:26.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.994+0000 7f8c781ed700 1 -- 172.21.15.69:0/1979794290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 msgr2=0x7f8c70108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:26.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.994+0000 7f8c781ed700 1 --2- 172.21.15.69:0/1979794290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 0x7f8c70108340 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000b0a0 tx=0x7f8c6000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.994+0000 7f8c781ed700 1 -- 172.21.15.69:0/1979794290 shutdown_connections 2023-12-14T14:10:26.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.994+0000 7f8c781ed700 1 --2- 172.21.15.69:0/1979794290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 0x7f8c70108340 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.994+0000 7f8c781ed700 1 --2- 172.21.15.69:0/1979794290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c70100ca0 0x7f8c70103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.994+0000 7f8c781ed700 1 --2- 172.21.15.69:0/1979794290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c701035c0 0x7f8c701059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:26.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.994+0000 7f8c781ed700 1 -- 172.21.15.69:0/1979794290 >> 172.21.15.69:0/1979794290 conn(0x7f8c700fa740 msgr2=0x7f8c700fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.994+0000 7f8c781ed700 1 -- 172.21.15.69:0/1979794290 shutdown_connections 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.994+0000 7f8c781ed700 1 -- 172.21.15.69:0/1979794290 wait complete. 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c781ed700 1 Processor -- start 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c781ed700 1 -- start start 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c781ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100ca0 0x7f8c70195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c781ed700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c701035c0 0x7f8c70196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c781ed700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 0x7f8c7019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c781ed700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7019db70 con 0x7f8c70105ee0 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c781ed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7019dcb0 con 0x7f8c70100ca0 2023-12-14T14:10:26.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c781ed700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7019de40 con 0x7f8c701035c0 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c7678a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 0x7f8c7019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c7678a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 0x7f8c7019d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54392/0 (socket says 172.21.15.69:54392) 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c7678a700 1 -- 172.21.15.69:0/710996576 learned_addr learned my addr 172.21.15.69:0/710996576 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c75f89700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100ca0 0x7f8c70195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c75788700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c701035c0 0x7f8c70196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c7678a700 1 -- 172.21.15.69:0/710996576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c701035c0 msgr2=0x7f8c70196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c7678a700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c701035c0 0x7f8c70196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c7678a700 1 -- 172.21.15.69:0/710996576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100ca0 msgr2=0x7f8c70195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c7678a700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100ca0 0x7f8c70195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c7678a700 1 -- 172.21.15.69:0/710996576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60009d00 con 0x7f8c70105ee0 2023-12-14T14:10:27.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c75f89700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100ca0 0x7f8c70195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:27.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c7678a700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 0x7f8c7019d5a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c600062a0 tx=0x7f8c60004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:27.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.995+0000 7f8c6effd700 1 -- 172.21.15.69:0/710996576 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000e040 con 0x7f8c70105ee0 2023-12-14T14:10:27.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.996+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7010bbe0 con 0x7f8c70105ee0 2023-12-14T14:10:27.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.996+0000 7f8c6effd700 1 -- 172.21.15.69:0/710996576 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c6001db50 con 0x7f8c70105ee0 2023-12-14T14:10:27.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.996+0000 7f8c6effd700 1 -- 172.21.15.69:0/710996576 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6001bc40 con 0x7f8c70105ee0 2023-12-14T14:10:27.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.996+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7010ba50 con 0x7f8c70105ee0 2023-12-14T14:10:27.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.996+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700fc2b0 con 0x7f8c70105ee0 2023-12-14T14:10:27.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.998+0000 7f8c6effd700 1 -- 172.21.15.69:0/710996576 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8c6001d690 con 0x7f8c70105ee0 2023-12-14T14:10:27.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.998+0000 7f8c6effd700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8c580a1260 0x7f8c580a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:27.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.998+0000 7f8c75f89700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8c580a1260 0x7f8c580a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.998+0000 7f8c6effd700 1 -- 172.21.15.69:0/710996576 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f8c600ceaf0 con 0x7f8c70105ee0 2023-12-14T14:10:27.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:26.999+0000 7f8c75f89700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8c580a1260 0x7f8c580a3710 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8c68005950 tx=0x7f8c680058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:27.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.001+0000 7f8c6effd700 1 -- 172.21.15.69:0/710996576 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8c60098270 con 0x7f8c70105ee0 2023-12-14T14:10:27.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:26 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3837747881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:27.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:26 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2112872870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:26 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1520678638' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:27.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:26 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3837747881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:27.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:26 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2112872870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:27.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:26 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1520678638' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:27.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.190+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c70067e40 con 0x7f8c70105ee0 2023-12-14T14:10:27.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.190+0000 7f8c6effd700 1 -- 172.21.15.69:0/710996576 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c6009b890 con 0x7f8c70105ee0 2023-12-14T14:10:27.190 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T14:10:27.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8c580a1260 msgr2=0x7f8c580a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8c580a1260 0x7f8c580a3710 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8c68005950 tx=0x7f8c680058e0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 msgr2=0x7f8c7019d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 0x7f8c7019d5a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c600062a0 tx=0x7f8c60004db0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 shutdown_connections 2023-12-14T14:10:27.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f8c580a1260 0x7f8c580a3710 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c70105ee0 0x7f8c7019d5a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100ca0 0x7f8c70195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 --2- 172.21.15.69:0/710996576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c701035c0 0x7f8c70196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 >> 172.21.15.69:0/710996576 conn(0x7f8c700fa740 msgr2=0x7f8c70101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:27.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 shutdown_connections 2023-12-14T14:10:27.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.192+0000 7f8c781ed700 1 -- 172.21.15.69:0/710996576 wait complete. 2023-12-14T14:10:27.205 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-12-14T14:10:27.205 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:10:27.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.328+0000 7f61b644f700 1 -- 172.21.15.69:0/102466591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b00fec40 msgr2=0x7f61b0108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.328+0000 7f61b644f700 1 --2- 172.21.15.69:0/102466591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b00fec40 0x7f61b0108800 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f61a800b0a0 tx=0x7f61a800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.328+0000 7f61b644f700 1 -- 172.21.15.69:0/102466591 shutdown_connections 2023-12-14T14:10:27.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.328+0000 7f61b644f700 1 --2- 172.21.15.69:0/102466591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b00fec40 0x7f61b0108800 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.328+0000 7f61b644f700 1 --2- 172.21.15.69:0/102466591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b0101820 0x7f61b0101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.328+0000 7f61b644f700 1 --2- 172.21.15.69:0/102466591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b00fe290 0x7f61b00fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.328+0000 7f61b644f700 1 -- 172.21.15.69:0/102466591 >> 172.21.15.69:0/102466591 conn(0x7f61b00f9e80 msgr2=0x7f61b00fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.328+0000 7f61b644f700 1 -- 172.21.15.69:0/102466591 shutdown_connections 2023-12-14T14:10:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.328+0000 7f61b644f700 1 -- 172.21.15.69:0/102466591 wait complete. 2023-12-14T14:10:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b644f700 1 Processor -- start 2023-12-14T14:10:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b644f700 1 -- start start 2023-12-14T14:10:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b644f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b00fe290 0x7f61b01960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b644f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b00fec40 0x7f61b0196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b644f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b0101820 0x7f61b019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b644f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b019dc60 con 0x7f61b0101820 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b644f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b019dda0 con 0x7f61b00fec40 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b644f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b019df30 con 0x7f61b00fe290 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b49ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b0101820 0x7f61b019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b49ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b0101820 0x7f61b019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54404/0 (socket says 172.21.15.69:54404) 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61b49ec700 1 -- 172.21.15.69:0/1993524493 learned_addr learned my addr 172.21.15.69:0/1993524493 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61af7fe700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b00fec40 0x7f61b0196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.329+0000 7f61affff700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b00fe290 0x7f61b01960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61b49ec700 1 -- 172.21.15.69:0/1993524493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b00fe290 msgr2=0x7f61b01960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61b49ec700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b00fe290 0x7f61b01960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61b49ec700 1 -- 172.21.15.69:0/1993524493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b00fec40 msgr2=0x7f61b0196620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61b49ec700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b00fec40 0x7f61b0196620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61b49ec700 1 -- 172.21.15.69:0/1993524493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8009d00 con 0x7f61b0101820 2023-12-14T14:10:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61affff700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b00fe290 0x7f61b01960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61b49ec700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b0101820 0x7f61b019d690 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f61a800b070 tx=0x7f61a8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61ad7fa700 1 -- 172.21.15.69:0/1993524493 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800e040 con 0x7f61b0101820 2023-12-14T14:10:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61ad7fa700 1 -- 172.21.15.69:0/1993524493 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61a8004e80 con 0x7f61b0101820 2023-12-14T14:10:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61ad7fa700 1 -- 172.21.15.69:0/1993524493 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a801b6b0 con 0x7f61b0101820 2023-12-14T14:10:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b010bbf0 con 0x7f61b0101820 2023-12-14T14:10:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.330+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b010ba60 con 0x7f61b0101820 2023-12-14T14:10:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.331+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b0067160 con 0x7f61b0101820 2023-12-14T14:10:27.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.332+0000 7f61ad7fa700 1 -- 172.21.15.69:0/1993524493 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f61a8003a00 con 0x7f61b0101820 2023-12-14T14:10:27.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.332+0000 7f61ad7fa700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f619c0a11e0 0x7f619c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:27.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.333+0000 7f61affff700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f619c0a11e0 0x7f619c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.333+0000 7f61ad7fa700 1 -- 172.21.15.69:0/1993524493 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f61a80cdff0 con 0x7f61b0101820 2023-12-14T14:10:27.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.333+0000 7f61affff700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f619c0a11e0 0x7f619c0a3690 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005fd0 tx=0x7f61a0005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:27.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.337+0000 7f61ad7fa700 1 -- 172.21.15.69:0/1993524493 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f61a8100730 con 0x7f61b0101820 2023-12-14T14:10:27.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.568+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61b01072e0 con 0x7f61b0101820 2023-12-14T14:10:27.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.569+0000 7f61ad7fa700 1 -- 172.21.15.69:0/1993524493 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f61a8097690 con 0x7f61b0101820 2023-12-14T14:10:27.569 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:27.569 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:10:27.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.570+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f619c0a11e0 msgr2=0x7f619c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f619c0a11e0 0x7f619c0a3690 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005fd0 tx=0x7f61a0005f00 comp rx=0 tx=0).stop 2023-12-14T14:10:27.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b0101820 msgr2=0x7f61b019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b0101820 0x7f61b019d690 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f61a800b070 tx=0x7f61a8004a50 comp rx=0 tx=0).stop 2023-12-14T14:10:27.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 shutdown_connections 2023-12-14T14:10:27.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f619c0a11e0 0x7f619c0a3690 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61b0101820 0x7f61b019d690 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b00fe290 0x7f61b01960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 --2- 172.21.15.69:0/1993524493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b00fec40 0x7f61b0196620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 >> 172.21.15.69:0/1993524493 conn(0x7f61b00f9e80 msgr2=0x7f61b00fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:27.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 shutdown_connections 2023-12-14T14:10:27.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.571+0000 7f61b644f700 1 -- 172.21.15.69:0/1993524493 wait complete. 2023-12-14T14:10:27.573 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:10:27.584 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-12-14T14:10:27.584 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-12-14T14:10:27.584 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T14:10:27.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.706+0000 7fbaf8d42700 1 -- 172.21.15.69:0/3338063679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 msgr2=0x7fbaf40ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.706+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/3338063679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 0x7fbaf40ff520 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbae400b0a0 tx=0x7fbae400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.706+0000 7fbaf8d42700 1 -- 172.21.15.69:0/3338063679 shutdown_connections 2023-12-14T14:10:27.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.706+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/3338063679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf4100c90 0x7fbaf4107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.706+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/3338063679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 0x7fbaf40ff520 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.706+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/3338063679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf4100300 0x7fbaf4100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.706+0000 7fbaf8d42700 1 -- 172.21.15.69:0/3338063679 >> 172.21.15.69:0/3338063679 conn(0x7fbaf40fa6f0 msgr2=0x7fbaf40fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:27.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 -- 172.21.15.69:0/3338063679 shutdown_connections 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 -- 172.21.15.69:0/3338063679 wait complete. 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 Processor -- start 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 -- start start 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 0x7fbaf4196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf4100300 0x7fbaf4196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf4100c90 0x7fbaf419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf419dcc0 con 0x7fbaf40ff110 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf419de00 con 0x7fbaf4100300 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.707+0000 7fbaf8d42700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf419df90 con 0x7fbaf4100c90 2023-12-14T14:10:27.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 0x7fbaf4196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 0x7fbaf4196140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54424/0 (socket says 172.21.15.69:54424) 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf259c700 1 -- 172.21.15.69:0/1235282994 learned_addr learned my addr 172.21.15.69:0/1235282994 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf2d9d700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf4100c90 0x7fbaf419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf1d9b700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf4100300 0x7fbaf4196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf259c700 1 -- 172.21.15.69:0/1235282994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf4100c90 msgr2=0x7fbaf419d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf259c700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf4100c90 0x7fbaf419d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf259c700 1 -- 172.21.15.69:0/1235282994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf4100300 msgr2=0x7fbaf4196680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf259c700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf4100300 0x7fbaf4196680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf259c700 1 -- 172.21.15.69:0/1235282994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae4009d00 con 0x7fbaf40ff110 2023-12-14T14:10:27.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf259c700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 0x7fbaf4196140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbae4004d00 tx=0x7fbae4004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:27.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaeb7fe700 1 -- 172.21.15.69:0/1235282994 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae400e040 con 0x7fbaf40ff110 2023-12-14T14:10:27.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf410aa70 con 0x7fbaf40ff110 2023-12-14T14:10:27.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaeb7fe700 1 -- 172.21.15.69:0/1235282994 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbae401db50 con 0x7fbaf40ff110 2023-12-14T14:10:27.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaeb7fe700 1 -- 172.21.15.69:0/1235282994 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae401bb90 con 0x7fbaf40ff110 2023-12-14T14:10:27.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.708+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf410a8e0 con 0x7fbaf40ff110 2023-12-14T14:10:27.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.709+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf40679f0 con 0x7fbaf40ff110 2023-12-14T14:10:27.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.710+0000 7fbaeb7fe700 1 -- 172.21.15.69:0/1235282994 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fbae401bcf0 con 0x7fbaf40ff110 2023-12-14T14:10:27.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.711+0000 7fbaeb7fe700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbae00a11e0 0x7fbae00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:27.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.711+0000 7fbaf1d9b700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbae00a11e0 0x7fbae00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:27.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.711+0000 7fbaeb7fe700 1 -- 172.21.15.69:0/1235282994 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fbae40cef90 con 0x7fbaf40ff110 2023-12-14T14:10:27.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.711+0000 7fbaf1d9b700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbae00a11e0 0x7fbae00a3690 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbadc005950 tx=0x7fbadc00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:27.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.714+0000 7fbaeb7fe700 1 -- 172.21.15.69:0/1235282994 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fbae4098710 con 0x7fbaf40ff110 2023-12-14T14:10:27.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:27 smithi069 ceph-mon[42034]: pgmap v262: 97 pgs: 97 active+clean; 640 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-14T14:10:27.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:27 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/125711982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:27.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:27 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/710996576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:27.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:27 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1993524493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:27.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.898+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbaf419ea00 con 0x7fbae00a11e0 2023-12-14T14:10:27.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.909+0000 7fbaeb7fe700 1 -- 172.21.15.69:0/1235282994 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344922 (secure 0 0 0) 0x7fbaf419ea00 con 0x7fbae00a11e0 2023-12-14T14:10:27.914 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:27.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbae00a11e0 msgr2=0x7fbae00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbae00a11e0 0x7fbae00a3690 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbadc005950 tx=0x7fbadc00a300 comp rx=0 tx=0).stop 2023-12-14T14:10:27.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 msgr2=0x7fbaf4196140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:27.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 0x7fbaf4196140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbae4004d00 tx=0x7fbae4004d30 comp rx=0 tx=0).stop 2023-12-14T14:10:27.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 shutdown_connections 2023-12-14T14:10:27.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fbae00a11e0 0x7fbae00a3690 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf4100c90 0x7fbaf419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf40ff110 0x7fbaf4196140 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 --2- 172.21.15.69:0/1235282994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf4100300 0x7fbaf4196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:27.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 >> 172.21.15.69:0/1235282994 conn(0x7fbaf40fa6f0 msgr2=0x7fbaf4067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:27.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 shutdown_connections 2023-12-14T14:10:27.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:27.912+0000 7fbaf8d42700 1 -- 172.21.15.69:0/1235282994 wait complete. 2023-12-14T14:10:27.920 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T14:10:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-12-14T14:10:26.621649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655789,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":586,"num_read_kb":412,"num_write":336,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":78976,"kb_used_data":11168,"kb_used_omap":0,"kb_used_meta":67712,"kb_avail":1124862848,"statfs":{"total":1151940427776,"available":1151859556352,"internally_reserved":0,"allocated":11436032,"data_stored":7243557,"data_compressed":107034,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":69337088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4640,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":45,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002821"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532076+0000","last_change":"2023-12-14T14:09:10.621884+0000","last_active":"2023-12-14T14:10:12.532076+0000","last_peered":"2023-12-14T14:10:12.532076+0000","last_clean":"2023-12-14T14:10:12.532076+0000","last_became_active":"2023-12-14T14:09:10.621605+0000","last_became_peered":"2023-12-14T14:09:10.621605+0000","last_unstale":"2023-12-14T14:10:12.532076+0000","last_undegraded":"2023-12-14T14:10:12.532076+0000","last_fullsized":"2023-12-14T14:10:12.532076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:13:21.636751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797344+0000","last_change":"2023-12-14T14:09:10.621555+0000","last_active":"2023-12-14T14:10:12.797344+0000","last_peered":"2023-12-14T14:10:12.797344+0000","last_clean":"2023-12-14T14:10:12.797344+0000","last_became_active":"2023-12-14T14:09:10.621265+0000","last_became_peered":"2023-12-14T14:09:10.621265+0000","last_unstale":"2023-12-14T14:10:12.797344+0000","last_undegraded":"2023-12-14T14:10:12.797344+0000","last_fullsized":"2023-12-14T14:10:12.797344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:15:38.893983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797176+0000","last_change":"2023-12-14T14:09:10.623575+0000","last_active":"2023-12-14T14:10:12.797176+0000","last_peered":"2023-12-14T14:10:12.797176+0000","last_clean":"2023-12-14T14:10:12.797176+0000","last_became_active":"2023-12-14T14:09:10.623289+0000","last_became_peered":"2023-12-14T14:09:10.623289+0000","last_unstale":"2023-12-14T14:10:12.797176+0000","last_undegraded":"2023-12-14T14:10:12.797176+0000","last_fullsized":"2023-12-14T14:10:12.797176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:55:02.118265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.756057+0000","last_change":"2023-12-14T14:09:10.622850+0000","last_active":"2023-12-14T14:10:12.756057+0000","last_peered":"2023-12-14T14:10:12.756057+0000","last_clean":"2023-12-14T14:10:12.756057+0000","last_became_active":"2023-12-14T14:09:10.622456+0000","last_became_peered":"2023-12-14T14:09:10.622456+0000","last_unstale":"2023-12-14T14:10:12.756057+0000","last_undegraded":"2023-12-14T14:10:12.756057+0000","last_fullsized":"2023-12-14T14:10:12.756057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:34.391111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532476+0000","last_change":"2023-12-14T14:09:10.623459+0000","last_active":"2023-12-14T14:10:12.532476+0000","last_peered":"2023-12-14T14:10:12.532476+0000","last_clean":"2023-12-14T14:10:12.532476+0000","last_became_active":"2023-12-14T14:09:10.623100+0000","last_became_peered":"2023-12-14T14:09:10.623100+0000","last_unstale":"2023-12-14T14:10:12.532476+0000","last_undegraded":"2023-12-14T14:10:12.532476+0000","last_fullsized":"2023-12-14T14:10:12.532476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:41:35.772179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527620+0000","last_change":"2023-12-14T14:09:10.624663+0000","last_active":"2023-12-14T14:10:12.527620+0000","last_peered":"2023-12-14T14:10:12.527620+0000","last_clean":"2023-12-14T14:10:12.527620+0000","last_became_active":"2023-12-14T14:09:10.624313+0000","last_became_peered":"2023-12-14T14:09:10.624313+0000","last_unstale":"2023-12-14T14:10:12.527620+0000","last_undegraded":"2023-12-14T14:10:12.527620+0000","last_fullsized":"2023-12-14T14:10:12.527620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:11:53.666252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532221+0000","last_change":"2023-12-14T14:09:10.622519+0000","last_active":"2023-12-14T14:10:12.532221+0000","last_peered":"2023-12-14T14:10:12.532221+0000","last_clean":"2023-12-14T14:10:12.532221+0000","last_became_active":"2023-12-14T14:09:10.622147+0000","last_became_peered":"2023-12-14T14:09:10.622147+0000","last_unstale":"2023-12-14T14:10:12.532221+0000","last_undegraded":"2023-12-14T14:10:12.532221+0000","last_fullsized":"2023-12-14T14:10:12.532221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:09:52.043290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529021+0000","last_change":"2023-12-14T14:09:10.622762+0000","last_active":"2023-12-14T14:10:12.529021+0000","last_peered":"2023-12-14T14:10:12.529021+0000","last_clean":"2023-12-14T14:10:12.529021+0000","last_became_active":"2023-12-14T14:09:10.622199+0000","last_became_peered":"2023-12-14T14:09:10.622199+0000","last_unstale":"2023-12-14T14:10:12.529021+0000","last_undegraded":"2023-12-14T14:10:12.529021+0000","last_fullsized":"2023-12-14T14:10:12.529021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:14:39.472497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053278+0000","last_change":"2023-12-14T14:09:10.625452+0000","last_active":"2023-12-14T14:10:13.053278+0000","last_peered":"2023-12-14T14:10:13.053278+0000","last_clean":"2023-12-14T14:10:13.053278+0000","last_became_active":"2023-12-14T14:09:10.620053+0000","last_became_peered":"2023-12-14T14:09:10.620053+0000","last_unstale":"2023-12-14T14:10:13.053278+0000","last_undegraded":"2023-12-14T14:10:13.053278+0000","last_fullsized":"2023-12-14T14:10:13.053278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:02:57.280143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531872+0000","last_change":"2023-12-14T14:10:12.531872+0000","last_active":"2023-12-14T14:10:12.531872+0000","last_peered":"2023-12-14T14:10:12.531872+0000","last_clean":"2023-12-14T14:10:12.531872+0000","last_became_active":"2023-12-14T14:10:12.531403+0000","last_became_peered":"2023-12-14T14:10:12.531403+0000","last_unstale":"2023-12-14T14:10:12.531872+0000","last_undegraded":"2023-12-14T14:10:12.531872+0000","last_fullsized":"2023-12-14T14:10:12.531872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:02:30.699926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532807+0000","last_change":"2023-12-14T14:09:10.633572+0000","last_active":"2023-12-14T14:10:12.532807+0000","last_peered":"2023-12-14T14:10:12.532807+0000","last_clean":"2023-12-14T14:10:12.532807+0000","last_became_active":"2023-12-14T14:09:10.633251+0000","last_became_peered":"2023-12-14T14:09:10.633251+0000","last_unstale":"2023-12-14T14:10:12.532807+0000","last_undegraded":"2023-12-14T14:10:12.532807+0000","last_fullsized":"2023-12-14T14:10:12.532807+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:06:59.990535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.756083+0000","last_change":"2023-12-14T14:09:10.630621+0000","last_active":"2023-12-14T14:10:12.756083+0000","last_peered":"2023-12-14T14:10:12.756083+0000","last_clean":"2023-12-14T14:10:12.756083+0000","last_became_active":"2023-12-14T14:09:10.630196+0000","last_became_peered":"2023-12-14T14:09:10.630196+0000","last_unstale":"2023-12-14T14:10:12.756083+0000","last_undegraded":"2023-12-14T14:10:12.756083+0000","last_fullsized":"2023-12-14T14:10:12.756083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:44.623922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526232+0000","last_change":"2023-12-14T14:09:10.617111+0000","last_active":"2023-12-14T14:10:12.526232+0000","last_peered":"2023-12-14T14:10:12.526232+0000","last_clean":"2023-12-14T14:10:12.526232+0000","last_became_active":"2023-12-14T14:09:10.616817+0000","last_became_peered":"2023-12-14T14:09:10.616817+0000","last_unstale":"2023-12-14T14:10:12.526232+0000","last_undegraded":"2023-12-14T14:10:12.526232+0000","last_fullsized":"2023-12-14T14:10:12.526232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:54:30.750020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797080+0000","last_change":"2023-12-14T14:09:10.620373+0000","last_active":"2023-12-14T14:10:12.797080+0000","last_peered":"2023-12-14T14:10:12.797080+0000","last_clean":"2023-12-14T14:10:12.797080+0000","last_became_active":"2023-12-14T14:09:10.620107+0000","last_became_peered":"2023-12-14T14:09:10.620107+0000","last_unstale":"2023-12-14T14:10:12.797080+0000","last_undegraded":"2023-12-14T14:10:12.797080+0000","last_fullsized":"2023-12-14T14:10:12.797080+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:26:50.872125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.796958+0000","last_change":"2023-12-14T14:09:10.624554+0000","last_active":"2023-12-14T14:10:12.796958+0000","last_peered":"2023-12-14T14:10:12.796958+0000","last_clean":"2023-12-14T14:10:12.796958+0000","last_became_active":"2023-12-14T14:09:10.624255+0000","last_became_peered":"2023-12-14T14:09:10.624255+0000","last_unstale":"2023-12-14T14:10:12.796958+0000","last_undegraded":"2023-12-14T14:10:12.796958+0000","last_fullsized":"2023-12-14T14:10:12.796958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:00:42.644826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.052691+0000","last_change":"2023-12-14T14:09:10.632464+0000","last_active":"2023-12-14T14:10:13.052691+0000","last_peered":"2023-12-14T14:10:13.052691+0000","last_clean":"2023-12-14T14:10:13.052691+0000","last_became_active":"2023-12-14T14:09:10.632102+0000","last_became_peered":"2023-12-14T14:09:10.632102+0000","last_unstale":"2023-12-14T14:10:13.052691+0000","last_undegraded":"2023-12-14T14:10:13.052691+0000","last_fullsized":"2023-12-14T14:10:13.052691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:56:36.034298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532334+0000","last_change":"2023-12-14T14:09:10.619144+0000","last_active":"2023-12-14T14:10:12.532334+0000","last_peered":"2023-12-14T14:10:12.532334+0000","last_clean":"2023-12-14T14:10:12.532334+0000","last_became_active":"2023-12-14T14:09:10.618833+0000","last_became_peered":"2023-12-14T14:09:10.618833+0000","last_unstale":"2023-12-14T14:10:12.532334+0000","last_undegraded":"2023-12-14T14:10:12.532334+0000","last_fullsized":"2023-12-14T14:10:12.532334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:56:11.786123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529939+0000","last_change":"2023-12-14T14:09:10.619062+0000","last_active":"2023-12-14T14:10:12.529939+0000","last_peered":"2023-12-14T14:10:12.529939+0000","last_clean":"2023-12-14T14:10:12.529939+0000","last_became_active":"2023-12-14T14:09:10.618750+0000","last_became_peered":"2023-12-14T14:09:10.618750+0000","last_unstale":"2023-12-14T14:10:12.529939+0000","last_undegraded":"2023-12-14T14:10:12.529939+0000","last_fullsized":"2023-12-14T14:10:12.529939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:23:35.700718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529301+0000","last_change":"2023-12-14T14:09:10.621410+0000","last_active":"2023-12-14T14:10:12.529301+0000","last_peered":"2023-12-14T14:10:12.529301+0000","last_clean":"2023-12-14T14:10:12.529301+0000","last_became_active":"2023-12-14T14:09:10.621037+0000","last_became_peered":"2023-12-14T14:09:10.621037+0000","last_unstale":"2023-12-14T14:10:12.529301+0000","last_undegraded":"2023-12-14T14:10:12.529301+0000","last_fullsized":"2023-12-14T14:10:12.529301+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:45:37.270156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529264+0000","last_change":"2023-12-14T14:09:10.218180+0000","last_active":"2023-12-14T14:10:12.529264+0000","last_peered":"2023-12-14T14:10:12.529264+0000","last_clean":"2023-12-14T14:10:12.529264+0000","last_became_active":"2023-12-14T14:09:10.217856+0000","last_became_peered":"2023-12-14T14:09:10.217856+0000","last_unstale":"2023-12-14T14:10:12.529264+0000","last_undegraded":"2023-12-14T14:10:12.529264+0000","last_fullsized":"2023-12-14T14:10:12.529264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:26:00.815008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528782+0000","last_change":"2023-12-14T14:09:10.628500+0000","last_active":"2023-12-14T14:10:12.528782+0000","last_peered":"2023-12-14T14:10:12.528782+0000","last_clean":"2023-12-14T14:10:12.528782+0000","last_became_active":"2023-12-14T14:09:10.628120+0000","last_became_peered":"2023-12-14T14:09:10.628120+0000","last_unstale":"2023-12-14T14:10:12.528782+0000","last_undegraded":"2023-12-14T14:10:12.528782+0000","last_fullsized":"2023-12-14T14:10:12.528782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:03:26.435929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528916+0000","last_change":"2023-12-14T14:09:10.218608+0000","last_active":"2023-12-14T14:10:12.528916+0000","last_peered":"2023-12-14T14:10:12.528916+0000","last_clean":"2023-12-14T14:10:12.528916+0000","last_became_active":"2023-12-14T14:09:10.218010+0000","last_became_peered":"2023-12-14T14:09:10.218010+0000","last_unstale":"2023-12-14T14:10:12.528916+0000","last_undegraded":"2023-12-14T14:10:12.528916+0000","last_fullsized":"2023-12-14T14:10:12.528916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:15:03.256341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797697+0000","last_change":"2023-12-14T14:09:10.621972+0000","last_active":"2023-12-14T14:10:12.797697+0000","last_peered":"2023-12-14T14:10:12.797697+0000","last_clean":"2023-12-14T14:10:12.797697+0000","last_became_active":"2023-12-14T14:09:10.621685+0000","last_became_peered":"2023-12-14T14:09:10.621685+0000","last_unstale":"2023-12-14T14:10:12.797697+0000","last_undegraded":"2023-12-14T14:10:12.797697+0000","last_fullsized":"2023-12-14T14:10:12.797697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:44:15.717843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.537829+0000","last_change":"2023-12-14T14:10:12.537432+0000","last_active":"2023-12-14T14:10:12.537829+0000","last_peered":"2023-12-14T14:10:12.537829+0000","last_clean":"2023-12-14T14:10:12.537829+0000","last_became_active":"2023-12-14T14:10:12.533574+0000","last_became_peered":"2023-12-14T14:10:12.533574+0000","last_unstale":"2023-12-14T14:10:12.537829+0000","last_undegraded":"2023-12-14T14:10:12.537829+0000","last_fullsized":"2023-12-14T14:10:12.537829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:37:38.449011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.052828+0000","last_change":"2023-12-14T14:09:10.626807+0000","last_active":"2023-12-14T14:10:13.052828+0000","last_peered":"2023-12-14T14:10:13.052828+0000","last_clean":"2023-12-14T14:10:13.052828+0000","last_became_active":"2023-12-14T14:09:10.626450+0000","last_became_peered":"2023-12-14T14:09:10.626450+0000","last_unstale":"2023-12-14T14:10:13.052828+0000","last_undegraded":"2023-12-14T14:10:13.052828+0000","last_fullsized":"2023-12-14T14:10:13.052828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:23:25.897586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532714+0000","last_change":"2023-12-14T14:09:10.216515+0000","last_active":"2023-12-14T14:10:12.532714+0000","last_peered":"2023-12-14T14:10:12.532714+0000","last_clean":"2023-12-14T14:10:12.532714+0000","last_became_active":"2023-12-14T14:09:10.216175+0000","last_became_peered":"2023-12-14T14:09:10.216175+0000","last_unstale":"2023-12-14T14:10:12.532714+0000","last_undegraded":"2023-12-14T14:10:12.532714+0000","last_fullsized":"2023-12-14T14:10:12.532714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:44:37.478657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527359+0000","last_change":"2023-12-14T14:09:10.627664+0000","last_active":"2023-12-14T14:10:12.527359+0000","last_peered":"2023-12-14T14:10:12.527359+0000","last_clean":"2023-12-14T14:10:12.527359+0000","last_became_active":"2023-12-14T14:09:10.627376+0000","last_became_peered":"2023-12-14T14:09:10.627376+0000","last_unstale":"2023-12-14T14:10:12.527359+0000","last_undegraded":"2023-12-14T14:10:12.527359+0000","last_fullsized":"2023-12-14T14:10:12.527359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:42:59.235684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":97,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:23.910449+0000","last_change":"2023-12-14T14:09:10.218806+0000","last_active":"2023-12-14T14:10:23.910449+0000","last_peered":"2023-12-14T14:10:23.910449+0000","last_clean":"2023-12-14T14:10:23.910449+0000","last_became_active":"2023-12-14T14:09:10.218441+0000","last_became_peered":"2023-12-14T14:09:10.218441+0000","last_unstale":"2023-12-14T14:10:23.910449+0000","last_undegraded":"2023-12-14T14:10:23.910449+0000","last_fullsized":"2023-12-14T14:10:23.910449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:12:59.215341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532407+0000","last_change":"2023-12-14T14:09:10.622903+0000","last_active":"2023-12-14T14:10:12.532407+0000","last_peered":"2023-12-14T14:10:12.532407+0000","last_clean":"2023-12-14T14:10:12.532407+0000","last_became_active":"2023-12-14T14:09:10.622261+0000","last_became_peered":"2023-12-14T14:09:10.622261+0000","last_unstale":"2023-12-14T14:10:12.532407+0000","last_undegraded":"2023-12-14T14:10:12.532407+0000","last_fullsized":"2023-12-14T14:10:12.532407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:36:00.934831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527794+0000","last_change":"2023-12-14T14:09:10.222254+0000","last_active":"2023-12-14T14:10:12.527794+0000","last_peered":"2023-12-14T14:10:12.527794+0000","last_clean":"2023-12-14T14:10:12.527794+0000","last_became_active":"2023-12-14T14:09:10.221861+0000","last_became_peered":"2023-12-14T14:09:10.221861+0000","last_unstale":"2023-12-14T14:10:12.527794+0000","last_undegraded":"2023-12-14T14:10:12.527794+0000","last_fullsized":"2023-12-14T14:10:12.527794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:52:59.679865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526998+0000","last_change":"2023-12-14T14:09:10.625646+0000","last_active":"2023-12-14T14:10:12.526998+0000","last_peered":"2023-12-14T14:10:12.526998+0000","last_clean":"2023-12-14T14:10:12.526998+0000","last_became_active":"2023-12-14T14:09:10.625179+0000","last_became_peered":"2023-12-14T14:09:10.625179+0000","last_unstale":"2023-12-14T14:10:12.526998+0000","last_undegraded":"2023-12-14T14:10:12.526998+0000","last_fullsized":"2023-12-14T14:10:12.526998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:52:32.325087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526156+0000","last_change":"2023-12-14T14:09:10.212885+0000","last_active":"2023-12-14T14:10:12.526156+0000","last_peered":"2023-12-14T14:10:12.526156+0000","last_clean":"2023-12-14T14:10:12.526156+0000","last_became_active":"2023-12-14T14:09:10.212311+0000","last_became_peered":"2023-12-14T14:09:10.212311+0000","last_unstale":"2023-12-14T14:10:12.526156+0000","last_undegraded":"2023-12-14T14:10:12.526156+0000","last_fullsized":"2023-12-14T14:10:12.526156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:47:33.645701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528167+0000","last_change":"2023-12-14T14:09:10.620795+0000","last_active":"2023-12-14T14:10:12.528167+0000","last_peered":"2023-12-14T14:10:12.528167+0000","last_clean":"2023-12-14T14:10:12.528167+0000","last_became_active":"2023-12-14T14:09:10.620453+0000","last_became_peered":"2023-12-14T14:09:10.620453+0000","last_unstale":"2023-12-14T14:10:12.528167+0000","last_undegraded":"2023-12-14T14:10:12.528167+0000","last_fullsized":"2023-12-14T14:10:12.528167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:25:31.871417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526686+0000","last_change":"2023-12-14T14:09:10.218969+0000","last_active":"2023-12-14T14:10:12.526686+0000","last_peered":"2023-12-14T14:10:12.526686+0000","last_clean":"2023-12-14T14:10:12.526686+0000","last_became_active":"2023-12-14T14:09:10.218624+0000","last_became_peered":"2023-12-14T14:09:10.218624+0000","last_unstale":"2023-12-14T14:10:12.526686+0000","last_undegraded":"2023-12-14T14:10:12.526686+0000","last_fullsized":"2023-12-14T14:10:12.526686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:33:35.928051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528961+0000","last_change":"2023-12-14T14:09:10.619202+0000","last_active":"2023-12-14T14:10:12.528961+0000","last_peered":"2023-12-14T14:10:12.528961+0000","last_clean":"2023-12-14T14:10:12.528961+0000","last_became_active":"2023-12-14T14:09:10.618944+0000","last_became_peered":"2023-12-14T14:09:10.618944+0000","last_unstale":"2023-12-14T14:10:12.528961+0000","last_undegraded":"2023-12-14T14:10:12.528961+0000","last_fullsized":"2023-12-14T14:10:12.528961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:08:37.692514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:24.911137+0000","last_change":"2023-12-14T14:09:10.214323+0000","last_active":"2023-12-14T14:10:24.911137+0000","last_peered":"2023-12-14T14:10:24.911137+0000","last_clean":"2023-12-14T14:10:24.911137+0000","last_became_active":"2023-12-14T14:09:10.213998+0000","last_became_peered":"2023-12-14T14:09:10.213998+0000","last_unstale":"2023-12-14T14:10:24.911137+0000","last_undegraded":"2023-12-14T14:10:24.911137+0000","last_fullsized":"2023-12-14T14:10:24.911137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:14:15.539169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053191+0000","last_change":"2023-12-14T14:09:10.626967+0000","last_active":"2023-12-14T14:10:13.053191+0000","last_peered":"2023-12-14T14:10:13.053191+0000","last_clean":"2023-12-14T14:10:13.053191+0000","last_became_active":"2023-12-14T14:09:10.626589+0000","last_became_peered":"2023-12-14T14:09:10.626589+0000","last_unstale":"2023-12-14T14:10:13.053191+0000","last_undegraded":"2023-12-14T14:10:13.053191+0000","last_fullsized":"2023-12-14T14:10:13.053191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:12:23.658401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532410+0000","last_change":"2023-12-14T14:09:10.221868+0000","last_active":"2023-12-14T14:10:12.532410+0000","last_peered":"2023-12-14T14:10:12.532410+0000","last_clean":"2023-12-14T14:10:12.532410+0000","last_became_active":"2023-12-14T14:09:10.221378+0000","last_became_peered":"2023-12-14T14:09:10.221378+0000","last_unstale":"2023-12-14T14:10:12.532410+0000","last_undegraded":"2023-12-14T14:10:12.532410+0000","last_fullsized":"2023-12-14T14:10:12.532410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:47:54.286181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797678+0000","last_change":"2023-12-14T14:09:10.630669+0000","last_active":"2023-12-14T14:10:12.797678+0000","last_peered":"2023-12-14T14:10:12.797678+0000","last_clean":"2023-12-14T14:10:12.797678+0000","last_became_active":"2023-12-14T14:09:10.630351+0000","last_became_peered":"2023-12-14T14:09:10.630351+0000","last_unstale":"2023-12-14T14:10:12.797678+0000","last_undegraded":"2023-12-14T14:10:12.797678+0000","last_fullsized":"2023-12-14T14:10:12.797678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:16:52.057368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527392+0000","last_change":"2023-12-14T14:09:10.214352+0000","last_active":"2023-12-14T14:10:12.527392+0000","last_peered":"2023-12-14T14:10:12.527392+0000","last_clean":"2023-12-14T14:10:12.527392+0000","last_became_active":"2023-12-14T14:09:10.213873+0000","last_became_peered":"2023-12-14T14:09:10.213873+0000","last_unstale":"2023-12-14T14:10:12.527392+0000","last_undegraded":"2023-12-14T14:10:12.527392+0000","last_fullsized":"2023-12-14T14:10:12.527392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:12:24.032109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053113+0000","last_change":"2023-12-14T14:09:10.631272+0000","last_active":"2023-12-14T14:10:13.053113+0000","last_peered":"2023-12-14T14:10:13.053113+0000","last_clean":"2023-12-14T14:10:13.053113+0000","last_became_active":"2023-12-14T14:09:10.630923+0000","last_became_peered":"2023-12-14T14:09:10.630923+0000","last_unstale":"2023-12-14T14:10:13.053113+0000","last_undegraded":"2023-12-14T14:10:13.053113+0000","last_fullsized":"2023-12-14T14:10:13.053113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:36:17.731850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'30","reported_seq":199,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:25.926137+0000","last_change":"2023-12-14T14:09:10.219006+0000","last_active":"2023-12-14T14:10:25.926137+0000","last_peered":"2023-12-14T14:10:25.926137+0000","last_clean":"2023-12-14T14:10:25.926137+0000","last_became_active":"2023-12-14T14:09:10.218694+0000","last_became_peered":"2023-12-14T14:09:10.218694+0000","last_unstale":"2023-12-14T14:10:25.926137+0000","last_undegraded":"2023-12-14T14:10:25.926137+0000","last_fullsized":"2023-12-14T14:10:25.926137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:29:19.743817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60881,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":133,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532873+0000","last_change":"2023-12-14T14:09:10.624056+0000","last_active":"2023-12-14T14:10:12.532873+0000","last_peered":"2023-12-14T14:10:12.532873+0000","last_clean":"2023-12-14T14:10:12.532873+0000","last_became_active":"2023-12-14T14:09:10.623622+0000","last_became_peered":"2023-12-14T14:09:10.623622+0000","last_unstale":"2023-12-14T14:10:12.532873+0000","last_undegraded":"2023-12-14T14:10:12.532873+0000","last_fullsized":"2023-12-14T14:10:12.532873+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:19:03.814303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529190+0000","last_change":"2023-12-14T14:09:10.215236+0000","last_active":"2023-12-14T14:10:12.529190+0000","last_peered":"2023-12-14T14:10:12.529190+0000","last_clean":"2023-12-14T14:10:12.529190+0000","last_became_active":"2023-12-14T14:09:10.214941+0000","last_became_peered":"2023-12-14T14:09:10.214941+0000","last_unstale":"2023-12-14T14:10:12.529190+0000","last_undegraded":"2023-12-14T14:10:12.529190+0000","last_fullsized":"2023-12-14T14:10:12.529190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:47:43.869792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.525888+0000","last_change":"2023-12-14T14:09:10.625352+0000","last_active":"2023-12-14T14:10:12.525888+0000","last_peered":"2023-12-14T14:10:12.525888+0000","last_clean":"2023-12-14T14:10:12.525888+0000","last_became_active":"2023-12-14T14:09:10.625037+0000","last_became_peered":"2023-12-14T14:09:10.625037+0000","last_unstale":"2023-12-14T14:10:12.525888+0000","last_undegraded":"2023-12-14T14:10:12.525888+0000","last_fullsized":"2023-12-14T14:10:12.525888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:33:04.723063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527360+0000","last_change":"2023-12-14T14:09:10.219028+0000","last_active":"2023-12-14T14:10:12.527360+0000","last_peered":"2023-12-14T14:10:12.527360+0000","last_clean":"2023-12-14T14:10:12.527360+0000","last_became_active":"2023-12-14T14:09:10.218687+0000","last_became_peered":"2023-12-14T14:09:10.218687+0000","last_unstale":"2023-12-14T14:10:12.527360+0000","last_undegraded":"2023-12-14T14:10:12.527360+0000","last_fullsized":"2023-12-14T14:10:12.527360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:17:39.685837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532414+0000","last_change":"2023-12-14T14:09:10.623660+0000","last_active":"2023-12-14T14:10:12.532414+0000","last_peered":"2023-12-14T14:10:12.532414+0000","last_clean":"2023-12-14T14:10:12.532414+0000","last_became_active":"2023-12-14T14:09:10.623321+0000","last_became_peered":"2023-12-14T14:09:10.623321+0000","last_unstale":"2023-12-14T14:10:12.532414+0000","last_undegraded":"2023-12-14T14:10:12.532414+0000","last_fullsized":"2023-12-14T14:10:12.532414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:32:49.708710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:22.908002+0000","last_change":"2023-12-14T14:09:10.217849+0000","last_active":"2023-12-14T14:10:22.908002+0000","last_peered":"2023-12-14T14:10:22.908002+0000","last_clean":"2023-12-14T14:10:22.908002+0000","last_became_active":"2023-12-14T14:09:10.217501+0000","last_became_peered":"2023-12-14T14:09:10.217501+0000","last_unstale":"2023-12-14T14:10:22.908002+0000","last_undegraded":"2023-12-14T14:10:22.908002+0000","last_fullsized":"2023-12-14T14:10:22.908002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:30:18.337627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532002+0000","last_change":"2023-12-14T14:09:10.627193+0000","last_active":"2023-12-14T14:10:12.532002+0000","last_peered":"2023-12-14T14:10:12.532002+0000","last_clean":"2023-12-14T14:10:12.532002+0000","last_became_active":"2023-12-14T14:09:10.626887+0000","last_became_peered":"2023-12-14T14:09:10.626887+0000","last_unstale":"2023-12-14T14:10:12.532002+0000","last_undegraded":"2023-12-14T14:10:12.532002+0000","last_fullsized":"2023-12-14T14:10:12.532002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:21:20.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532277+0000","last_change":"2023-12-14T14:09:10.220564+0000","last_active":"2023-12-14T14:10:12.532277+0000","last_peered":"2023-12-14T14:10:12.532277+0000","last_clean":"2023-12-14T14:10:12.532277+0000","last_became_active":"2023-12-14T14:09:10.219921+0000","last_became_peered":"2023-12-14T14:09:10.219921+0000","last_unstale":"2023-12-14T14:10:12.532277+0000","last_undegraded":"2023-12-14T14:10:12.532277+0000","last_fullsized":"2023-12-14T14:10:12.532277+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:08:02.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526837+0000","last_change":"2023-12-14T14:09:10.625056+0000","last_active":"2023-12-14T14:10:12.526837+0000","last_peered":"2023-12-14T14:10:12.526837+0000","last_clean":"2023-12-14T14:10:12.526837+0000","last_became_active":"2023-12-14T14:09:10.624626+0000","last_became_peered":"2023-12-14T14:09:10.624626+0000","last_unstale":"2023-12-14T14:10:12.526837+0000","last_undegraded":"2023-12-14T14:10:12.526837+0000","last_fullsized":"2023-12-14T14:10:12.526837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:35:00.124910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.533020+0000","last_change":"2023-12-14T14:09:10.215413+0000","last_active":"2023-12-14T14:10:12.533020+0000","last_peered":"2023-12-14T14:10:12.533020+0000","last_clean":"2023-12-14T14:10:12.533020+0000","last_became_active":"2023-12-14T14:09:10.214925+0000","last_became_peered":"2023-12-14T14:09:10.214925+0000","last_unstale":"2023-12-14T14:10:12.533020+0000","last_undegraded":"2023-12-14T14:10:12.533020+0000","last_fullsized":"2023-12-14T14:10:12.533020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:00:34.365885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531792+0000","last_change":"2023-12-14T14:09:10.629879+0000","last_active":"2023-12-14T14:10:12.531792+0000","last_peered":"2023-12-14T14:10:12.531792+0000","last_clean":"2023-12-14T14:10:12.531792+0000","last_became_active":"2023-12-14T14:09:10.629539+0000","last_became_peered":"2023-12-14T14:09:10.629539+0000","last_unstale":"2023-12-14T14:10:12.531792+0000","last_undegraded":"2023-12-14T14:10:12.531792+0000","last_fullsized":"2023-12-14T14:10:12.531792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:51:46.941614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.798142+0000","last_change":"2023-12-14T14:10:12.798142+0000","last_active":"2023-12-14T14:10:12.798142+0000","last_peered":"2023-12-14T14:10:12.798142+0000","last_clean":"2023-12-14T14:10:12.798142+0000","last_became_active":"2023-12-14T14:10:12.797763+0000","last_became_peered":"2023-12-14T14:10:12.797763+0000","last_unstale":"2023-12-14T14:10:12.798142+0000","last_undegraded":"2023-12-14T14:10:12.798142+0000","last_fullsized":"2023-12-14T14:10:12.798142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:53:06.227507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527531+0000","last_change":"2023-12-14T14:09:10.619279+0000","last_active":"2023-12-14T14:10:12.527531+0000","last_peered":"2023-12-14T14:10:12.527531+0000","last_clean":"2023-12-14T14:10:12.527531+0000","last_became_active":"2023-12-14T14:09:10.618794+0000","last_became_peered":"2023-12-14T14:09:10.618794+0000","last_unstale":"2023-12-14T14:10:12.527531+0000","last_undegraded":"2023-12-14T14:10:12.527531+0000","last_fullsized":"2023-12-14T14:10:12.527531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:52:19.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532513+0000","last_change":"2023-12-14T14:09:10.222213+0000","last_active":"2023-12-14T14:10:12.532513+0000","last_peered":"2023-12-14T14:10:12.532513+0000","last_clean":"2023-12-14T14:10:12.532513+0000","last_became_active":"2023-12-14T14:09:10.221314+0000","last_became_peered":"2023-12-14T14:09:10.221314+0000","last_unstale":"2023-12-14T14:10:12.532513+0000","last_undegraded":"2023-12-14T14:10:12.532513+0000","last_fullsized":"2023-12-14T14:10:12.532513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:21:43.468606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527564+0000","last_change":"2023-12-14T14:09:10.624523+0000","last_active":"2023-12-14T14:10:12.527564+0000","last_peered":"2023-12-14T14:10:12.527564+0000","last_clean":"2023-12-14T14:10:12.527564+0000","last_became_active":"2023-12-14T14:09:10.624204+0000","last_became_peered":"2023-12-14T14:09:10.624204+0000","last_unstale":"2023-12-14T14:10:12.527564+0000","last_undegraded":"2023-12-14T14:10:12.527564+0000","last_fullsized":"2023-12-14T14:10:12.527564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:04:50.294802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526896+0000","last_change":"2023-12-14T14:09:10.626166+0000","last_active":"2023-12-14T14:10:12.526896+0000","last_peered":"2023-12-14T14:10:12.526896+0000","last_clean":"2023-12-14T14:10:12.526896+0000","last_became_active":"2023-12-14T14:09:10.625831+0000","last_became_peered":"2023-12-14T14:09:10.625831+0000","last_unstale":"2023-12-14T14:10:12.526896+0000","last_undegraded":"2023-12-14T14:10:12.526896+0000","last_fullsized":"2023-12-14T14:10:12.526896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:25:33.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":91,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:22.907288+0000","last_change":"2023-12-14T14:09:10.217759+0000","last_active":"2023-12-14T14:10:22.907288+0000","last_peered":"2023-12-14T14:10:22.907288+0000","last_clean":"2023-12-14T14:10:22.907288+0000","last_became_active":"2023-12-14T14:09:10.217454+0000","last_became_peered":"2023-12-14T14:09:10.217454+0000","last_unstale":"2023-12-14T14:10:22.907288+0000","last_undegraded":"2023-12-14T14:10:22.907288+0000","last_fullsized":"2023-12-14T14:10:22.907288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:45.595634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.054566+0000","last_change":"2023-12-14T14:10:13.054168+0000","last_active":"2023-12-14T14:10:13.054566+0000","last_peered":"2023-12-14T14:10:13.054566+0000","last_clean":"2023-12-14T14:10:13.054566+0000","last_became_active":"2023-12-14T14:10:13.053907+0000","last_became_peered":"2023-12-14T14:10:13.053907+0000","last_unstale":"2023-12-14T14:10:13.054566+0000","last_undegraded":"2023-12-14T14:10:13.054566+0000","last_fullsized":"2023-12-14T14:10:13.054566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:32:50.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.755707+0000","last_change":"2023-12-14T14:09:10.214557+0000","last_active":"2023-12-14T14:10:12.755707+0000","last_peered":"2023-12-14T14:10:12.755707+0000","last_clean":"2023-12-14T14:10:12.755707+0000","last_became_active":"2023-12-14T14:09:10.214179+0000","last_became_peered":"2023-12-14T14:09:10.214179+0000","last_unstale":"2023-12-14T14:10:12.755707+0000","last_undegraded":"2023-12-14T14:10:12.755707+0000","last_fullsized":"2023-12-14T14:10:12.755707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:25:16.025802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":339,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532472+0000","last_change":"2023-12-14T14:08:24.268746+0000","last_active":"2023-12-14T14:10:12.532472+0000","last_peered":"2023-12-14T14:10:12.532472+0000","last_clean":"2023-12-14T14:10:12.532472+0000","last_became_active":"2023-12-14T14:08:24.268402+0000","last_became_peered":"2023-12-14T14:08:24.268402+0000","last_unstale":"2023-12-14T14:10:12.532472+0000","last_undegraded":"2023-12-14T14:10:12.532472+0000","last_fullsized":"2023-12-14T14:10:12.532472+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_clean_scrub_stamp":"2023-12-14T14:05:59.057653+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:46:12.936597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531780+0000","last_change":"2023-12-14T14:10:12.531780+0000","last_active":"2023-12-14T14:10:12.531780+0000","last_peered":"2023-12-14T14:10:12.531780+0000","last_clean":"2023-12-14T14:10:12.531780+0000","last_became_active":"2023-12-14T14:10:12.531437+0000","last_became_peered":"2023-12-14T14:10:12.531437+0000","last_unstale":"2023-12-14T14:10:12.531780+0000","last_undegraded":"2023-12-14T14:10:12.531780+0000","last_fullsized":"2023-12-14T14:10:12.531780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:45:55.441797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532302+0000","last_change":"2023-12-14T14:09:10.221812+0000","last_active":"2023-12-14T14:10:12.532302+0000","last_peered":"2023-12-14T14:10:12.532302+0000","last_clean":"2023-12-14T14:10:12.532302+0000","last_became_active":"2023-12-14T14:09:10.221483+0000","last_became_peered":"2023-12-14T14:09:10.221483+0000","last_unstale":"2023-12-14T14:10:12.532302+0000","last_undegraded":"2023-12-14T14:10:12.532302+0000","last_fullsized":"2023-12-14T14:10:12.532302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:41:43.778300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532911+0000","last_change":"2023-12-14T14:09:10.217249+0000","last_active":"2023-12-14T14:10:12.532911+0000","last_peered":"2023-12-14T14:10:12.532911+0000","last_clean":"2023-12-14T14:10:12.532911+0000","last_became_active":"2023-12-14T14:09:10.216953+0000","last_became_peered":"2023-12-14T14:09:10.216953+0000","last_unstale":"2023-12-14T14:10:12.532911+0000","last_undegraded":"2023-12-14T14:10:12.532911+0000","last_fullsized":"2023-12-14T14:10:12.532911+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:06:32.739744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527278+0000","last_change":"2023-12-14T14:09:10.616264+0000","last_active":"2023-12-14T14:10:12.527278+0000","last_peered":"2023-12-14T14:10:12.527278+0000","last_clean":"2023-12-14T14:10:12.527278+0000","last_became_active":"2023-12-14T14:09:10.615993+0000","last_became_peered":"2023-12-14T14:09:10.615993+0000","last_unstale":"2023-12-14T14:10:12.527278+0000","last_undegraded":"2023-12-14T14:10:12.527278+0000","last_fullsized":"2023-12-14T14:10:12.527278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:17:58.050642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529818+0000","last_change":"2023-12-14T14:09:10.218040+0000","last_active":"2023-12-14T14:10:12.529818+0000","last_peered":"2023-12-14T14:10:12.529818+0000","last_clean":"2023-12-14T14:10:12.529818+0000","last_became_active":"2023-12-14T14:09:10.217698+0000","last_became_peered":"2023-12-14T14:09:10.217698+0000","last_unstale":"2023-12-14T14:10:12.529818+0000","last_undegraded":"2023-12-14T14:10:12.529818+0000","last_fullsized":"2023-12-14T14:10:12.529818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:24:14.577324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529192+0000","last_change":"2023-12-14T14:09:10.626705+0000","last_active":"2023-12-14T14:10:12.529192+0000","last_peered":"2023-12-14T14:10:12.529192+0000","last_clean":"2023-12-14T14:10:12.529192+0000","last_became_active":"2023-12-14T14:09:10.626390+0000","last_became_peered":"2023-12-14T14:09:10.626390+0000","last_unstale":"2023-12-14T14:10:12.529192+0000","last_undegraded":"2023-12-14T14:10:12.529192+0000","last_fullsized":"2023-12-14T14:10:12.529192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:11:51.665277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.756152+0000","last_change":"2023-12-14T14:09:10.224068+0000","last_active":"2023-12-14T14:10:12.756152+0000","last_peered":"2023-12-14T14:10:12.756152+0000","last_clean":"2023-12-14T14:10:12.756152+0000","last_became_active":"2023-12-14T14:09:10.223709+0000","last_became_peered":"2023-12-14T14:09:10.223709+0000","last_unstale":"2023-12-14T14:10:12.756152+0000","last_undegraded":"2023-12-14T14:10:12.756152+0000","last_fullsized":"2023-12-14T14:10:12.756152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:09:02.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797414+0000","last_change":"2023-12-14T14:09:10.633221+0000","last_active":"2023-12-14T14:10:12.797414+0000","last_peered":"2023-12-14T14:10:12.797414+0000","last_clean":"2023-12-14T14:10:12.797414+0000","last_became_active":"2023-12-14T14:09:10.632881+0000","last_became_peered":"2023-12-14T14:09:10.632881+0000","last_unstale":"2023-12-14T14:10:12.797414+0000","last_undegraded":"2023-12-14T14:10:12.797414+0000","last_fullsized":"2023-12-14T14:10:12.797414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:18:22.961120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.052653+0000","last_change":"2023-12-14T14:09:10.219793+0000","last_active":"2023-12-14T14:10:13.052653+0000","last_peered":"2023-12-14T14:10:13.052653+0000","last_clean":"2023-12-14T14:10:13.052653+0000","last_became_active":"2023-12-14T14:09:10.219485+0000","last_became_peered":"2023-12-14T14:09:10.219485+0000","last_unstale":"2023-12-14T14:10:13.052653+0000","last_undegraded":"2023-12-14T14:10:13.052653+0000","last_fullsized":"2023-12-14T14:10:13.052653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:05:25.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532431+0000","last_change":"2023-12-14T14:09:10.622064+0000","last_active":"2023-12-14T14:10:12.532431+0000","last_peered":"2023-12-14T14:10:12.532431+0000","last_clean":"2023-12-14T14:10:12.532431+0000","last_became_active":"2023-12-14T14:09:10.621741+0000","last_became_peered":"2023-12-14T14:09:10.621741+0000","last_unstale":"2023-12-14T14:10:12.532431+0000","last_undegraded":"2023-12-14T14:10:12.532431+0000","last_fullsized":"2023-12-14T14:10:12.532431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:59:00.963112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528925+0000","last_change":"2023-12-14T14:09:10.209152+0000","last_active":"2023-12-14T14:10:12.528925+0000","last_peered":"2023-12-14T14:10:12.528925+0000","last_clean":"2023-12-14T14:10:12.528925+0000","last_became_active":"2023-12-14T14:09:10.208798+0000","last_became_peered":"2023-12-14T14:09:10.208798+0000","last_unstale":"2023-12-14T14:10:12.528925+0000","last_undegraded":"2023-12-14T14:10:12.528925+0000","last_fullsized":"2023-12-14T14:10:12.528925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:55.451603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.530802+0000","last_change":"2023-12-14T14:09:10.616109+0000","last_active":"2023-12-14T14:10:12.530802+0000","last_peered":"2023-12-14T14:10:12.530802+0000","last_clean":"2023-12-14T14:10:12.530802+0000","last_became_active":"2023-12-14T14:09:10.615694+0000","last_became_peered":"2023-12-14T14:09:10.615694+0000","last_unstale":"2023-12-14T14:10:12.530802+0000","last_undegraded":"2023-12-14T14:10:12.530802+0000","last_fullsized":"2023-12-14T14:10:12.530802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:57:04.359521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529034+0000","last_change":"2023-12-14T14:09:10.224376+0000","last_active":"2023-12-14T14:10:12.529034+0000","last_peered":"2023-12-14T14:10:12.529034+0000","last_clean":"2023-12-14T14:10:12.529034+0000","last_became_active":"2023-12-14T14:09:10.224010+0000","last_became_peered":"2023-12-14T14:09:10.224010+0000","last_unstale":"2023-12-14T14:10:12.529034+0000","last_undegraded":"2023-12-14T14:10:12.529034+0000","last_fullsized":"2023-12-14T14:10:12.529034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:14.170417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528610+0000","last_change":"2023-12-14T14:09:10.622490+0000","last_active":"2023-12-14T14:10:12.528610+0000","last_peered":"2023-12-14T14:10:12.528610+0000","last_clean":"2023-12-14T14:10:12.528610+0000","last_became_active":"2023-12-14T14:09:10.622154+0000","last_became_peered":"2023-12-14T14:09:10.622154+0000","last_unstale":"2023-12-14T14:10:12.528610+0000","last_undegraded":"2023-12-14T14:10:12.528610+0000","last_fullsized":"2023-12-14T14:10:12.528610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:14:08.643046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532652+0000","last_change":"2023-12-14T14:09:10.220343+0000","last_active":"2023-12-14T14:10:12.532652+0000","last_peered":"2023-12-14T14:10:12.532652+0000","last_clean":"2023-12-14T14:10:12.532652+0000","last_became_active":"2023-12-14T14:09:10.219657+0000","last_became_peered":"2023-12-14T14:09:10.219657+0000","last_unstale":"2023-12-14T14:10:12.532652+0000","last_undegraded":"2023-12-14T14:10:12.532652+0000","last_fullsized":"2023-12-14T14:10:12.532652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:06:01.543748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532666+0000","last_change":"2023-12-14T14:09:10.633980+0000","last_active":"2023-12-14T14:10:12.532666+0000","last_peered":"2023-12-14T14:10:12.532666+0000","last_clean":"2023-12-14T14:10:12.532666+0000","last_became_active":"2023-12-14T14:09:10.633541+0000","last_became_peered":"2023-12-14T14:09:10.633541+0000","last_unstale":"2023-12-14T14:10:12.532666+0000","last_undegraded":"2023-12-14T14:10:12.532666+0000","last_fullsized":"2023-12-14T14:10:12.532666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:39:19.970037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529499+0000","last_change":"2023-12-14T14:09:10.218042+0000","last_active":"2023-12-14T14:10:12.529499+0000","last_peered":"2023-12-14T14:10:12.529499+0000","last_clean":"2023-12-14T14:10:12.529499+0000","last_became_active":"2023-12-14T14:09:10.217540+0000","last_became_peered":"2023-12-14T14:09:10.217540+0000","last_unstale":"2023-12-14T14:10:12.529499+0000","last_undegraded":"2023-12-14T14:10:12.529499+0000","last_fullsized":"2023-12-14T14:10:12.529499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:18:19.659078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532924+0000","last_change":"2023-12-14T14:09:10.633527+0000","last_active":"2023-12-14T14:10:12.532924+0000","last_peered":"2023-12-14T14:10:12.532924+0000","last_clean":"2023-12-14T14:10:12.532924+0000","last_became_active":"2023-12-14T14:09:10.632614+0000","last_became_peered":"2023-12-14T14:09:10.632614+0000","last_unstale":"2023-12-14T14:10:12.532924+0000","last_undegraded":"2023-12-14T14:10:12.532924+0000","last_fullsized":"2023-12-14T14:10:12.532924+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:24:02.650617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527211+0000","last_change":"2023-12-14T14:09:10.211731+0000","last_active":"2023-12-14T14:10:12.527211+0000","last_peered":"2023-12-14T14:10:12.527211+0000","last_clean":"2023-12-14T14:10:12.527211+0000","last_became_active":"2023-12-14T14:09:10.211366+0000","last_became_peered":"2023-12-14T14:09:10.211366+0000","last_unstale":"2023-12-14T14:10:12.527211+0000","last_undegraded":"2023-12-14T14:10:12.527211+0000","last_fullsized":"2023-12-14T14:10:12.527211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:49:40.508221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532233+0000","last_change":"2023-12-14T14:09:10.621483+0000","last_active":"2023-12-14T14:10:12.532233+0000","last_peered":"2023-12-14T14:10:12.532233+0000","last_clean":"2023-12-14T14:10:12.532233+0000","last_became_active":"2023-12-14T14:09:10.621105+0000","last_became_peered":"2023-12-14T14:09:10.621105+0000","last_unstale":"2023-12-14T14:10:12.532233+0000","last_undegraded":"2023-12-14T14:10:12.532233+0000","last_fullsized":"2023-12-14T14:10:12.532233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:25:34.331333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.759796+0000","last_change":"2023-12-14T14:10:12.759796+0000","last_active":"2023-12-14T14:10:12.759796+0000","last_peered":"2023-12-14T14:10:12.759796+0000","last_clean":"2023-12-14T14:10:12.759796+0000","last_became_active":"2023-12-14T14:10:12.757507+0000","last_became_peered":"2023-12-14T14:10:12.757507+0000","last_unstale":"2023-12-14T14:10:12.759796+0000","last_undegraded":"2023-12-14T14:10:12.759796+0000","last_fullsized":"2023-12-14T14:10:12.759796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:08:46.390118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532664+0000","last_change":"2023-12-14T14:09:10.633084+0000","last_active":"2023-12-14T14:10:12.532664+0000","last_peered":"2023-12-14T14:10:12.532664+0000","last_clean":"2023-12-14T14:10:12.532664+0000","last_became_active":"2023-12-14T14:09:10.632544+0000","last_became_peered":"2023-12-14T14:09:10.632544+0000","last_unstale":"2023-12-14T14:10:12.532664+0000","last_undegraded":"2023-12-14T14:10:12.532664+0000","last_fullsized":"2023-12-14T14:10:12.532664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:36:46.213060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.530946+0000","last_change":"2023-12-14T14:09:10.618373+0000","last_active":"2023-12-14T14:10:12.530946+0000","last_peered":"2023-12-14T14:10:12.530946+0000","last_clean":"2023-12-14T14:10:12.530946+0000","last_became_active":"2023-12-14T14:09:10.618028+0000","last_became_peered":"2023-12-14T14:09:10.618028+0000","last_unstale":"2023-12-14T14:10:12.530946+0000","last_undegraded":"2023-12-14T14:10:12.530946+0000","last_fullsized":"2023-12-14T14:10:12.530946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:14:02.328236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528984+0000","last_change":"2023-12-14T14:09:10.622775+0000","last_active":"2023-12-14T14:10:12.528984+0000","last_peered":"2023-12-14T14:10:12.528984+0000","last_clean":"2023-12-14T14:10:12.528984+0000","last_became_active":"2023-12-14T14:09:10.622407+0000","last_became_peered":"2023-12-14T14:09:10.622407+0000","last_unstale":"2023-12-14T14:10:12.528984+0000","last_undegraded":"2023-12-14T14:10:12.528984+0000","last_fullsized":"2023-12-14T14:10:12.528984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:54:19.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528836+0000","last_change":"2023-12-14T14:09:10.622137+0000","last_active":"2023-12-14T14:10:12.528836+0000","last_peered":"2023-12-14T14:10:12.528836+0000","last_clean":"2023-12-14T14:10:12.528836+0000","last_became_active":"2023-12-14T14:09:10.621829+0000","last_became_peered":"2023-12-14T14:09:10.621829+0000","last_unstale":"2023-12-14T14:10:12.528836+0000","last_undegraded":"2023-12-14T14:10:12.528836+0000","last_fullsized":"2023-12-14T14:10:12.528836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:02:06.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797053+0000","last_change":"2023-12-14T14:09:10.625511+0000","last_active":"2023-12-14T14:10:12.797053+0000","last_peered":"2023-12-14T14:10:12.797053+0000","last_clean":"2023-12-14T14:10:12.797053+0000","last_became_active":"2023-12-14T14:09:10.624863+0000","last_became_peered":"2023-12-14T14:09:10.624863+0000","last_unstale":"2023-12-14T14:10:12.797053+0000","last_undegraded":"2023-12-14T14:10:12.797053+0000","last_fullsized":"2023-12-14T14:10:12.797053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:15:14.831325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527405+0000","last_change":"2023-12-14T14:09:10.623824+0000","last_active":"2023-12-14T14:10:12.527405+0000","last_peered":"2023-12-14T14:10:12.527405+0000","last_clean":"2023-12-14T14:10:12.527405+0000","last_became_active":"2023-12-14T14:09:10.623482+0000","last_became_peered":"2023-12-14T14:09:10.623482+0000","last_unstale":"2023-12-14T14:10:12.527405+0000","last_undegraded":"2023-12-14T14:10:12.527405+0000","last_fullsized":"2023-12-14T14:10:12.527405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:03:53.219733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532039+0000","last_change":"2023-12-14T14:09:10.618004+0000","last_active":"2023-12-14T14:10:12.532039+0000","last_peered":"2023-12-14T14:10:12.532039+0000","last_clean":"2023-12-14T14:10:12.532039+0000","last_became_active":"2023-12-14T14:09:10.617184+0000","last_became_peered":"2023-12-14T14:09:10.617184+0000","last_unstale":"2023-12-14T14:10:12.532039+0000","last_undegraded":"2023-12-14T14:10:12.532039+0000","last_fullsized":"2023-12-14T14:10:12.532039+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:00:28.593004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529967+0000","last_change":"2023-12-14T14:09:10.621183+0000","last_active":"2023-12-14T14:10:12.529967+0000","last_peered":"2023-12-14T14:10:12.529967+0000","last_clean":"2023-12-14T14:10:12.529967+0000","last_became_active":"2023-12-14T14:09:10.620474+0000","last_became_peered":"2023-12-14T14:09:10.620474+0000","last_unstale":"2023-12-14T14:10:12.529967+0000","last_undegraded":"2023-12-14T14:10:12.529967+0000","last_fullsized":"2023-12-14T14:10:12.529967+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:55:57.422251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528615+0000","last_change":"2023-12-14T14:09:10.630668+0000","last_active":"2023-12-14T14:10:12.528615+0000","last_peered":"2023-12-14T14:10:12.528615+0000","last_clean":"2023-12-14T14:10:12.528615+0000","last_became_active":"2023-12-14T14:09:10.630337+0000","last_became_peered":"2023-12-14T14:09:10.630337+0000","last_unstale":"2023-12-14T14:10:12.528615+0000","last_undegraded":"2023-12-14T14:10:12.528615+0000","last_fullsized":"2023-12-14T14:10:12.528615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:31:23.847778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526713+0000","last_change":"2023-12-14T14:09:10.619550+0000","last_active":"2023-12-14T14:10:12.526713+0000","last_peered":"2023-12-14T14:10:12.526713+0000","last_clean":"2023-12-14T14:10:12.526713+0000","last_became_active":"2023-12-14T14:09:10.619029+0000","last_became_peered":"2023-12-14T14:09:10.619029+0000","last_unstale":"2023-12-14T14:10:12.526713+0000","last_undegraded":"2023-12-14T14:10:12.526713+0000","last_fullsized":"2023-12-14T14:10:12.526713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:56:08.554200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528969+0000","last_change":"2023-12-14T14:09:10.622158+0000","last_active":"2023-12-14T14:10:12.528969+0000","last_peered":"2023-12-14T14:10:12.528969+0000","last_clean":"2023-12-14T14:10:12.528969+0000","last_became_active":"2023-12-14T14:09:10.621853+0000","last_became_peered":"2023-12-14T14:09:10.621853+0000","last_unstale":"2023-12-14T14:10:12.528969+0000","last_undegraded":"2023-12-14T14:10:12.528969+0000","last_fullsized":"2023-12-14T14:10:12.528969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:21:50.173060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053003+0000","last_change":"2023-12-14T14:09:10.627728+0000","last_active":"2023-12-14T14:10:13.053003+0000","last_peered":"2023-12-14T14:10:13.053003+0000","last_clean":"2023-12-14T14:10:13.053003+0000","last_became_active":"2023-12-14T14:09:10.627352+0000","last_became_peered":"2023-12-14T14:09:10.627352+0000","last_unstale":"2023-12-14T14:10:13.053003+0000","last_undegraded":"2023-12-14T14:10:13.053003+0000","last_fullsized":"2023-12-14T14:10:13.053003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:45:33.802754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526139+0000","last_change":"2023-12-14T14:09:10.625676+0000","last_active":"2023-12-14T14:10:12.526139+0000","last_peered":"2023-12-14T14:10:12.526139+0000","last_clean":"2023-12-14T14:10:12.526139+0000","last_became_active":"2023-12-14T14:09:10.625191+0000","last_became_peered":"2023-12-14T14:09:10.625191+0000","last_unstale":"2023-12-14T14:10:12.526139+0000","last_undegraded":"2023-12-14T14:10:12.526139+0000","last_fullsized":"2023-12-14T14:10:12.526139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:13:27.311452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531846+0000","last_change":"2023-12-14T14:09:10.624258+0000","last_active":"2023-12-14T14:10:12.531846+0000","last_peered":"2023-12-14T14:10:12.531846+0000","last_clean":"2023-12-14T14:10:12.531846+0000","last_became_active":"2023-12-14T14:09:10.623917+0000","last_became_peered":"2023-12-14T14:09:10.623917+0000","last_unstale":"2023-12-14T14:10:12.531846+0000","last_undegraded":"2023-12-14T14:10:12.531846+0000","last_fullsized":"2023-12-14T14:10:12.531846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:44:13.500368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65175,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":450,"num_read_kb":293,"num_write":153,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":186245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481816,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6016,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739136,"statfs":{"total":95995035648,"available":95988875264,"internally_reserved":0,"allocated":909312,"data_stored":441084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.746}]},{"osd":8,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53600000000000003}]},{"osd":9,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.81000000000000005}]}]},{"osd":10,"up_from":70,"seq":300647710749,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738732,"statfs":{"total":95995035648,"available":95988461568,"internally_reserved":0,"allocated":1060864,"data_stored":1093794,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58899999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.754,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.372}]},{"osd":2,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73699999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.52900000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78000000000000003,"5min":1.29,"15min":1.29},"last":0.497}]},{"osd":4,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.437},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64200000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.79100000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.61699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.67600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.90800000000000003,"5min":1.244,"15min":1.244},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.84899999999999998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.52100000000000002}]},{"osd":9,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.64700000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.395,"15min":1.395},"last":0.59599999999999997}]},{"osd":11,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.621}]}]},{"osd":9,"up_from":65,"seq":279172874271,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6160,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738992,"statfs":{"total":95995035648,"available":95988727808,"internally_reserved":0,"allocated":925696,"data_stored":441320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":0.61199999999999999,"15min":0.48499999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":21.376000000000001,"5min":21.376000000000001,"15min":21.376000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":0.63700000000000001,"15min":0.51100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":21.303000000000001,"5min":21.303000000000001,"15min":21.303000000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.65400000000000003,"15min":0.60299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":10.380000000000001,"5min":10.380000000000001,"15min":10.380000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.556,"5min":0.77500000000000002,"15min":0.64500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":21.317,"5min":21.317,"15min":21.317},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.67300000000000004,"15min":0.621},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":10.406000000000001,"5min":10.406000000000001,"15min":10.406000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.556,"5min":0.78700000000000003,"15min":0.65900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":21.402000000000001,"5min":21.402000000000001,"15min":21.402000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":0.69299999999999995,"15min":0.57299999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":21.097999999999999,"5min":21.097999999999999,"15min":21.097999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.57299999999999995,"15min":0.52500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":10.455,"5min":10.455,"15min":10.455},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":0.80100000000000005,"15min":0.67700000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":21.068000000000001,"5min":21.068000000000001,"15min":21.068000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.5620000000000001,"5min":0.78600000000000003,"15min":0.65700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":21.178999999999998,"5min":21.178999999999998,"15min":21.178999999999998},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":0.83199999999999996,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":21.25,"5min":21.25,"15min":21.25},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.016,"5min":0.72599999999999998,"15min":0.67800000000000005},"min":{"1min":0.436,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":10.337999999999999,"5min":10.337999999999999,"15min":10.337999999999999},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":0.746,"15min":0.65600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":17.748000000000001,"5min":17.748000000000001,"15min":17.748000000000001},"last":0.307},{"interface":"front","average":{"1min":1.5,"5min":0.82899999999999996,"15min":0.71699999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":21.452999999999999,"5min":21.452999999999999,"15min":21.452999999999999},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":0.89100000000000001,"15min":0.76800000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":21.219000000000001,"5min":21.219000000000001,"15min":21.219000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.79000000000000004,"15min":0.74199999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.430999999999999,"5min":10.430999999999999,"15min":10.430999999999999},"last":0.51700000000000002}]},{"osd":8,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":0.91800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":21.428999999999998,"5min":21.428999999999998,"15min":21.428999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.6579999999999999,"5min":0.91700000000000004,"15min":0.79300000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":21.274999999999999,"5min":21.274999999999999,"15min":21.274999999999999},"last":0.65300000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":0.92000000000000004,"15min":0.79100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":21.347000000000001,"5min":21.347000000000001,"15min":21.347000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.708,"5min":0.90800000000000003,"15min":0.77500000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":21.152999999999999,"5min":21.152999999999999,"15min":21.152999999999999},"last":0.58899999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":8,"up_from":58,"seq":249108103204,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6288,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738864,"statfs":{"total":95995035648,"available":95988596736,"internally_reserved":0,"allocated":925696,"data_stored":441240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81399999999999995,"5min":0.88,"15min":0.88},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.79700000000000004,"5min":0.875,"15min":0.875},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78700000000000003,"5min":1.411,"15min":1.411},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97299999999999998,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.34899999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90100000000000002,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.66900000000000004,"15min":0.65800000000000003},"min":{"1min":0.50900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.88100000000000001}]},{"osd":9,"last update":"Thu Dec 14 14:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.70899999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.73999999999999999},"min":{"1min":0.57899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92800000000000005,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.89900000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.60999999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94699999999999995,"5min":1.032,"15min":1.032},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78700000000000003,"15min":0.77800000000000002},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.86699999999999999}]}]},{"osd":7,"up_from":50,"seq":214748364838,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6400,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738752,"statfs":{"total":95995035648,"available":95988482048,"internally_reserved":0,"allocated":974848,"data_stored":1033469,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.311}]},{"osd":1,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.436,"15min":0.44},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.63}]},{"osd":2,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78700000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.752}]},{"osd":5,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.79900000000000004}]},{"osd":6,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66400000000000003},"min":{"1min":0.46800000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.81799999999999995}]},{"osd":8,"last update":"Thu Dec 14 14:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86899999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.876}]},{"osd":9,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.115,"5min":0.78500000000000003,"15min":0.72999999999999998},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":0.82899999999999996}]},{"osd":10,"last update":"Thu Dec 14 14:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.87}]},{"osd":11,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91000000000000003}]}]},{"osd":6,"up_from":45,"seq":193273528362,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6276,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738876,"statfs":{"total":95995035648,"available":95988609024,"internally_reserved":0,"allocated":913408,"data_stored":440715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46899999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27300000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.501,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.436,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60099999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58499999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.63800000000000001,"5min":1.075,"15min":1.075},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68300000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.626,"15min":0.64200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71799999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65600000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":0.995,"15min":0.995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90200000000000002,"5min":1.254,"15min":1.254},"last":0.57399999999999995}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81100000000000005,"5min":1.288,"15min":1.288},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65900000000000003}]},{"osd":9,"last update":"Thu Dec 14 14:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.64500000000000002,"15min":0.66900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66700000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":0.46999999999999997}]},{"osd":10,"last update":"Thu Dec 14 14:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.77400000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84999999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7292,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737860,"statfs":{"total":95995035648,"available":95987568640,"internally_reserved":0,"allocated":970752,"data_stored":496743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.503,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71299999999999997,"5min":0.87,"15min":0.87},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Dec 14 14:10:06 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.311,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.52800000000000002,"15min":0.505},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.439}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.40799999999999997,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.42499999999999999,"15min":0.40699999999999997},"min":{"1min":0.30199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.59599999999999997,"15min":0.57499999999999996},"min":{"1min":0.47799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.57599999999999996,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.42599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.49399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84199999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Dec 14 14:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63300000000000001}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67200000000000004,"15min":0.66100000000000003},"min":{"1min":0.55500000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002}]},{"osd":9,"last update":"Thu Dec 14 14:10:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.51200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.53000000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.71599999999999997}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Dec 14 14:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.81799999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7192,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737960,"statfs":{"total":95995035648,"available":95987671040,"internally_reserved":0,"allocated":933888,"data_stored":441980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.45800000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.54400000000000004,"15min":0.496},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Dec 14 14:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.57299999999999995,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":5.5270000000000001,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.57699999999999996,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.372,"15min":0.372},"max":{"1min":5.0259999999999998,"5min":5.0259999999999998,"15min":5.0259999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Dec 14 14:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.6660000000000004,"5min":5.6660000000000004,"15min":5.6660000000000004},"last":0.376}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":0.503},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.55700000000000005,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.61499999999999999,"15min":0.57199999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":5.3890000000000002,"5min":5.3890000000000002,"15min":5.3890000000000002},"last":0.315},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.1340000000000003,"5min":5.1340000000000003,"15min":5.1340000000000003},"last":0.35099999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.109,"5min":5.109,"15min":5.109},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu Dec 14 14:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.9509999999999996,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66700000000000004,"15min":0.65500000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":5.0019999999999998,"5min":5.0019999999999998,"15min":5.0019999999999998},"last":0.437}]},{"osd":10,"last update":"Thu Dec 14 14:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.70399999999999996,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.622},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.66700000000000004,"15min":0.63400000000000001},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.4500000000000002,"5min":5.4500000000000002,"15min":5.4500000000000002},"last":0.55900000000000005}]},{"osd":11,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.63},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.0499999999999998,"5min":5.0499999999999998,"15min":5.0499999999999998},"last":0.46500000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7440,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737712,"statfs":{"total":95995035648,"available":95987417088,"internally_reserved":0,"allocated":991232,"data_stored":498162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.47099999999999997,"15min":0.437},"min":{"1min":0.35999999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.46000000000000002},"min":{"1min":0.38700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.51900000000000002,"15min":0.47699999999999998},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.52000000000000002,"15min":0.47199999999999998},"min":{"1min":0.375,"5min":0.308,"15min":0.308},"max":{"1min":0.76600000000000001,"5min":0.877,"15min":0.877},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.40899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71299999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.46100000000000002},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.505,"15min":0.497},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89900000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.747}]},{"osd":7,"last update":"Thu Dec 14 14:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626}]},{"osd":8,"last update":"Thu Dec 14 14:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Dec 14 14:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.57799999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.63300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95299999999999996,"5min":1.046,"15min":1.046},"last":0.80700000000000005}]},{"osd":10,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65600000000000003,"15min":0.64800000000000002},"min":{"1min":0.57999999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.88},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.58199999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91700000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.89000000000000001}]},{"osd":11,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.82499999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215157,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6548,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738604,"statfs":{"total":95995035648,"available":95988330496,"internally_reserved":0,"allocated":929792,"data_stored":441032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.316},"min":{"1min":0.252,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.308},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.505,"15min":0.47999999999999998},"min":{"1min":0.44700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.45600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55500000000000005,"15min":0.53500000000000003},"min":{"1min":0.47499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84499999999999997,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77900000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.58999999999999997}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58899999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.65000000000000002,"15min":0.67400000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":1.012,"15min":1.012},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67800000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65500000000000003}]},{"osd":11,"last update":"Thu Dec 14 14:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.623}]}]},{"osd":4,"up_from":32,"seq":137438953521,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6408,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738744,"statfs":{"total":95995035648,"available":95988473856,"internally_reserved":0,"allocated":917504,"data_stored":441488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.498}]},{"osd":1,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.32100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81100000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52700000000000002,"15min":0.51200000000000001},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78000000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Dec 14 14:09:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80700000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84299999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.746}]},{"osd":6,"last update":"Thu Dec 14 14:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76900000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.58999999999999997},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83699999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.88200000000000001}]},{"osd":9,"last update":"Thu Dec 14 14:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":1.216,"15min":1.216},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.78400000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67400000000000004}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.73199999999999998}]},{"osd":11,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.90100000000000002}]}]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6536,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738616,"statfs":{"total":95995035648,"available":95988342784,"internally_reserved":0,"allocated":983040,"data_stored":1032530,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.499},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.54500000000000004,"15min":0.51400000000000001},"min":{"1min":0.51500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56200000000000006,"15min":0.53800000000000003},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.41099999999999998,"15min":0.38300000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.57799999999999996,"15min":0.54800000000000004},"min":{"1min":0.48199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.57499999999999996,"15min":0.54700000000000004},"min":{"1min":0.48599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Dec 14 14:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":1.032,"15min":1.032},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.69299999999999995}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 14:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.69699999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69299999999999995,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60899999999999999}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.747},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T14:10:27.931 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T14:10:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:27 smithi119 ceph-mon[43834]: pgmap v262: 97 pgs: 97 active+clean; 640 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-14T14:10:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:27 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/125711982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:27 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/710996576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:27 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1993524493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:28.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 -- 172.21.15.69:0/3825312287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100310 msgr2=0x7f4e1c100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/3825312287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100310 0x7f4e1c100760 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009990 tx=0x7f4e10009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 -- 172.21.15.69:0/3825312287 shutdown_connections 2023-12-14T14:10:28.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/3825312287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e1c100ca0 0x7f4e1c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/3825312287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0ff120 0x7f4e1c0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/3825312287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100310 0x7f4e1c100760 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 -- 172.21.15.69:0/3825312287 >> 172.21.15.69:0/3825312287 conn(0x7f4e1c0fa700 msgr2=0x7f4e1c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:28.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 -- 172.21.15.69:0/3825312287 shutdown_connections 2023-12-14T14:10:28.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 -- 172.21.15.69:0/3825312287 wait complete. 2023-12-14T14:10:28.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 Processor -- start 2023-12-14T14:10:28.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.088+0000 7f4e21bb3700 1 -- start start 2023-12-14T14:10:28.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e21bb3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e1c0ff120 0x7f4e1c194e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e21bb3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c100310 0x7f4e1c1953c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e21bb3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100ca0 0x7f4e1c19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e21bb3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c19ca00 con 0x7f4e1c100ca0 2023-12-14T14:10:28.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e21bb3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c19cb40 con 0x7f4e1c100310 2023-12-14T14:10:28.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e21bb3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c19ccd0 con 0x7f4e1c0ff120 2023-12-14T14:10:28.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100ca0 0x7f4e1c19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100ca0 0x7f4e1c19c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54434/0 (socket says 172.21.15.69:54434) 2023-12-14T14:10:28.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1bfff700 1 -- 172.21.15.69:0/199357632 learned_addr learned my addr 172.21.15.69:0/199357632 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:28.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1b7fe700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e1c0ff120 0x7f4e1c194e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1affd700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c100310 0x7f4e1c1953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1bfff700 1 -- 172.21.15.69:0/199357632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e1c0ff120 msgr2=0x7f4e1c194e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1bfff700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e1c0ff120 0x7f4e1c194e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1bfff700 1 -- 172.21.15.69:0/199357632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c100310 msgr2=0x7f4e1c1953c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1bfff700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c100310 0x7f4e1c1953c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1bfff700 1 -- 172.21.15.69:0/199357632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100095f0 con 0x7f4e1c100ca0 2023-12-14T14:10:28.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e1bfff700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100ca0 0x7f4e1c19c430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400e580 tx=0x7f4e1400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:28.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e18ff9700 1 -- 172.21.15.69:0/199357632 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14004bb0 con 0x7f4e1c100ca0 2023-12-14T14:10:28.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c10aa80 con 0x7f4e1c100ca0 2023-12-14T14:10:28.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e18ff9700 1 -- 172.21.15.69:0/199357632 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e14004d10 con 0x7f4e1c100ca0 2023-12-14T14:10:28.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e18ff9700 1 -- 172.21.15.69:0/199357632 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14004850 con 0x7f4e1c100ca0 2023-12-14T14:10:28.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.089+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c10a8f0 con 0x7f4e1c100ca0 2023-12-14T14:10:28.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.090+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c069a40 con 0x7f4e1c100ca0 2023-12-14T14:10:28.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.091+0000 7f4e18ff9700 1 -- 172.21.15.69:0/199357632 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4e14003a00 con 0x7f4e1c100ca0 2023-12-14T14:10:28.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.092+0000 7f4e18ff9700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4e040a11e0 0x7f4e040a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.092+0000 7f4e18ff9700 1 -- 172.21.15.69:0/199357632 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4e14016070 con 0x7f4e1c100ca0 2023-12-14T14:10:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.092+0000 7f4e1b7fe700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4e040a11e0 0x7f4e040a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.092+0000 7f4e1b7fe700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4e040a11e0 0x7f4e040a3690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c100170 tx=0x7f4e0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.096+0000 7f4e18ff9700 1 -- 172.21.15.69:0/199357632 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4e14098190 con 0x7f4e1c100ca0 2023-12-14T14:10:28.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:27 smithi081 ceph-mon[43371]: pgmap v262: 97 pgs: 97 active+clean; 640 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-14T14:10:28.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:27 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/125711982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:28.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:27 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/710996576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:28.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:27 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1993524493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:28.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.282+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e1c105fc0 con 0x7f4e040a11e0 2023-12-14T14:10:28.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.292+0000 7f4e18ff9700 1 -- 172.21.15.69:0/199357632 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344922 (secure 0 0 0) 0x7f4e1c105fc0 con 0x7f4e040a11e0 2023-12-14T14:10:28.298 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:28.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.295+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4e040a11e0 msgr2=0x7f4e040a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.295+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4e040a11e0 0x7f4e040a3690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c100170 tx=0x7f4e0c009260 comp rx=0 tx=0).stop 2023-12-14T14:10:28.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.295+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100ca0 msgr2=0x7f4e1c19c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.295+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100ca0 0x7f4e1c19c430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400e580 tx=0x7f4e1400e940 comp rx=0 tx=0).stop 2023-12-14T14:10:28.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.295+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 shutdown_connections 2023-12-14T14:10:28.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.296+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4e040a11e0 0x7f4e040a3690 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.296+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1c100ca0 0x7f4e1c19c430 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.296+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e1c0ff120 0x7f4e1c194e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.296+0000 7f4e21bb3700 1 --2- 172.21.15.69:0/199357632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c100310 0x7f4e1c1953c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.296+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 >> 172.21.15.69:0/199357632 conn(0x7f4e1c0fa700 msgr2=0x7f4e1c0fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:28.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.296+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 shutdown_connections 2023-12-14T14:10:28.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.296+0000 7f4e21bb3700 1 -- 172.21.15.69:0/199357632 wait complete. 2023-12-14T14:10:28.304 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T14:10:28.308 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-12-14T14:10:26.621649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655789,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":586,"num_read_kb":412,"num_write":336,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":78976,"kb_used_data":11168,"kb_used_omap":0,"kb_used_meta":67712,"kb_avail":1124862848,"statfs":{"total":1151940427776,"available":1151859556352,"internally_reserved":0,"allocated":11436032,"data_stored":7243557,"data_compressed":107034,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":69337088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4640,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":45,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002821"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532076+0000","last_change":"2023-12-14T14:09:10.621884+0000","last_active":"2023-12-14T14:10:12.532076+0000","last_peered":"2023-12-14T14:10:12.532076+0000","last_clean":"2023-12-14T14:10:12.532076+0000","last_became_active":"2023-12-14T14:09:10.621605+0000","last_became_peered":"2023-12-14T14:09:10.621605+0000","last_unstale":"2023-12-14T14:10:12.532076+0000","last_undegraded":"2023-12-14T14:10:12.532076+0000","last_fullsized":"2023-12-14T14:10:12.532076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:13:21.636751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797344+0000","last_change":"2023-12-14T14:09:10.621555+0000","last_active":"2023-12-14T14:10:12.797344+0000","last_peered":"2023-12-14T14:10:12.797344+0000","last_clean":"2023-12-14T14:10:12.797344+0000","last_became_active":"2023-12-14T14:09:10.621265+0000","last_became_peered":"2023-12-14T14:09:10.621265+0000","last_unstale":"2023-12-14T14:10:12.797344+0000","last_undegraded":"2023-12-14T14:10:12.797344+0000","last_fullsized":"2023-12-14T14:10:12.797344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:15:38.893983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797176+0000","last_change":"2023-12-14T14:09:10.623575+0000","last_active":"2023-12-14T14:10:12.797176+0000","last_peered":"2023-12-14T14:10:12.797176+0000","last_clean":"2023-12-14T14:10:12.797176+0000","last_became_active":"2023-12-14T14:09:10.623289+0000","last_became_peered":"2023-12-14T14:09:10.623289+0000","last_unstale":"2023-12-14T14:10:12.797176+0000","last_undegraded":"2023-12-14T14:10:12.797176+0000","last_fullsized":"2023-12-14T14:10:12.797176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:55:02.118265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.756057+0000","last_change":"2023-12-14T14:09:10.622850+0000","last_active":"2023-12-14T14:10:12.756057+0000","last_peered":"2023-12-14T14:10:12.756057+0000","last_clean":"2023-12-14T14:10:12.756057+0000","last_became_active":"2023-12-14T14:09:10.622456+0000","last_became_peered":"2023-12-14T14:09:10.622456+0000","last_unstale":"2023-12-14T14:10:12.756057+0000","last_undegraded":"2023-12-14T14:10:12.756057+0000","last_fullsized":"2023-12-14T14:10:12.756057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:34.391111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532476+0000","last_change":"2023-12-14T14:09:10.623459+0000","last_active":"2023-12-14T14:10:12.532476+0000","last_peered":"2023-12-14T14:10:12.532476+0000","last_clean":"2023-12-14T14:10:12.532476+0000","last_became_active":"2023-12-14T14:09:10.623100+0000","last_became_peered":"2023-12-14T14:09:10.623100+0000","last_unstale":"2023-12-14T14:10:12.532476+0000","last_undegraded":"2023-12-14T14:10:12.532476+0000","last_fullsized":"2023-12-14T14:10:12.532476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:41:35.772179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527620+0000","last_change":"2023-12-14T14:09:10.624663+0000","last_active":"2023-12-14T14:10:12.527620+0000","last_peered":"2023-12-14T14:10:12.527620+0000","last_clean":"2023-12-14T14:10:12.527620+0000","last_became_active":"2023-12-14T14:09:10.624313+0000","last_became_peered":"2023-12-14T14:09:10.624313+0000","last_unstale":"2023-12-14T14:10:12.527620+0000","last_undegraded":"2023-12-14T14:10:12.527620+0000","last_fullsized":"2023-12-14T14:10:12.527620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:11:53.666252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532221+0000","last_change":"2023-12-14T14:09:10.622519+0000","last_active":"2023-12-14T14:10:12.532221+0000","last_peered":"2023-12-14T14:10:12.532221+0000","last_clean":"2023-12-14T14:10:12.532221+0000","last_became_active":"2023-12-14T14:09:10.622147+0000","last_became_peered":"2023-12-14T14:09:10.622147+0000","last_unstale":"2023-12-14T14:10:12.532221+0000","last_undegraded":"2023-12-14T14:10:12.532221+0000","last_fullsized":"2023-12-14T14:10:12.532221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:09:52.043290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529021+0000","last_change":"2023-12-14T14:09:10.622762+0000","last_active":"2023-12-14T14:10:12.529021+0000","last_peered":"2023-12-14T14:10:12.529021+0000","last_clean":"2023-12-14T14:10:12.529021+0000","last_became_active":"2023-12-14T14:09:10.622199+0000","last_became_peered":"2023-12-14T14:09:10.622199+0000","last_unstale":"2023-12-14T14:10:12.529021+0000","last_undegraded":"2023-12-14T14:10:12.529021+0000","last_fullsized":"2023-12-14T14:10:12.529021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:14:39.472497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053278+0000","last_change":"2023-12-14T14:09:10.625452+0000","last_active":"2023-12-14T14:10:13.053278+0000","last_peered":"2023-12-14T14:10:13.053278+0000","last_clean":"2023-12-14T14:10:13.053278+0000","last_became_active":"2023-12-14T14:09:10.620053+0000","last_became_peered":"2023-12-14T14:09:10.620053+0000","last_unstale":"2023-12-14T14:10:13.053278+0000","last_undegraded":"2023-12-14T14:10:13.053278+0000","last_fullsized":"2023-12-14T14:10:13.053278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:02:57.280143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531872+0000","last_change":"2023-12-14T14:10:12.531872+0000","last_active":"2023-12-14T14:10:12.531872+0000","last_peered":"2023-12-14T14:10:12.531872+0000","last_clean":"2023-12-14T14:10:12.531872+0000","last_became_active":"2023-12-14T14:10:12.531403+0000","last_became_peered":"2023-12-14T14:10:12.531403+0000","last_unstale":"2023-12-14T14:10:12.531872+0000","last_undegraded":"2023-12-14T14:10:12.531872+0000","last_fullsized":"2023-12-14T14:10:12.531872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:02:30.699926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532807+0000","last_change":"2023-12-14T14:09:10.633572+0000","last_active":"2023-12-14T14:10:12.532807+0000","last_peered":"2023-12-14T14:10:12.532807+0000","last_clean":"2023-12-14T14:10:12.532807+0000","last_became_active":"2023-12-14T14:09:10.633251+0000","last_became_peered":"2023-12-14T14:09:10.633251+0000","last_unstale":"2023-12-14T14:10:12.532807+0000","last_undegraded":"2023-12-14T14:10:12.532807+0000","last_fullsized":"2023-12-14T14:10:12.532807+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:06:59.990535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.756083+0000","last_change":"2023-12-14T14:09:10.630621+0000","last_active":"2023-12-14T14:10:12.756083+0000","last_peered":"2023-12-14T14:10:12.756083+0000","last_clean":"2023-12-14T14:10:12.756083+0000","last_became_active":"2023-12-14T14:09:10.630196+0000","last_became_peered":"2023-12-14T14:09:10.630196+0000","last_unstale":"2023-12-14T14:10:12.756083+0000","last_undegraded":"2023-12-14T14:10:12.756083+0000","last_fullsized":"2023-12-14T14:10:12.756083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:44.623922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526232+0000","last_change":"2023-12-14T14:09:10.617111+0000","last_active":"2023-12-14T14:10:12.526232+0000","last_peered":"2023-12-14T14:10:12.526232+0000","last_clean":"2023-12-14T14:10:12.526232+0000","last_became_active":"2023-12-14T14:09:10.616817+0000","last_became_peered":"2023-12-14T14:09:10.616817+0000","last_unstale":"2023-12-14T14:10:12.526232+0000","last_undegraded":"2023-12-14T14:10:12.526232+0000","last_fullsized":"2023-12-14T14:10:12.526232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:54:30.750020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797080+0000","last_change":"2023-12-14T14:09:10.620373+0000","last_active":"2023-12-14T14:10:12.797080+0000","last_peered":"2023-12-14T14:10:12.797080+0000","last_clean":"2023-12-14T14:10:12.797080+0000","last_became_active":"2023-12-14T14:09:10.620107+0000","last_became_peered":"2023-12-14T14:09:10.620107+0000","last_unstale":"2023-12-14T14:10:12.797080+0000","last_undegraded":"2023-12-14T14:10:12.797080+0000","last_fullsized":"2023-12-14T14:10:12.797080+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:26:50.872125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.796958+0000","last_change":"2023-12-14T14:09:10.624554+0000","last_active":"2023-12-14T14:10:12.796958+0000","last_peered":"2023-12-14T14:10:12.796958+0000","last_clean":"2023-12-14T14:10:12.796958+0000","last_became_active":"2023-12-14T14:09:10.624255+0000","last_became_peered":"2023-12-14T14:09:10.624255+0000","last_unstale":"2023-12-14T14:10:12.796958+0000","last_undegraded":"2023-12-14T14:10:12.796958+0000","last_fullsized":"2023-12-14T14:10:12.796958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:00:42.644826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.052691+0000","last_change":"2023-12-14T14:09:10.632464+0000","last_active":"2023-12-14T14:10:13.052691+0000","last_peered":"2023-12-14T14:10:13.052691+0000","last_clean":"2023-12-14T14:10:13.052691+0000","last_became_active":"2023-12-14T14:09:10.632102+0000","last_became_peered":"2023-12-14T14:09:10.632102+0000","last_unstale":"2023-12-14T14:10:13.052691+0000","last_undegraded":"2023-12-14T14:10:13.052691+0000","last_fullsized":"2023-12-14T14:10:13.052691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:56:36.034298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532334+0000","last_change":"2023-12-14T14:09:10.619144+0000","last_active":"2023-12-14T14:10:12.532334+0000","last_peered":"2023-12-14T14:10:12.532334+0000","last_clean":"2023-12-14T14:10:12.532334+0000","last_became_active":"2023-12-14T14:09:10.618833+0000","last_became_peered":"2023-12-14T14:09:10.618833+0000","last_unstale":"2023-12-14T14:10:12.532334+0000","last_undegraded":"2023-12-14T14:10:12.532334+0000","last_fullsized":"2023-12-14T14:10:12.532334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:56:11.786123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529939+0000","last_change":"2023-12-14T14:09:10.619062+0000","last_active":"2023-12-14T14:10:12.529939+0000","last_peered":"2023-12-14T14:10:12.529939+0000","last_clean":"2023-12-14T14:10:12.529939+0000","last_became_active":"2023-12-14T14:09:10.618750+0000","last_became_peered":"2023-12-14T14:09:10.618750+0000","last_unstale":"2023-12-14T14:10:12.529939+0000","last_undegraded":"2023-12-14T14:10:12.529939+0000","last_fullsized":"2023-12-14T14:10:12.529939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:23:35.700718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529301+0000","last_change":"2023-12-14T14:09:10.621410+0000","last_active":"2023-12-14T14:10:12.529301+0000","last_peered":"2023-12-14T14:10:12.529301+0000","last_clean":"2023-12-14T14:10:12.529301+0000","last_became_active":"2023-12-14T14:09:10.621037+0000","last_became_peered":"2023-12-14T14:09:10.621037+0000","last_unstale":"2023-12-14T14:10:12.529301+0000","last_undegraded":"2023-12-14T14:10:12.529301+0000","last_fullsized":"2023-12-14T14:10:12.529301+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:45:37.270156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529264+0000","last_change":"2023-12-14T14:09:10.218180+0000","last_active":"2023-12-14T14:10:12.529264+0000","last_peered":"2023-12-14T14:10:12.529264+0000","last_clean":"2023-12-14T14:10:12.529264+0000","last_became_active":"2023-12-14T14:09:10.217856+0000","last_became_peered":"2023-12-14T14:09:10.217856+0000","last_unstale":"2023-12-14T14:10:12.529264+0000","last_undegraded":"2023-12-14T14:10:12.529264+0000","last_fullsized":"2023-12-14T14:10:12.529264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:26:00.815008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528782+0000","last_change":"2023-12-14T14:09:10.628500+0000","last_active":"2023-12-14T14:10:12.528782+0000","last_peered":"2023-12-14T14:10:12.528782+0000","last_clean":"2023-12-14T14:10:12.528782+0000","last_became_active":"2023-12-14T14:09:10.628120+0000","last_became_peered":"2023-12-14T14:09:10.628120+0000","last_unstale":"2023-12-14T14:10:12.528782+0000","last_undegraded":"2023-12-14T14:10:12.528782+0000","last_fullsized":"2023-12-14T14:10:12.528782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:03:26.435929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528916+0000","last_change":"2023-12-14T14:09:10.218608+0000","last_active":"2023-12-14T14:10:12.528916+0000","last_peered":"2023-12-14T14:10:12.528916+0000","last_clean":"2023-12-14T14:10:12.528916+0000","last_became_active":"2023-12-14T14:09:10.218010+0000","last_became_peered":"2023-12-14T14:09:10.218010+0000","last_unstale":"2023-12-14T14:10:12.528916+0000","last_undegraded":"2023-12-14T14:10:12.528916+0000","last_fullsized":"2023-12-14T14:10:12.528916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:15:03.256341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797697+0000","last_change":"2023-12-14T14:09:10.621972+0000","last_active":"2023-12-14T14:10:12.797697+0000","last_peered":"2023-12-14T14:10:12.797697+0000","last_clean":"2023-12-14T14:10:12.797697+0000","last_became_active":"2023-12-14T14:09:10.621685+0000","last_became_peered":"2023-12-14T14:09:10.621685+0000","last_unstale":"2023-12-14T14:10:12.797697+0000","last_undegraded":"2023-12-14T14:10:12.797697+0000","last_fullsized":"2023-12-14T14:10:12.797697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:44:15.717843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.537829+0000","last_change":"2023-12-14T14:10:12.537432+0000","last_active":"2023-12-14T14:10:12.537829+0000","last_peered":"2023-12-14T14:10:12.537829+0000","last_clean":"2023-12-14T14:10:12.537829+0000","last_became_active":"2023-12-14T14:10:12.533574+0000","last_became_peered":"2023-12-14T14:10:12.533574+0000","last_unstale":"2023-12-14T14:10:12.537829+0000","last_undegraded":"2023-12-14T14:10:12.537829+0000","last_fullsized":"2023-12-14T14:10:12.537829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:37:38.449011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.052828+0000","last_change":"2023-12-14T14:09:10.626807+0000","last_active":"2023-12-14T14:10:13.052828+0000","last_peered":"2023-12-14T14:10:13.052828+0000","last_clean":"2023-12-14T14:10:13.052828+0000","last_became_active":"2023-12-14T14:09:10.626450+0000","last_became_peered":"2023-12-14T14:09:10.626450+0000","last_unstale":"2023-12-14T14:10:13.052828+0000","last_undegraded":"2023-12-14T14:10:13.052828+0000","last_fullsized":"2023-12-14T14:10:13.052828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:23:25.897586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532714+0000","last_change":"2023-12-14T14:09:10.216515+0000","last_active":"2023-12-14T14:10:12.532714+0000","last_peered":"2023-12-14T14:10:12.532714+0000","last_clean":"2023-12-14T14:10:12.532714+0000","last_became_active":"2023-12-14T14:09:10.216175+0000","last_became_peered":"2023-12-14T14:09:10.216175+0000","last_unstale":"2023-12-14T14:10:12.532714+0000","last_undegraded":"2023-12-14T14:10:12.532714+0000","last_fullsized":"2023-12-14T14:10:12.532714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:44:37.478657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527359+0000","last_change":"2023-12-14T14:09:10.627664+0000","last_active":"2023-12-14T14:10:12.527359+0000","last_peered":"2023-12-14T14:10:12.527359+0000","last_clean":"2023-12-14T14:10:12.527359+0000","last_became_active":"2023-12-14T14:09:10.627376+0000","last_became_peered":"2023-12-14T14:09:10.627376+0000","last_unstale":"2023-12-14T14:10:12.527359+0000","last_undegraded":"2023-12-14T14:10:12.527359+0000","last_fullsized":"2023-12-14T14:10:12.527359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:42:59.235684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":97,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:23.910449+0000","last_change":"2023-12-14T14:09:10.218806+0000","last_active":"2023-12-14T14:10:23.910449+0000","last_peered":"2023-12-14T14:10:23.910449+0000","last_clean":"2023-12-14T14:10:23.910449+0000","last_became_active":"2023-12-14T14:09:10.218441+0000","last_became_peered":"2023-12-14T14:09:10.218441+0000","last_unstale":"2023-12-14T14:10:23.910449+0000","last_undegraded":"2023-12-14T14:10:23.910449+0000","last_fullsized":"2023-12-14T14:10:23.910449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:12:59.215341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532407+0000","last_change":"2023-12-14T14:09:10.622903+0000","last_active":"2023-12-14T14:10:12.532407+0000","last_peered":"2023-12-14T14:10:12.532407+0000","last_clean":"2023-12-14T14:10:12.532407+0000","last_became_active":"2023-12-14T14:09:10.622261+0000","last_became_peered":"2023-12-14T14:09:10.622261+0000","last_unstale":"2023-12-14T14:10:12.532407+0000","last_undegraded":"2023-12-14T14:10:12.532407+0000","last_fullsized":"2023-12-14T14:10:12.532407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:36:00.934831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527794+0000","last_change":"2023-12-14T14:09:10.222254+0000","last_active":"2023-12-14T14:10:12.527794+0000","last_peered":"2023-12-14T14:10:12.527794+0000","last_clean":"2023-12-14T14:10:12.527794+0000","last_became_active":"2023-12-14T14:09:10.221861+0000","last_became_peered":"2023-12-14T14:09:10.221861+0000","last_unstale":"2023-12-14T14:10:12.527794+0000","last_undegraded":"2023-12-14T14:10:12.527794+0000","last_fullsized":"2023-12-14T14:10:12.527794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:52:59.679865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526998+0000","last_change":"2023-12-14T14:09:10.625646+0000","last_active":"2023-12-14T14:10:12.526998+0000","last_peered":"2023-12-14T14:10:12.526998+0000","last_clean":"2023-12-14T14:10:12.526998+0000","last_became_active":"2023-12-14T14:09:10.625179+0000","last_became_peered":"2023-12-14T14:09:10.625179+0000","last_unstale":"2023-12-14T14:10:12.526998+0000","last_undegraded":"2023-12-14T14:10:12.526998+0000","last_fullsized":"2023-12-14T14:10:12.526998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:52:32.325087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526156+0000","last_change":"2023-12-14T14:09:10.212885+0000","last_active":"2023-12-14T14:10:12.526156+0000","last_peered":"2023-12-14T14:10:12.526156+0000","last_clean":"2023-12-14T14:10:12.526156+0000","last_became_active":"2023-12-14T14:09:10.212311+0000","last_became_peered":"2023-12-14T14:09:10.212311+0000","last_unstale":"2023-12-14T14:10:12.526156+0000","last_undegraded":"2023-12-14T14:10:12.526156+0000","last_fullsized":"2023-12-14T14:10:12.526156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:47:33.645701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528167+0000","last_change":"2023-12-14T14:09:10.620795+0000","last_active":"2023-12-14T14:10:12.528167+0000","last_peered":"2023-12-14T14:10:12.528167+0000","last_clean":"2023-12-14T14:10:12.528167+0000","last_became_active":"2023-12-14T14:09:10.620453+0000","last_became_peered":"2023-12-14T14:09:10.620453+0000","last_unstale":"2023-12-14T14:10:12.528167+0000","last_undegraded":"2023-12-14T14:10:12.528167+0000","last_fullsized":"2023-12-14T14:10:12.528167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:25:31.871417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526686+0000","last_change":"2023-12-14T14:09:10.218969+0000","last_active":"2023-12-14T14:10:12.526686+0000","last_peered":"2023-12-14T14:10:12.526686+0000","last_clean":"2023-12-14T14:10:12.526686+0000","last_became_active":"2023-12-14T14:09:10.218624+0000","last_became_peered":"2023-12-14T14:09:10.218624+0000","last_unstale":"2023-12-14T14:10:12.526686+0000","last_undegraded":"2023-12-14T14:10:12.526686+0000","last_fullsized":"2023-12-14T14:10:12.526686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:33:35.928051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528961+0000","last_change":"2023-12-14T14:09:10.619202+0000","last_active":"2023-12-14T14:10:12.528961+0000","last_peered":"2023-12-14T14:10:12.528961+0000","last_clean":"2023-12-14T14:10:12.528961+0000","last_became_active":"2023-12-14T14:09:10.618944+0000","last_became_peered":"2023-12-14T14:09:10.618944+0000","last_unstale":"2023-12-14T14:10:12.528961+0000","last_undegraded":"2023-12-14T14:10:12.528961+0000","last_fullsized":"2023-12-14T14:10:12.528961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:08:37.692514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:24.911137+0000","last_change":"2023-12-14T14:09:10.214323+0000","last_active":"2023-12-14T14:10:24.911137+0000","last_peered":"2023-12-14T14:10:24.911137+0000","last_clean":"2023-12-14T14:10:24.911137+0000","last_became_active":"2023-12-14T14:09:10.213998+0000","last_became_peered":"2023-12-14T14:09:10.213998+0000","last_unstale":"2023-12-14T14:10:24.911137+0000","last_undegraded":"2023-12-14T14:10:24.911137+0000","last_fullsized":"2023-12-14T14:10:24.911137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:14:15.539169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053191+0000","last_change":"2023-12-14T14:09:10.626967+0000","last_active":"2023-12-14T14:10:13.053191+0000","last_peered":"2023-12-14T14:10:13.053191+0000","last_clean":"2023-12-14T14:10:13.053191+0000","last_became_active":"2023-12-14T14:09:10.626589+0000","last_became_peered":"2023-12-14T14:09:10.626589+0000","last_unstale":"2023-12-14T14:10:13.053191+0000","last_undegraded":"2023-12-14T14:10:13.053191+0000","last_fullsized":"2023-12-14T14:10:13.053191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:12:23.658401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532410+0000","last_change":"2023-12-14T14:09:10.221868+0000","last_active":"2023-12-14T14:10:12.532410+0000","last_peered":"2023-12-14T14:10:12.532410+0000","last_clean":"2023-12-14T14:10:12.532410+0000","last_became_active":"2023-12-14T14:09:10.221378+0000","last_became_peered":"2023-12-14T14:09:10.221378+0000","last_unstale":"2023-12-14T14:10:12.532410+0000","last_undegraded":"2023-12-14T14:10:12.532410+0000","last_fullsized":"2023-12-14T14:10:12.532410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:47:54.286181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797678+0000","last_change":"2023-12-14T14:09:10.630669+0000","last_active":"2023-12-14T14:10:12.797678+0000","last_peered":"2023-12-14T14:10:12.797678+0000","last_clean":"2023-12-14T14:10:12.797678+0000","last_became_active":"2023-12-14T14:09:10.630351+0000","last_became_peered":"2023-12-14T14:09:10.630351+0000","last_unstale":"2023-12-14T14:10:12.797678+0000","last_undegraded":"2023-12-14T14:10:12.797678+0000","last_fullsized":"2023-12-14T14:10:12.797678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:16:52.057368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527392+0000","last_change":"2023-12-14T14:09:10.214352+0000","last_active":"2023-12-14T14:10:12.527392+0000","last_peered":"2023-12-14T14:10:12.527392+0000","last_clean":"2023-12-14T14:10:12.527392+0000","last_became_active":"2023-12-14T14:09:10.213873+0000","last_became_peered":"2023-12-14T14:09:10.213873+0000","last_unstale":"2023-12-14T14:10:12.527392+0000","last_undegraded":"2023-12-14T14:10:12.527392+0000","last_fullsized":"2023-12-14T14:10:12.527392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:12:24.032109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053113+0000","last_change":"2023-12-14T14:09:10.631272+0000","last_active":"2023-12-14T14:10:13.053113+0000","last_peered":"2023-12-14T14:10:13.053113+0000","last_clean":"2023-12-14T14:10:13.053113+0000","last_became_active":"2023-12-14T14:09:10.630923+0000","last_became_peered":"2023-12-14T14:09:10.630923+0000","last_unstale":"2023-12-14T14:10:13.053113+0000","last_undegraded":"2023-12-14T14:10:13.053113+0000","last_fullsized":"2023-12-14T14:10:13.053113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:36:17.731850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'30","reported_seq":199,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:25.926137+0000","last_change":"2023-12-14T14:09:10.219006+0000","last_active":"2023-12-14T14:10:25.926137+0000","last_peered":"2023-12-14T14:10:25.926137+0000","last_clean":"2023-12-14T14:10:25.926137+0000","last_became_active":"2023-12-14T14:09:10.218694+0000","last_became_peered":"2023-12-14T14:09:10.218694+0000","last_unstale":"2023-12-14T14:10:25.926137+0000","last_undegraded":"2023-12-14T14:10:25.926137+0000","last_fullsized":"2023-12-14T14:10:25.926137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:29:19.743817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60881,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":133,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532873+0000","last_change":"2023-12-14T14:09:10.624056+0000","last_active":"2023-12-14T14:10:12.532873+0000","last_peered":"2023-12-14T14:10:12.532873+0000","last_clean":"2023-12-14T14:10:12.532873+0000","last_became_active":"2023-12-14T14:09:10.623622+0000","last_became_peered":"2023-12-14T14:09:10.623622+0000","last_unstale":"2023-12-14T14:10:12.532873+0000","last_undegraded":"2023-12-14T14:10:12.532873+0000","last_fullsized":"2023-12-14T14:10:12.532873+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:19:03.814303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529190+0000","last_change":"2023-12-14T14:09:10.215236+0000","last_active":"2023-12-14T14:10:12.529190+0000","last_peered":"2023-12-14T14:10:12.529190+0000","last_clean":"2023-12-14T14:10:12.529190+0000","last_became_active":"2023-12-14T14:09:10.214941+0000","last_became_peered":"2023-12-14T14:09:10.214941+0000","last_unstale":"2023-12-14T14:10:12.529190+0000","last_undegraded":"2023-12-14T14:10:12.529190+0000","last_fullsized":"2023-12-14T14:10:12.529190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:47:43.869792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.525888+0000","last_change":"2023-12-14T14:09:10.625352+0000","last_active":"2023-12-14T14:10:12.525888+0000","last_peered":"2023-12-14T14:10:12.525888+0000","last_clean":"2023-12-14T14:10:12.525888+0000","last_became_active":"2023-12-14T14:09:10.625037+0000","last_became_peered":"2023-12-14T14:09:10.625037+0000","last_unstale":"2023-12-14T14:10:12.525888+0000","last_undegraded":"2023-12-14T14:10:12.525888+0000","last_fullsized":"2023-12-14T14:10:12.525888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:33:04.723063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527360+0000","last_change":"2023-12-14T14:09:10.219028+0000","last_active":"2023-12-14T14:10:12.527360+0000","last_peered":"2023-12-14T14:10:12.527360+0000","last_clean":"2023-12-14T14:10:12.527360+0000","last_became_active":"2023-12-14T14:09:10.218687+0000","last_became_peered":"2023-12-14T14:09:10.218687+0000","last_unstale":"2023-12-14T14:10:12.527360+0000","last_undegraded":"2023-12-14T14:10:12.527360+0000","last_fullsized":"2023-12-14T14:10:12.527360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:17:39.685837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532414+0000","last_change":"2023-12-14T14:09:10.623660+0000","last_active":"2023-12-14T14:10:12.532414+0000","last_peered":"2023-12-14T14:10:12.532414+0000","last_clean":"2023-12-14T14:10:12.532414+0000","last_became_active":"2023-12-14T14:09:10.623321+0000","last_became_peered":"2023-12-14T14:09:10.623321+0000","last_unstale":"2023-12-14T14:10:12.532414+0000","last_undegraded":"2023-12-14T14:10:12.532414+0000","last_fullsized":"2023-12-14T14:10:12.532414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:32:49.708710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:22.908002+0000","last_change":"2023-12-14T14:09:10.217849+0000","last_active":"2023-12-14T14:10:22.908002+0000","last_peered":"2023-12-14T14:10:22.908002+0000","last_clean":"2023-12-14T14:10:22.908002+0000","last_became_active":"2023-12-14T14:09:10.217501+0000","last_became_peered":"2023-12-14T14:09:10.217501+0000","last_unstale":"2023-12-14T14:10:22.908002+0000","last_undegraded":"2023-12-14T14:10:22.908002+0000","last_fullsized":"2023-12-14T14:10:22.908002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:30:18.337627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532002+0000","last_change":"2023-12-14T14:09:10.627193+0000","last_active":"2023-12-14T14:10:12.532002+0000","last_peered":"2023-12-14T14:10:12.532002+0000","last_clean":"2023-12-14T14:10:12.532002+0000","last_became_active":"2023-12-14T14:09:10.626887+0000","last_became_peered":"2023-12-14T14:09:10.626887+0000","last_unstale":"2023-12-14T14:10:12.532002+0000","last_undegraded":"2023-12-14T14:10:12.532002+0000","last_fullsized":"2023-12-14T14:10:12.532002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:21:20.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532277+0000","last_change":"2023-12-14T14:09:10.220564+0000","last_active":"2023-12-14T14:10:12.532277+0000","last_peered":"2023-12-14T14:10:12.532277+0000","last_clean":"2023-12-14T14:10:12.532277+0000","last_became_active":"2023-12-14T14:09:10.219921+0000","last_became_peered":"2023-12-14T14:09:10.219921+0000","last_unstale":"2023-12-14T14:10:12.532277+0000","last_undegraded":"2023-12-14T14:10:12.532277+0000","last_fullsized":"2023-12-14T14:10:12.532277+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:08:02.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526837+0000","last_change":"2023-12-14T14:09:10.625056+0000","last_active":"2023-12-14T14:10:12.526837+0000","last_peered":"2023-12-14T14:10:12.526837+0000","last_clean":"2023-12-14T14:10:12.526837+0000","last_became_active":"2023-12-14T14:09:10.624626+0000","last_became_peered":"2023-12-14T14:09:10.624626+0000","last_unstale":"2023-12-14T14:10:12.526837+0000","last_undegraded":"2023-12-14T14:10:12.526837+0000","last_fullsized":"2023-12-14T14:10:12.526837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:35:00.124910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.533020+0000","last_change":"2023-12-14T14:09:10.215413+0000","last_active":"2023-12-14T14:10:12.533020+0000","last_peered":"2023-12-14T14:10:12.533020+0000","last_clean":"2023-12-14T14:10:12.533020+0000","last_became_active":"2023-12-14T14:09:10.214925+0000","last_became_peered":"2023-12-14T14:09:10.214925+0000","last_unstale":"2023-12-14T14:10:12.533020+0000","last_undegraded":"2023-12-14T14:10:12.533020+0000","last_fullsized":"2023-12-14T14:10:12.533020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:00:34.365885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531792+0000","last_change":"2023-12-14T14:09:10.629879+0000","last_active":"2023-12-14T14:10:12.531792+0000","last_peered":"2023-12-14T14:10:12.531792+0000","last_clean":"2023-12-14T14:10:12.531792+0000","last_became_active":"2023-12-14T14:09:10.629539+0000","last_became_peered":"2023-12-14T14:09:10.629539+0000","last_unstale":"2023-12-14T14:10:12.531792+0000","last_undegraded":"2023-12-14T14:10:12.531792+0000","last_fullsized":"2023-12-14T14:10:12.531792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:51:46.941614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.798142+0000","last_change":"2023-12-14T14:10:12.798142+0000","last_active":"2023-12-14T14:10:12.798142+0000","last_peered":"2023-12-14T14:10:12.798142+0000","last_clean":"2023-12-14T14:10:12.798142+0000","last_became_active":"2023-12-14T14:10:12.797763+0000","last_became_peered":"2023-12-14T14:10:12.797763+0000","last_unstale":"2023-12-14T14:10:12.798142+0000","last_undegraded":"2023-12-14T14:10:12.798142+0000","last_fullsized":"2023-12-14T14:10:12.798142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:53:06.227507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527531+0000","last_change":"2023-12-14T14:09:10.619279+0000","last_active":"2023-12-14T14:10:12.527531+0000","last_peered":"2023-12-14T14:10:12.527531+0000","last_clean":"2023-12-14T14:10:12.527531+0000","last_became_active":"2023-12-14T14:09:10.618794+0000","last_became_peered":"2023-12-14T14:09:10.618794+0000","last_unstale":"2023-12-14T14:10:12.527531+0000","last_undegraded":"2023-12-14T14:10:12.527531+0000","last_fullsized":"2023-12-14T14:10:12.527531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:52:19.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532513+0000","last_change":"2023-12-14T14:09:10.222213+0000","last_active":"2023-12-14T14:10:12.532513+0000","last_peered":"2023-12-14T14:10:12.532513+0000","last_clean":"2023-12-14T14:10:12.532513+0000","last_became_active":"2023-12-14T14:09:10.221314+0000","last_became_peered":"2023-12-14T14:09:10.221314+0000","last_unstale":"2023-12-14T14:10:12.532513+0000","last_undegraded":"2023-12-14T14:10:12.532513+0000","last_fullsized":"2023-12-14T14:10:12.532513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:21:43.468606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527564+0000","last_change":"2023-12-14T14:09:10.624523+0000","last_active":"2023-12-14T14:10:12.527564+0000","last_peered":"2023-12-14T14:10:12.527564+0000","last_clean":"2023-12-14T14:10:12.527564+0000","last_became_active":"2023-12-14T14:09:10.624204+0000","last_became_peered":"2023-12-14T14:09:10.624204+0000","last_unstale":"2023-12-14T14:10:12.527564+0000","last_undegraded":"2023-12-14T14:10:12.527564+0000","last_fullsized":"2023-12-14T14:10:12.527564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:04:50.294802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526896+0000","last_change":"2023-12-14T14:09:10.626166+0000","last_active":"2023-12-14T14:10:12.526896+0000","last_peered":"2023-12-14T14:10:12.526896+0000","last_clean":"2023-12-14T14:10:12.526896+0000","last_became_active":"2023-12-14T14:09:10.625831+0000","last_became_peered":"2023-12-14T14:09:10.625831+0000","last_unstale":"2023-12-14T14:10:12.526896+0000","last_undegraded":"2023-12-14T14:10:12.526896+0000","last_fullsized":"2023-12-14T14:10:12.526896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:25:33.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":91,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:22.907288+0000","last_change":"2023-12-14T14:09:10.217759+0000","last_active":"2023-12-14T14:10:22.907288+0000","last_peered":"2023-12-14T14:10:22.907288+0000","last_clean":"2023-12-14T14:10:22.907288+0000","last_became_active":"2023-12-14T14:09:10.217454+0000","last_became_peered":"2023-12-14T14:09:10.217454+0000","last_unstale":"2023-12-14T14:10:22.907288+0000","last_undegraded":"2023-12-14T14:10:22.907288+0000","last_fullsized":"2023-12-14T14:10:22.907288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:45.595634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.054566+0000","last_change":"2023-12-14T14:10:13.054168+0000","last_active":"2023-12-14T14:10:13.054566+0000","last_peered":"2023-12-14T14:10:13.054566+0000","last_clean":"2023-12-14T14:10:13.054566+0000","last_became_active":"2023-12-14T14:10:13.053907+0000","last_became_peered":"2023-12-14T14:10:13.053907+0000","last_unstale":"2023-12-14T14:10:13.054566+0000","last_undegraded":"2023-12-14T14:10:13.054566+0000","last_fullsized":"2023-12-14T14:10:13.054566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:32:50.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.755707+0000","last_change":"2023-12-14T14:09:10.214557+0000","last_active":"2023-12-14T14:10:12.755707+0000","last_peered":"2023-12-14T14:10:12.755707+0000","last_clean":"2023-12-14T14:10:12.755707+0000","last_became_active":"2023-12-14T14:09:10.214179+0000","last_became_peered":"2023-12-14T14:09:10.214179+0000","last_unstale":"2023-12-14T14:10:12.755707+0000","last_undegraded":"2023-12-14T14:10:12.755707+0000","last_fullsized":"2023-12-14T14:10:12.755707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:25:16.025802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":339,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532472+0000","last_change":"2023-12-14T14:08:24.268746+0000","last_active":"2023-12-14T14:10:12.532472+0000","last_peered":"2023-12-14T14:10:12.532472+0000","last_clean":"2023-12-14T14:10:12.532472+0000","last_became_active":"2023-12-14T14:08:24.268402+0000","last_became_peered":"2023-12-14T14:08:24.268402+0000","last_unstale":"2023-12-14T14:10:12.532472+0000","last_undegraded":"2023-12-14T14:10:12.532472+0000","last_fullsized":"2023-12-14T14:10:12.532472+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_clean_scrub_stamp":"2023-12-14T14:05:59.057653+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:46:12.936597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531780+0000","last_change":"2023-12-14T14:10:12.531780+0000","last_active":"2023-12-14T14:10:12.531780+0000","last_peered":"2023-12-14T14:10:12.531780+0000","last_clean":"2023-12-14T14:10:12.531780+0000","last_became_active":"2023-12-14T14:10:12.531437+0000","last_became_peered":"2023-12-14T14:10:12.531437+0000","last_unstale":"2023-12-14T14:10:12.531780+0000","last_undegraded":"2023-12-14T14:10:12.531780+0000","last_fullsized":"2023-12-14T14:10:12.531780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:45:55.441797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532302+0000","last_change":"2023-12-14T14:09:10.221812+0000","last_active":"2023-12-14T14:10:12.532302+0000","last_peered":"2023-12-14T14:10:12.532302+0000","last_clean":"2023-12-14T14:10:12.532302+0000","last_became_active":"2023-12-14T14:09:10.221483+0000","last_became_peered":"2023-12-14T14:09:10.221483+0000","last_unstale":"2023-12-14T14:10:12.532302+0000","last_undegraded":"2023-12-14T14:10:12.532302+0000","last_fullsized":"2023-12-14T14:10:12.532302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:41:43.778300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532911+0000","last_change":"2023-12-14T14:09:10.217249+0000","last_active":"2023-12-14T14:10:12.532911+0000","last_peered":"2023-12-14T14:10:12.532911+0000","last_clean":"2023-12-14T14:10:12.532911+0000","last_became_active":"2023-12-14T14:09:10.216953+0000","last_became_peered":"2023-12-14T14:09:10.216953+0000","last_unstale":"2023-12-14T14:10:12.532911+0000","last_undegraded":"2023-12-14T14:10:12.532911+0000","last_fullsized":"2023-12-14T14:10:12.532911+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:06:32.739744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527278+0000","last_change":"2023-12-14T14:09:10.616264+0000","last_active":"2023-12-14T14:10:12.527278+0000","last_peered":"2023-12-14T14:10:12.527278+0000","last_clean":"2023-12-14T14:10:12.527278+0000","last_became_active":"2023-12-14T14:09:10.615993+0000","last_became_peered":"2023-12-14T14:09:10.615993+0000","last_unstale":"2023-12-14T14:10:12.527278+0000","last_undegraded":"2023-12-14T14:10:12.527278+0000","last_fullsized":"2023-12-14T14:10:12.527278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:17:58.050642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529818+0000","last_change":"2023-12-14T14:09:10.218040+0000","last_active":"2023-12-14T14:10:12.529818+0000","last_peered":"2023-12-14T14:10:12.529818+0000","last_clean":"2023-12-14T14:10:12.529818+0000","last_became_active":"2023-12-14T14:09:10.217698+0000","last_became_peered":"2023-12-14T14:09:10.217698+0000","last_unstale":"2023-12-14T14:10:12.529818+0000","last_undegraded":"2023-12-14T14:10:12.529818+0000","last_fullsized":"2023-12-14T14:10:12.529818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:24:14.577324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529192+0000","last_change":"2023-12-14T14:09:10.626705+0000","last_active":"2023-12-14T14:10:12.529192+0000","last_peered":"2023-12-14T14:10:12.529192+0000","last_clean":"2023-12-14T14:10:12.529192+0000","last_became_active":"2023-12-14T14:09:10.626390+0000","last_became_peered":"2023-12-14T14:09:10.626390+0000","last_unstale":"2023-12-14T14:10:12.529192+0000","last_undegraded":"2023-12-14T14:10:12.529192+0000","last_fullsized":"2023-12-14T14:10:12.529192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:11:51.665277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.756152+0000","last_change":"2023-12-14T14:09:10.224068+0000","last_active":"2023-12-14T14:10:12.756152+0000","last_peered":"2023-12-14T14:10:12.756152+0000","last_clean":"2023-12-14T14:10:12.756152+0000","last_became_active":"2023-12-14T14:09:10.223709+0000","last_became_peered":"2023-12-14T14:09:10.223709+0000","last_unstale":"2023-12-14T14:10:12.756152+0000","last_undegraded":"2023-12-14T14:10:12.756152+0000","last_fullsized":"2023-12-14T14:10:12.756152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:09:02.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797414+0000","last_change":"2023-12-14T14:09:10.633221+0000","last_active":"2023-12-14T14:10:12.797414+0000","last_peered":"2023-12-14T14:10:12.797414+0000","last_clean":"2023-12-14T14:10:12.797414+0000","last_became_active":"2023-12-14T14:09:10.632881+0000","last_became_peered":"2023-12-14T14:09:10.632881+0000","last_unstale":"2023-12-14T14:10:12.797414+0000","last_undegraded":"2023-12-14T14:10:12.797414+0000","last_fullsized":"2023-12-14T14:10:12.797414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:18:22.961120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.052653+0000","last_change":"2023-12-14T14:09:10.219793+0000","last_active":"2023-12-14T14:10:13.052653+0000","last_peered":"2023-12-14T14:10:13.052653+0000","last_clean":"2023-12-14T14:10:13.052653+0000","last_became_active":"2023-12-14T14:09:10.219485+0000","last_became_peered":"2023-12-14T14:09:10.219485+0000","last_unstale":"2023-12-14T14:10:13.052653+0000","last_undegraded":"2023-12-14T14:10:13.052653+0000","last_fullsized":"2023-12-14T14:10:13.052653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:05:25.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532431+0000","last_change":"2023-12-14T14:09:10.622064+0000","last_active":"2023-12-14T14:10:12.532431+0000","last_peered":"2023-12-14T14:10:12.532431+0000","last_clean":"2023-12-14T14:10:12.532431+0000","last_became_active":"2023-12-14T14:09:10.621741+0000","last_became_peered":"2023-12-14T14:09:10.621741+0000","last_unstale":"2023-12-14T14:10:12.532431+0000","last_undegraded":"2023-12-14T14:10:12.532431+0000","last_fullsized":"2023-12-14T14:10:12.532431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:59:00.963112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528925+0000","last_change":"2023-12-14T14:09:10.209152+0000","last_active":"2023-12-14T14:10:12.528925+0000","last_peered":"2023-12-14T14:10:12.528925+0000","last_clean":"2023-12-14T14:10:12.528925+0000","last_became_active":"2023-12-14T14:09:10.208798+0000","last_became_peered":"2023-12-14T14:09:10.208798+0000","last_unstale":"2023-12-14T14:10:12.528925+0000","last_undegraded":"2023-12-14T14:10:12.528925+0000","last_fullsized":"2023-12-14T14:10:12.528925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:55.451603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.530802+0000","last_change":"2023-12-14T14:09:10.616109+0000","last_active":"2023-12-14T14:10:12.530802+0000","last_peered":"2023-12-14T14:10:12.530802+0000","last_clean":"2023-12-14T14:10:12.530802+0000","last_became_active":"2023-12-14T14:09:10.615694+0000","last_became_peered":"2023-12-14T14:09:10.615694+0000","last_unstale":"2023-12-14T14:10:12.530802+0000","last_undegraded":"2023-12-14T14:10:12.530802+0000","last_fullsized":"2023-12-14T14:10:12.530802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:57:04.359521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529034+0000","last_change":"2023-12-14T14:09:10.224376+0000","last_active":"2023-12-14T14:10:12.529034+0000","last_peered":"2023-12-14T14:10:12.529034+0000","last_clean":"2023-12-14T14:10:12.529034+0000","last_became_active":"2023-12-14T14:09:10.224010+0000","last_became_peered":"2023-12-14T14:09:10.224010+0000","last_unstale":"2023-12-14T14:10:12.529034+0000","last_undegraded":"2023-12-14T14:10:12.529034+0000","last_fullsized":"2023-12-14T14:10:12.529034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:14.170417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528610+0000","last_change":"2023-12-14T14:09:10.622490+0000","last_active":"2023-12-14T14:10:12.528610+0000","last_peered":"2023-12-14T14:10:12.528610+0000","last_clean":"2023-12-14T14:10:12.528610+0000","last_became_active":"2023-12-14T14:09:10.622154+0000","last_became_peered":"2023-12-14T14:09:10.622154+0000","last_unstale":"2023-12-14T14:10:12.528610+0000","last_undegraded":"2023-12-14T14:10:12.528610+0000","last_fullsized":"2023-12-14T14:10:12.528610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:14:08.643046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532652+0000","last_change":"2023-12-14T14:09:10.220343+0000","last_active":"2023-12-14T14:10:12.532652+0000","last_peered":"2023-12-14T14:10:12.532652+0000","last_clean":"2023-12-14T14:10:12.532652+0000","last_became_active":"2023-12-14T14:09:10.219657+0000","last_became_peered":"2023-12-14T14:09:10.219657+0000","last_unstale":"2023-12-14T14:10:12.532652+0000","last_undegraded":"2023-12-14T14:10:12.532652+0000","last_fullsized":"2023-12-14T14:10:12.532652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:06:01.543748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532666+0000","last_change":"2023-12-14T14:09:10.633980+0000","last_active":"2023-12-14T14:10:12.532666+0000","last_peered":"2023-12-14T14:10:12.532666+0000","last_clean":"2023-12-14T14:10:12.532666+0000","last_became_active":"2023-12-14T14:09:10.633541+0000","last_became_peered":"2023-12-14T14:09:10.633541+0000","last_unstale":"2023-12-14T14:10:12.532666+0000","last_undegraded":"2023-12-14T14:10:12.532666+0000","last_fullsized":"2023-12-14T14:10:12.532666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:39:19.970037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529499+0000","last_change":"2023-12-14T14:09:10.218042+0000","last_active":"2023-12-14T14:10:12.529499+0000","last_peered":"2023-12-14T14:10:12.529499+0000","last_clean":"2023-12-14T14:10:12.529499+0000","last_became_active":"2023-12-14T14:09:10.217540+0000","last_became_peered":"2023-12-14T14:09:10.217540+0000","last_unstale":"2023-12-14T14:10:12.529499+0000","last_undegraded":"2023-12-14T14:10:12.529499+0000","last_fullsized":"2023-12-14T14:10:12.529499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:18:19.659078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532924+0000","last_change":"2023-12-14T14:09:10.633527+0000","last_active":"2023-12-14T14:10:12.532924+0000","last_peered":"2023-12-14T14:10:12.532924+0000","last_clean":"2023-12-14T14:10:12.532924+0000","last_became_active":"2023-12-14T14:09:10.632614+0000","last_became_peered":"2023-12-14T14:09:10.632614+0000","last_unstale":"2023-12-14T14:10:12.532924+0000","last_undegraded":"2023-12-14T14:10:12.532924+0000","last_fullsized":"2023-12-14T14:10:12.532924+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:24:02.650617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527211+0000","last_change":"2023-12-14T14:09:10.211731+0000","last_active":"2023-12-14T14:10:12.527211+0000","last_peered":"2023-12-14T14:10:12.527211+0000","last_clean":"2023-12-14T14:10:12.527211+0000","last_became_active":"2023-12-14T14:09:10.211366+0000","last_became_peered":"2023-12-14T14:09:10.211366+0000","last_unstale":"2023-12-14T14:10:12.527211+0000","last_undegraded":"2023-12-14T14:10:12.527211+0000","last_fullsized":"2023-12-14T14:10:12.527211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:49:40.508221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532233+0000","last_change":"2023-12-14T14:09:10.621483+0000","last_active":"2023-12-14T14:10:12.532233+0000","last_peered":"2023-12-14T14:10:12.532233+0000","last_clean":"2023-12-14T14:10:12.532233+0000","last_became_active":"2023-12-14T14:09:10.621105+0000","last_became_peered":"2023-12-14T14:09:10.621105+0000","last_unstale":"2023-12-14T14:10:12.532233+0000","last_undegraded":"2023-12-14T14:10:12.532233+0000","last_fullsized":"2023-12-14T14:10:12.532233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:25:34.331333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.759796+0000","last_change":"2023-12-14T14:10:12.759796+0000","last_active":"2023-12-14T14:10:12.759796+0000","last_peered":"2023-12-14T14:10:12.759796+0000","last_clean":"2023-12-14T14:10:12.759796+0000","last_became_active":"2023-12-14T14:10:12.757507+0000","last_became_peered":"2023-12-14T14:10:12.757507+0000","last_unstale":"2023-12-14T14:10:12.759796+0000","last_undegraded":"2023-12-14T14:10:12.759796+0000","last_fullsized":"2023-12-14T14:10:12.759796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:08:46.390118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532664+0000","last_change":"2023-12-14T14:09:10.633084+0000","last_active":"2023-12-14T14:10:12.532664+0000","last_peered":"2023-12-14T14:10:12.532664+0000","last_clean":"2023-12-14T14:10:12.532664+0000","last_became_active":"2023-12-14T14:09:10.632544+0000","last_became_peered":"2023-12-14T14:09:10.632544+0000","last_unstale":"2023-12-14T14:10:12.532664+0000","last_undegraded":"2023-12-14T14:10:12.532664+0000","last_fullsized":"2023-12-14T14:10:12.532664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:36:46.213060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.530946+0000","last_change":"2023-12-14T14:09:10.618373+0000","last_active":"2023-12-14T14:10:12.530946+0000","last_peered":"2023-12-14T14:10:12.530946+0000","last_clean":"2023-12-14T14:10:12.530946+0000","last_became_active":"2023-12-14T14:09:10.618028+0000","last_became_peered":"2023-12-14T14:09:10.618028+0000","last_unstale":"2023-12-14T14:10:12.530946+0000","last_undegraded":"2023-12-14T14:10:12.530946+0000","last_fullsized":"2023-12-14T14:10:12.530946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:14:02.328236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528984+0000","last_change":"2023-12-14T14:09:10.622775+0000","last_active":"2023-12-14T14:10:12.528984+0000","last_peered":"2023-12-14T14:10:12.528984+0000","last_clean":"2023-12-14T14:10:12.528984+0000","last_became_active":"2023-12-14T14:09:10.622407+0000","last_became_peered":"2023-12-14T14:09:10.622407+0000","last_unstale":"2023-12-14T14:10:12.528984+0000","last_undegraded":"2023-12-14T14:10:12.528984+0000","last_fullsized":"2023-12-14T14:10:12.528984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:54:19.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528836+0000","last_change":"2023-12-14T14:09:10.622137+0000","last_active":"2023-12-14T14:10:12.528836+0000","last_peered":"2023-12-14T14:10:12.528836+0000","last_clean":"2023-12-14T14:10:12.528836+0000","last_became_active":"2023-12-14T14:09:10.621829+0000","last_became_peered":"2023-12-14T14:09:10.621829+0000","last_unstale":"2023-12-14T14:10:12.528836+0000","last_undegraded":"2023-12-14T14:10:12.528836+0000","last_fullsized":"2023-12-14T14:10:12.528836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:02:06.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797053+0000","last_change":"2023-12-14T14:09:10.625511+0000","last_active":"2023-12-14T14:10:12.797053+0000","last_peered":"2023-12-14T14:10:12.797053+0000","last_clean":"2023-12-14T14:10:12.797053+0000","last_became_active":"2023-12-14T14:09:10.624863+0000","last_became_peered":"2023-12-14T14:09:10.624863+0000","last_unstale":"2023-12-14T14:10:12.797053+0000","last_undegraded":"2023-12-14T14:10:12.797053+0000","last_fullsized":"2023-12-14T14:10:12.797053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:15:14.831325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527405+0000","last_change":"2023-12-14T14:09:10.623824+0000","last_active":"2023-12-14T14:10:12.527405+0000","last_peered":"2023-12-14T14:10:12.527405+0000","last_clean":"2023-12-14T14:10:12.527405+0000","last_became_active":"2023-12-14T14:09:10.623482+0000","last_became_peered":"2023-12-14T14:09:10.623482+0000","last_unstale":"2023-12-14T14:10:12.527405+0000","last_undegraded":"2023-12-14T14:10:12.527405+0000","last_fullsized":"2023-12-14T14:10:12.527405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:03:53.219733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532039+0000","last_change":"2023-12-14T14:09:10.618004+0000","last_active":"2023-12-14T14:10:12.532039+0000","last_peered":"2023-12-14T14:10:12.532039+0000","last_clean":"2023-12-14T14:10:12.532039+0000","last_became_active":"2023-12-14T14:09:10.617184+0000","last_became_peered":"2023-12-14T14:09:10.617184+0000","last_unstale":"2023-12-14T14:10:12.532039+0000","last_undegraded":"2023-12-14T14:10:12.532039+0000","last_fullsized":"2023-12-14T14:10:12.532039+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:00:28.593004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529967+0000","last_change":"2023-12-14T14:09:10.621183+0000","last_active":"2023-12-14T14:10:12.529967+0000","last_peered":"2023-12-14T14:10:12.529967+0000","last_clean":"2023-12-14T14:10:12.529967+0000","last_became_active":"2023-12-14T14:09:10.620474+0000","last_became_peered":"2023-12-14T14:09:10.620474+0000","last_unstale":"2023-12-14T14:10:12.529967+0000","last_undegraded":"2023-12-14T14:10:12.529967+0000","last_fullsized":"2023-12-14T14:10:12.529967+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:55:57.422251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528615+0000","last_change":"2023-12-14T14:09:10.630668+0000","last_active":"2023-12-14T14:10:12.528615+0000","last_peered":"2023-12-14T14:10:12.528615+0000","last_clean":"2023-12-14T14:10:12.528615+0000","last_became_active":"2023-12-14T14:09:10.630337+0000","last_became_peered":"2023-12-14T14:09:10.630337+0000","last_unstale":"2023-12-14T14:10:12.528615+0000","last_undegraded":"2023-12-14T14:10:12.528615+0000","last_fullsized":"2023-12-14T14:10:12.528615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:31:23.847778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526713+0000","last_change":"2023-12-14T14:09:10.619550+0000","last_active":"2023-12-14T14:10:12.526713+0000","last_peered":"2023-12-14T14:10:12.526713+0000","last_clean":"2023-12-14T14:10:12.526713+0000","last_became_active":"2023-12-14T14:09:10.619029+0000","last_became_peered":"2023-12-14T14:09:10.619029+0000","last_unstale":"2023-12-14T14:10:12.526713+0000","last_undegraded":"2023-12-14T14:10:12.526713+0000","last_fullsized":"2023-12-14T14:10:12.526713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:56:08.554200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528969+0000","last_change":"2023-12-14T14:09:10.622158+0000","last_active":"2023-12-14T14:10:12.528969+0000","last_peered":"2023-12-14T14:10:12.528969+0000","last_clean":"2023-12-14T14:10:12.528969+0000","last_became_active":"2023-12-14T14:09:10.621853+0000","last_became_peered":"2023-12-14T14:09:10.621853+0000","last_unstale":"2023-12-14T14:10:12.528969+0000","last_undegraded":"2023-12-14T14:10:12.528969+0000","last_fullsized":"2023-12-14T14:10:12.528969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:21:50.173060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053003+0000","last_change":"2023-12-14T14:09:10.627728+0000","last_active":"2023-12-14T14:10:13.053003+0000","last_peered":"2023-12-14T14:10:13.053003+0000","last_clean":"2023-12-14T14:10:13.053003+0000","last_became_active":"2023-12-14T14:09:10.627352+0000","last_became_peered":"2023-12-14T14:09:10.627352+0000","last_unstale":"2023-12-14T14:10:13.053003+0000","last_undegraded":"2023-12-14T14:10:13.053003+0000","last_fullsized":"2023-12-14T14:10:13.053003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:45:33.802754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526139+0000","last_change":"2023-12-14T14:09:10.625676+0000","last_active":"2023-12-14T14:10:12.526139+0000","last_peered":"2023-12-14T14:10:12.526139+0000","last_clean":"2023-12-14T14:10:12.526139+0000","last_became_active":"2023-12-14T14:09:10.625191+0000","last_became_peered":"2023-12-14T14:09:10.625191+0000","last_unstale":"2023-12-14T14:10:12.526139+0000","last_undegraded":"2023-12-14T14:10:12.526139+0000","last_fullsized":"2023-12-14T14:10:12.526139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:13:27.311452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531846+0000","last_change":"2023-12-14T14:09:10.624258+0000","last_active":"2023-12-14T14:10:12.531846+0000","last_peered":"2023-12-14T14:10:12.531846+0000","last_clean":"2023-12-14T14:10:12.531846+0000","last_became_active":"2023-12-14T14:09:10.623917+0000","last_became_peered":"2023-12-14T14:09:10.623917+0000","last_unstale":"2023-12-14T14:10:12.531846+0000","last_undegraded":"2023-12-14T14:10:12.531846+0000","last_fullsized":"2023-12-14T14:10:12.531846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:44:13.500368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65175,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":450,"num_read_kb":293,"num_write":153,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":186245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481816,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6016,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739136,"statfs":{"total":95995035648,"available":95988875264,"internally_reserved":0,"allocated":909312,"data_stored":441084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.746}]},{"osd":8,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53600000000000003}]},{"osd":9,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.81000000000000005}]}]},{"osd":10,"up_from":70,"seq":300647710749,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738732,"statfs":{"total":95995035648,"available":95988461568,"internally_reserved":0,"allocated":1060864,"data_stored":1093794,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58899999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.754,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.372}]},{"osd":2,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73699999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.52900000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78000000000000003,"5min":1.29,"15min":1.29},"last":0.497}]},{"osd":4,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.437},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64200000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.79100000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.61699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.67600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.90800000000000003,"5min":1.244,"15min":1.244},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.84899999999999998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.52100000000000002}]},{"osd":9,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.64700000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.395,"15min":1.395},"last":0.59599999999999997}]},{"osd":11,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.621}]}]},{"osd":9,"up_from":65,"seq":279172874271,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6160,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738992,"statfs":{"total":95995035648,"available":95988727808,"internally_reserved":0,"allocated":925696,"data_stored":441320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":0.61199999999999999,"15min":0.48499999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":21.376000000000001,"5min":21.376000000000001,"15min":21.376000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":0.63700000000000001,"15min":0.51100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":21.303000000000001,"5min":21.303000000000001,"15min":21.303000000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.65400000000000003,"15min":0.60299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":10.380000000000001,"5min":10.380000000000001,"15min":10.380000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.556,"5min":0.77500000000000002,"15min":0.64500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":21.317,"5min":21.317,"15min":21.317},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.67300000000000004,"15min":0.621},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":10.406000000000001,"5min":10.406000000000001,"15min":10.406000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.556,"5min":0.78700000000000003,"15min":0.65900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":21.402000000000001,"5min":21.402000000000001,"15min":21.402000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":0.69299999999999995,"15min":0.57299999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":21.097999999999999,"5min":21.097999999999999,"15min":21.097999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.57299999999999995,"15min":0.52500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":10.455,"5min":10.455,"15min":10.455},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":0.80100000000000005,"15min":0.67700000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":21.068000000000001,"5min":21.068000000000001,"15min":21.068000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.5620000000000001,"5min":0.78600000000000003,"15min":0.65700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":21.178999999999998,"5min":21.178999999999998,"15min":21.178999999999998},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":0.83199999999999996,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":21.25,"5min":21.25,"15min":21.25},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.016,"5min":0.72599999999999998,"15min":0.67800000000000005},"min":{"1min":0.436,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":10.337999999999999,"5min":10.337999999999999,"15min":10.337999999999999},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":0.746,"15min":0.65600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":17.748000000000001,"5min":17.748000000000001,"15min":17.748000000000001},"last":0.307},{"interface":"front","average":{"1min":1.5,"5min":0.82899999999999996,"15min":0.71699999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":21.452999999999999,"5min":21.452999999999999,"15min":21.452999999999999},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":0.89100000000000001,"15min":0.76800000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":21.219000000000001,"5min":21.219000000000001,"15min":21.219000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.79000000000000004,"15min":0.74199999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.430999999999999,"5min":10.430999999999999,"15min":10.430999999999999},"last":0.51700000000000002}]},{"osd":8,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":0.91800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":21.428999999999998,"5min":21.428999999999998,"15min":21.428999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.6579999999999999,"5min":0.91700000000000004,"15min":0.79300000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":21.274999999999999,"5min":21.274999999999999,"15min":21.274999999999999},"last":0.65300000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":0.92000000000000004,"15min":0.79100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":21.347000000000001,"5min":21.347000000000001,"15min":21.347000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.708,"5min":0.90800000000000003,"15min":0.77500000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":21.152999999999999,"5min":21.152999999999999,"15min":21.152999999999999},"last":0.58899999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":8,"up_from":58,"seq":249108103204,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6288,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738864,"statfs":{"total":95995035648,"available":95988596736,"internally_reserved":0,"allocated":925696,"data_stored":441240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81399999999999995,"5min":0.88,"15min":0.88},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.79700000000000004,"5min":0.875,"15min":0.875},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78700000000000003,"5min":1.411,"15min":1.411},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97299999999999998,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.34899999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90100000000000002,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.66900000000000004,"15min":0.65800000000000003},"min":{"1min":0.50900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.88100000000000001}]},{"osd":9,"last update":"Thu Dec 14 14:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.70899999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.73999999999999999},"min":{"1min":0.57899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92800000000000005,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.89900000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.60999999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94699999999999995,"5min":1.032,"15min":1.032},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78700000000000003,"15min":0.77800000000000002},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.86699999999999999}]}]},{"osd":7,"up_from":50,"seq":214748364838,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6400,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738752,"statfs":{"total":95995035648,"available":95988482048,"internally_reserved":0,"allocated":974848,"data_stored":1033469,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.311}]},{"osd":1,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.436,"15min":0.44},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.63}]},{"osd":2,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78700000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.752}]},{"osd":5,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.79900000000000004}]},{"osd":6,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66400000000000003},"min":{"1min":0.46800000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.81799999999999995}]},{"osd":8,"last update":"Thu Dec 14 14:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86899999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.876}]},{"osd":9,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.115,"5min":0.78500000000000003,"15min":0.72999999999999998},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":0.82899999999999996}]},{"osd":10,"last update":"Thu Dec 14 14:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.87}]},{"osd":11,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91000000000000003}]}]},{"osd":6,"up_from":45,"seq":193273528362,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6276,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738876,"statfs":{"total":95995035648,"available":95988609024,"internally_reserved":0,"allocated":913408,"data_stored":440715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46899999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27300000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.501,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.436,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60099999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58499999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.63800000000000001,"5min":1.075,"15min":1.075},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68300000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.626,"15min":0.64200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71799999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65600000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":0.995,"15min":0.995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90200000000000002,"5min":1.254,"15min":1.254},"last":0.57399999999999995}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81100000000000005,"5min":1.288,"15min":1.288},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65900000000000003}]},{"osd":9,"last update":"Thu Dec 14 14:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.64500000000000002,"15min":0.66900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66700000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":0.46999999999999997}]},{"osd":10,"last update":"Thu Dec 14 14:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.77400000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84999999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7292,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737860,"statfs":{"total":95995035648,"available":95987568640,"internally_reserved":0,"allocated":970752,"data_stored":496743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.503,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71299999999999997,"5min":0.87,"15min":0.87},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Dec 14 14:10:06 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.311,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.52800000000000002,"15min":0.505},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.439}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.40799999999999997,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.42499999999999999,"15min":0.40699999999999997},"min":{"1min":0.30199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.59599999999999997,"15min":0.57499999999999996},"min":{"1min":0.47799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.57599999999999996,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.42599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.49399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84199999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Dec 14 14:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63300000000000001}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67200000000000004,"15min":0.66100000000000003},"min":{"1min":0.55500000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002}]},{"osd":9,"last update":"Thu Dec 14 14:10:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.51200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.53000000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.71599999999999997}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Dec 14 14:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.81799999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7192,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737960,"statfs":{"total":95995035648,"available":95987671040,"internally_reserved":0,"allocated":933888,"data_stored":441980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.45800000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.54400000000000004,"15min":0.496},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Dec 14 14:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.57299999999999995,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":5.5270000000000001,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.57699999999999996,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.372,"15min":0.372},"max":{"1min":5.0259999999999998,"5min":5.0259999999999998,"15min":5.0259999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Dec 14 14:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.6660000000000004,"5min":5.6660000000000004,"15min":5.6660000000000004},"last":0.376}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":0.503},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.55700000000000005,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.61499999999999999,"15min":0.57199999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":5.3890000000000002,"5min":5.3890000000000002,"15min":5.3890000000000002},"last":0.315},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.1340000000000003,"5min":5.1340000000000003,"15min":5.1340000000000003},"last":0.35099999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.109,"5min":5.109,"15min":5.109},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu Dec 14 14:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.9509999999999996,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66700000000000004,"15min":0.65500000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":5.0019999999999998,"5min":5.0019999999999998,"15min":5.0019999999999998},"last":0.437}]},{"osd":10,"last update":"Thu Dec 14 14:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.70399999999999996,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.622},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.66700000000000004,"15min":0.63400000000000001},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.4500000000000002,"5min":5.4500000000000002,"15min":5.4500000000000002},"last":0.55900000000000005}]},{"osd":11,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.63},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.0499999999999998,"5min":5.0499999999999998,"15min":5.0499999999999998},"last":0.46500000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7440,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737712,"statfs":{"total":95995035648,"available":95987417088,"internally_reserved":0,"allocated":991232,"data_stored":498162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.47099999999999997,"15min":0.437},"min":{"1min":0.35999999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.46000000000000002},"min":{"1min":0.38700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.51900000000000002,"15min":0.47699999999999998},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.52000000000000002,"15min":0.47199999999999998},"min":{"1min":0.375,"5min":0.308,"15min":0.308},"max":{"1min":0.76600000000000001,"5min":0.877,"15min":0.877},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.40899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71299999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.46100000000000002},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.505,"15min":0.497},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89900000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.747}]},{"osd":7,"last update":"Thu Dec 14 14:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626}]},{"osd":8,"last update":"Thu Dec 14 14:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Dec 14 14:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.57799999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.63300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95299999999999996,"5min":1.046,"15min":1.046},"last":0.80700000000000005}]},{"osd":10,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65600000000000003,"15min":0.64800000000000002},"min":{"1min":0.57999999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.88},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.58199999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91700000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.89000000000000001}]},{"osd":11,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.82499999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215157,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6548,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738604,"statfs":{"total":95995035648,"available":95988330496,"internally_reserved":0,"allocated":929792,"data_stored":441032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.316},"min":{"1min":0.252,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.308},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.505,"15min":0.47999999999999998},"min":{"1min":0.44700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.45600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55500000000000005,"15min":0.53500000000000003},"min":{"1min":0.47499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84499999999999997,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77900000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.58999999999999997}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58899999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.65000000000000002,"15min":0.67400000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":1.012,"15min":1.012},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67800000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65500000000000003}]},{"osd":11,"last update":"Thu Dec 14 14:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.623}]}]},{"osd":4,"up_from":32,"seq":137438953521,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6408,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738744,"statfs":{"total":95995035648,"available":95988473856,"internally_reserved":0,"allocated":917504,"data_stored":441488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.498}]},{"osd":1,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.32100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81100000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52700000000000002,"15min":0.51200000000000001},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78000000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Dec 14 14:09:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80700000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84299999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.746}]},{"osd":6,"last update":"Thu Dec 14 14:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76900000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.58999999999999997},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83699999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.88200000000000001}]},{"osd":9,"last update":"Thu Dec 14 14:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":1.216,"15min":1.216},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.78400000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67400000000000004}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.73199999999999998}]},{"osd":11,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.90100000000000002}]}]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6536,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738616,"statfs":{"total":95995035648,"available":95988342784,"internally_reserved":0,"allocated":983040,"data_stored":1032530,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.499},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.54500000000000004,"15min":0.51400000000000001},"min":{"1min":0.51500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56200000000000006,"15min":0.53800000000000003},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.41099999999999998,"15min":0.38300000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.57799999999999996,"15min":0.54800000000000004},"min":{"1min":0.48199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.57499999999999996,"15min":0.54700000000000004},"min":{"1min":0.48599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Dec 14 14:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":1.032,"15min":1.032},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.69299999999999995}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 14:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.69699999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69299999999999995,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60899999999999999}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.747},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T14:10:28.315 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-12-14T14:10:28.315 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T14:10:28.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 -- 172.21.15.69:0/707123036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c103610 msgr2=0x7f5c7c1059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 --2- 172.21.15.69:0/707123036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c103610 0x7f5c7c1059f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009990 tx=0x7f5c78009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 -- 172.21.15.69:0/707123036 shutdown_connections 2023-12-14T14:10:28.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 --2- 172.21.15.69:0/707123036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c7c105f30 0x7f5c7c108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 --2- 172.21.15.69:0/707123036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c100cf0 0x7f5c7c1030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 --2- 172.21.15.69:0/707123036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c103610 0x7f5c7c1059f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 -- 172.21.15.69:0/707123036 >> 172.21.15.69:0/707123036 conn(0x7f5c7c0fa6f0 msgr2=0x7f5c7c0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:28.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 -- 172.21.15.69:0/707123036 shutdown_connections 2023-12-14T14:10:28.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 -- 172.21.15.69:0/707123036 wait complete. 2023-12-14T14:10:28.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 Processor -- start 2023-12-14T14:10:28.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.470+0000 7f5c832c6700 1 -- start start 2023-12-14T14:10:28.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c832c6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c7c100cf0 0x7f5c7c100660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c832c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c103610 0x7f5c7c0feca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c832c6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c105f30 0x7f5c7c0ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c832c6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0ff980 con 0x7f5c7c105f30 2023-12-14T14:10:28.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c832c6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0ffaf0 con 0x7f5c7c103610 2023-12-14T14:10:28.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c832c6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c19fec0 con 0x7f5c7c100cf0 2023-12-14T14:10:28.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81863700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c105f30 0x7f5c7c0ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81863700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c105f30 0x7f5c7c0ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54458/0 (socket says 172.21.15.69:54458) 2023-12-14T14:10:28.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81863700 1 -- 172.21.15.69:0/1439422793 learned_addr learned my addr 172.21.15.69:0/1439422793 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:28.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c80861700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c103610 0x7f5c7c0feca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81062700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c7c100cf0 0x7f5c7c100660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81863700 1 -- 172.21.15.69:0/1439422793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c7c100cf0 msgr2=0x7f5c7c100660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81863700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c7c100cf0 0x7f5c7c100660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81863700 1 -- 172.21.15.69:0/1439422793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c103610 msgr2=0x7f5c7c0feca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81863700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c103610 0x7f5c7c0feca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81863700 1 -- 172.21.15.69:0/1439422793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780095f0 con 0x7f5c7c105f30 2023-12-14T14:10:28.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81062700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c7c100cf0 0x7f5c7c100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:28.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c81863700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c105f30 0x7f5c7c0ff1e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5c74007d70 tx=0x7f5c7400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:28.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c727fc700 1 -- 172.21.15.69:0/1439422793 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7400ad40 con 0x7f5c7c105f30 2023-12-14T14:10:28.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c727fc700 1 -- 172.21.15.69:0/1439422793 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c740128e0 con 0x7f5c7c105f30 2023-12-14T14:10:28.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c10bbd0 con 0x7f5c7c105f30 2023-12-14T14:10:28.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c727fc700 1 -- 172.21.15.69:0/1439422793 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740116b0 con 0x7f5c7c105f30 2023-12-14T14:10:28.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.471+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c10ba40 con 0x7f5c7c105f30 2023-12-14T14:10:28.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.472+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c0fc260 con 0x7f5c7c105f30 2023-12-14T14:10:28.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.474+0000 7f5c727fc700 1 -- 172.21.15.69:0/1439422793 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5c74012420 con 0x7f5c7c105f30 2023-12-14T14:10:28.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.474+0000 7f5c727fc700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5c680a1260 0x7f5c680a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.475+0000 7f5c81062700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5c680a1260 0x7f5c680a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.475+0000 7f5c727fc700 1 -- 172.21.15.69:0/1439422793 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f5c740ccfb0 con 0x7f5c7c105f30 2023-12-14T14:10:28.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.475+0000 7f5c81062700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5c680a1260 0x7f5c680a3710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c005fd0 tx=0x7f5c6c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:28.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.478+0000 7f5c727fc700 1 -- 172.21.15.69:0/1439422793 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5c740966b0 con 0x7f5c7c105f30 2023-12-14T14:10:28.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.664+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c7c061c40 con 0x7f5c680a1260 2023-12-14T14:10:28.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.674+0000 7f5c727fc700 1 -- 172.21.15.69:0/1439422793 <== mgr.14152 v2:172.21.15.69:6800/933503151 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344953 (secure 0 0 0) 0x7f5c7c061c40 con 0x7f5c680a1260 2023-12-14T14:10:28.680 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:28.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.677+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5c680a1260 msgr2=0x7f5c680a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.677+0000 7f5c832c6700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5c680a1260 0x7f5c680a3710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c005fd0 tx=0x7f5c6c005e30 comp rx=0 tx=0).stop 2023-12-14T14:10:28.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.677+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c105f30 msgr2=0x7f5c7c0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.677+0000 7f5c832c6700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c105f30 0x7f5c7c0ff1e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5c74007d70 tx=0x7f5c7400a340 comp rx=0 tx=0).stop 2023-12-14T14:10:28.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.678+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 shutdown_connections 2023-12-14T14:10:28.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.678+0000 7f5c832c6700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5c680a1260 0x7f5c680a3710 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.678+0000 7f5c832c6700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c7c105f30 0x7f5c7c0ff1e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.678+0000 7f5c832c6700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c7c100cf0 0x7f5c7c100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.678+0000 7f5c832c6700 1 --2- 172.21.15.69:0/1439422793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c103610 0x7f5c7c0feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.678+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 >> 172.21.15.69:0/1439422793 conn(0x7f5c7c0fa6f0 msgr2=0x7f5c7c101950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:28.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.678+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 shutdown_connections 2023-12-14T14:10:28.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.678+0000 7f5c832c6700 1 -- 172.21.15.69:0/1439422793 wait complete. 2023-12-14T14:10:28.686 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T14:10:28.691 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2023-12-14T14:10:28.622090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655789,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":586,"num_read_kb":412,"num_write":336,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":78980,"kb_used_data":11172,"kb_used_omap":0,"kb_used_meta":67712,"kb_avail":1124862844,"statfs":{"total":1151940427776,"available":1151859552256,"internally_reserved":0,"allocated":11440128,"data_stored":7248197,"data_compressed":107034,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":69337088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4640,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002738"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532076+0000","last_change":"2023-12-14T14:09:10.621884+0000","last_active":"2023-12-14T14:10:12.532076+0000","last_peered":"2023-12-14T14:10:12.532076+0000","last_clean":"2023-12-14T14:10:12.532076+0000","last_became_active":"2023-12-14T14:09:10.621605+0000","last_became_peered":"2023-12-14T14:09:10.621605+0000","last_unstale":"2023-12-14T14:10:12.532076+0000","last_undegraded":"2023-12-14T14:10:12.532076+0000","last_fullsized":"2023-12-14T14:10:12.532076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:13:21.636751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797344+0000","last_change":"2023-12-14T14:09:10.621555+0000","last_active":"2023-12-14T14:10:12.797344+0000","last_peered":"2023-12-14T14:10:12.797344+0000","last_clean":"2023-12-14T14:10:12.797344+0000","last_became_active":"2023-12-14T14:09:10.621265+0000","last_became_peered":"2023-12-14T14:09:10.621265+0000","last_unstale":"2023-12-14T14:10:12.797344+0000","last_undegraded":"2023-12-14T14:10:12.797344+0000","last_fullsized":"2023-12-14T14:10:12.797344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:15:38.893983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797176+0000","last_change":"2023-12-14T14:09:10.623575+0000","last_active":"2023-12-14T14:10:12.797176+0000","last_peered":"2023-12-14T14:10:12.797176+0000","last_clean":"2023-12-14T14:10:12.797176+0000","last_became_active":"2023-12-14T14:09:10.623289+0000","last_became_peered":"2023-12-14T14:09:10.623289+0000","last_unstale":"2023-12-14T14:10:12.797176+0000","last_undegraded":"2023-12-14T14:10:12.797176+0000","last_fullsized":"2023-12-14T14:10:12.797176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:55:02.118265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.756057+0000","last_change":"2023-12-14T14:09:10.622850+0000","last_active":"2023-12-14T14:10:12.756057+0000","last_peered":"2023-12-14T14:10:12.756057+0000","last_clean":"2023-12-14T14:10:12.756057+0000","last_became_active":"2023-12-14T14:09:10.622456+0000","last_became_peered":"2023-12-14T14:09:10.622456+0000","last_unstale":"2023-12-14T14:10:12.756057+0000","last_undegraded":"2023-12-14T14:10:12.756057+0000","last_fullsized":"2023-12-14T14:10:12.756057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:34.391111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532476+0000","last_change":"2023-12-14T14:09:10.623459+0000","last_active":"2023-12-14T14:10:12.532476+0000","last_peered":"2023-12-14T14:10:12.532476+0000","last_clean":"2023-12-14T14:10:12.532476+0000","last_became_active":"2023-12-14T14:09:10.623100+0000","last_became_peered":"2023-12-14T14:09:10.623100+0000","last_unstale":"2023-12-14T14:10:12.532476+0000","last_undegraded":"2023-12-14T14:10:12.532476+0000","last_fullsized":"2023-12-14T14:10:12.532476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:41:35.772179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527620+0000","last_change":"2023-12-14T14:09:10.624663+0000","last_active":"2023-12-14T14:10:12.527620+0000","last_peered":"2023-12-14T14:10:12.527620+0000","last_clean":"2023-12-14T14:10:12.527620+0000","last_became_active":"2023-12-14T14:09:10.624313+0000","last_became_peered":"2023-12-14T14:09:10.624313+0000","last_unstale":"2023-12-14T14:10:12.527620+0000","last_undegraded":"2023-12-14T14:10:12.527620+0000","last_fullsized":"2023-12-14T14:10:12.527620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:11:53.666252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532221+0000","last_change":"2023-12-14T14:09:10.622519+0000","last_active":"2023-12-14T14:10:12.532221+0000","last_peered":"2023-12-14T14:10:12.532221+0000","last_clean":"2023-12-14T14:10:12.532221+0000","last_became_active":"2023-12-14T14:09:10.622147+0000","last_became_peered":"2023-12-14T14:09:10.622147+0000","last_unstale":"2023-12-14T14:10:12.532221+0000","last_undegraded":"2023-12-14T14:10:12.532221+0000","last_fullsized":"2023-12-14T14:10:12.532221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:09:52.043290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529021+0000","last_change":"2023-12-14T14:09:10.622762+0000","last_active":"2023-12-14T14:10:12.529021+0000","last_peered":"2023-12-14T14:10:12.529021+0000","last_clean":"2023-12-14T14:10:12.529021+0000","last_became_active":"2023-12-14T14:09:10.622199+0000","last_became_peered":"2023-12-14T14:09:10.622199+0000","last_unstale":"2023-12-14T14:10:12.529021+0000","last_undegraded":"2023-12-14T14:10:12.529021+0000","last_fullsized":"2023-12-14T14:10:12.529021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:14:39.472497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053278+0000","last_change":"2023-12-14T14:09:10.625452+0000","last_active":"2023-12-14T14:10:13.053278+0000","last_peered":"2023-12-14T14:10:13.053278+0000","last_clean":"2023-12-14T14:10:13.053278+0000","last_became_active":"2023-12-14T14:09:10.620053+0000","last_became_peered":"2023-12-14T14:09:10.620053+0000","last_unstale":"2023-12-14T14:10:13.053278+0000","last_undegraded":"2023-12-14T14:10:13.053278+0000","last_fullsized":"2023-12-14T14:10:13.053278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:02:57.280143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531872+0000","last_change":"2023-12-14T14:10:12.531872+0000","last_active":"2023-12-14T14:10:12.531872+0000","last_peered":"2023-12-14T14:10:12.531872+0000","last_clean":"2023-12-14T14:10:12.531872+0000","last_became_active":"2023-12-14T14:10:12.531403+0000","last_became_peered":"2023-12-14T14:10:12.531403+0000","last_unstale":"2023-12-14T14:10:12.531872+0000","last_undegraded":"2023-12-14T14:10:12.531872+0000","last_fullsized":"2023-12-14T14:10:12.531872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:02:30.699926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532807+0000","last_change":"2023-12-14T14:09:10.633572+0000","last_active":"2023-12-14T14:10:12.532807+0000","last_peered":"2023-12-14T14:10:12.532807+0000","last_clean":"2023-12-14T14:10:12.532807+0000","last_became_active":"2023-12-14T14:09:10.633251+0000","last_became_peered":"2023-12-14T14:09:10.633251+0000","last_unstale":"2023-12-14T14:10:12.532807+0000","last_undegraded":"2023-12-14T14:10:12.532807+0000","last_fullsized":"2023-12-14T14:10:12.532807+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:06:59.990535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.756083+0000","last_change":"2023-12-14T14:09:10.630621+0000","last_active":"2023-12-14T14:10:12.756083+0000","last_peered":"2023-12-14T14:10:12.756083+0000","last_clean":"2023-12-14T14:10:12.756083+0000","last_became_active":"2023-12-14T14:09:10.630196+0000","last_became_peered":"2023-12-14T14:09:10.630196+0000","last_unstale":"2023-12-14T14:10:12.756083+0000","last_undegraded":"2023-12-14T14:10:12.756083+0000","last_fullsized":"2023-12-14T14:10:12.756083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:44.623922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526232+0000","last_change":"2023-12-14T14:09:10.617111+0000","last_active":"2023-12-14T14:10:12.526232+0000","last_peered":"2023-12-14T14:10:12.526232+0000","last_clean":"2023-12-14T14:10:12.526232+0000","last_became_active":"2023-12-14T14:09:10.616817+0000","last_became_peered":"2023-12-14T14:09:10.616817+0000","last_unstale":"2023-12-14T14:10:12.526232+0000","last_undegraded":"2023-12-14T14:10:12.526232+0000","last_fullsized":"2023-12-14T14:10:12.526232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:54:30.750020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797080+0000","last_change":"2023-12-14T14:09:10.620373+0000","last_active":"2023-12-14T14:10:12.797080+0000","last_peered":"2023-12-14T14:10:12.797080+0000","last_clean":"2023-12-14T14:10:12.797080+0000","last_became_active":"2023-12-14T14:09:10.620107+0000","last_became_peered":"2023-12-14T14:09:10.620107+0000","last_unstale":"2023-12-14T14:10:12.797080+0000","last_undegraded":"2023-12-14T14:10:12.797080+0000","last_fullsized":"2023-12-14T14:10:12.797080+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:26:50.872125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.796958+0000","last_change":"2023-12-14T14:09:10.624554+0000","last_active":"2023-12-14T14:10:12.796958+0000","last_peered":"2023-12-14T14:10:12.796958+0000","last_clean":"2023-12-14T14:10:12.796958+0000","last_became_active":"2023-12-14T14:09:10.624255+0000","last_became_peered":"2023-12-14T14:09:10.624255+0000","last_unstale":"2023-12-14T14:10:12.796958+0000","last_undegraded":"2023-12-14T14:10:12.796958+0000","last_fullsized":"2023-12-14T14:10:12.796958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:00:42.644826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.052691+0000","last_change":"2023-12-14T14:09:10.632464+0000","last_active":"2023-12-14T14:10:13.052691+0000","last_peered":"2023-12-14T14:10:13.052691+0000","last_clean":"2023-12-14T14:10:13.052691+0000","last_became_active":"2023-12-14T14:09:10.632102+0000","last_became_peered":"2023-12-14T14:09:10.632102+0000","last_unstale":"2023-12-14T14:10:13.052691+0000","last_undegraded":"2023-12-14T14:10:13.052691+0000","last_fullsized":"2023-12-14T14:10:13.052691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:56:36.034298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532334+0000","last_change":"2023-12-14T14:09:10.619144+0000","last_active":"2023-12-14T14:10:12.532334+0000","last_peered":"2023-12-14T14:10:12.532334+0000","last_clean":"2023-12-14T14:10:12.532334+0000","last_became_active":"2023-12-14T14:09:10.618833+0000","last_became_peered":"2023-12-14T14:09:10.618833+0000","last_unstale":"2023-12-14T14:10:12.532334+0000","last_undegraded":"2023-12-14T14:10:12.532334+0000","last_fullsized":"2023-12-14T14:10:12.532334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:56:11.786123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529939+0000","last_change":"2023-12-14T14:09:10.619062+0000","last_active":"2023-12-14T14:10:12.529939+0000","last_peered":"2023-12-14T14:10:12.529939+0000","last_clean":"2023-12-14T14:10:12.529939+0000","last_became_active":"2023-12-14T14:09:10.618750+0000","last_became_peered":"2023-12-14T14:09:10.618750+0000","last_unstale":"2023-12-14T14:10:12.529939+0000","last_undegraded":"2023-12-14T14:10:12.529939+0000","last_fullsized":"2023-12-14T14:10:12.529939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:23:35.700718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529301+0000","last_change":"2023-12-14T14:09:10.621410+0000","last_active":"2023-12-14T14:10:12.529301+0000","last_peered":"2023-12-14T14:10:12.529301+0000","last_clean":"2023-12-14T14:10:12.529301+0000","last_became_active":"2023-12-14T14:09:10.621037+0000","last_became_peered":"2023-12-14T14:09:10.621037+0000","last_unstale":"2023-12-14T14:10:12.529301+0000","last_undegraded":"2023-12-14T14:10:12.529301+0000","last_fullsized":"2023-12-14T14:10:12.529301+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:45:37.270156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529264+0000","last_change":"2023-12-14T14:09:10.218180+0000","last_active":"2023-12-14T14:10:12.529264+0000","last_peered":"2023-12-14T14:10:12.529264+0000","last_clean":"2023-12-14T14:10:12.529264+0000","last_became_active":"2023-12-14T14:09:10.217856+0000","last_became_peered":"2023-12-14T14:09:10.217856+0000","last_unstale":"2023-12-14T14:10:12.529264+0000","last_undegraded":"2023-12-14T14:10:12.529264+0000","last_fullsized":"2023-12-14T14:10:12.529264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:26:00.815008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528782+0000","last_change":"2023-12-14T14:09:10.628500+0000","last_active":"2023-12-14T14:10:12.528782+0000","last_peered":"2023-12-14T14:10:12.528782+0000","last_clean":"2023-12-14T14:10:12.528782+0000","last_became_active":"2023-12-14T14:09:10.628120+0000","last_became_peered":"2023-12-14T14:09:10.628120+0000","last_unstale":"2023-12-14T14:10:12.528782+0000","last_undegraded":"2023-12-14T14:10:12.528782+0000","last_fullsized":"2023-12-14T14:10:12.528782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:03:26.435929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528916+0000","last_change":"2023-12-14T14:09:10.218608+0000","last_active":"2023-12-14T14:10:12.528916+0000","last_peered":"2023-12-14T14:10:12.528916+0000","last_clean":"2023-12-14T14:10:12.528916+0000","last_became_active":"2023-12-14T14:09:10.218010+0000","last_became_peered":"2023-12-14T14:09:10.218010+0000","last_unstale":"2023-12-14T14:10:12.528916+0000","last_undegraded":"2023-12-14T14:10:12.528916+0000","last_fullsized":"2023-12-14T14:10:12.528916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:15:03.256341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797697+0000","last_change":"2023-12-14T14:09:10.621972+0000","last_active":"2023-12-14T14:10:12.797697+0000","last_peered":"2023-12-14T14:10:12.797697+0000","last_clean":"2023-12-14T14:10:12.797697+0000","last_became_active":"2023-12-14T14:09:10.621685+0000","last_became_peered":"2023-12-14T14:09:10.621685+0000","last_unstale":"2023-12-14T14:10:12.797697+0000","last_undegraded":"2023-12-14T14:10:12.797697+0000","last_fullsized":"2023-12-14T14:10:12.797697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:44:15.717843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.537829+0000","last_change":"2023-12-14T14:10:12.537432+0000","last_active":"2023-12-14T14:10:12.537829+0000","last_peered":"2023-12-14T14:10:12.537829+0000","last_clean":"2023-12-14T14:10:12.537829+0000","last_became_active":"2023-12-14T14:10:12.533574+0000","last_became_peered":"2023-12-14T14:10:12.533574+0000","last_unstale":"2023-12-14T14:10:12.537829+0000","last_undegraded":"2023-12-14T14:10:12.537829+0000","last_fullsized":"2023-12-14T14:10:12.537829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:37:38.449011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.052828+0000","last_change":"2023-12-14T14:09:10.626807+0000","last_active":"2023-12-14T14:10:13.052828+0000","last_peered":"2023-12-14T14:10:13.052828+0000","last_clean":"2023-12-14T14:10:13.052828+0000","last_became_active":"2023-12-14T14:09:10.626450+0000","last_became_peered":"2023-12-14T14:09:10.626450+0000","last_unstale":"2023-12-14T14:10:13.052828+0000","last_undegraded":"2023-12-14T14:10:13.052828+0000","last_fullsized":"2023-12-14T14:10:13.052828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:23:25.897586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532714+0000","last_change":"2023-12-14T14:09:10.216515+0000","last_active":"2023-12-14T14:10:12.532714+0000","last_peered":"2023-12-14T14:10:12.532714+0000","last_clean":"2023-12-14T14:10:12.532714+0000","last_became_active":"2023-12-14T14:09:10.216175+0000","last_became_peered":"2023-12-14T14:09:10.216175+0000","last_unstale":"2023-12-14T14:10:12.532714+0000","last_undegraded":"2023-12-14T14:10:12.532714+0000","last_fullsized":"2023-12-14T14:10:12.532714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:44:37.478657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527359+0000","last_change":"2023-12-14T14:09:10.627664+0000","last_active":"2023-12-14T14:10:12.527359+0000","last_peered":"2023-12-14T14:10:12.527359+0000","last_clean":"2023-12-14T14:10:12.527359+0000","last_became_active":"2023-12-14T14:09:10.627376+0000","last_became_peered":"2023-12-14T14:09:10.627376+0000","last_unstale":"2023-12-14T14:10:12.527359+0000","last_undegraded":"2023-12-14T14:10:12.527359+0000","last_fullsized":"2023-12-14T14:10:12.527359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:42:59.235684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":97,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:23.910449+0000","last_change":"2023-12-14T14:09:10.218806+0000","last_active":"2023-12-14T14:10:23.910449+0000","last_peered":"2023-12-14T14:10:23.910449+0000","last_clean":"2023-12-14T14:10:23.910449+0000","last_became_active":"2023-12-14T14:09:10.218441+0000","last_became_peered":"2023-12-14T14:09:10.218441+0000","last_unstale":"2023-12-14T14:10:23.910449+0000","last_undegraded":"2023-12-14T14:10:23.910449+0000","last_fullsized":"2023-12-14T14:10:23.910449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:12:59.215341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532407+0000","last_change":"2023-12-14T14:09:10.622903+0000","last_active":"2023-12-14T14:10:12.532407+0000","last_peered":"2023-12-14T14:10:12.532407+0000","last_clean":"2023-12-14T14:10:12.532407+0000","last_became_active":"2023-12-14T14:09:10.622261+0000","last_became_peered":"2023-12-14T14:09:10.622261+0000","last_unstale":"2023-12-14T14:10:12.532407+0000","last_undegraded":"2023-12-14T14:10:12.532407+0000","last_fullsized":"2023-12-14T14:10:12.532407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:36:00.934831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527794+0000","last_change":"2023-12-14T14:09:10.222254+0000","last_active":"2023-12-14T14:10:12.527794+0000","last_peered":"2023-12-14T14:10:12.527794+0000","last_clean":"2023-12-14T14:10:12.527794+0000","last_became_active":"2023-12-14T14:09:10.221861+0000","last_became_peered":"2023-12-14T14:09:10.221861+0000","last_unstale":"2023-12-14T14:10:12.527794+0000","last_undegraded":"2023-12-14T14:10:12.527794+0000","last_fullsized":"2023-12-14T14:10:12.527794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:52:59.679865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526998+0000","last_change":"2023-12-14T14:09:10.625646+0000","last_active":"2023-12-14T14:10:12.526998+0000","last_peered":"2023-12-14T14:10:12.526998+0000","last_clean":"2023-12-14T14:10:12.526998+0000","last_became_active":"2023-12-14T14:09:10.625179+0000","last_became_peered":"2023-12-14T14:09:10.625179+0000","last_unstale":"2023-12-14T14:10:12.526998+0000","last_undegraded":"2023-12-14T14:10:12.526998+0000","last_fullsized":"2023-12-14T14:10:12.526998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:52:32.325087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526156+0000","last_change":"2023-12-14T14:09:10.212885+0000","last_active":"2023-12-14T14:10:12.526156+0000","last_peered":"2023-12-14T14:10:12.526156+0000","last_clean":"2023-12-14T14:10:12.526156+0000","last_became_active":"2023-12-14T14:09:10.212311+0000","last_became_peered":"2023-12-14T14:09:10.212311+0000","last_unstale":"2023-12-14T14:10:12.526156+0000","last_undegraded":"2023-12-14T14:10:12.526156+0000","last_fullsized":"2023-12-14T14:10:12.526156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:47:33.645701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528167+0000","last_change":"2023-12-14T14:09:10.620795+0000","last_active":"2023-12-14T14:10:12.528167+0000","last_peered":"2023-12-14T14:10:12.528167+0000","last_clean":"2023-12-14T14:10:12.528167+0000","last_became_active":"2023-12-14T14:09:10.620453+0000","last_became_peered":"2023-12-14T14:09:10.620453+0000","last_unstale":"2023-12-14T14:10:12.528167+0000","last_undegraded":"2023-12-14T14:10:12.528167+0000","last_fullsized":"2023-12-14T14:10:12.528167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:25:31.871417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526686+0000","last_change":"2023-12-14T14:09:10.218969+0000","last_active":"2023-12-14T14:10:12.526686+0000","last_peered":"2023-12-14T14:10:12.526686+0000","last_clean":"2023-12-14T14:10:12.526686+0000","last_became_active":"2023-12-14T14:09:10.218624+0000","last_became_peered":"2023-12-14T14:09:10.218624+0000","last_unstale":"2023-12-14T14:10:12.526686+0000","last_undegraded":"2023-12-14T14:10:12.526686+0000","last_fullsized":"2023-12-14T14:10:12.526686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:33:35.928051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528961+0000","last_change":"2023-12-14T14:09:10.619202+0000","last_active":"2023-12-14T14:10:12.528961+0000","last_peered":"2023-12-14T14:10:12.528961+0000","last_clean":"2023-12-14T14:10:12.528961+0000","last_became_active":"2023-12-14T14:09:10.618944+0000","last_became_peered":"2023-12-14T14:09:10.618944+0000","last_unstale":"2023-12-14T14:10:12.528961+0000","last_undegraded":"2023-12-14T14:10:12.528961+0000","last_fullsized":"2023-12-14T14:10:12.528961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:08:37.692514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:24.911137+0000","last_change":"2023-12-14T14:09:10.214323+0000","last_active":"2023-12-14T14:10:24.911137+0000","last_peered":"2023-12-14T14:10:24.911137+0000","last_clean":"2023-12-14T14:10:24.911137+0000","last_became_active":"2023-12-14T14:09:10.213998+0000","last_became_peered":"2023-12-14T14:09:10.213998+0000","last_unstale":"2023-12-14T14:10:24.911137+0000","last_undegraded":"2023-12-14T14:10:24.911137+0000","last_fullsized":"2023-12-14T14:10:24.911137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:14:15.539169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053191+0000","last_change":"2023-12-14T14:09:10.626967+0000","last_active":"2023-12-14T14:10:13.053191+0000","last_peered":"2023-12-14T14:10:13.053191+0000","last_clean":"2023-12-14T14:10:13.053191+0000","last_became_active":"2023-12-14T14:09:10.626589+0000","last_became_peered":"2023-12-14T14:09:10.626589+0000","last_unstale":"2023-12-14T14:10:13.053191+0000","last_undegraded":"2023-12-14T14:10:13.053191+0000","last_fullsized":"2023-12-14T14:10:13.053191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:12:23.658401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532410+0000","last_change":"2023-12-14T14:09:10.221868+0000","last_active":"2023-12-14T14:10:12.532410+0000","last_peered":"2023-12-14T14:10:12.532410+0000","last_clean":"2023-12-14T14:10:12.532410+0000","last_became_active":"2023-12-14T14:09:10.221378+0000","last_became_peered":"2023-12-14T14:09:10.221378+0000","last_unstale":"2023-12-14T14:10:12.532410+0000","last_undegraded":"2023-12-14T14:10:12.532410+0000","last_fullsized":"2023-12-14T14:10:12.532410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:47:54.286181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797678+0000","last_change":"2023-12-14T14:09:10.630669+0000","last_active":"2023-12-14T14:10:12.797678+0000","last_peered":"2023-12-14T14:10:12.797678+0000","last_clean":"2023-12-14T14:10:12.797678+0000","last_became_active":"2023-12-14T14:09:10.630351+0000","last_became_peered":"2023-12-14T14:09:10.630351+0000","last_unstale":"2023-12-14T14:10:12.797678+0000","last_undegraded":"2023-12-14T14:10:12.797678+0000","last_fullsized":"2023-12-14T14:10:12.797678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:16:52.057368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527392+0000","last_change":"2023-12-14T14:09:10.214352+0000","last_active":"2023-12-14T14:10:12.527392+0000","last_peered":"2023-12-14T14:10:12.527392+0000","last_clean":"2023-12-14T14:10:12.527392+0000","last_became_active":"2023-12-14T14:09:10.213873+0000","last_became_peered":"2023-12-14T14:09:10.213873+0000","last_unstale":"2023-12-14T14:10:12.527392+0000","last_undegraded":"2023-12-14T14:10:12.527392+0000","last_fullsized":"2023-12-14T14:10:12.527392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:12:24.032109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053113+0000","last_change":"2023-12-14T14:09:10.631272+0000","last_active":"2023-12-14T14:10:13.053113+0000","last_peered":"2023-12-14T14:10:13.053113+0000","last_clean":"2023-12-14T14:10:13.053113+0000","last_became_active":"2023-12-14T14:09:10.630923+0000","last_became_peered":"2023-12-14T14:09:10.630923+0000","last_unstale":"2023-12-14T14:10:13.053113+0000","last_undegraded":"2023-12-14T14:10:13.053113+0000","last_fullsized":"2023-12-14T14:10:13.053113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:36:17.731850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'30","reported_seq":199,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:25.926137+0000","last_change":"2023-12-14T14:09:10.219006+0000","last_active":"2023-12-14T14:10:25.926137+0000","last_peered":"2023-12-14T14:10:25.926137+0000","last_clean":"2023-12-14T14:10:25.926137+0000","last_became_active":"2023-12-14T14:09:10.218694+0000","last_became_peered":"2023-12-14T14:09:10.218694+0000","last_unstale":"2023-12-14T14:10:25.926137+0000","last_undegraded":"2023-12-14T14:10:25.926137+0000","last_fullsized":"2023-12-14T14:10:25.926137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:29:19.743817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60881,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":133,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532873+0000","last_change":"2023-12-14T14:09:10.624056+0000","last_active":"2023-12-14T14:10:12.532873+0000","last_peered":"2023-12-14T14:10:12.532873+0000","last_clean":"2023-12-14T14:10:12.532873+0000","last_became_active":"2023-12-14T14:09:10.623622+0000","last_became_peered":"2023-12-14T14:09:10.623622+0000","last_unstale":"2023-12-14T14:10:12.532873+0000","last_undegraded":"2023-12-14T14:10:12.532873+0000","last_fullsized":"2023-12-14T14:10:12.532873+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:19:03.814303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529190+0000","last_change":"2023-12-14T14:09:10.215236+0000","last_active":"2023-12-14T14:10:12.529190+0000","last_peered":"2023-12-14T14:10:12.529190+0000","last_clean":"2023-12-14T14:10:12.529190+0000","last_became_active":"2023-12-14T14:09:10.214941+0000","last_became_peered":"2023-12-14T14:09:10.214941+0000","last_unstale":"2023-12-14T14:10:12.529190+0000","last_undegraded":"2023-12-14T14:10:12.529190+0000","last_fullsized":"2023-12-14T14:10:12.529190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:47:43.869792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.525888+0000","last_change":"2023-12-14T14:09:10.625352+0000","last_active":"2023-12-14T14:10:12.525888+0000","last_peered":"2023-12-14T14:10:12.525888+0000","last_clean":"2023-12-14T14:10:12.525888+0000","last_became_active":"2023-12-14T14:09:10.625037+0000","last_became_peered":"2023-12-14T14:09:10.625037+0000","last_unstale":"2023-12-14T14:10:12.525888+0000","last_undegraded":"2023-12-14T14:10:12.525888+0000","last_fullsized":"2023-12-14T14:10:12.525888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:33:04.723063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527360+0000","last_change":"2023-12-14T14:09:10.219028+0000","last_active":"2023-12-14T14:10:12.527360+0000","last_peered":"2023-12-14T14:10:12.527360+0000","last_clean":"2023-12-14T14:10:12.527360+0000","last_became_active":"2023-12-14T14:09:10.218687+0000","last_became_peered":"2023-12-14T14:09:10.218687+0000","last_unstale":"2023-12-14T14:10:12.527360+0000","last_undegraded":"2023-12-14T14:10:12.527360+0000","last_fullsized":"2023-12-14T14:10:12.527360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:17:39.685837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532414+0000","last_change":"2023-12-14T14:09:10.623660+0000","last_active":"2023-12-14T14:10:12.532414+0000","last_peered":"2023-12-14T14:10:12.532414+0000","last_clean":"2023-12-14T14:10:12.532414+0000","last_became_active":"2023-12-14T14:09:10.623321+0000","last_became_peered":"2023-12-14T14:09:10.623321+0000","last_unstale":"2023-12-14T14:10:12.532414+0000","last_undegraded":"2023-12-14T14:10:12.532414+0000","last_fullsized":"2023-12-14T14:10:12.532414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:32:49.708710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:22.908002+0000","last_change":"2023-12-14T14:09:10.217849+0000","last_active":"2023-12-14T14:10:22.908002+0000","last_peered":"2023-12-14T14:10:22.908002+0000","last_clean":"2023-12-14T14:10:22.908002+0000","last_became_active":"2023-12-14T14:09:10.217501+0000","last_became_peered":"2023-12-14T14:09:10.217501+0000","last_unstale":"2023-12-14T14:10:22.908002+0000","last_undegraded":"2023-12-14T14:10:22.908002+0000","last_fullsized":"2023-12-14T14:10:22.908002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:30:18.337627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532002+0000","last_change":"2023-12-14T14:09:10.627193+0000","last_active":"2023-12-14T14:10:12.532002+0000","last_peered":"2023-12-14T14:10:12.532002+0000","last_clean":"2023-12-14T14:10:12.532002+0000","last_became_active":"2023-12-14T14:09:10.626887+0000","last_became_peered":"2023-12-14T14:09:10.626887+0000","last_unstale":"2023-12-14T14:10:12.532002+0000","last_undegraded":"2023-12-14T14:10:12.532002+0000","last_fullsized":"2023-12-14T14:10:12.532002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:21:20.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532277+0000","last_change":"2023-12-14T14:09:10.220564+0000","last_active":"2023-12-14T14:10:12.532277+0000","last_peered":"2023-12-14T14:10:12.532277+0000","last_clean":"2023-12-14T14:10:12.532277+0000","last_became_active":"2023-12-14T14:09:10.219921+0000","last_became_peered":"2023-12-14T14:09:10.219921+0000","last_unstale":"2023-12-14T14:10:12.532277+0000","last_undegraded":"2023-12-14T14:10:12.532277+0000","last_fullsized":"2023-12-14T14:10:12.532277+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:08:02.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526837+0000","last_change":"2023-12-14T14:09:10.625056+0000","last_active":"2023-12-14T14:10:12.526837+0000","last_peered":"2023-12-14T14:10:12.526837+0000","last_clean":"2023-12-14T14:10:12.526837+0000","last_became_active":"2023-12-14T14:09:10.624626+0000","last_became_peered":"2023-12-14T14:09:10.624626+0000","last_unstale":"2023-12-14T14:10:12.526837+0000","last_undegraded":"2023-12-14T14:10:12.526837+0000","last_fullsized":"2023-12-14T14:10:12.526837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:35:00.124910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.533020+0000","last_change":"2023-12-14T14:09:10.215413+0000","last_active":"2023-12-14T14:10:12.533020+0000","last_peered":"2023-12-14T14:10:12.533020+0000","last_clean":"2023-12-14T14:10:12.533020+0000","last_became_active":"2023-12-14T14:09:10.214925+0000","last_became_peered":"2023-12-14T14:09:10.214925+0000","last_unstale":"2023-12-14T14:10:12.533020+0000","last_undegraded":"2023-12-14T14:10:12.533020+0000","last_fullsized":"2023-12-14T14:10:12.533020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:00:34.365885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531792+0000","last_change":"2023-12-14T14:09:10.629879+0000","last_active":"2023-12-14T14:10:12.531792+0000","last_peered":"2023-12-14T14:10:12.531792+0000","last_clean":"2023-12-14T14:10:12.531792+0000","last_became_active":"2023-12-14T14:09:10.629539+0000","last_became_peered":"2023-12-14T14:09:10.629539+0000","last_unstale":"2023-12-14T14:10:12.531792+0000","last_undegraded":"2023-12-14T14:10:12.531792+0000","last_fullsized":"2023-12-14T14:10:12.531792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:51:46.941614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.798142+0000","last_change":"2023-12-14T14:10:12.798142+0000","last_active":"2023-12-14T14:10:12.798142+0000","last_peered":"2023-12-14T14:10:12.798142+0000","last_clean":"2023-12-14T14:10:12.798142+0000","last_became_active":"2023-12-14T14:10:12.797763+0000","last_became_peered":"2023-12-14T14:10:12.797763+0000","last_unstale":"2023-12-14T14:10:12.798142+0000","last_undegraded":"2023-12-14T14:10:12.798142+0000","last_fullsized":"2023-12-14T14:10:12.798142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:53:06.227507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527531+0000","last_change":"2023-12-14T14:09:10.619279+0000","last_active":"2023-12-14T14:10:12.527531+0000","last_peered":"2023-12-14T14:10:12.527531+0000","last_clean":"2023-12-14T14:10:12.527531+0000","last_became_active":"2023-12-14T14:09:10.618794+0000","last_became_peered":"2023-12-14T14:09:10.618794+0000","last_unstale":"2023-12-14T14:10:12.527531+0000","last_undegraded":"2023-12-14T14:10:12.527531+0000","last_fullsized":"2023-12-14T14:10:12.527531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:52:19.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532513+0000","last_change":"2023-12-14T14:09:10.222213+0000","last_active":"2023-12-14T14:10:12.532513+0000","last_peered":"2023-12-14T14:10:12.532513+0000","last_clean":"2023-12-14T14:10:12.532513+0000","last_became_active":"2023-12-14T14:09:10.221314+0000","last_became_peered":"2023-12-14T14:09:10.221314+0000","last_unstale":"2023-12-14T14:10:12.532513+0000","last_undegraded":"2023-12-14T14:10:12.532513+0000","last_fullsized":"2023-12-14T14:10:12.532513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:21:43.468606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527564+0000","last_change":"2023-12-14T14:09:10.624523+0000","last_active":"2023-12-14T14:10:12.527564+0000","last_peered":"2023-12-14T14:10:12.527564+0000","last_clean":"2023-12-14T14:10:12.527564+0000","last_became_active":"2023-12-14T14:09:10.624204+0000","last_became_peered":"2023-12-14T14:09:10.624204+0000","last_unstale":"2023-12-14T14:10:12.527564+0000","last_undegraded":"2023-12-14T14:10:12.527564+0000","last_fullsized":"2023-12-14T14:10:12.527564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:04:50.294802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526896+0000","last_change":"2023-12-14T14:09:10.626166+0000","last_active":"2023-12-14T14:10:12.526896+0000","last_peered":"2023-12-14T14:10:12.526896+0000","last_clean":"2023-12-14T14:10:12.526896+0000","last_became_active":"2023-12-14T14:09:10.625831+0000","last_became_peered":"2023-12-14T14:09:10.625831+0000","last_unstale":"2023-12-14T14:10:12.526896+0000","last_undegraded":"2023-12-14T14:10:12.526896+0000","last_fullsized":"2023-12-14T14:10:12.526896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:25:33.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":91,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:22.907288+0000","last_change":"2023-12-14T14:09:10.217759+0000","last_active":"2023-12-14T14:10:22.907288+0000","last_peered":"2023-12-14T14:10:22.907288+0000","last_clean":"2023-12-14T14:10:22.907288+0000","last_became_active":"2023-12-14T14:09:10.217454+0000","last_became_peered":"2023-12-14T14:09:10.217454+0000","last_unstale":"2023-12-14T14:10:22.907288+0000","last_undegraded":"2023-12-14T14:10:22.907288+0000","last_fullsized":"2023-12-14T14:10:22.907288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:45.595634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.054566+0000","last_change":"2023-12-14T14:10:13.054168+0000","last_active":"2023-12-14T14:10:13.054566+0000","last_peered":"2023-12-14T14:10:13.054566+0000","last_clean":"2023-12-14T14:10:13.054566+0000","last_became_active":"2023-12-14T14:10:13.053907+0000","last_became_peered":"2023-12-14T14:10:13.053907+0000","last_unstale":"2023-12-14T14:10:13.054566+0000","last_undegraded":"2023-12-14T14:10:13.054566+0000","last_fullsized":"2023-12-14T14:10:13.054566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:32:50.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.755707+0000","last_change":"2023-12-14T14:09:10.214557+0000","last_active":"2023-12-14T14:10:12.755707+0000","last_peered":"2023-12-14T14:10:12.755707+0000","last_clean":"2023-12-14T14:10:12.755707+0000","last_became_active":"2023-12-14T14:09:10.214179+0000","last_became_peered":"2023-12-14T14:09:10.214179+0000","last_unstale":"2023-12-14T14:10:12.755707+0000","last_undegraded":"2023-12-14T14:10:12.755707+0000","last_fullsized":"2023-12-14T14:10:12.755707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:25:16.025802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":339,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532472+0000","last_change":"2023-12-14T14:08:24.268746+0000","last_active":"2023-12-14T14:10:12.532472+0000","last_peered":"2023-12-14T14:10:12.532472+0000","last_clean":"2023-12-14T14:10:12.532472+0000","last_became_active":"2023-12-14T14:08:24.268402+0000","last_became_peered":"2023-12-14T14:08:24.268402+0000","last_unstale":"2023-12-14T14:10:12.532472+0000","last_undegraded":"2023-12-14T14:10:12.532472+0000","last_fullsized":"2023-12-14T14:10:12.532472+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:05:59.057653+0000","last_clean_scrub_stamp":"2023-12-14T14:05:59.057653+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:46:12.936597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531780+0000","last_change":"2023-12-14T14:10:12.531780+0000","last_active":"2023-12-14T14:10:12.531780+0000","last_peered":"2023-12-14T14:10:12.531780+0000","last_clean":"2023-12-14T14:10:12.531780+0000","last_became_active":"2023-12-14T14:10:12.531437+0000","last_became_peered":"2023-12-14T14:10:12.531437+0000","last_unstale":"2023-12-14T14:10:12.531780+0000","last_undegraded":"2023-12-14T14:10:12.531780+0000","last_fullsized":"2023-12-14T14:10:12.531780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:45:55.441797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532302+0000","last_change":"2023-12-14T14:09:10.221812+0000","last_active":"2023-12-14T14:10:12.532302+0000","last_peered":"2023-12-14T14:10:12.532302+0000","last_clean":"2023-12-14T14:10:12.532302+0000","last_became_active":"2023-12-14T14:09:10.221483+0000","last_became_peered":"2023-12-14T14:09:10.221483+0000","last_unstale":"2023-12-14T14:10:12.532302+0000","last_undegraded":"2023-12-14T14:10:12.532302+0000","last_fullsized":"2023-12-14T14:10:12.532302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T17:41:43.778300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532911+0000","last_change":"2023-12-14T14:09:10.217249+0000","last_active":"2023-12-14T14:10:12.532911+0000","last_peered":"2023-12-14T14:10:12.532911+0000","last_clean":"2023-12-14T14:10:12.532911+0000","last_became_active":"2023-12-14T14:09:10.216953+0000","last_became_peered":"2023-12-14T14:09:10.216953+0000","last_unstale":"2023-12-14T14:10:12.532911+0000","last_undegraded":"2023-12-14T14:10:12.532911+0000","last_fullsized":"2023-12-14T14:10:12.532911+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:06:32.739744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527278+0000","last_change":"2023-12-14T14:09:10.616264+0000","last_active":"2023-12-14T14:10:12.527278+0000","last_peered":"2023-12-14T14:10:12.527278+0000","last_clean":"2023-12-14T14:10:12.527278+0000","last_became_active":"2023-12-14T14:09:10.615993+0000","last_became_peered":"2023-12-14T14:09:10.615993+0000","last_unstale":"2023-12-14T14:10:12.527278+0000","last_undegraded":"2023-12-14T14:10:12.527278+0000","last_fullsized":"2023-12-14T14:10:12.527278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:17:58.050642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529818+0000","last_change":"2023-12-14T14:09:10.218040+0000","last_active":"2023-12-14T14:10:12.529818+0000","last_peered":"2023-12-14T14:10:12.529818+0000","last_clean":"2023-12-14T14:10:12.529818+0000","last_became_active":"2023-12-14T14:09:10.217698+0000","last_became_peered":"2023-12-14T14:09:10.217698+0000","last_unstale":"2023-12-14T14:10:12.529818+0000","last_undegraded":"2023-12-14T14:10:12.529818+0000","last_fullsized":"2023-12-14T14:10:12.529818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:24:14.577324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529192+0000","last_change":"2023-12-14T14:09:10.626705+0000","last_active":"2023-12-14T14:10:12.529192+0000","last_peered":"2023-12-14T14:10:12.529192+0000","last_clean":"2023-12-14T14:10:12.529192+0000","last_became_active":"2023-12-14T14:09:10.626390+0000","last_became_peered":"2023-12-14T14:09:10.626390+0000","last_unstale":"2023-12-14T14:10:12.529192+0000","last_undegraded":"2023-12-14T14:10:12.529192+0000","last_fullsized":"2023-12-14T14:10:12.529192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:11:51.665277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.756152+0000","last_change":"2023-12-14T14:09:10.224068+0000","last_active":"2023-12-14T14:10:12.756152+0000","last_peered":"2023-12-14T14:10:12.756152+0000","last_clean":"2023-12-14T14:10:12.756152+0000","last_became_active":"2023-12-14T14:09:10.223709+0000","last_became_peered":"2023-12-14T14:09:10.223709+0000","last_unstale":"2023-12-14T14:10:12.756152+0000","last_undegraded":"2023-12-14T14:10:12.756152+0000","last_fullsized":"2023-12-14T14:10:12.756152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:09:02.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797414+0000","last_change":"2023-12-14T14:09:10.633221+0000","last_active":"2023-12-14T14:10:12.797414+0000","last_peered":"2023-12-14T14:10:12.797414+0000","last_clean":"2023-12-14T14:10:12.797414+0000","last_became_active":"2023-12-14T14:09:10.632881+0000","last_became_peered":"2023-12-14T14:09:10.632881+0000","last_unstale":"2023-12-14T14:10:12.797414+0000","last_undegraded":"2023-12-14T14:10:12.797414+0000","last_fullsized":"2023-12-14T14:10:12.797414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:18:22.961120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.052653+0000","last_change":"2023-12-14T14:09:10.219793+0000","last_active":"2023-12-14T14:10:13.052653+0000","last_peered":"2023-12-14T14:10:13.052653+0000","last_clean":"2023-12-14T14:10:13.052653+0000","last_became_active":"2023-12-14T14:09:10.219485+0000","last_became_peered":"2023-12-14T14:09:10.219485+0000","last_unstale":"2023-12-14T14:10:13.052653+0000","last_undegraded":"2023-12-14T14:10:13.052653+0000","last_fullsized":"2023-12-14T14:10:13.052653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:05:25.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532431+0000","last_change":"2023-12-14T14:09:10.622064+0000","last_active":"2023-12-14T14:10:12.532431+0000","last_peered":"2023-12-14T14:10:12.532431+0000","last_clean":"2023-12-14T14:10:12.532431+0000","last_became_active":"2023-12-14T14:09:10.621741+0000","last_became_peered":"2023-12-14T14:09:10.621741+0000","last_unstale":"2023-12-14T14:10:12.532431+0000","last_undegraded":"2023-12-14T14:10:12.532431+0000","last_fullsized":"2023-12-14T14:10:12.532431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:59:00.963112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528925+0000","last_change":"2023-12-14T14:09:10.209152+0000","last_active":"2023-12-14T14:10:12.528925+0000","last_peered":"2023-12-14T14:10:12.528925+0000","last_clean":"2023-12-14T14:10:12.528925+0000","last_became_active":"2023-12-14T14:09:10.208798+0000","last_became_peered":"2023-12-14T14:09:10.208798+0000","last_unstale":"2023-12-14T14:10:12.528925+0000","last_undegraded":"2023-12-14T14:10:12.528925+0000","last_fullsized":"2023-12-14T14:10:12.528925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:55.451603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.530802+0000","last_change":"2023-12-14T14:09:10.616109+0000","last_active":"2023-12-14T14:10:12.530802+0000","last_peered":"2023-12-14T14:10:12.530802+0000","last_clean":"2023-12-14T14:10:12.530802+0000","last_became_active":"2023-12-14T14:09:10.615694+0000","last_became_peered":"2023-12-14T14:09:10.615694+0000","last_unstale":"2023-12-14T14:10:12.530802+0000","last_undegraded":"2023-12-14T14:10:12.530802+0000","last_fullsized":"2023-12-14T14:10:12.530802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:57:04.359521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529034+0000","last_change":"2023-12-14T14:09:10.224376+0000","last_active":"2023-12-14T14:10:12.529034+0000","last_peered":"2023-12-14T14:10:12.529034+0000","last_clean":"2023-12-14T14:10:12.529034+0000","last_became_active":"2023-12-14T14:09:10.224010+0000","last_became_peered":"2023-12-14T14:09:10.224010+0000","last_unstale":"2023-12-14T14:10:12.529034+0000","last_undegraded":"2023-12-14T14:10:12.529034+0000","last_fullsized":"2023-12-14T14:10:12.529034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:18:14.170417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528610+0000","last_change":"2023-12-14T14:09:10.622490+0000","last_active":"2023-12-14T14:10:12.528610+0000","last_peered":"2023-12-14T14:10:12.528610+0000","last_clean":"2023-12-14T14:10:12.528610+0000","last_became_active":"2023-12-14T14:09:10.622154+0000","last_became_peered":"2023-12-14T14:09:10.622154+0000","last_unstale":"2023-12-14T14:10:12.528610+0000","last_undegraded":"2023-12-14T14:10:12.528610+0000","last_fullsized":"2023-12-14T14:10:12.528610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T14:14:08.643046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532652+0000","last_change":"2023-12-14T14:09:10.220343+0000","last_active":"2023-12-14T14:10:12.532652+0000","last_peered":"2023-12-14T14:10:12.532652+0000","last_clean":"2023-12-14T14:10:12.532652+0000","last_became_active":"2023-12-14T14:09:10.219657+0000","last_became_peered":"2023-12-14T14:09:10.219657+0000","last_unstale":"2023-12-14T14:10:12.532652+0000","last_undegraded":"2023-12-14T14:10:12.532652+0000","last_fullsized":"2023-12-14T14:10:12.532652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:06:01.543748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532666+0000","last_change":"2023-12-14T14:09:10.633980+0000","last_active":"2023-12-14T14:10:12.532666+0000","last_peered":"2023-12-14T14:10:12.532666+0000","last_clean":"2023-12-14T14:10:12.532666+0000","last_became_active":"2023-12-14T14:09:10.633541+0000","last_became_peered":"2023-12-14T14:09:10.633541+0000","last_unstale":"2023-12-14T14:10:12.532666+0000","last_undegraded":"2023-12-14T14:10:12.532666+0000","last_fullsized":"2023-12-14T14:10:12.532666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:39:19.970037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529499+0000","last_change":"2023-12-14T14:09:10.218042+0000","last_active":"2023-12-14T14:10:12.529499+0000","last_peered":"2023-12-14T14:10:12.529499+0000","last_clean":"2023-12-14T14:10:12.529499+0000","last_became_active":"2023-12-14T14:09:10.217540+0000","last_became_peered":"2023-12-14T14:09:10.217540+0000","last_unstale":"2023-12-14T14:10:12.529499+0000","last_undegraded":"2023-12-14T14:10:12.529499+0000","last_fullsized":"2023-12-14T14:10:12.529499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:18:19.659078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532924+0000","last_change":"2023-12-14T14:09:10.633527+0000","last_active":"2023-12-14T14:10:12.532924+0000","last_peered":"2023-12-14T14:10:12.532924+0000","last_clean":"2023-12-14T14:10:12.532924+0000","last_became_active":"2023-12-14T14:09:10.632614+0000","last_became_peered":"2023-12-14T14:09:10.632614+0000","last_unstale":"2023-12-14T14:10:12.532924+0000","last_undegraded":"2023-12-14T14:10:12.532924+0000","last_fullsized":"2023-12-14T14:10:12.532924+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:24:02.650617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527211+0000","last_change":"2023-12-14T14:09:10.211731+0000","last_active":"2023-12-14T14:10:12.527211+0000","last_peered":"2023-12-14T14:10:12.527211+0000","last_clean":"2023-12-14T14:10:12.527211+0000","last_became_active":"2023-12-14T14:09:10.211366+0000","last_became_peered":"2023-12-14T14:09:10.211366+0000","last_unstale":"2023-12-14T14:10:12.527211+0000","last_undegraded":"2023-12-14T14:10:12.527211+0000","last_fullsized":"2023-12-14T14:10:12.527211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:49:40.508221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532233+0000","last_change":"2023-12-14T14:09:10.621483+0000","last_active":"2023-12-14T14:10:12.532233+0000","last_peered":"2023-12-14T14:10:12.532233+0000","last_clean":"2023-12-14T14:10:12.532233+0000","last_became_active":"2023-12-14T14:09:10.621105+0000","last_became_peered":"2023-12-14T14:09:10.621105+0000","last_unstale":"2023-12-14T14:10:12.532233+0000","last_undegraded":"2023-12-14T14:10:12.532233+0000","last_fullsized":"2023-12-14T14:10:12.532233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:25:34.331333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.759796+0000","last_change":"2023-12-14T14:10:12.759796+0000","last_active":"2023-12-14T14:10:12.759796+0000","last_peered":"2023-12-14T14:10:12.759796+0000","last_clean":"2023-12-14T14:10:12.759796+0000","last_became_active":"2023-12-14T14:10:12.757507+0000","last_became_peered":"2023-12-14T14:10:12.757507+0000","last_unstale":"2023-12-14T14:10:12.759796+0000","last_undegraded":"2023-12-14T14:10:12.759796+0000","last_fullsized":"2023-12-14T14:10:12.759796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:09.189620+0000","last_clean_scrub_stamp":"2023-12-14T14:09:09.189620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:08:46.390118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532664+0000","last_change":"2023-12-14T14:09:10.633084+0000","last_active":"2023-12-14T14:10:12.532664+0000","last_peered":"2023-12-14T14:10:12.532664+0000","last_clean":"2023-12-14T14:10:12.532664+0000","last_became_active":"2023-12-14T14:09:10.632544+0000","last_became_peered":"2023-12-14T14:09:10.632544+0000","last_unstale":"2023-12-14T14:10:12.532664+0000","last_undegraded":"2023-12-14T14:10:12.532664+0000","last_fullsized":"2023-12-14T14:10:12.532664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:36:46.213060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.530946+0000","last_change":"2023-12-14T14:09:10.618373+0000","last_active":"2023-12-14T14:10:12.530946+0000","last_peered":"2023-12-14T14:10:12.530946+0000","last_clean":"2023-12-14T14:10:12.530946+0000","last_became_active":"2023-12-14T14:09:10.618028+0000","last_became_peered":"2023-12-14T14:09:10.618028+0000","last_unstale":"2023-12-14T14:10:12.530946+0000","last_undegraded":"2023-12-14T14:10:12.530946+0000","last_fullsized":"2023-12-14T14:10:12.530946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:14:02.328236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528984+0000","last_change":"2023-12-14T14:09:10.622775+0000","last_active":"2023-12-14T14:10:12.528984+0000","last_peered":"2023-12-14T14:10:12.528984+0000","last_clean":"2023-12-14T14:10:12.528984+0000","last_became_active":"2023-12-14T14:09:10.622407+0000","last_became_peered":"2023-12-14T14:09:10.622407+0000","last_unstale":"2023-12-14T14:10:12.528984+0000","last_undegraded":"2023-12-14T14:10:12.528984+0000","last_fullsized":"2023-12-14T14:10:12.528984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:54:19.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528836+0000","last_change":"2023-12-14T14:09:10.622137+0000","last_active":"2023-12-14T14:10:12.528836+0000","last_peered":"2023-12-14T14:10:12.528836+0000","last_clean":"2023-12-14T14:10:12.528836+0000","last_became_active":"2023-12-14T14:09:10.621829+0000","last_became_peered":"2023-12-14T14:09:10.621829+0000","last_unstale":"2023-12-14T14:10:12.528836+0000","last_undegraded":"2023-12-14T14:10:12.528836+0000","last_fullsized":"2023-12-14T14:10:12.528836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:02:06.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.797053+0000","last_change":"2023-12-14T14:09:10.625511+0000","last_active":"2023-12-14T14:10:12.797053+0000","last_peered":"2023-12-14T14:10:12.797053+0000","last_clean":"2023-12-14T14:10:12.797053+0000","last_became_active":"2023-12-14T14:09:10.624863+0000","last_became_peered":"2023-12-14T14:09:10.624863+0000","last_unstale":"2023-12-14T14:10:12.797053+0000","last_undegraded":"2023-12-14T14:10:12.797053+0000","last_fullsized":"2023-12-14T14:10:12.797053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:15:14.831325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.527405+0000","last_change":"2023-12-14T14:09:10.623824+0000","last_active":"2023-12-14T14:10:12.527405+0000","last_peered":"2023-12-14T14:10:12.527405+0000","last_clean":"2023-12-14T14:10:12.527405+0000","last_became_active":"2023-12-14T14:09:10.623482+0000","last_became_peered":"2023-12-14T14:09:10.623482+0000","last_unstale":"2023-12-14T14:10:12.527405+0000","last_undegraded":"2023-12-14T14:10:12.527405+0000","last_fullsized":"2023-12-14T14:10:12.527405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:03:53.219733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.532039+0000","last_change":"2023-12-14T14:09:10.618004+0000","last_active":"2023-12-14T14:10:12.532039+0000","last_peered":"2023-12-14T14:10:12.532039+0000","last_clean":"2023-12-14T14:10:12.532039+0000","last_became_active":"2023-12-14T14:09:10.617184+0000","last_became_peered":"2023-12-14T14:09:10.617184+0000","last_unstale":"2023-12-14T14:10:12.532039+0000","last_undegraded":"2023-12-14T14:10:12.532039+0000","last_fullsized":"2023-12-14T14:10:12.532039+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:00:28.593004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.529967+0000","last_change":"2023-12-14T14:09:10.621183+0000","last_active":"2023-12-14T14:10:12.529967+0000","last_peered":"2023-12-14T14:10:12.529967+0000","last_clean":"2023-12-14T14:10:12.529967+0000","last_became_active":"2023-12-14T14:09:10.620474+0000","last_became_peered":"2023-12-14T14:09:10.620474+0000","last_unstale":"2023-12-14T14:10:12.529967+0000","last_undegraded":"2023-12-14T14:10:12.529967+0000","last_fullsized":"2023-12-14T14:10:12.529967+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:55:57.422251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528615+0000","last_change":"2023-12-14T14:09:10.630668+0000","last_active":"2023-12-14T14:10:12.528615+0000","last_peered":"2023-12-14T14:10:12.528615+0000","last_clean":"2023-12-14T14:10:12.528615+0000","last_became_active":"2023-12-14T14:09:10.630337+0000","last_became_peered":"2023-12-14T14:09:10.630337+0000","last_unstale":"2023-12-14T14:10:12.528615+0000","last_undegraded":"2023-12-14T14:10:12.528615+0000","last_fullsized":"2023-12-14T14:10:12.528615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:31:23.847778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526713+0000","last_change":"2023-12-14T14:09:10.619550+0000","last_active":"2023-12-14T14:10:12.526713+0000","last_peered":"2023-12-14T14:10:12.526713+0000","last_clean":"2023-12-14T14:10:12.526713+0000","last_became_active":"2023-12-14T14:09:10.619029+0000","last_became_peered":"2023-12-14T14:09:10.619029+0000","last_unstale":"2023-12-14T14:10:12.526713+0000","last_undegraded":"2023-12-14T14:10:12.526713+0000","last_fullsized":"2023-12-14T14:10:12.526713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T16:56:08.554200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.528969+0000","last_change":"2023-12-14T14:09:10.622158+0000","last_active":"2023-12-14T14:10:12.528969+0000","last_peered":"2023-12-14T14:10:12.528969+0000","last_clean":"2023-12-14T14:10:12.528969+0000","last_became_active":"2023-12-14T14:09:10.621853+0000","last_became_peered":"2023-12-14T14:09:10.621853+0000","last_unstale":"2023-12-14T14:10:12.528969+0000","last_undegraded":"2023-12-14T14:10:12.528969+0000","last_fullsized":"2023-12-14T14:10:12.528969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T15:21:50.173060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:13.053003+0000","last_change":"2023-12-14T14:09:10.627728+0000","last_active":"2023-12-14T14:10:13.053003+0000","last_peered":"2023-12-14T14:10:13.053003+0000","last_clean":"2023-12-14T14:10:13.053003+0000","last_became_active":"2023-12-14T14:09:10.627352+0000","last_became_peered":"2023-12-14T14:09:10.627352+0000","last_unstale":"2023-12-14T14:10:13.053003+0000","last_undegraded":"2023-12-14T14:10:13.053003+0000","last_fullsized":"2023-12-14T14:10:13.053003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:45:33.802754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.526139+0000","last_change":"2023-12-14T14:09:10.625676+0000","last_active":"2023-12-14T14:10:12.526139+0000","last_peered":"2023-12-14T14:10:12.526139+0000","last_clean":"2023-12-14T14:10:12.526139+0000","last_became_active":"2023-12-14T14:09:10.625191+0000","last_became_peered":"2023-12-14T14:09:10.625191+0000","last_unstale":"2023-12-14T14:10:12.526139+0000","last_undegraded":"2023-12-14T14:10:12.526139+0000","last_fullsized":"2023-12-14T14:10:12.526139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:13:27.311452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-14T14:10:12.531846+0000","last_change":"2023-12-14T14:09:10.624258+0000","last_active":"2023-12-14T14:10:12.531846+0000","last_peered":"2023-12-14T14:10:12.531846+0000","last_clean":"2023-12-14T14:10:12.531846+0000","last_became_active":"2023-12-14T14:09:10.623917+0000","last_became_peered":"2023-12-14T14:09:10.623917+0000","last_unstale":"2023-12-14T14:10:12.531846+0000","last_undegraded":"2023-12-14T14:10:12.531846+0000","last_fullsized":"2023-12-14T14:10:12.531846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T14:09:10.196083+0000","last_clean_scrub_stamp":"2023-12-14T14:09:10.196083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:44:13.500368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65175,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":450,"num_read_kb":293,"num_write":153,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":190885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481816,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6016,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739136,"statfs":{"total":95995035648,"available":95988875264,"internally_reserved":0,"allocated":909312,"data_stored":441084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.746}]},{"osd":8,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53600000000000003}]},{"osd":9,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Dec 14 14:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.81000000000000005}]}]},{"osd":10,"up_from":70,"seq":300647710749,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738732,"statfs":{"total":95995035648,"available":95988461568,"internally_reserved":0,"allocated":1060864,"data_stored":1093794,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58899999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.754,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.372}]},{"osd":2,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73699999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.52900000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78000000000000003,"5min":1.29,"15min":1.29},"last":0.497}]},{"osd":4,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.437},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64200000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.79100000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.61699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.67600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.90800000000000003,"5min":1.244,"15min":1.244},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.84899999999999998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.52100000000000002}]},{"osd":9,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.64700000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.395,"15min":1.395},"last":0.59599999999999997}]},{"osd":11,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.621}]}]},{"osd":9,"up_from":65,"seq":279172874272,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6160,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738992,"statfs":{"total":95995035648,"available":95988727808,"internally_reserved":0,"allocated":925696,"data_stored":441320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":0.61199999999999999,"15min":0.48499999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":21.376000000000001,"5min":21.376000000000001,"15min":21.376000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":0.63700000000000001,"15min":0.51100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":21.303000000000001,"5min":21.303000000000001,"15min":21.303000000000001},"last":0.495}]},{"osd":1,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.65400000000000003,"15min":0.60299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":10.380000000000001,"5min":10.380000000000001,"15min":10.380000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.556,"5min":0.77500000000000002,"15min":0.64500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":21.317,"5min":21.317,"15min":21.317},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.67300000000000004,"15min":0.621},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":10.406000000000001,"5min":10.406000000000001,"15min":10.406000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.556,"5min":0.78700000000000003,"15min":0.65900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":21.402000000000001,"5min":21.402000000000001,"15min":21.402000000000001},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":0.69299999999999995,"15min":0.57299999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":21.097999999999999,"5min":21.097999999999999,"15min":21.097999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.57299999999999995,"15min":0.52500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":10.455,"5min":10.455,"15min":10.455},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":0.80100000000000005,"15min":0.67700000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":21.068000000000001,"5min":21.068000000000001,"15min":21.068000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.5620000000000001,"5min":0.78600000000000003,"15min":0.65700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":21.178999999999998,"5min":21.178999999999998,"15min":21.178999999999998},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":0.83199999999999996,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":21.25,"5min":21.25,"15min":21.25},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.016,"5min":0.72599999999999998,"15min":0.67800000000000005},"min":{"1min":0.436,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":10.337999999999999,"5min":10.337999999999999,"15min":10.337999999999999},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":0.746,"15min":0.65600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":17.748000000000001,"5min":17.748000000000001,"15min":17.748000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.5,"5min":0.82899999999999996,"15min":0.71699999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":21.452999999999999,"5min":21.452999999999999,"15min":21.452999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":0.89100000000000001,"15min":0.76800000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":21.219000000000001,"5min":21.219000000000001,"15min":21.219000000000001},"last":0.438},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.79000000000000004,"15min":0.74199999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.430999999999999,"5min":10.430999999999999,"15min":10.430999999999999},"last":0.57599999999999996}]},{"osd":8,"last update":"Thu Dec 14 14:10:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":0.91800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":21.428999999999998,"5min":21.428999999999998,"15min":21.428999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.6579999999999999,"5min":0.91700000000000004,"15min":0.79300000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":21.274999999999999,"5min":21.274999999999999,"15min":21.274999999999999},"last":0.53900000000000003}]},{"osd":10,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":0.92000000000000004,"15min":0.79100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":21.347000000000001,"5min":21.347000000000001,"15min":21.347000000000001},"last":0.626},{"interface":"front","average":{"1min":1.708,"5min":0.90800000000000003,"15min":0.77500000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":21.152999999999999,"5min":21.152999999999999,"15min":21.152999999999999},"last":0.39000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103204,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6288,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738864,"statfs":{"total":95995035648,"available":95988596736,"internally_reserved":0,"allocated":925696,"data_stored":441240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81399999999999995,"5min":0.88,"15min":0.88},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.79700000000000004,"5min":0.875,"15min":0.875},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78700000000000003,"5min":1.411,"15min":1.411},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97299999999999998,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.34899999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90100000000000002,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.66900000000000004,"15min":0.65800000000000003},"min":{"1min":0.50900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.88100000000000001}]},{"osd":9,"last update":"Thu Dec 14 14:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.70899999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.73999999999999999},"min":{"1min":0.57899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92800000000000005,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.89900000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.60999999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94699999999999995,"5min":1.032,"15min":1.032},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78700000000000003,"15min":0.77800000000000002},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.86699999999999999}]}]},{"osd":7,"up_from":50,"seq":214748364839,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6400,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738752,"statfs":{"total":95995035648,"available":95988482048,"internally_reserved":0,"allocated":974848,"data_stored":1033469,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.311}]},{"osd":1,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.436,"15min":0.44},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78700000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.502},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Dec 14 14:09:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66400000000000003},"min":{"1min":0.46800000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.42599999999999999}]},{"osd":8,"last update":"Thu Dec 14 14:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86899999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59099999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.115,"5min":0.78500000000000003,"15min":0.72999999999999998},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":0.55700000000000005}]},{"osd":10,"last update":"Thu Dec 14 14:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89700000000000002,"5min":1.02,"15min":1.02},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69999999999999996,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71499999999999997}]},{"osd":11,"last update":"Thu Dec 14 14:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.83499999999999996}]}]},{"osd":6,"up_from":45,"seq":193273528362,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6276,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738876,"statfs":{"total":95995035648,"available":95988609024,"internally_reserved":0,"allocated":913408,"data_stored":440715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46899999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27300000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.501,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.436,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60099999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58499999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.63800000000000001,"5min":1.075,"15min":1.075},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68300000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.626,"15min":0.64200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71799999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Dec 14 14:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65600000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":0.995,"15min":0.995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90200000000000002,"5min":1.254,"15min":1.254},"last":0.57399999999999995}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81100000000000005,"5min":1.288,"15min":1.288},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65900000000000003}]},{"osd":9,"last update":"Thu Dec 14 14:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.64500000000000002,"15min":0.66900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66700000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":0.46999999999999997}]},{"osd":10,"last update":"Thu Dec 14 14:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.77400000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84999999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7296,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737856,"statfs":{"total":95995035648,"available":95987564544,"internally_reserved":0,"allocated":974848,"data_stored":501383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.503,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71299999999999997,"5min":0.87,"15min":0.87},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:10:06 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.40799999999999997,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.42499999999999999,"15min":0.40699999999999997},"min":{"1min":0.30199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.36899999999999999}]},{"osd":5,"last update":"Thu Dec 14 14:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.59599999999999997,"15min":0.57499999999999996},"min":{"1min":0.47799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.57599999999999996,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Dec 14 14:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.42599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.505},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.49399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84199999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55400000000000005}]},{"osd":8,"last update":"Thu Dec 14 14:09:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67200000000000004,"15min":0.66100000000000003},"min":{"1min":0.55500000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.746}]},{"osd":9,"last update":"Thu Dec 14 14:10:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.51200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.53000000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Dec 14 14:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.67600000000000005,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.628},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.71199999999999997},"min":{"1min":0.56599999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.878,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.61599999999999999}]},{"osd":11,"last update":"Thu Dec 14 14:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.72399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7192,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737960,"statfs":{"total":95995035648,"available":95987671040,"internally_reserved":0,"allocated":933888,"data_stored":441980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.45800000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.54400000000000004,"15min":0.496},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Dec 14 14:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.57299999999999995,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":5.5270000000000001,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.57699999999999996,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.372,"15min":0.372},"max":{"1min":5.0259999999999998,"5min":5.0259999999999998,"15min":5.0259999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Dec 14 14:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.6660000000000004,"5min":5.6660000000000004,"15min":5.6660000000000004},"last":0.376}]},{"osd":4,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":0.503},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.55700000000000005,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.61499999999999999,"15min":0.57199999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Dec 14 14:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":5.3890000000000002,"5min":5.3890000000000002,"15min":5.3890000000000002},"last":0.315},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.1340000000000003,"5min":5.1340000000000003,"15min":5.1340000000000003},"last":0.35099999999999998}]},{"osd":7,"last update":"Thu Dec 14 14:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.109,"5min":5.109,"15min":5.109},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu Dec 14 14:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.9509999999999996,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66700000000000004,"15min":0.65500000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":5.0019999999999998,"5min":5.0019999999999998,"15min":5.0019999999999998},"last":0.437}]},{"osd":10,"last update":"Thu Dec 14 14:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.70399999999999996,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.622},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.66700000000000004,"15min":0.63400000000000001},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.4500000000000002,"5min":5.4500000000000002,"15min":5.4500000000000002},"last":0.55900000000000005}]},{"osd":11,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.63},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":5.0499999999999998,"5min":5.0499999999999998,"15min":5.0499999999999998},"last":0.46500000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7440,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737712,"statfs":{"total":95995035648,"available":95987417088,"internally_reserved":0,"allocated":991232,"data_stored":498162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.47099999999999997,"15min":0.437},"min":{"1min":0.35999999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.46000000000000002},"min":{"1min":0.38700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.51900000000000002,"15min":0.47699999999999998},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.52000000000000002,"15min":0.47199999999999998},"min":{"1min":0.375,"5min":0.308,"15min":0.308},"max":{"1min":0.76600000000000001,"5min":0.877,"15min":0.877},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.40899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71299999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Dec 14 14:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.46100000000000002},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.505,"15min":0.497},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89900000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.747}]},{"osd":7,"last update":"Thu Dec 14 14:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626}]},{"osd":8,"last update":"Thu Dec 14 14:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Dec 14 14:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.57799999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.63300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95299999999999996,"5min":1.046,"15min":1.046},"last":0.80700000000000005}]},{"osd":10,"last update":"Thu Dec 14 14:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65600000000000003,"15min":0.64800000000000002},"min":{"1min":0.57999999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.88},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.58199999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91700000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.89000000000000001}]},{"osd":11,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.82499999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215157,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6548,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738604,"statfs":{"total":95995035648,"available":95988330496,"internally_reserved":0,"allocated":929792,"data_stored":441032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.316},"min":{"1min":0.252,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.308},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.505,"15min":0.47999999999999998},"min":{"1min":0.44700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.45600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Dec 14 14:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Dec 14 14:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55500000000000005,"15min":0.53500000000000003},"min":{"1min":0.47499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84499999999999997,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Dec 14 14:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77900000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.58999999999999997}]},{"osd":8,"last update":"Thu Dec 14 14:08:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58899999999999997}]},{"osd":9,"last update":"Thu Dec 14 14:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.65000000000000002,"15min":0.67400000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":1.012,"15min":1.012},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67800000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Dec 14 14:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65500000000000003}]},{"osd":11,"last update":"Thu Dec 14 14:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.623}]}]},{"osd":4,"up_from":32,"seq":137438953521,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6408,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738744,"statfs":{"total":95995035648,"available":95988473856,"internally_reserved":0,"allocated":917504,"data_stored":441488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.498}]},{"osd":1,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.32100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81100000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52700000000000002,"15min":0.51200000000000001},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Dec 14 14:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78000000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Dec 14 14:09:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80700000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84299999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.746}]},{"osd":6,"last update":"Thu Dec 14 14:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76900000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.58999999999999997},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83699999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.88200000000000001}]},{"osd":9,"last update":"Thu Dec 14 14:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":1.216,"15min":1.216},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.78400000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67400000000000004}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.73199999999999998}]},{"osd":11,"last update":"Thu Dec 14 14:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.90100000000000002}]}]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6536,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738616,"statfs":{"total":95995035648,"available":95988342784,"internally_reserved":0,"allocated":983040,"data_stored":1032530,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.499},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.54500000000000004,"15min":0.51400000000000001},"min":{"1min":0.51500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56200000000000006,"15min":0.53800000000000003},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.41099999999999998,"15min":0.38300000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Dec 14 14:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.57799999999999996,"15min":0.54800000000000004},"min":{"1min":0.48199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.57499999999999996,"15min":0.54700000000000004},"min":{"1min":0.48599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Dec 14 14:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":1.032,"15min":1.032},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Dec 14 14:09:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.69299999999999995}]},{"osd":8,"last update":"Thu Dec 14 14:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 14:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.69699999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69299999999999995,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60899999999999999}]},{"osd":10,"last update":"Thu Dec 14 14:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.747},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34044,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35678,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T14:10:28.696 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:10:28.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.854+0000 7f7b49901700 1 -- 172.21.15.69:0/894584125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 msgr2=0x7f7b440ff870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.854+0000 7f7b49901700 1 --2- 172.21.15.69:0/894584125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 0x7f7b440ff870 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009990 tx=0x7f7b38009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.854+0000 7f7b49901700 1 -- 172.21.15.69:0/894584125 shutdown_connections 2023-12-14T14:10:28.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.854+0000 7f7b49901700 1 --2- 172.21.15.69:0/894584125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b440ffdb0 0x7f7b44107660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.854+0000 7f7b49901700 1 --2- 172.21.15.69:0/894584125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b441007b0 0x7f7b44100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.854+0000 7f7b49901700 1 --2- 172.21.15.69:0/894584125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 0x7f7b440ff870 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.854+0000 7f7b49901700 1 -- 172.21.15.69:0/894584125 >> 172.21.15.69:0/894584125 conn(0x7f7b440f9f80 msgr2=0x7f7b440fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:28.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.854+0000 7f7b49901700 1 -- 172.21.15.69:0/894584125 shutdown_connections 2023-12-14T14:10:28.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.854+0000 7f7b49901700 1 -- 172.21.15.69:0/894584125 wait complete. 2023-12-14T14:10:28.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b49901700 1 Processor -- start 2023-12-14T14:10:28.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b49901700 1 -- start start 2023-12-14T14:10:28.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b49901700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 0x7f7b440fee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b49901700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b440ffdb0 0x7f7b4419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b49901700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b441007b0 0x7f7b4419d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b49901700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4419db20 con 0x7f7b440ff400 2023-12-14T14:10:28.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b49901700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4419dc90 con 0x7f7b440ffdb0 2023-12-14T14:10:28.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b49901700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4419de50 con 0x7f7b441007b0 2023-12-14T14:10:28.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b42ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 0x7f7b440fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b42ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 0x7f7b440fee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54474/0 (socket says 172.21.15.69:54474) 2023-12-14T14:10:28.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b42ffd700 1 -- 172.21.15.69:0/3628234486 learned_addr learned my addr 172.21.15.69:0/3628234486 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:28.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.855+0000 7f7b427fc700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b440ffdb0 0x7f7b4419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b437fe700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b441007b0 0x7f7b4419d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b42ffd700 1 -- 172.21.15.69:0/3628234486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b441007b0 msgr2=0x7f7b4419d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b42ffd700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b441007b0 0x7f7b4419d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b42ffd700 1 -- 172.21.15.69:0/3628234486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b440ffdb0 msgr2=0x7f7b4419ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:28.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b42ffd700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b440ffdb0 0x7f7b4419ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:28.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b42ffd700 1 -- 172.21.15.69:0/3628234486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b380095f0 con 0x7f7b440ff400 2023-12-14T14:10:28.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b427fc700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b440ffdb0 0x7f7b4419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:28.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b42ffd700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 0x7f7b440fee60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c970 tx=0x7f7b3400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:28.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b488ff700 1 -- 172.21.15.69:0/3628234486 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34004220 con 0x7f7b440ff400 2023-12-14T14:10:28.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b488ff700 1 -- 172.21.15.69:0/3628234486 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b34007d60 con 0x7f7b440ff400 2023-12-14T14:10:28.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4410aae0 con 0x7f7b440ff400 2023-12-14T14:10:28.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b488ff700 1 -- 172.21.15.69:0/3628234486 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34003d00 con 0x7f7b440ff400 2023-12-14T14:10:28.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.856+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4410a950 con 0x7f7b440ff400 2023-12-14T14:10:28.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.857+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b441061a0 con 0x7f7b440ff400 2023-12-14T14:10:28.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.858+0000 7f7b488ff700 1 -- 172.21.15.69:0/3628234486 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f7b34004380 con 0x7f7b440ff400 2023-12-14T14:10:28.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.859+0000 7f7b488ff700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7b2c0a1260 0x7f7b2c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:28.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.859+0000 7f7b427fc700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7b2c0a1260 0x7f7b2c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:28.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.859+0000 7f7b488ff700 1 -- 172.21.15.69:0/3628234486 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f7b340cc970 con 0x7f7b440ff400 2023-12-14T14:10:28.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.859+0000 7f7b427fc700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7b2c0a1260 0x7f7b2c0a3710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7b38006010 tx=0x7f7b3800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:28.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:28.862+0000 7f7b488ff700 1 -- 172.21.15.69:0/3628234486 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7b34095fe0 con 0x7f7b440ff400 2023-12-14T14:10:29.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:28 smithi119 ceph-mon[43834]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:10:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.050+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b4402cfe0 con 0x7f7b440ff400 2023-12-14T14:10:29.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.052+0000 7f7b488ff700 1 -- 172.21.15.69:0/3628234486 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22434 (secure 0 0 0) 0x7f7b34099600 con 0x7f7b440ff400 2023-12-14T14:10:29.052 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:29.053 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":84,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:10:12.522850+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:10:29.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7b2c0a1260 msgr2=0x7f7b2c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7b2c0a1260 0x7f7b2c0a3710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7b38006010 tx=0x7f7b3800b540 comp rx=0 tx=0).stop 2023-12-14T14:10:29.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 msgr2=0x7f7b440fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 0x7f7b440fee60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c970 tx=0x7f7b3400cd30 comp rx=0 tx=0).stop 2023-12-14T14:10:29.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 shutdown_connections 2023-12-14T14:10:29.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f7b2c0a1260 0x7f7b2c0a3710 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b441007b0 0x7f7b4419d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b440ff400 0x7f7b440fee60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 --2- 172.21.15.69:0/3628234486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b440ffdb0 0x7f7b4419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 >> 172.21.15.69:0/3628234486 conn(0x7f7b440f9f80 msgr2=0x7f7b440fc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:29.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 shutdown_connections 2023-12-14T14:10:29.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.054+0000 7f7b49901700 1 -- 172.21.15.69:0/3628234486 wait complete. 2023-12-14T14:10:29.065 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:28 smithi069 ceph-mon[42034]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:10:29.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T14:09:08.720147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T14:09:09.776845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:10:29.068 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:10:29.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:28 smithi081 ceph-mon[43371]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:10:29.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 -- 172.21.15.69:0/3503895301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100310 msgr2=0x7fd9c0100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 --2- 172.21.15.69:0/3503895301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100310 0x7fd9c0100760 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009990 tx=0x7fd9ac009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 -- 172.21.15.69:0/3503895301 shutdown_connections 2023-12-14T14:10:29.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 --2- 172.21.15.69:0/3503895301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c0100ca0 0x7fd9c0107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 --2- 172.21.15.69:0/3503895301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9c00ff120 0x7fd9c00ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 --2- 172.21.15.69:0/3503895301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100310 0x7fd9c0100760 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 -- 172.21.15.69:0/3503895301 >> 172.21.15.69:0/3503895301 conn(0x7fd9c00fa740 msgr2=0x7fd9c00fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:29.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 -- 172.21.15.69:0/3503895301 shutdown_connections 2023-12-14T14:10:29.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 -- 172.21.15.69:0/3503895301 wait complete. 2023-12-14T14:10:29.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 Processor -- start 2023-12-14T14:10:29.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.192+0000 7fd9c718e700 1 -- start start 2023-12-14T14:10:29.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c718e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c00ff120 0x7fd9c0196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c718e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9c0100310 0x7fd9c0196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c718e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100ca0 0x7fd9c019d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c718e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c019db90 con 0x7fd9c0100ca0 2023-12-14T14:10:29.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c718e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c019dcd0 con 0x7fd9c0100310 2023-12-14T14:10:29.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c718e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c019de60 con 0x7fd9c00ff120 2023-12-14T14:10:29.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c572b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100ca0 0x7fd9c019d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c572b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100ca0 0x7fd9c019d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54500/0 (socket says 172.21.15.69:54500) 2023-12-14T14:10:29.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c572b700 1 -- 172.21.15.69:0/678896894 learned_addr learned my addr 172.21.15.69:0/678896894 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:29.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9bffff700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9c0100310 0x7fd9c0196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c4f2a700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c00ff120 0x7fd9c0196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c572b700 1 -- 172.21.15.69:0/678896894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c00ff120 msgr2=0x7fd9c0196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c572b700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c00ff120 0x7fd9c0196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c572b700 1 -- 172.21.15.69:0/678896894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9c0100310 msgr2=0x7fd9c0196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c572b700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9c0100310 0x7fd9c0196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c572b700 1 -- 172.21.15.69:0/678896894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac0095f0 con 0x7fd9c0100ca0 2023-12-14T14:10:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c572b700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100ca0 0x7fd9c019d5c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800b970 tx=0x7fd9b800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9bdffb700 1 -- 172.21.15.69:0/678896894 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800d860 con 0x7fd9c0100ca0 2023-12-14T14:10:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9bdffb700 1 -- 172.21.15.69:0/678896894 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9b800de80 con 0x7fd9c0100ca0 2023-12-14T14:10:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c010ab00 con 0x7fd9c0100ca0 2023-12-14T14:10:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.193+0000 7fd9bdffb700 1 -- 172.21.15.69:0/678896894 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8017400 con 0x7fd9c0100ca0 2023-12-14T14:10:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.194+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c010a970 con 0x7fd9c0100ca0 2023-12-14T14:10:29.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.194+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c0107250 con 0x7fd9c0100ca0 2023-12-14T14:10:29.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.195+0000 7fd9bdffb700 1 -- 172.21.15.69:0/678896894 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd9b800e630 con 0x7fd9c0100ca0 2023-12-14T14:10:29.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.196+0000 7fd9bdffb700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd9b00a11e0 0x7fd9b00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.196+0000 7fd9c4f2a700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd9b00a11e0 0x7fd9b00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.196+0000 7fd9bdffb700 1 -- 172.21.15.69:0/678896894 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fd9b8006e40 con 0x7fd9c0100ca0 2023-12-14T14:10:29.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.197+0000 7fd9c4f2a700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd9b00a11e0 0x7fd9b00a3690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0100170 tx=0x7fd9b400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:29.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.200+0000 7fd9bdffb700 1 -- 172.21.15.69:0/678896894 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd9b8095cb0 con 0x7fd9c0100ca0 2023-12-14T14:10:29.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.388+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9c0061940 con 0x7fd9c0100ca0 2023-12-14T14:10:29.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.388+0000 7fd9bdffb700 1 -- 172.21.15.69:0/678896894 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9b80992d0 con 0x7fd9c0100ca0 2023-12-14T14:10:29.389 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:10:29.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd9b00a11e0 msgr2=0x7fd9b00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd9b00a11e0 0x7fd9b00a3690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0100170 tx=0x7fd9b400b410 comp rx=0 tx=0).stop 2023-12-14T14:10:29.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100ca0 msgr2=0x7fd9c019d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100ca0 0x7fd9c019d5c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800b970 tx=0x7fd9b800bc80 comp rx=0 tx=0).stop 2023-12-14T14:10:29.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 shutdown_connections 2023-12-14T14:10:29.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fd9b00a11e0 0x7fd9b00a3690 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c0100ca0 0x7fd9c019d5c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c00ff120 0x7fd9c0196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 --2- 172.21.15.69:0/678896894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9c0100310 0x7fd9c0196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.390+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 >> 172.21.15.69:0/678896894 conn(0x7fd9c00fa740 msgr2=0x7fd9c00fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:29.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.391+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 shutdown_connections 2023-12-14T14:10:29.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.391+0000 7fd9c718e700 1 -- 172.21.15.69:0/678896894 wait complete. 2023-12-14T14:10:29.403 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T14:10:29.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.527+0000 7f86a3cc2700 1 -- 172.21.15.69:0/1741614075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 msgr2=0x7f869c107580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.527+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/1741614075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 0x7f869c107580 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8694009990 tx=0x7f8694009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.527+0000 7f86a3cc2700 1 -- 172.21.15.69:0/1741614075 shutdown_connections 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.527+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/1741614075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 0x7f869c107580 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.527+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/1741614075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f869c0ff140 0x7f869c0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.527+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/1741614075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f869c100330 0x7f869c100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.527+0000 7f86a3cc2700 1 -- 172.21.15.69:0/1741614075 >> 172.21.15.69:0/1741614075 conn(0x7f869c0fa740 msgr2=0x7f869c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.527+0000 7f86a3cc2700 1 -- 172.21.15.69:0/1741614075 shutdown_connections 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.527+0000 7f86a3cc2700 1 -- 172.21.15.69:0/1741614075 wait complete. 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a3cc2700 1 Processor -- start 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a3cc2700 1 -- start start 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a3cc2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f869c0ff140 0x7f869c194e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a3cc2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f869c100330 0x7f869c195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a3cc2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 0x7f869c19c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a3cc2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c19c980 con 0x7f869c100cc0 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a3cc2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c19cac0 con 0x7f869c0ff140 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a3cc2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c19cc50 con 0x7f869c100330 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a225f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 0x7f869c19c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a225f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 0x7f869c19c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54520/0 (socket says 172.21.15.69:54520) 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a225f700 1 -- 172.21.15.69:0/3701674567 learned_addr learned my addr 172.21.15.69:0/3701674567 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a1a5e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f869c0ff140 0x7f869c194e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a125d700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f869c100330 0x7f869c195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a225f700 1 -- 172.21.15.69:0/3701674567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f869c100330 msgr2=0x7f869c195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a225f700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f869c100330 0x7f869c195340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a225f700 1 -- 172.21.15.69:0/3701674567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f869c0ff140 msgr2=0x7f869c194e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.528+0000 7f86a225f700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f869c0ff140 0x7f869c194e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.529+0000 7f86a225f700 1 -- 172.21.15.69:0/3701674567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940095f0 con 0x7f869c100cc0 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.529+0000 7f86a225f700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 0x7f869c19c3b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8694005910 tx=0x7f8694004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.529+0000 7f869affd700 1 -- 172.21.15.69:0/3701674567 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869401f070 con 0x7f869c100cc0 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.529+0000 7f869affd700 1 -- 172.21.15.69:0/3701674567 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8694005030 con 0x7f869c100cc0 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.529+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869c10aab0 con 0x7f869c100cc0 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.529+0000 7f869affd700 1 -- 172.21.15.69:0/3701674567 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694004b20 con 0x7f869c100cc0 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.529+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c10a920 con 0x7f869c100cc0 2023-12-14T14:10:29.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.530+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869c067160 con 0x7f869c100cc0 2023-12-14T14:10:29.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.531+0000 7f869affd700 1 -- 172.21.15.69:0/3701674567 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8694023070 con 0x7f869c100cc0 2023-12-14T14:10:29.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.532+0000 7f869affd700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86840a11e0 0x7f86840a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.532+0000 7f86a1a5e700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86840a11e0 0x7f86840a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.532+0000 7f869affd700 1 -- 172.21.15.69:0/3701674567 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f86940d0450 con 0x7f869c100cc0 2023-12-14T14:10:29.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.532+0000 7f86a1a5e700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86840a11e0 0x7f86840a3690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f868c009550 tx=0x7f868c0091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:29.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.535+0000 7f869affd700 1 -- 172.21.15.69:0/3701674567 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8694099ad0 con 0x7f869c100cc0 2023-12-14T14:10:29.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.724+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f869c106240 con 0x7f869c100cc0 2023-12-14T14:10:29.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.724+0000 7f869affd700 1 -- 172.21.15.69:0/3701674567 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f869409d0f0 con 0x7f869c100cc0 2023-12-14T14:10:29.724 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86840a11e0 msgr2=0x7f86840a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86840a11e0 0x7f86840a3690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f868c009550 tx=0x7f868c0091b0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 msgr2=0x7f869c19c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 0x7f869c19c3b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8694005910 tx=0x7f8694004730 comp rx=0 tx=0).stop 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 shutdown_connections 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f86840a11e0 0x7f86840a3690 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f869c100cc0 0x7f869c19c3b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f869c0ff140 0x7f869c194e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 --2- 172.21.15.69:0/3701674567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f869c100330 0x7f869c195340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 >> 172.21.15.69:0/3701674567 conn(0x7f869c0fa740 msgr2=0x7f869c1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:29.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 shutdown_connections 2023-12-14T14:10:29.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.726+0000 7f86a3cc2700 1 -- 172.21.15.69:0/3701674567 wait complete. 2023-12-14T14:10:29.739 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T14:10:29.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.864+0000 7f632343d700 1 -- 172.21.15.69:0/157642549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100310 msgr2=0x7f631c100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.864+0000 7f632343d700 1 --2- 172.21.15.69:0/157642549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100310 0x7f631c100760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6318009990 tx=0x7f6318009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.864+0000 7f632343d700 1 -- 172.21.15.69:0/157642549 shutdown_connections 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.864+0000 7f632343d700 1 --2- 172.21.15.69:0/157642549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c100ca0 0x7f631c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.864+0000 7f632343d700 1 --2- 172.21.15.69:0/157642549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0ff120 0x7f631c0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.864+0000 7f632343d700 1 --2- 172.21.15.69:0/157642549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100310 0x7f631c100760 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.864+0000 7f632343d700 1 -- 172.21.15.69:0/157642549 >> 172.21.15.69:0/157642549 conn(0x7f631c0fa740 msgr2=0x7f631c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.864+0000 7f632343d700 1 -- 172.21.15.69:0/157642549 shutdown_connections 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.864+0000 7f632343d700 1 -- 172.21.15.69:0/157642549 wait complete. 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f632343d700 1 Processor -- start 2023-12-14T14:10:29.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f632343d700 1 -- start start 2023-12-14T14:10:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f632343d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0ff120 0x7f631c0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f632343d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c100310 0x7f631c19ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f632343d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100ca0 0x7f631c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f632343d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c19db40 con 0x7f631c100ca0 2023-12-14T14:10:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f632343d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c19dcb0 con 0x7f631c0ff120 2023-12-14T14:10:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f632343d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c19de70 con 0x7f631c100310 2023-12-14T14:10:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63219da700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100ca0 0x7f631c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63219da700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100ca0 0x7f631c19d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54536/0 (socket says 172.21.15.69:54536) 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63219da700 1 -- 172.21.15.69:0/3114531619 learned_addr learned my addr 172.21.15.69:0/3114531619 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63211d9700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0ff120 0x7f631c0689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63209d8700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c100310 0x7f631c19ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63219da700 1 -- 172.21.15.69:0/3114531619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c100310 msgr2=0x7f631c19ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63219da700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c100310 0x7f631c19ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63219da700 1 -- 172.21.15.69:0/3114531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0ff120 msgr2=0x7f631c0689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63219da700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0ff120 0x7f631c0689a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63219da700 1 -- 172.21.15.69:0/3114531619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63180095f0 con 0x7f631c100ca0 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.865+0000 7f63219da700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100ca0 0x7f631c19d3a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6314007ee0 tx=0x7f631400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.866+0000 7f63127fc700 1 -- 172.21.15.69:0/3114531619 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314017070 con 0x7f631c100ca0 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.866+0000 7f63127fc700 1 -- 172.21.15.69:0/3114531619 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f631400f040 con 0x7f631c100ca0 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.866+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c10aa80 con 0x7f631c100ca0 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.866+0000 7f63127fc700 1 -- 172.21.15.69:0/3114531619 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314005740 con 0x7f631c100ca0 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.866+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c10a8f0 con 0x7f631c100ca0 2023-12-14T14:10:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.867+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c106760 con 0x7f631c100ca0 2023-12-14T14:10:29.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.868+0000 7f63127fc700 1 -- 172.21.15.69:0/3114531619 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f631400dc60 con 0x7f631c100ca0 2023-12-14T14:10:29.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.868+0000 7f63127fc700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63080a11e0 0x7f63080a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:29.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.868+0000 7f63211d9700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63080a11e0 0x7f63080a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:29.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.868+0000 7f63127fc700 1 -- 172.21.15.69:0/3114531619 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f63140cc0f0 con 0x7f631c100ca0 2023-12-14T14:10:29.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.869+0000 7f63211d9700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63080a11e0 0x7f63080a3690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f631c100170 tx=0x7f630c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:29.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:29.872+0000 7f63127fc700 1 -- 172.21.15.69:0/3114531619 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f63140957e0 con 0x7f631c100ca0 2023-12-14T14:10:30.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:29 smithi119 ceph-mon[43834]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:10:30.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:29 smithi119 ceph-mon[43834]: pgmap v263: 97 pgs: 97 active+clean; 640 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2023-12-14T14:10:30.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:29 smithi119 ceph-mon[43834]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:10:30.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:29 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3628234486' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:30.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:29 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/678896894' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.058+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f631c061730 con 0x7f631c100ca0 2023-12-14T14:10:30.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.059+0000 7f63127fc700 1 -- 172.21.15.69:0/3114531619 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6314098e00 con 0x7f631c100ca0 2023-12-14T14:10:30.059 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T14:10:30.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63080a11e0 msgr2=0x7f63080a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63080a11e0 0x7f63080a3690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f631c100170 tx=0x7f630c00b410 comp rx=0 tx=0).stop 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100ca0 msgr2=0x7f631c19d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100ca0 0x7f631c19d3a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6314007ee0 tx=0x7f631400d3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 shutdown_connections 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f63080a11e0 0x7f63080a3690 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f631c100ca0 0x7f631c19d3a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0ff120 0x7f631c0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 --2- 172.21.15.69:0/3114531619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c100310 0x7f631c19ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 >> 172.21.15.69:0/3114531619 conn(0x7f631c0fa740 msgr2=0x7f631c1038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 shutdown_connections 2023-12-14T14:10:30.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.061+0000 7f632343d700 1 -- 172.21.15.69:0/3114531619 wait complete. 2023-12-14T14:10:30.073 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:29 smithi069 ceph-mon[42034]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:10:30.073 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:29 smithi069 ceph-mon[42034]: pgmap v263: 97 pgs: 97 active+clean; 640 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2023-12-14T14:10:30.073 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:29 smithi069 ceph-mon[42034]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:10:30.073 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:29 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3628234486' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:30.073 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:29 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/678896894' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:30.074 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:10:30.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:29 smithi081 ceph-mon[43371]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:10:30.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:29 smithi081 ceph-mon[43371]: pgmap v263: 97 pgs: 97 active+clean; 640 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2023-12-14T14:10:30.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:29 smithi081 ceph-mon[43371]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T14:10:30.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:29 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3628234486' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:30.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:29 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/678896894' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.195+0000 7f42887a6700 1 -- 172.21.15.69:0/1372059443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280105ed0 msgr2=0x7f4280108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.195+0000 7f42887a6700 1 --2- 172.21.15.69:0/1372059443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280105ed0 0x7f4280108330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f427800b0a0 tx=0x7f427800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.195+0000 7f42887a6700 1 -- 172.21.15.69:0/1372059443 shutdown_connections 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.195+0000 7f42887a6700 1 --2- 172.21.15.69:0/1372059443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280105ed0 0x7f4280108330 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.195+0000 7f42887a6700 1 --2- 172.21.15.69:0/1372059443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4280100c90 0x7f4280103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.195+0000 7f42887a6700 1 --2- 172.21.15.69:0/1372059443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42801035b0 0x7f4280105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.195+0000 7f42887a6700 1 -- 172.21.15.69:0/1372059443 >> 172.21.15.69:0/1372059443 conn(0x7f42800fa6f0 msgr2=0x7f42800fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.195+0000 7f42887a6700 1 -- 172.21.15.69:0/1372059443 shutdown_connections 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.195+0000 7f42887a6700 1 -- 172.21.15.69:0/1372059443 wait complete. 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f42887a6700 1 Processor -- start 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f42887a6700 1 -- start start 2023-12-14T14:10:30.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f42887a6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280100c90 0x7f4280196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f42887a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42801035b0 0x7f4280196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f42887a6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4280105ed0 0x7f428019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f42887a6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428019dbd0 con 0x7f4280100c90 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f42887a6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428019dd10 con 0x7f42801035b0 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f42887a6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428019dea0 con 0x7f4280105ed0 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f4286542700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280100c90 0x7f4280196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f4286542700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280100c90 0x7f4280196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54546/0 (socket says 172.21.15.69:54546) 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.196+0000 7f4286542700 1 -- 172.21.15.69:0/4220064988 learned_addr learned my addr 172.21.15.69:0/4220064988 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f4286542700 1 -- 172.21.15.69:0/4220064988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4280105ed0 msgr2=0x7f428019d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f4286542700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4280105ed0 0x7f428019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f4286542700 1 -- 172.21.15.69:0/4220064988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42801035b0 msgr2=0x7f4280196590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f4285d41700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42801035b0 0x7f4280196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f4286542700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42801035b0 0x7f4280196590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f4286542700 1 -- 172.21.15.69:0/4220064988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009d00 con 0x7f4280100c90 2023-12-14T14:10:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f4285d41700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42801035b0 0x7f4280196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f4286542700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280100c90 0x7f4280196050 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f427400d950 tx=0x7f427400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f42737fe700 1 -- 172.21.15.69:0/4220064988 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274009b40 con 0x7f4280100c90 2023-12-14T14:10:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f42737fe700 1 -- 172.21.15.69:0/4220064988 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4274009ca0 con 0x7f4280100c90 2023-12-14T14:10:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f42737fe700 1 -- 172.21.15.69:0/4220064988 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400f620 con 0x7f4280100c90 2023-12-14T14:10:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428010bbd0 con 0x7f4280100c90 2023-12-14T14:10:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.197+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428010ba40 con 0x7f4280100c90 2023-12-14T14:10:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.198+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42800fc260 con 0x7f4280100c90 2023-12-14T14:10:30.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.199+0000 7f42737fe700 1 -- 172.21.15.69:0/4220064988 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4274010460 con 0x7f4280100c90 2023-12-14T14:10:30.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.200+0000 7f42737fe700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f426c0a11e0 0x7f426c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.200+0000 7f4285d41700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f426c0a11e0 0x7f426c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.200+0000 7f42737fe700 1 -- 172.21.15.69:0/4220064988 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f42740ccd20 con 0x7f4280100c90 2023-12-14T14:10:30.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.200+0000 7f4285d41700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f426c0a11e0 0x7f426c0a3690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f427c005fd0 tx=0x7f427c005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.203+0000 7f42737fe700 1 -- 172.21.15.69:0/4220064988 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4274096410 con 0x7f4280100c90 2023-12-14T14:10:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.439+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f428002cfe0 con 0x7f4280100c90 2023-12-14T14:10:30.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.440+0000 7f42737fe700 1 -- 172.21.15.69:0/4220064988 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f4274020090 con 0x7f4280100c90 2023-12-14T14:10:30.440 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:30.440 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:10:30.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f426c0a11e0 msgr2=0x7f426c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f426c0a11e0 0x7f426c0a3690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f427c005fd0 tx=0x7f427c005ee0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280100c90 msgr2=0x7f4280196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280100c90 0x7f4280196050 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f427400d950 tx=0x7f427400dd10 comp rx=0 tx=0).stop 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 shutdown_connections 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f426c0a11e0 0x7f426c0a3690 secure :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f427c005fd0 tx=0x7f427c005ee0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4280105ed0 0x7f428019d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4280100c90 0x7f4280196050 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 --2- 172.21.15.69:0/4220064988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42801035b0 0x7f4280196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 >> 172.21.15.69:0/4220064988 conn(0x7f42800fa6f0 msgr2=0x7f4280101990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 shutdown_connections 2023-12-14T14:10:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.442+0000 7f42887a6700 1 -- 172.21.15.69:0/4220064988 wait complete. 2023-12-14T14:10:30.444 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:10:30.455 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:10:30.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.575+0000 7efca05ab700 1 -- 172.21.15.69:0/1494523057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc980ffde0 msgr2=0x7efc98107690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.575+0000 7efca05ab700 1 --2- 172.21.15.69:0/1494523057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc980ffde0 0x7efc98107690 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efc9000b0a0 tx=0x7efc9000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.575+0000 7efca05ab700 1 -- 172.21.15.69:0/1494523057 shutdown_connections 2023-12-14T14:10:30.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.575+0000 7efca05ab700 1 --2- 172.21.15.69:0/1494523057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc980ffde0 0x7efc98107690 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.575+0000 7efca05ab700 1 --2- 172.21.15.69:0/1494523057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc981007e0 0x7efc98100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.575+0000 7efca05ab700 1 --2- 172.21.15.69:0/1494523057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc980ff430 0x7efc980ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.575+0000 7efca05ab700 1 -- 172.21.15.69:0/1494523057 >> 172.21.15.69:0/1494523057 conn(0x7efc980f9fb0 msgr2=0x7efc980fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.575+0000 7efca05ab700 1 -- 172.21.15.69:0/1494523057 shutdown_connections 2023-12-14T14:10:30.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.575+0000 7efca05ab700 1 -- 172.21.15.69:0/1494523057 wait complete. 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.576+0000 7efca05ab700 1 Processor -- start 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.576+0000 7efca05ab700 1 -- start start 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.576+0000 7efca05ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc980ff430 0x7efc98194fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.576+0000 7efca05ab700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc980ffde0 0x7efc98195510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.576+0000 7efca05ab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc981007e0 0x7efc9819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.576+0000 7efca05ab700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9819cb50 con 0x7efc981007e0 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.576+0000 7efca05ab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9819cc90 con 0x7efc980ff430 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.576+0000 7efca05ab700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9819ce20 con 0x7efc980ffde0 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9eb48700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc981007e0 0x7efc9819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9eb48700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc981007e0 0x7efc9819c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54552/0 (socket says 172.21.15.69:54552) 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9eb48700 1 -- 172.21.15.69:0/931828586 learned_addr learned my addr 172.21.15.69:0/931828586 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9db46700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc980ffde0 0x7efc98195510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9e347700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc980ff430 0x7efc98194fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9eb48700 1 -- 172.21.15.69:0/931828586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc980ffde0 msgr2=0x7efc98195510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9eb48700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc980ffde0 0x7efc98195510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9eb48700 1 -- 172.21.15.69:0/931828586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc980ff430 msgr2=0x7efc98194fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9eb48700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc980ff430 0x7efc98194fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9eb48700 1 -- 172.21.15.69:0/931828586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90009d00 con 0x7efc981007e0 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9e347700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc980ff430 0x7efc98194fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc9eb48700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc981007e0 0x7efc9819c580 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc9000b780 tx=0x7efc9000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc8f7fe700 1 -- 172.21.15.69:0/931828586 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000e040 con 0x7efc981007e0 2023-12-14T14:10:30.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9810ab80 con 0x7efc981007e0 2023-12-14T14:10:30.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc8f7fe700 1 -- 172.21.15.69:0/931828586 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc90004c50 con 0x7efc981007e0 2023-12-14T14:10:30.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efc8f7fe700 1 -- 172.21.15.69:0/931828586 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900053b0 con 0x7efc981007e0 2023-12-14T14:10:30.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.577+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9810a9f0 con 0x7efc981007e0 2023-12-14T14:10:30.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.578+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc98106790 con 0x7efc981007e0 2023-12-14T14:10:30.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.579+0000 7efc8f7fe700 1 -- 172.21.15.69:0/931828586 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7efc9001d9c0 con 0x7efc981007e0 2023-12-14T14:10:30.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.580+0000 7efc8f7fe700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efc840a1260 0x7efc840a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.580+0000 7efc9e347700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efc840a1260 0x7efc840a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.580+0000 7efc8f7fe700 1 -- 172.21.15.69:0/931828586 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7efc900ce360 con 0x7efc981007e0 2023-12-14T14:10:30.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.580+0000 7efc9e347700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efc840a1260 0x7efc840a3710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efc98068ae0 tx=0x7efc94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.584+0000 7efc8f7fe700 1 -- 172.21.15.69:0/931828586 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7efc900979e0 con 0x7efc981007e0 2023-12-14T14:10:30.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.783+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc9802cfe0 con 0x7efc981007e0 2023-12-14T14:10:30.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.784+0000 7efc8f7fe700 1 -- 172.21.15.69:0/931828586 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22434 (secure 0 0 0) 0x7efc9009b000 con 0x7efc981007e0 2023-12-14T14:10:30.785 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:10:30.785 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":84,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:10:12.522850+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:10:30.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efc840a1260 msgr2=0x7efc840a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efc840a1260 0x7efc840a3710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efc98068ae0 tx=0x7efc94009260 comp rx=0 tx=0).stop 2023-12-14T14:10:30.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc981007e0 msgr2=0x7efc9819c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc981007e0 0x7efc9819c580 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc9000b780 tx=0x7efc9000bab0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 shutdown_connections 2023-12-14T14:10:30.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7efc840a1260 0x7efc840a3710 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc981007e0 0x7efc9819c580 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc980ff430 0x7efc98194fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 --2- 172.21.15.69:0/931828586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc980ffde0 0x7efc98195510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 >> 172.21.15.69:0/931828586 conn(0x7efc980f9fb0 msgr2=0x7efc981038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 shutdown_connections 2023-12-14T14:10:30.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.787+0000 7efca05ab700 1 -- 172.21.15.69:0/931828586 wait complete. 2023-12-14T14:10:30.798 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:30 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3701674567' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:30.798 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:30 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3114531619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:30.798 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:30 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4220064988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:30.800 DEBUG:tasks.fwd_scrub:Yielding 2023-12-14T14:10:30.800 INFO:teuthology.run_tasks:Running task exec... 2023-12-14T14:10:30.823 INFO:teuthology.task.exec:Executing custom commands... 2023-12-14T14:10:30.823 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T14:10:30.823 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-12-14T14:10:30.824 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-12-14T14:10:30.824 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:10:30.824 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:10:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.956+0000 7f722ce5b700 1 -- 172.21.15.69:0/2113911178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 msgr2=0x7f7228101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.956+0000 7f722ce5b700 1 --2- 172.21.15.69:0/2113911178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 0x7f7228101d00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7218009990 tx=0x7f7218009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.956+0000 7f722ce5b700 1 -- 172.21.15.69:0/2113911178 shutdown_connections 2023-12-14T14:10:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.956+0000 7f722ce5b700 1 --2- 172.21.15.69:0/2113911178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72280fe980 0x7f72280fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.956+0000 7f722ce5b700 1 --2- 172.21.15.69:0/2113911178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 0x7f7228101d00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.956+0000 7f722ce5b700 1 --2- 172.21.15.69:0/2113911178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7228102240 0x7f72280fe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.956+0000 7f722ce5b700 1 -- 172.21.15.69:0/2113911178 >> 172.21.15.69:0/2113911178 conn(0x7f72280f9f10 msgr2=0x7f72280fc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.956+0000 7f722ce5b700 1 -- 172.21.15.69:0/2113911178 shutdown_connections 2023-12-14T14:10:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.956+0000 7f722ce5b700 1 -- 172.21.15.69:0/2113911178 wait complete. 2023-12-14T14:10:30.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.957+0000 7f722ce5b700 1 Processor -- start 2023-12-14T14:10:30.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.957+0000 7f722ce5b700 1 -- start start 2023-12-14T14:10:30.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f722ce5b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72280fe980 0x7f7228195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f722ce5b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 0x7f7228196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f722ce5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228102240 0x7f722819d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f722ce5b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722819db60 con 0x7f72281018f0 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f722ce5b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722819dca0 con 0x7f7228102240 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f722ce5b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722819de30 con 0x7f72280fe980 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7225d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 0x7f7228196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7225d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 0x7f7228196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54580/0 (socket says 172.21.15.69:54580) 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7225d9b700 1 -- 172.21.15.69:0/3124878587 learned_addr learned my addr 172.21.15.69:0/3124878587 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7226d9d700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228102240 0x7f722819d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f722659c700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72280fe980 0x7f7228195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7225d9b700 1 -- 172.21.15.69:0/3124878587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72280fe980 msgr2=0x7f7228195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7225d9b700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72280fe980 0x7f7228195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7225d9b700 1 -- 172.21.15.69:0/3124878587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228102240 msgr2=0x7f722819d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7225d9b700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228102240 0x7f722819d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7225d9b700 1 -- 172.21.15.69:0/3124878587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180095f0 con 0x7f72281018f0 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7226d9d700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228102240 0x7f722819d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f7225d9b700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 0x7f7228196520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f721c00e9a0 tx=0x7f721c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f72177fe700 1 -- 172.21.15.69:0/3124878587 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c009790 con 0x7f72281018f0 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f72177fe700 1 -- 172.21.15.69:0/3124878587 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f721c010430 con 0x7f72281018f0 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f72177fe700 1 -- 172.21.15.69:0/3124878587 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c018680 con 0x7f72281018f0 2023-12-14T14:10:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722810bc20 con 0x7f72281018f0 2023-12-14T14:10:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7fa949d7b700 1 -- 172.21.15.69:0/2050467003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944100ce0 msgr2=0x7fa9441030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.958+0000 7fa949d7b700 1 --2- 172.21.15.69:0/2050467003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944100ce0 0x7fa9441030c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa934009990 tx=0x7fa934009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.959+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722810ba90 con 0x7f72281018f0 2023-12-14T14:10:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.959+0000 7fa949d7b700 1 -- 172.21.15.69:0/2050467003 shutdown_connections 2023-12-14T14:10:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.959+0000 7fa949d7b700 1 --2- 172.21.15.69:0/2050467003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa944105f20 0x7fa944108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.959+0000 7fa949d7b700 1 --2- 172.21.15.69:0/2050467003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944100ce0 0x7fa9441030c0 secure :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa934009990 tx=0x7fa934009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.959+0000 7fa949d7b700 1 --2- 172.21.15.69:0/2050467003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa944103600 0x7fa9441059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.959+0000 7fa949d7b700 1 -- 172.21.15.69:0/2050467003 >> 172.21.15.69:0/2050467003 conn(0x7fa9440fa780 msgr2=0x7fa9440fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.959+0000 7fa949d7b700 1 -- 172.21.15.69:0/2050467003 shutdown_connections 2023-12-14T14:10:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.959+0000 7fa949d7b700 1 -- 172.21.15.69:0/2050467003 wait complete. 2023-12-14T14:10:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.959+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7228107060 con 0x7f72281018f0 2023-12-14T14:10:30.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa949d7b700 1 Processor -- start 2023-12-14T14:10:30.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa949d7b700 1 -- start start 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa949d7b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944103600 0x7fa9441961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa949d7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa944105f20 0x7fa9441966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa949d7b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94419b740 0x7fa94419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa949d7b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94419e0f0 con 0x7fa944103600 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa949d7b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94419e230 con 0x7fa944105f20 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa949d7b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94419e3c0 con 0x7fa94419b740 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944103600 0x7fa9441961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944103600 0x7fa9441961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54588/0 (socket says 172.21.15.69:54588) 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.960+0000 7fa9437fe700 1 -- 172.21.15.69:0/397892647 learned_addr learned my addr 172.21.15.69:0/397892647 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7fa943fff700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94419b740 0x7fa94419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7fa9437fe700 1 -- 172.21.15.69:0/397892647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94419b740 msgr2=0x7fa94419db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7fa942ffd700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa944105f20 0x7fa9441966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7fa9437fe700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94419b740 0x7fa94419db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7fa9437fe700 1 -- 172.21.15.69:0/397892647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa944105f20 msgr2=0x7fa9441966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7fa9437fe700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa944105f20 0x7fa9441966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7fa9437fe700 1 -- 172.21.15.69:0/397892647 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340095f0 con 0x7fa944103600 2023-12-14T14:10:30.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7fa9437fe700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944103600 0x7fa9441961a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa934006010 tx=0x7fa93400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7f72177fe700 1 -- 172.21.15.69:0/3124878587 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f721c0105a0 con 0x7f72281018f0 2023-12-14T14:10:30.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.961+0000 7f72177fe700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f72100a12e0 0x7f72100a3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.962+0000 7f722659c700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f72100a12e0 0x7f72100a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.962+0000 7f72177fe700 1 -- 172.21.15.69:0/3124878587 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f721c014070 con 0x7f72281018f0 2023-12-14T14:10:30.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.962+0000 7f722659c700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f72100a12e0 0x7f72100a3790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f721800b2e0 tx=0x7f7218005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.965+0000 7fa940ff9700 1 -- 172.21.15.69:0/397892647 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93401d070 con 0x7fa944103600 2023-12-14T14:10:30.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.965+0000 7fa940ff9700 1 -- 172.21.15.69:0/397892647 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa93400fbf0 con 0x7fa944103600 2023-12-14T14:10:30.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.965+0000 7fa949d7b700 1 -- 172.21.15.69:0/397892647 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94410bbc0 con 0x7fa944103600 2023-12-14T14:10:30.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.965+0000 7fa940ff9700 1 -- 172.21.15.69:0/397892647 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340173f0 con 0x7fa944103600 2023-12-14T14:10:30.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.965+0000 7f72177fe700 1 -- 172.21.15.69:0/3124878587 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f721c096400 con 0x7f72281018f0 2023-12-14T14:10:30.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.965+0000 7fa949d7b700 1 -- 172.21.15.69:0/397892647 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94410ba30 con 0x7fa944103600 2023-12-14T14:10:30.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.968+0000 7fa940ff9700 1 -- 172.21.15.69:0/397892647 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa934021410 con 0x7fa944103600 2023-12-14T14:10:30.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.968+0000 7fa940ff9700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa92c0a1260 0x7fa92c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.968+0000 7fa940ff9700 1 -- 172.21.15.69:0/397892647 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa9340cdb80 con 0x7fa944103600 2023-12-14T14:10:30.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa942ffd700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa92c0a1260 0x7fa92c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa955f09b80 1 Processor -- start 2023-12-14T14:10:30.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa955f09b80 1 -- start start 2023-12-14T14:10:30.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa942ffd700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa92c0a1260 0x7fa92c0a3710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa938005950 tx=0x7fa9380058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59bb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 0x55c5c59bc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c59bd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa955f09b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c58a4660 con 0x55c5c59bcd80 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa955f09b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c59138f0 con 0x55c5c59bb580 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa955f09b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c590cd80 con 0x55c5c59bbed0 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa943fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c59bd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa943fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c59bd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54594/0 (socket says 172.21.15.69:54594) 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa943fff700 1 -- 172.21.15.69:0/2800934589 learned_addr learned my addr 172.21.15.69:0/2800934589 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.969+0000 7fa9437fe700 1 --2- 172.21.15.69:0/2800934589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa942ffd700 1 --2- 172.21.15.69:0/2800934589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 0x55c5c59bc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa943fff700 1 -- 172.21.15.69:0/2800934589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 msgr2=0x55c5c59bc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa943fff700 1 --2- 172.21.15.69:0/2800934589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 0x55c5c59bc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa943fff700 1 -- 172.21.15.69:0/2800934589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 msgr2=0x55c5c59bb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa943fff700 1 --2- 172.21.15.69:0/2800934589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59bb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa943fff700 1 -- 172.21.15.69:0/2800934589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5c578e430 con 0x55c5c59bcd80 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa943fff700 1 --2- 172.21.15.69:0/2800934589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c59bd1f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009c70 tx=0x7fa93c009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c855cc06d037ab5c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa929ffb700 1 -- 172.21.15.69:0/2800934589 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c004bb0 con 0x55c5c59bcd80 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa929ffb700 1 -- 172.21.15.69:0/2800934589 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa93c004d10 con 0x55c5c59bcd80 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.970+0000 7fa929ffb700 1 -- 172.21.15.69:0/2800934589 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c014660 con 0x55c5c59bcd80 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 -- 172.21.15.69:0/2800934589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 msgr2=0x55c5c59bd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2800934589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c59bd1f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009c70 tx=0x7fa93c009f80 comp rx=0 tx=0).stop 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 -- 172.21.15.69:0/2800934589 shutdown_connections 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2800934589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c59bd1f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2800934589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59bb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2800934589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 0x55c5c59bc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 -- 172.21.15.69:0/2800934589 >> 172.21.15.69:0/2800934589 conn(0x55c5c59b0d20 msgr2=0x55c5c59b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 -- 172.21.15.69:0/2800934589 shutdown_connections 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 -- 172.21.15.69:0/2800934589 wait complete. 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 -- start start 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.971+0000 7fa955f09b80 1 Processor -- start 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bb580 0x55c5c59c5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bbed0 0x55c5c59c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 0x55c5c59cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa955f09b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c58a9010 con 0x55c5c59bb580 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa955f09b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c58a8cb0 con 0x55c5c59bbed0 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa955f09b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c5790720 con 0x55c5c59bcd80 2023-12-14T14:10:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa955f09b80 10 client.0 _ll_register_callbacks cb 0x55c5c58cc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa942ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bbed0 0x55c5c59c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa942ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bbed0 0x55c5c59c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:47698/0 (socket says 172.21.15.69:47698) 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa942ffd700 1 -- 172.21.15.69:0/1374927662 learned_addr learned my addr 172.21.15.69:0/1374927662 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa943fff700 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 0x55c5c59cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa9437fe700 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bb580 0x55c5c59c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa942ffd700 1 -- 172.21.15.69:0/1374927662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 msgr2=0x55c5c59cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa942ffd700 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 0x55c5c59cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa942ffd700 1 -- 172.21.15.69:0/1374927662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bb580 msgr2=0x55c5c59c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa942ffd700 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bb580 0x55c5c59c5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa942ffd700 1 -- 172.21.15.69:0/1374927662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c0098a0 con 0x55c5c59bbed0 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa943fff700 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 0x55c5c59cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa9437fe700 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bb580 0x55c5c59c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa942ffd700 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bbed0 0x55c5c59c56b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa938011720 tx=0x7fa938004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29e67fd5100ba0d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.972+0000 7fa922ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa922ffd700 1 -- 172.21.15.69:0/1374927662 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93801f830 con 0x55c5c59bbed0 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa955f09b80 1 -- 172.21.15.69:0/1374927662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5c59ae330 con 0x55c5c59bbed0 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa922ffd700 1 -- 172.21.15.69:0/1374927662 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa93801f990 con 0x55c5c59bbed0 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa922ffd700 1 -- 172.21.15.69:0/1374927662 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa93801fb50 con 0x55c5c59bbed0 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa955f09b80 10 client.24965 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa955f09b80 1 -- 172.21.15.69:0/1374927662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55c5c58d31f0 con 0x55c5c59bbed0 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa922ffd700 1 -- 172.21.15.69:0/1374927662 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c5c59ae330 con 0x55c5c59bbed0 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa922ffd700 1 -- 172.21.15.69:0/1374927662 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa9380273b0 con 0x55c5c59bbed0 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa955f09b80 10 client.24965 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa955f09b80 10 client.24965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:10:30.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa955f09b80 20 client.24965 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa955f09b80 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c5c59d0f70 0x55c5c59d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa955f09b80 4 client.24965 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.973+0000 7fa955f09b80 1 -- 172.21.15.69:0/1374927662 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5c5905d60 con 0x55c5c59d0f70 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.974+0000 7fa9437fe700 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c5c59d0f70 0x55c5c59d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.974+0000 7fa922ffd700 10 client.24965 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.974+0000 7fa9437fe700 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c5c59d0f70 0x55c5c59d3380 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa4ebc91854a1bb server_cookie=baaf35a21f1a7528 in_seq=0 out_seq=0 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa922ffd700 1 -- 172.21.15.69:0/1374927662 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c5c5905d60 con 0x55c5c59d0f70 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa922ffd700 10 client.24965 handle_command_reply: tid=0 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 client.24965 shutdown 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 -- 172.21.15.69:0/1374927662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bbed0 msgr2=0x55c5c59c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bbed0 0x55c5c59c56b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa938011720 tx=0x7fa938004750 comp rx=0 tx=0).stop 2023-12-14T14:10:30.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 -- 172.21.15.69:0/1374927662 shutdown_connections 2023-12-14T14:10:30.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c5c59d0f70 0x55c5c59d3380 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 0x55c5c59cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bb580 0x55c5c59c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 --2- 172.21.15.69:0/1374927662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bbed0 0x55c5c59c56b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa922ffd700 0 client.24965 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:30.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 -- 172.21.15.69:0/1374927662 >> 172.21.15.69:0/1374927662 conn(0x55c5c59b0d20 msgr2=0x55c5c59b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 -- 172.21.15.69:0/1374927662 shutdown_connections 2023-12-14T14:10:30.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 1 -- 172.21.15.69:0/1374927662 wait complete. 2023-12-14T14:10:30.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.975+0000 7fa955f09b80 20 client.24965 trim_cache size 0 max 16384 2023-12-14T14:10:30.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa955f09b80 1 Processor -- start 2023-12-14T14:10:30.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa955f09b80 1 -- start start 2023-12-14T14:10:30.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bbed0 0x55c5c59cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 0x55c5c59c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:30.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa955f09b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c59b08a0 con 0x55c5c59bbed0 2023-12-14T14:10:30.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa955f09b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c59c2eb0 con 0x55c5c59bb580 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa955f09b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c59cd630 con 0x55c5c59bcd80 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa942ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bbed0 0x55c5c59cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa942ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bbed0 0x55c5c59cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54614/0 (socket says 172.21.15.69:54614) 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa942ffd700 1 -- 172.21.15.69:0/2275856541 learned_addr learned my addr 172.21.15.69:0/2275856541 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.992+0000 7fa9437fe700 1 --2- 172.21.15.69:0/2275856541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa942ffd700 1 -- 172.21.15.69:0/2275856541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 msgr2=0x55c5c59c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa942ffd700 1 --2- 172.21.15.69:0/2275856541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 0x55c5c59c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa942ffd700 1 -- 172.21.15.69:0/2275856541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 msgr2=0x55c5c59b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa942ffd700 1 --2- 172.21.15.69:0/2275856541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa942ffd700 1 -- 172.21.15.69:0/2275856541 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5c59b2560 con 0x55c5c59bbed0 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa9437fe700 1 --2- 172.21.15.69:0/2275856541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa942ffd700 1 --2- 172.21.15.69:0/2275856541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bbed0 0x55c5c59cc6b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa938027740 tx=0x7fa938027940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f520c58ba0934a66 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa92a7fc700 1 -- 172.21.15.69:0/2275856541 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380097d0 con 0x55c5c59bbed0 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa92a7fc700 1 -- 172.21.15.69:0/2275856541 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9380279b0 con 0x55c5c59bbed0 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.993+0000 7fa92a7fc700 1 -- 172.21.15.69:0/2275856541 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380052a0 con 0x55c5c59bbed0 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 -- 172.21.15.69:0/2275856541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bbed0 msgr2=0x55c5c59cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2275856541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bbed0 0x55c5c59cc6b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa938027740 tx=0x7fa938027940 comp rx=0 tx=0).stop 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 -- 172.21.15.69:0/2275856541 shutdown_connections 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2275856541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bcd80 0x55c5c59c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2275856541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2275856541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bbed0 0x55c5c59cc6b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 -- 172.21.15.69:0/2275856541 >> 172.21.15.69:0/2275856541 conn(0x55c5c59b0d20 msgr2=0x55c5c59ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 -- 172.21.15.69:0/2275856541 shutdown_connections 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 -- 172.21.15.69:0/2275856541 wait complete. 2023-12-14T14:10:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 -- start start 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 Processor -- start 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 0x55c5c59c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c5a24e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c59cc7c0 con 0x55c5c59bcd80 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c59cc930 con 0x55c5c59bb580 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5c5a25360 con 0x55c5c59bbed0 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.994+0000 7fa955f09b80 10 client.0 _ll_register_callbacks cb 0x7fa93800edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa943fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c5a24e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa943fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c5a24e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54622/0 (socket says 172.21.15.69:54622) 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa943fff700 1 -- 172.21.15.69:0/2651166551 learned_addr learned my addr 172.21.15.69:0/2651166551 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa942ffd700 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 0x55c5c59c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa9437fe700 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa943fff700 1 -- 172.21.15.69:0/2651166551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 msgr2=0x55c5c59c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa943fff700 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 0x55c5c59c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa943fff700 1 -- 172.21.15.69:0/2651166551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 msgr2=0x55c5c59c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa943fff700 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa943fff700 1 -- 172.21.15.69:0/2651166551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5c58d31f0 con 0x55c5c59bcd80 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa9437fe700 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa943fff700 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c5a24e20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009b90 tx=0x7fa93c014c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ebb30d30c2ba27 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa922ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa922ffd700 1 -- 172.21.15.69:0/2651166551 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c009040 con 0x55c5c59bcd80 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa922ffd700 1 -- 172.21.15.69:0/2651166551 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa93c01e430 con 0x55c5c59bcd80 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa955f09b80 1 -- 172.21.15.69:0/2651166551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa93c004d10 con 0x55c5c59bcd80 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa922ffd700 1 -- 172.21.15.69:0/2651166551 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa93c01e630 con 0x55c5c59bcd80 2023-12-14T14:10:31.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa955f09b80 10 client.15381 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa955f09b80 1 -- 172.21.15.69:0/2651166551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55c5c58d2f40 con 0x55c5c59bcd80 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.995+0000 7fa922ffd700 1 -- 172.21.15.69:0/2651166551 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa93c004d10 con 0x55c5c59bcd80 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa922ffd700 1 -- 172.21.15.69:0/2651166551 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa93c007500 con 0x55c5c59bcd80 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa955f09b80 10 client.15381 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa955f09b80 10 client.15381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa955f09b80 20 client.15381 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c5c5a26c00 0x55c5c5a29010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa955f09b80 4 client.15381 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa955f09b80 1 -- 172.21.15.69:0/2651166551 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c5c5905a80 con 0x55c5c5a26c00 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa9437fe700 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c5c5a26c00 0x55c5c5a29010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa922ffd700 10 client.15381 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.996+0000 7fa9437fe700 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c5c5a26c00 0x55c5c5a29010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5bf82cf294f182a server_cookie=da522f672a08e67 in_seq=0 out_seq=0 2023-12-14T14:10:31.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa922ffd700 1 -- 172.21.15.69:0/2651166551 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c5c5905a80 con 0x55c5c5a26c00 2023-12-14T14:10:31.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa922ffd700 10 client.15381 handle_command_reply: tid=0 2023-12-14T14:10:31.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 client.15381 shutdown 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 -- 172.21.15.69:0/2651166551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 msgr2=0x55c5c5a24e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c5a24e20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009b90 tx=0x7fa93c014c00 comp rx=0 tx=0).stop 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 -- 172.21.15.69:0/2651166551 shutdown_connections 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c5c5a26c00 0x55c5c5a29010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c5c59bcd80 0x55c5c5a24e20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5c59bb580 0x55c5c59c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa922ffd700 0 client.15381 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 --2- 172.21.15.69:0/2651166551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c5c59bbed0 0x55c5c59c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 -- 172.21.15.69:0/2651166551 >> 172.21.15.69:0/2651166551 conn(0x55c5c59b0d20 msgr2=0x55c5c59bfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 -- 172.21.15.69:0/2651166551 shutdown_connections 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 1 -- 172.21.15.69:0/2651166551 wait complete. 2023-12-14T14:10:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa955f09b80 20 client.15381 trim_cache size 0 max 16384 2023-12-14T14:10:31.005 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:10:31.005 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:10:31.005 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "6f15d226-5970-4d23-b871-b9b5e97bbf48", 2023-12-14T14:10:31.005 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:10:31.005 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa949d7b700 1 -- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa92c0a1260 msgr2=0x7fa92c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa949d7b700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa92c0a1260 0x7fa92c0a3710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa938005950 tx=0x7fa9380058e0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa949d7b700 1 -- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944103600 msgr2=0x7fa9441961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.998+0000 7fa949d7b700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944103600 0x7fa9441961a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa934006010 tx=0x7fa93400f740 comp rx=0 tx=0).stop 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.999+0000 7fa949d7b700 1 -- 172.21.15.69:0/397892647 shutdown_connections 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.999+0000 7fa949d7b700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7fa92c0a1260 0x7fa92c0a3710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.999+0000 7fa949d7b700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94419b740 0x7fa94419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.999+0000 7fa949d7b700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa944103600 0x7fa9441961a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.999+0000 7fa949d7b700 1 --2- 172.21.15.69:0/397892647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa944105f20 0x7fa9441966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.999+0000 7fa949d7b700 1 -- 172.21.15.69:0/397892647 >> 172.21.15.69:0/397892647 conn(0x7fa9440fa780 msgr2=0x7fa944101940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.999+0000 7fa949d7b700 1 -- 172.21.15.69:0/397892647 shutdown_connections 2023-12-14T14:10:31.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:30.999+0000 7fa949d7b700 1 -- 172.21.15.69:0/397892647 wait complete. 2023-12-14T14:10:31.011 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:10:31.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:30 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3701674567' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:31.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:30 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3114531619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:31.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:30 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4220064988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.139+0000 7f32600e4700 1 -- 172.21.15.69:0/4121072240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3258105ee0 msgr2=0x7f3258108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.139+0000 7f32600e4700 1 --2- 172.21.15.69:0/4121072240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3258105ee0 0x7f3258108340 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f325000b0a0 tx=0x7f325000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.139+0000 7f32600e4700 1 -- 172.21.15.69:0/4121072240 shutdown_connections 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.139+0000 7f32600e4700 1 --2- 172.21.15.69:0/4121072240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3258105ee0 0x7f3258108340 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.139+0000 7f32600e4700 1 --2- 172.21.15.69:0/4121072240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3258100ca0 0x7f3258103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.139+0000 7f32600e4700 1 --2- 172.21.15.69:0/4121072240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32581035c0 0x7f32581059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.139+0000 7f32600e4700 1 -- 172.21.15.69:0/4121072240 >> 172.21.15.69:0/4121072240 conn(0x7f32580fa740 msgr2=0x7f32580fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.139+0000 7f32600e4700 1 -- 172.21.15.69:0/4121072240 shutdown_connections 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f32600e4700 1 -- 172.21.15.69:0/4121072240 wait complete. 2023-12-14T14:10:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f32600e4700 1 Processor -- start 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f32600e4700 1 -- start start 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f32600e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3258100ca0 0x7f3258198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f32600e4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32581035c0 0x7f32581987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f32600e4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3258105ee0 0x7f325819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f32600e4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325819fe00 con 0x7f32581035c0 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f32600e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325819ff40 con 0x7f3258100ca0 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f32600e4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32581a00d0 con 0x7f3258105ee0 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f325d67f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32581035c0 0x7f32581987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f325d67f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32581035c0 0x7f32581987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54640/0 (socket says 172.21.15.69:54640) 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f325d67f700 1 -- 172.21.15.69:0/3149163660 learned_addr learned my addr 172.21.15.69:0/3149163660 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f325de80700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3258100ca0 0x7f3258198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.140+0000 7f325e681700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3258105ee0 0x7f325819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f325d67f700 1 -- 172.21.15.69:0/3149163660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3258105ee0 msgr2=0x7f325819f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f325d67f700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3258105ee0 0x7f325819f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f325d67f700 1 -- 172.21.15.69:0/3149163660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3258100ca0 msgr2=0x7f3258198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f325d67f700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3258100ca0 0x7f3258198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f325d67f700 1 -- 172.21.15.69:0/3149163660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3250009d00 con 0x7f32581035c0 2023-12-14T14:10:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f325d67f700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32581035c0 0x7f32581987c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f324800d950 tx=0x7f324800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f324effd700 1 -- 172.21.15.69:0/3149163660 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800f890 con 0x7f32581035c0 2023-12-14T14:10:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f32600e4700 1 -- 172.21.15.69:0/3149163660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325810bbe0 con 0x7f32581035c0 2023-12-14T14:10:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f324effd700 1 -- 172.21.15.69:0/3149163660 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3248010460 con 0x7f32581035c0 2023-12-14T14:10:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f324effd700 1 -- 172.21.15.69:0/3149163660 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800e610 con 0x7f32581035c0 2023-12-14T14:10:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.141+0000 7f32600e4700 1 -- 172.21.15.69:0/3149163660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325810ba50 con 0x7f32581035c0 2023-12-14T14:10:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.144+0000 7f324effd700 1 -- 172.21.15.69:0/3149163660 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f32480108d0 con 0x7f32581035c0 2023-12-14T14:10:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.145+0000 7f324effd700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f32440a11e0 0x7f32440a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.145+0000 7f325de80700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f32440a11e0 0x7f32440a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.145+0000 7f324effd700 1 -- 172.21.15.69:0/3149163660 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f32480cc780 con 0x7f32581035c0 2023-12-14T14:10:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.145+0000 7f325de80700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f32440a11e0 0x7f32440a3690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3254009c60 tx=0x7f3254009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:31.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.146+0000 7f326c272b80 1 Processor -- start 2023-12-14T14:10:31.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.146+0000 7f326c272b80 1 -- start start 2023-12-14T14:10:31.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.146+0000 7f326c272b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x56522108a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.146+0000 7f326c272b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108ae50 0x56522108b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.146+0000 7f326c272b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108bd00 0x56522108c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.146+0000 7f326c272b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565220f735e0 con 0x56522108a500 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.146+0000 7f326c272b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565220fe2870 con 0x56522108ae50 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.146+0000 7f326c272b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x565220fdbd00 con 0x56522108bd00 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325de80700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x56522108a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325de80700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x56522108a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54648/0 (socket says 172.21.15.69:54648) 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325de80700 1 -- 172.21.15.69:0/2995725192 learned_addr learned my addr 172.21.15.69:0/2995725192 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325e681700 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108bd00 0x56522108c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325d67f700 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108ae50 0x56522108b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325de80700 1 -- 172.21.15.69:0/2995725192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108bd00 msgr2=0x56522108c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325de80700 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108bd00 0x56522108c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325de80700 1 -- 172.21.15.69:0/2995725192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108ae50 msgr2=0x56522108b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325de80700 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108ae50 0x56522108b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325de80700 1 -- 172.21.15.69:0/2995725192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565220e5d3b0 con 0x56522108a500 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325d67f700 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108ae50 0x56522108b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f325de80700 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x56522108a910 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f325400e4e0 tx=0x7f3254014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d497e7ea2f9973d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f3243fff700 1 -- 172.21.15.69:0/2995725192 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400ee00 con 0x56522108a500 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f3243fff700 1 -- 172.21.15.69:0/2995725192 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3254021070 con 0x56522108a500 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.147+0000 7f3243fff700 1 -- 172.21.15.69:0/2995725192 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325401d7f0 con 0x56522108a500 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 -- 172.21.15.69:0/2995725192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 msgr2=0x56522108a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x56522108a910 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f325400e4e0 tx=0x7f3254014000 comp rx=0 tx=0).stop 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 -- 172.21.15.69:0/2995725192 shutdown_connections 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108bd00 0x56522108c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x56522108a910 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 --2- 172.21.15.69:0/2995725192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108ae50 0x56522108b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 -- 172.21.15.69:0/2995725192 >> 172.21.15.69:0/2995725192 conn(0x56522107fca0 msgr2=0x565221085430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 -- 172.21.15.69:0/2995725192 shutdown_connections 2023-12-14T14:10:31.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 -- 172.21.15.69:0/2995725192 wait complete. 2023-12-14T14:10:31.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.148+0000 7f326c272b80 1 -- start start 2023-12-14T14:10:31.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f326c272b80 1 Processor -- start 2023-12-14T14:10:31.151 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:30 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3701674567' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:10:31.151 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:30 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3114531619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:10:31.151 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:30 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4220064988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f326c272b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108a500 0x565221094120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f326c272b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108ae50 0x565221094660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f326c272b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108bd00 0x56522109b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f326c272b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565220f77f90 con 0x56522108bd00 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f326c272b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565220f77c30 con 0x56522108a500 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f326c272b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x565220e5f6a0 con 0x56522108ae50 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f326c272b80 10 client.0 _ll_register_callbacks cb 0x565220f9b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f325e681700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108bd00 0x56522109b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f325e681700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108bd00 0x56522109b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54654/0 (socket says 172.21.15.69:54654) 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f325e681700 1 -- 172.21.15.69:0/2125103680 learned_addr learned my addr 172.21.15.69:0/2125103680 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f325de80700 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108a500 0x565221094120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f325d67f700 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108ae50 0x565221094660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f325e681700 1 -- 172.21.15.69:0/2125103680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108ae50 msgr2=0x565221094660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f325e681700 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108ae50 0x565221094660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f325e681700 1 -- 172.21.15.69:0/2125103680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108a500 msgr2=0x565221094120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.149+0000 7f325e681700 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108a500 0x565221094120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f325e681700 1 -- 172.21.15.69:0/2125103680 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3254017070 con 0x56522108bd00 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f325e681700 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108bd00 0x56522109b6a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f325000b0a0 tx=0x7f325000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67693bb53dfa93a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f32417fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f32417fa700 1 -- 172.21.15.69:0/2125103680 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325000e040 con 0x56522108bd00 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f32417fa700 1 -- 172.21.15.69:0/2125103680 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3250003c00 con 0x56522108bd00 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f326c272b80 1 -- 172.21.15.69:0/2125103680 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56522107d2b0 con 0x56522108bd00 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f32417fa700 1 -- 172.21.15.69:0/2125103680 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3250003dc0 con 0x56522108bd00 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f326c272b80 10 client.15393 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f326c272b80 1 -- 172.21.15.69:0/2125103680 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x565220fa2170 con 0x56522108bd00 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f32417fa700 1 -- 172.21.15.69:0/2125103680 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56522107d2b0 con 0x56522108bd00 2023-12-14T14:10:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f32417fa700 1 -- 172.21.15.69:0/2125103680 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3250023020 con 0x56522108bd00 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f326c272b80 10 client.15393 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f326c272b80 10 client.15393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f326c272b80 20 client.15393 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f326c272b80 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56522109ff00 0x5652210a2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f326c272b80 4 client.15393 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.150+0000 7f326c272b80 1 -- 172.21.15.69:0/2125103680 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565220fd4ce0 con 0x56522109ff00 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.151+0000 7f325de80700 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56522109ff00 0x5652210a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.151+0000 7f325de80700 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56522109ff00 0x5652210a2310 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=258c356199dbceb server_cookie=ed59061629dcc9f4 in_seq=0 out_seq=0 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.151+0000 7f32417fa700 10 client.15393 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f32417fa700 1 -- 172.21.15.69:0/2125103680 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x565220fd4ce0 con 0x56522109ff00 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f32417fa700 10 client.15393 handle_command_reply: tid=0 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 client.15393 shutdown 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 -- 172.21.15.69:0/2125103680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108bd00 msgr2=0x56522109b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108bd00 0x56522109b6a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f325000b0a0 tx=0x7f325000bab0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 -- 172.21.15.69:0/2125103680 shutdown_connections 2023-12-14T14:10:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56522109ff00 0x5652210a2310 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108bd00 0x56522109b6a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108a500 0x565221094120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 --2- 172.21.15.69:0/2125103680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108ae50 0x565221094660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f32417fa700 0 client.15393 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 -- 172.21.15.69:0/2125103680 >> 172.21.15.69:0/2125103680 conn(0x56522107fca0 msgr2=0x565221083f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 -- 172.21.15.69:0/2125103680 shutdown_connections 2023-12-14T14:10:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 1 -- 172.21.15.69:0/2125103680 wait complete. 2023-12-14T14:10:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.152+0000 7f326c272b80 20 client.15393 trim_cache size 0 max 16384 2023-12-14T14:10:31.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f326c272b80 1 Processor -- start 2023-12-14T14:10:31.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f326c272b80 1 -- start start 2023-12-14T14:10:31.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f326c272b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x5652210920b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f326c272b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108ae50 0x56522109b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f326c272b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x56522108ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f326c272b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565221086510 con 0x56522108a500 2023-12-14T14:10:31.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f326c272b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565221091e60 con 0x56522108bd00 2023-12-14T14:10:31.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f326c272b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56522108f770 con 0x56522108ae50 2023-12-14T14:10:31.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325de80700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x5652210920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325de80700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x5652210920b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54656/0 (socket says 172.21.15.69:54656) 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325de80700 1 -- 172.21.15.69:0/2675284191 learned_addr learned my addr 172.21.15.69:0/2675284191 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325e681700 1 --2- 172.21.15.69:0/2675284191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x56522108ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325de80700 1 -- 172.21.15.69:0/2675284191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108ae50 msgr2=0x56522109b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325de80700 1 --2- 172.21.15.69:0/2675284191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108ae50 0x56522109b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325de80700 1 -- 172.21.15.69:0/2675284191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 msgr2=0x56522108ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325de80700 1 --2- 172.21.15.69:0/2675284191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x56522108ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325de80700 1 -- 172.21.15.69:0/2675284191 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565220fa1ec0 con 0x56522108a500 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325e681700 1 --2- 172.21.15.69:0/2675284191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x56522108ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f325de80700 1 --2- 172.21.15.69:0/2675284191 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x5652210920b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f325400e480 tx=0x7f3254005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363acf79452be08c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.169+0000 7f324cff9700 1 -- 172.21.15.69:0/2675284191 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254033ae0 con 0x56522108a500 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f324cff9700 1 -- 172.21.15.69:0/2675284191 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3254033c40 con 0x56522108a500 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f324cff9700 1 -- 172.21.15.69:0/2675284191 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254003680 con 0x56522108a500 2023-12-14T14:10:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 -- 172.21.15.69:0/2675284191 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 msgr2=0x5652210920b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 --2- 172.21.15.69:0/2675284191 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x5652210920b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f325400e480 tx=0x7f3254005ce0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 -- 172.21.15.69:0/2675284191 shutdown_connections 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 --2- 172.21.15.69:0/2675284191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x56522108ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 --2- 172.21.15.69:0/2675284191 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108a500 0x5652210920b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 --2- 172.21.15.69:0/2675284191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108ae50 0x56522109b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 -- 172.21.15.69:0/2675284191 >> 172.21.15.69:0/2675284191 conn(0x56522107fca0 msgr2=0x565221092ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 -- 172.21.15.69:0/2675284191 shutdown_connections 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 -- 172.21.15.69:0/2675284191 wait complete. 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.170+0000 7f326c272b80 1 -- start start 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f326c272b80 1 Processor -- start 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f326c272b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108a500 0x56522109ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f326c272b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108ae50 0x56522109b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f326c272b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x565221097810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f326c272b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565221097d50 con 0x56522108ae50 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f326c272b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565221097e90 con 0x56522108bd00 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f326c272b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x565221098050 con 0x56522108a500 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f326c272b80 10 client.0 _ll_register_callbacks cb 0x7f32500074e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325d67f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108ae50 0x56522109b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325d67f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108ae50 0x56522109b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54670/0 (socket says 172.21.15.69:54670) 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325d67f700 1 -- 172.21.15.69:0/3371982872 learned_addr learned my addr 172.21.15.69:0/3371982872 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325e681700 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x565221097810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325de80700 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108a500 0x56522109ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325d67f700 1 -- 172.21.15.69:0/3371982872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108a500 msgr2=0x56522109ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325d67f700 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108a500 0x56522109ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325d67f700 1 -- 172.21.15.69:0/3371982872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 msgr2=0x565221097810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:10:31.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325d67f700 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x565221097810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325d67f700 1 -- 172.21.15.69:0/3371982872 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325402a040 con 0x56522108ae50 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325de80700 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108a500 0x56522109ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.171+0000 7f325e681700 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x565221097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f325d67f700 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108ae50 0x56522109b2b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3248099830 tx=0x7f3248099c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d4d6e1f17ed8fe server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f32417fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f32417fa700 1 -- 172.21.15.69:0/3371982872 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248014070 con 0x56522108ae50 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f32417fa700 1 -- 172.21.15.69:0/3371982872 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3248099020 con 0x56522108ae50 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f326c272b80 1 -- 172.21.15.69:0/3371982872 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3254021070 con 0x56522108ae50 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f32417fa700 1 -- 172.21.15.69:0/3371982872 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f324809a060 con 0x56522108ae50 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f326c272b80 10 client.15399 fetch_fsmap learned FSMap version 22 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f326c272b80 1 -- 172.21.15.69:0/3371982872 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x565220f889a0 con 0x56522108ae50 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f32417fa700 1 -- 172.21.15.69:0/3371982872 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3254021070 con 0x56522108ae50 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f32417fa700 1 -- 172.21.15.69:0/3371982872 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3248098b20 con 0x56522108ae50 2023-12-14T14:10:31.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f326c272b80 10 client.15399 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f326c272b80 10 client.15399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f326c272b80 20 client.15399 populate_metadata read hostname 'smithi069' 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f326c272b80 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5652210f5210 0x5652210f7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f326c272b80 4 client.15399 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f326c272b80 1 -- 172.21.15.69:0/3371982872 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x565220fd4a00 con 0x5652210f5210 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.172+0000 7f325de80700 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5652210f5210 0x5652210f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f32417fa700 10 client.15399 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f325de80700 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5652210f5210 0x5652210f7620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f184bc293cab6a5f server_cookie=619081ab2621a8c0 in_seq=0 out_seq=0 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f32417fa700 1 -- 172.21.15.69:0/3371982872 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x565220fd4a00 con 0x5652210f5210 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f32417fa700 10 client.15399 handle_command_reply: tid=0 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 client.15399 shutdown 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 -- 172.21.15.69:0/3371982872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108ae50 msgr2=0x56522109b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108ae50 0x56522109b2b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3248099830 tx=0x7f3248099c70 comp rx=0 tx=0).stop 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 -- 172.21.15.69:0/3371982872 shutdown_connections 2023-12-14T14:10:31.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5652210f5210 0x5652210f7620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56522108bd00 0x565221097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f32417fa700 0 client.15399 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56522108a500 0x56522109ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 --2- 172.21.15.69:0/3371982872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56522108ae50 0x56522109b2b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 -- 172.21.15.69:0/3371982872 >> 172.21.15.69:0/3371982872 conn(0x56522107fca0 msgr2=0x5652210920b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 -- 172.21.15.69:0/3371982872 shutdown_connections 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 1 -- 172.21.15.69:0/3371982872 wait complete. 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.173+0000 7f326c272b80 20 client.15399 trim_cache size 0 max 16384 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stdout: "6f15d226-5970-4d23-b871-b9b5e97bbf48": { 2023-12-14T14:10:31.180 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:10:31.181 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6f15d226-5970-4d23-b871-b9b5e97bbf48", 2023-12-14T14:10:31.181 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:10:31.181 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:10:31.181 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:10:31.181 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:10:31.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 -- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f32440a11e0 msgr2=0x7f32440a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f32440a11e0 0x7f32440a3690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3254009c60 tx=0x7f3254009260 comp rx=0 tx=0).stop 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 -- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32581035c0 msgr2=0x7f32581987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32581035c0 0x7f32581987c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f324800d950 tx=0x7f324800dc60 comp rx=0 tx=0).stop 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 -- 172.21.15.69:0/3149163660 shutdown_connections 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f32440a11e0 0x7f32440a3690 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3258105ee0 0x7f325819f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3258100ca0 0x7f3258198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 --2- 172.21.15.69:0/3149163660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32581035c0 0x7f32581987c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 -- 172.21.15.69:0/3149163660 >> 172.21.15.69:0/3149163660 conn(0x7f32580fa740 msgr2=0x7f32580ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 -- 172.21.15.69:0/3149163660 shutdown_connections 2023-12-14T14:10:31.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.174+0000 7f32600e4700 1 -- 172.21.15.69:0/3149163660 wait complete. 2023-12-14T14:10:31.186 INFO:tasks.cephfs.filesystem:scrub status for tag:6f15d226-5970-4d23-b871-b9b5e97bbf48 - {'path': '/', 'tag': '6f15d226-5970-4d23-b871-b9b5e97bbf48', 'options': 'recursive,force'} 2023-12-14T14:10:31.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.235+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f7228061700 con 0x7f72281018f0 2023-12-14T14:10:31.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.704+0000 7f72177fe700 1 -- 172.21.15.69:0/3124878587 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 18) v1 ==== 135783+0+0 (secure 0 0 0) 0x7f721c010880 con 0x7f72281018f0 2023-12-14T14:10:31.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.706+0000 7f72177fe700 1 -- 172.21.15.69:0/3124878587 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) v1 ==== 92+0+0 (secure 0 0 0) 0x7f721c08b200 con 0x7f72281018f0 2023-12-14T14:10:31.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f72100a12e0 msgr2=0x7f72100a3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f72100a12e0 0x7f72100a3790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f721800b2e0 tx=0x7f7218005fb0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 msgr2=0x7f7228196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 0x7f7228196520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f721c00e9a0 tx=0x7f721c00ecb0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 shutdown_connections 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f72100a12e0 0x7f72100a3790 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228102240 0x7f722819d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72280fe980 0x7f7228195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 --2- 172.21.15.69:0/3124878587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72281018f0 0x7f7228196520 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 >> 172.21.15.69:0/3124878587 conn(0x7f72280f9f10 msgr2=0x7f72280fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 shutdown_connections 2023-12-14T14:10:31.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.708+0000 7f722ce5b700 1 -- 172.21.15.69:0/3124878587 wait complete. 2023-12-14T14:10:31.721 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-12-14T14:10:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.852+0000 7f5e94e76700 1 -- 172.21.15.69:0/2212624372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e90100d40 msgr2=0x7f5e90103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.852+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2212624372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e90100d40 0x7f5e90103120 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e800098f0 tx=0x7f5e80009c00 comp rx=0 tx=0).stop 2023-12-14T14:10:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.852+0000 7f5e94e76700 1 -- 172.21.15.69:0/2212624372 shutdown_connections 2023-12-14T14:10:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.852+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2212624372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e90105f80 0x7f5e90108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.852+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2212624372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e90100d40 0x7f5e90103120 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.852+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2212624372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e90103660 0x7f5e90105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.852+0000 7f5e94e76700 1 -- 172.21.15.69:0/2212624372 >> 172.21.15.69:0/2212624372 conn(0x7f5e900fa720 msgr2=0x7f5e900fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.852+0000 7f5e94e76700 1 -- 172.21.15.69:0/2212624372 shutdown_connections 2023-12-14T14:10:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.852+0000 7f5e94e76700 1 -- 172.21.15.69:0/2212624372 wait complete. 2023-12-14T14:10:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e94e76700 1 Processor -- start 2023-12-14T14:10:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e94e76700 1 -- start start 2023-12-14T14:10:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e94e76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e90100d40 0x7f5e90195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e94e76700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e90103660 0x7f5e901964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e94e76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e90105f80 0x7f5e9019d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e94e76700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9019db30 con 0x7f5e90100d40 2023-12-14T14:10:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e94e76700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9019dc70 con 0x7f5e90105f80 2023-12-14T14:10:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e94e76700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9019de00 con 0x7f5e90103660 2023-12-14T14:10:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e90100d40 0x7f5e90195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e90100d40 0x7f5e90195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54712/0 (socket says 172.21.15.69:54712) 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8e59c700 1 -- 172.21.15.69:0/2651770992 learned_addr learned my addr 172.21.15.69:0/2651770992 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8ed9d700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e90105f80 0x7f5e9019d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8dd9b700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e90103660 0x7f5e901964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8e59c700 1 -- 172.21.15.69:0/2651770992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e90103660 msgr2=0x7f5e901964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8e59c700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e90103660 0x7f5e901964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8e59c700 1 -- 172.21.15.69:0/2651770992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e90105f80 msgr2=0x7f5e9019d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8e59c700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e90105f80 0x7f5e9019d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8e59c700 1 -- 172.21.15.69:0/2651770992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840095f0 con 0x7f5e90100d40 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8dd9b700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e90103660 0x7f5e901964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.853+0000 7f5e8ed9d700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e90105f80 0x7f5e9019d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.854+0000 7f5e8e59c700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e90100d40 0x7f5e90195fb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e80011040 tx=0x7f5e8000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.854+0000 7f5e7f7fe700 1 -- 172.21.15.69:0/2651770992 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8001c070 con 0x7f5e90100d40 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.854+0000 7f5e7f7fe700 1 -- 172.21.15.69:0/2651770992 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e8000f7d0 con 0x7f5e90100d40 2023-12-14T14:10:31.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.854+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e80009520 con 0x7f5e90100d40 2023-12-14T14:10:31.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.854+0000 7f5e7f7fe700 1 -- 172.21.15.69:0/2651770992 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e800049c0 con 0x7f5e90100d40 2023-12-14T14:10:31.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.854+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9010bba0 con 0x7f5e90100d40 2023-12-14T14:10:31.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.855+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9010bd30 con 0x7f5e90100d40 2023-12-14T14:10:31.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.856+0000 7f5e7f7fe700 1 -- 172.21.15.69:0/2651770992 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135783+0+0 (secure 0 0 0) 0x7f5e80020070 con 0x7f5e90100d40 2023-12-14T14:10:31.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.857+0000 7f5e7f7fe700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e780a1230 0x7f5e780a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:31.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.857+0000 7f5e8dd9b700 1 -- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e780a1230 msgr2=0x7f5e780a36e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/933503151 2023-12-14T14:10:31.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.857+0000 7f5e7f7fe700 1 -- 172.21.15.69:0/2651770992 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f5e800cd8c0 con 0x7f5e90100d40 2023-12-14T14:10:31.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.857+0000 7f5e8dd9b700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e780a1230 0x7f5e780a36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:10:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:31.861+0000 7f5e7f7fe700 1 -- 172.21.15.69:0/2651770992 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5e80096f40 con 0x7f5e90100d40 2023-12-14T14:10:32.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:31 smithi119 ceph-mon[43834]: pgmap v264: 97 pgs: 97 active+clean; 640 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-14T14:10:32.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:31 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/931828586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:32.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:31 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3124878587' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-12-14T14:10:32.025 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: ignoring --setuser ceph since I am not root 2023-12-14T14:10:32.025 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: ignoring --setgroup ceph since I am not root 2023-12-14T14:10:32.025 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:31 smithi119 ceph-mgr[45730]: -- 172.21.15.119:0/4061299528 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5601a8c5b520 con 0x5601a8c31000 2023-12-14T14:10:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.058+0000 7f5e8dd9b700 1 -- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e780a1230 msgr2=0x7f5e780a36e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/933503151 2023-12-14T14:10:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.058+0000 7f5e8dd9b700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e780a1230 0x7f5e780a36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T14:10:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.058+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f5e9019eb80 con 0x7f5e90100d40 2023-12-14T14:10:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.063+0000 7f5e7f7fe700 1 -- 172.21.15.69:0/2651770992 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5e8009a560 con 0x7f5e90100d40 2023-12-14T14:10:32.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e780a1230 msgr2=0x7f5e780a36e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:10:32.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e780a1230 0x7f5e780a36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e90100d40 msgr2=0x7f5e90195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e90100d40 0x7f5e90195fb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e80011040 tx=0x7f5e8000b790 comp rx=0 tx=0).stop 2023-12-14T14:10:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 shutdown_connections 2023-12-14T14:10:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f5e780a1230 0x7f5e780a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e90105f80 0x7f5e9019d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e90100d40 0x7f5e90195fb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 --2- 172.21.15.69:0/2651770992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e90103660 0x7f5e901964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 >> 172.21.15.69:0/2651770992 conn(0x7f5e900fa720 msgr2=0x7f5e90102220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 shutdown_connections 2023-12-14T14:10:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.065+0000 7f5e94e76700 1 -- 172.21.15.69:0/2651770992 wait complete. 2023-12-14T14:10:32.069 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:31 smithi081 ceph-mon[43371]: pgmap v264: 97 pgs: 97 active+clean; 640 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-14T14:10:32.070 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:31 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/931828586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:32.070 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:31 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3124878587' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-12-14T14:10:32.070 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:31 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: ignoring --setuser ceph since I am not root 2023-12-14T14:10:32.070 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:31 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: ignoring --setgroup ceph since I am not root 2023-12-14T14:10:32.070 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:31 smithi081 ceph-mgr[44846]: -- 172.21.15.81:0/2560087030 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56007cc0f520 con 0x56007cbe5000 2023-12-14T14:10:32.075 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:31 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: ignoring --setuser ceph since I am not root 2023-12-14T14:10:32.075 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:31 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: ignoring --setgroup ceph since I am not root 2023-12-14T14:10:32.076 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:31 smithi069 ceph-mgr[42306]: -- 172.21.15.69:0/3117105835 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ecc9287520 con 0x55ecc925cc00 2023-12-14T14:10:32.076 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:31 smithi069 ceph-mon[42034]: pgmap v264: 97 pgs: 97 active+clean; 640 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-14T14:10:32.076 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:31 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/931828586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:10:32.076 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:31 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3124878587' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-12-14T14:10:32.077 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-12-14T14:10:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.204+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1861644898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 msgr2=0x7f4e10103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.204+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1861644898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 0x7f4e10103140 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009990 tx=0x7f4e0c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.204+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1861644898 shutdown_connections 2023-12-14T14:10:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.204+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1861644898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e10105fa0 0x7f4e10108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.204+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1861644898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 0x7f4e10103140 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.204+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1861644898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10103680 0x7f4e10105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.204+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1861644898 >> 172.21.15.69:0/1861644898 conn(0x7f4e100fa720 msgr2=0x7f4e100fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:32.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.204+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1861644898 shutdown_connections 2023-12-14T14:10:32.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.204+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1861644898 wait complete. 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e17e9a700 1 Processor -- start 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e17e9a700 1 -- start start 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e17e9a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 0x7f4e10195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e17e9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10103680 0x7f4e10196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e17e9a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e10105fa0 0x7f4e1019d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e17e9a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1019db60 con 0x7f4e10100d60 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e17e9a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1019dca0 con 0x7f4e10103680 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e17e9a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1019de30 con 0x7f4e10105fa0 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15c36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 0x7f4e10195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:32.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15c36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 0x7f4e10195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54734/0 (socket says 172.21.15.69:54734) 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15c36700 1 -- 172.21.15.69:0/1357102159 learned_addr learned my addr 172.21.15.69:0/1357102159 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15435700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10103680 0x7f4e10196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e16437700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e10105fa0 0x7f4e1019d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15c36700 1 -- 172.21.15.69:0/1357102159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e10105fa0 msgr2=0x7f4e1019d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15c36700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e10105fa0 0x7f4e1019d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15c36700 1 -- 172.21.15.69:0/1357102159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10103680 msgr2=0x7f4e10196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15c36700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10103680 0x7f4e10196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15c36700 1 -- 172.21.15.69:0/1357102159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c0095f0 con 0x7f4e10100d60 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.205+0000 7f4e15c36700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 0x7f4e10195fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00b680 tx=0x7f4e0c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.206+0000 7f4e06ffd700 1 -- 172.21.15.69:0/1357102159 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c01d070 con 0x7f4e10100d60 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.206+0000 7f4e06ffd700 1 -- 172.21.15.69:0/1357102159 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e0c022470 con 0x7f4e10100d60 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.206+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1010bbf0 con 0x7f4e10100d60 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.206+0000 7f4e06ffd700 1 -- 172.21.15.69:0/1357102159 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c017650 con 0x7f4e10100d60 2023-12-14T14:10:32.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.206+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1010ba60 con 0x7f4e10100d60 2023-12-14T14:10:32.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.207+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1019e3d0 con 0x7f4e10100d60 2023-12-14T14:10:32.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.208+0000 7f4e06ffd700 1 -- 172.21.15.69:0/1357102159 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135783+0+0 (secure 0 0 0) 0x7f4e0c0225e0 con 0x7f4e10100d60 2023-12-14T14:10:32.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.208+0000 7f4e06ffd700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4dfc0a1230 0x7f4dfc0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:32.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.208+0000 7f4e15435700 1 -- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4dfc0a1230 msgr2=0x7f4dfc0a36e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/933503151 2023-12-14T14:10:32.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.208+0000 7f4e06ffd700 1 -- 172.21.15.69:0/1357102159 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4e0c0ce630 con 0x7f4e10100d60 2023-12-14T14:10:32.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.208+0000 7f4e15435700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4dfc0a1230 0x7f4dfc0a36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:10:32.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.212+0000 7f4e06ffd700 1 -- 172.21.15.69:0/1357102159 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4e0c097db0 con 0x7f4e10100d60 2023-12-14T14:10:32.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:32.076+0000 7f2339e4e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T14:10:32.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:32.185+0000 7f2339e4e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T14:10:32.335 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:32.278+0000 7f2339e4e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T14:10:32.340 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:32.068+0000 7f8923910200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T14:10:32.340 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:32.169+0000 7f8923910200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T14:10:32.340 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:32.257+0000 7f8923910200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T14:10:32.343 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:32.070+0000 7fbd937e5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T14:10:32.343 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:32.171+0000 7fbd937e5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T14:10:32.343 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:32.260+0000 7fbd937e5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T14:10:32.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.409+0000 7f4e15435700 1 -- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4dfc0a1230 msgr2=0x7f4dfc0a36e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/933503151 2023-12-14T14:10:32.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.409+0000 7f4e15435700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4dfc0a1230 0x7f4dfc0a36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T14:10:32.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.410+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f4e1019eab0 con 0x7f4e10100d60 2023-12-14T14:10:32.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.415+0000 7f4e06ffd700 1 -- 172.21.15.69:0/1357102159 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4e0c09b3d0 con 0x7f4e10100d60 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4dfc0a1230 msgr2=0x7f4dfc0a36e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4dfc0a1230 0x7f4dfc0a36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 msgr2=0x7f4e10195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 0x7f4e10195fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00b680 tx=0x7f4e0c0057b0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 shutdown_connections 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f4dfc0a1230 0x7f4dfc0a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e10105fa0 0x7f4e1019d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e10100d60 0x7f4e10195fe0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 --2- 172.21.15.69:0/1357102159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10103680 0x7f4e10196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 >> 172.21.15.69:0/1357102159 conn(0x7f4e100fa720 msgr2=0x7f4e101021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.417+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 shutdown_connections 2023-12-14T14:10:32.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.418+0000 7f4e17e9a700 1 -- 172.21.15.69:0/1357102159 wait complete. 2023-12-14T14:10:32.429 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-12-14T14:10:32.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.556+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/3287764665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c58105fa0 msgr2=0x7f1c58108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:32.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.556+0000 7f1c5ecb3700 1 --2- 172.21.15.69:0/3287764665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c58105fa0 0x7f1c58108380 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000b0a0 tx=0x7f1c5000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.556+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/3287764665 shutdown_connections 2023-12-14T14:10:32.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.556+0000 7f1c5ecb3700 1 --2- 172.21.15.69:0/3287764665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c58105fa0 0x7f1c58108380 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.556+0000 7f1c5ecb3700 1 --2- 172.21.15.69:0/3287764665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c58100d60 0x7f1c58103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.556+0000 7f1c5ecb3700 1 --2- 172.21.15.69:0/3287764665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c58103680 0x7f1c58105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.556+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/3287764665 >> 172.21.15.69:0/3287764665 conn(0x7f1c580fa720 msgr2=0x7f1c580fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.556+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/3287764665 shutdown_connections 2023-12-14T14:10:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.556+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/3287764665 wait complete. 2023-12-14T14:10:32.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ecb3700 1 Processor -- start 2023-12-14T14:10:32.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ecb3700 1 -- start start 2023-12-14T14:10:32.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ecb3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c58100d60 0x7f1c581960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:32.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ecb3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c58103680 0x7f1c58196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:32.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ecb3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c58105fa0 0x7f1c5819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:32.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ecb3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5819dc70 con 0x7f1c58100d60 2023-12-14T14:10:32.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ecb3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5819ddb0 con 0x7f1c58103680 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ecb3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5819df40 con 0x7f1c58105fa0 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ca4f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c58100d60 0x7f1c581960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ca4f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c58100d60 0x7f1c581960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54748/0 (socket says 172.21.15.69:54748) 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ca4f700 1 -- 172.21.15.69:0/950728084 learned_addr learned my addr 172.21.15.69:0/950728084 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c57fff700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c58103680 0x7f1c58196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5d250700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c58105fa0 0x7f1c5819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ca4f700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c58105fa0 msgr2=0x7f1c5819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ca4f700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c58105fa0 0x7f1c5819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ca4f700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c58103680 msgr2=0x7f1c58196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ca4f700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c58103680 0x7f1c58196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.557+0000 7f1c5ca4f700 1 -- 172.21.15.69:0/950728084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c009520 con 0x7f1c58100d60 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.558+0000 7f1c5ca4f700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c58100d60 0x7f1c581960f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00eb30 tx=0x7f1c4c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.558+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c009880 con 0x7f1c58100d60 2023-12-14T14:10:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.558+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c4c0044e0 con 0x7f1c58100d60 2023-12-14T14:10:32.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.558+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c50009d00 con 0x7f1c58100d60 2023-12-14T14:10:32.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.558+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c003d80 con 0x7f1c58100d60 2023-12-14T14:10:32.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.558+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5810bc50 con 0x7f1c58100d60 2023-12-14T14:10:32.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.559+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c58067c10 con 0x7f1c58100d60 2023-12-14T14:10:32.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.560+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135783+0+0 (secure 0 0 0) 0x7f1c4c004000 con 0x7f1c58100d60 2023-12-14T14:10:32.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.561+0000 7f1c55ffb700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 0x7f1c480a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:32.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.561+0000 7f1c57fff700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 msgr2=0x7f1c480a3760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/933503151 2023-12-14T14:10:32.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.561+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1c4c014070 con 0x7f1c58100d60 2023-12-14T14:10:32.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.561+0000 7f1c57fff700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 0x7f1c480a3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T14:10:32.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.565+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1c4c0965c0 con 0x7f1c58100d60 2023-12-14T14:10:32.647 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:32.344+0000 7fbd937e5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T14:10:32.695 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:32.365+0000 7f2339e4e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T14:10:32.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.762+0000 7f1c57fff700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 msgr2=0x7f1c480a3760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/933503151 2023-12-14T14:10:32.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.762+0000 7f1c57fff700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 0x7f1c480a3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T14:10:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:32.806+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 --> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c5819eb00 con 0x7f1c480a12b0 2023-12-14T14:10:32.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:10:32.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3124878587' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-mon[43371]: mgrmap e18: x(active, since 6m), standbys: z, y 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2651770992' entity='client.admin' 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1357102159' entity='client.admin' 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:32.340+0000 7f8923910200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:10:32.948 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:10:32.949 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3124878587' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-12-14T14:10:32.949 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-mon[43834]: mgrmap e18: x(active, since 6m), standbys: z, y 2023-12-14T14:10:32.949 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2651770992' entity='client.admin' 2023-12-14T14:10:32.949 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1357102159' entity='client.admin' 2023-12-14T14:10:32.995 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:10:32.995 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:10:32.996 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:10:32.996 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:10:32.996 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3124878587' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-12-14T14:10:32.996 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-mon[42034]: mgrmap e18: x(active, since 6m), standbys: z, y 2023-12-14T14:10:32.996 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2651770992' entity='client.admin' 2023-12-14T14:10:32.996 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1357102159' entity='client.admin' 2023-12-14T14:10:33.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:33.163+0000 7f1c57fff700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 msgr2=0x7f1c480a3760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/933503151 2023-12-14T14:10:33.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:33.163+0000 7f1c57fff700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 0x7f1c480a3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-14T14:10:33.264 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:32.947+0000 7f8923910200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:10:33.264 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:33.179+0000 7f8923910200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T14:10:33.268 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:32.948+0000 7fbd937e5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:10:33.268 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:33.183+0000 7fbd937e5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T14:10:33.318 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:32.996+0000 7f2339e4e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:10:33.318 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:33.234+0000 7f2339e4e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T14:10:33.524 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:33.264+0000 7f8923910200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T14:10:33.524 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:33.373+0000 7f8923910200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T14:10:33.524 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:33.462+0000 7f8923910200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T14:10:33.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:33.319+0000 7f2339e4e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T14:10:33.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:33.428+0000 7f2339e4e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T14:10:33.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:33.518+0000 7f2339e4e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T14:10:33.648 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:33.268+0000 7fbd937e5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T14:10:33.648 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:33.377+0000 7fbd937e5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T14:10:33.648 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:33.466+0000 7fbd937e5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T14:10:33.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:33.964+0000 7f1c57fff700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 msgr2=0x7f1c480a3760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/933503151 2023-12-14T14:10:33.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:33.964+0000 7f1c57fff700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 0x7f1c480a3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-14T14:10:34.024 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:33.656+0000 7f8923910200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T14:10:34.024 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:33.739+0000 7f8923910200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T14:10:34.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:33.711+0000 7f2339e4e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T14:10:34.086 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:33.797+0000 7f2339e4e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T14:10:34.110 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:33.659+0000 7fbd937e5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T14:10:34.110 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:33.744+0000 7fbd937e5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T14:10:34.374 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:34 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:34.111+0000 7fbd937e5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T14:10:34.374 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:34.111+0000 7f8923910200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T14:10:34.431 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:34.166+0000 7f2339e4e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T14:10:34.647 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:34 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:34.374+0000 7fbd937e5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T14:10:34.655 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:34.374+0000 7f8923910200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T14:10:34.713 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:34.431+0000 7f2339e4e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T14:10:35.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:34 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:10:35.024 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:34.655+0000 7f8923910200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T14:10:35.025 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:34.749+0000 7f8923910200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T14:10:35.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:34 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:10:35.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:34.714+0000 7f2339e4e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T14:10:35.086 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:34.811+0000 7f2339e4e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T14:10:35.147 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:34 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:10:35.148 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:34 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:34.653+0000 7fbd937e5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T14:10:35.148 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:34 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:34.747+0000 7fbd937e5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T14:10:35.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:35.565+0000 7f1c57fff700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 msgr2=0x7f1c480a3760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/933503151 2023-12-14T14:10:35.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:35.565+0000 7f1c57fff700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 0x7f1c480a3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-14T14:10:35.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:35.498+0000 7f8923910200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T14:10:35.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:35.592+0000 7f8923910200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T14:10:35.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:35.737+0000 7f8923910200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T14:10:35.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:35.561+0000 7f2339e4e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T14:10:35.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:35.657+0000 7f2339e4e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T14:10:35.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:35.803+0000 7f2339e4e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T14:10:35.897 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:35 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:35.494+0000 7fbd937e5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T14:10:35.897 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:35 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:35.588+0000 7fbd937e5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T14:10:35.897 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:35 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:35.734+0000 7fbd937e5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T14:10:36.647 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:36 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:36.356+0000 7fbd937e5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T14:10:36.648 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:36 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:36.537+0000 7fbd937e5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T14:10:36.735 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:36.360+0000 7f8923910200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T14:10:36.735 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:36.542+0000 7f8923910200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T14:10:36.808 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:36.426+0000 7f2339e4e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T14:10:36.808 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:36.612+0000 7f2339e4e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T14:10:37.085 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:36.809+0000 7f2339e4e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T14:10:37.147 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:36 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:36.732+0000 7fbd937e5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T14:10:37.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:36.735+0000 7f8923910200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T14:10:37.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:37 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:37.442+0000 7f8923910200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T14:10:37.835 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:37 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:37.526+0000 7f2339e4e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T14:10:37.897 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:37 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:37.436+0000 7fbd937e5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T14:10:38.182 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:37 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:37.903+0000 7fbd937e5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:10:38.182 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:37 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:37.993+0000 7fbd937e5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T14:10:38.189 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:37 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:37.911+0000 7f8923910200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:10:38.190 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:38.000+0000 7f8923910200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T14:10:38.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:38.257+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 19) v1 ==== 135783+0+0 (secure 0 0 0) 0x7f1c4c0d2020 con 0x7f1c58100d60 2023-12-14T14:10:38.259 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.005+0000 7f2339e4e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T14:10:38.259 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.096+0000 7f2339e4e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T14:10:38.260 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: Standby manager daemon y restarted 2023-12-14T14:10:38.260 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: Standby manager daemon y started 2023-12-14T14:10:38.260 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-14T14:10:38.260 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:10:38.260 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-14T14:10:38.260 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:10:38.260 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: Standby manager daemon z restarted 2023-12-14T14:10:38.260 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: Standby manager daemon z started 2023-12-14T14:10:38.261 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-14T14:10:38.261 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:10:38.261 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-14T14:10:38.261 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-mon[42034]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:10:38.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:38.325+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 20) v1 ==== 135400+0+0 (secure 0 0 0) 0x7f1c4c096990 con 0x7f1c58100d60 2023-12-14T14:10:38.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:38.326+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 msgr2=0x7f1c480a3760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T14:10:38.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:38.326+0000 7f1c55ffb700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/933503151,v1:172.21.15.69:6801/933503151] conn(0x7f1c480a12b0 0x7f1c480a3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y[44823]: 2023-12-14T14:10:38.183+0000 7fbd937e5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: Standby manager daemon y restarted 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: Standby manager daemon y started 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: Standby manager daemon z restarted 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: Standby manager daemon z started 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:10:38.499 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-14T14:10:38.500 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:38 smithi081 ceph-mon[43371]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:10:38.500 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z[45676]: 2023-12-14T14:10:38.190+0000 7f8923910200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T14:10:38.500 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: Standby manager daemon y restarted 2023-12-14T14:10:38.500 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: Standby manager daemon y started 2023-12-14T14:10:38.500 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-14T14:10:38.500 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:10:38.500 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-14T14:10:38.500 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.81:0/1849495476' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:10:38.500 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: Standby manager daemon z restarted 2023-12-14T14:10:38.501 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: Standby manager daemon z started 2023-12-14T14:10:38.501 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-14T14:10:38.501 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T14:10:38.501 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-14T14:10:38.501 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:38 smithi119 ceph-mon[43834]: from='mgr.? 172.21.15.119:0/109299493' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T14:10:38.549 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.298+0000 7f2339e4e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T14:10:38.549 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f2295a9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:38.549 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f2295a9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:38.549 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f2295a9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:38.550 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f2295a9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:38.550 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f2295a9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:38.550 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f229829f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:38.550 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f229829f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:38.550 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f229829f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:38.550 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f229829f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:38.550 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:10:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:10:38.549+0000 7f229829f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:10:39.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.329+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mon.0 v2:172.21.15.69:3300/0 9 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7f1c4c068ad0 con 0x7f1c58100d60 2023-12-14T14:10:39.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.329+0000 7f1c55ffb700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c4801b8f0 0x7f1c4801bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:39.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.329+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 --> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c5819eb00 con 0x7f1c4801b8f0 2023-12-14T14:10:39.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.333+0000 7f1c57fff700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c4801b8f0 0x7f1c4801bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:39.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.337+0000 7f1c57fff700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c4801b8f0 0x7f1c4801bcc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009880 tx=0x7f1c44009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:39.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.387+0000 7f1c55ffb700 1 -- 172.21.15.69:0/950728084 <== mgr.15411 v2:172.21.15.69:6800/4150820502 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1c5819eb00 con 0x7f1c4801b8f0 2023-12-14T14:10:39.386 INFO:teuthology.orchestra.run.smithi069.stdout:Schedule set for path / 2023-12-14T14:10:39.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.389+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c4801b8f0 msgr2=0x7f1c4801bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:39.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.389+0000 7f1c5ecb3700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c4801b8f0 0x7f1c4801bcc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009880 tx=0x7f1c44009260 comp rx=0 tx=0).stop 2023-12-14T14:10:39.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.389+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c58100d60 msgr2=0x7f1c581960f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:39.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.389+0000 7f1c5ecb3700 1 --2- 172.21.15.69:0/950728084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c58100d60 0x7f1c581960f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00eb30 tx=0x7f1c4c00ee40 comp rx=0 tx=0).stop 2023-12-14T14:10:39.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.389+0000 7f1c5d250700 1 -- 172.21.15.69:0/950728084 reap_dead start 2023-12-14T14:10:39.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.389+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 shutdown_connections 2023-12-14T14:10:39.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.389+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 >> 172.21.15.69:0/950728084 conn(0x7f1c580fa720 msgr2=0x7f1c581021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:39.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.390+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 shutdown_connections 2023-12-14T14:10:39.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.390+0000 7f1c5ecb3700 1 -- 172.21.15.69:0/950728084 wait complete. 2023-12-14T14:10:39.403 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-12-14T14:10:39.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: mgrmap e19: x(active, since 6m), standbys: z, y 2023-12-14T14:10:39.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: Active manager daemon x restarted 2023-12-14T14:10:39.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: Activating manager daemon x 2023-12-14T14:10:39.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: osdmap e85: 12 total, 12 up, 12 in 2023-12-14T14:10:39.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: mgrmap e20: x(active, starting, since 0.0156141s), standbys: z, y 2023-12-14T14:10:39.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:10:39.526 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T14:10:39.527 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:10:39.528 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-14T14:10:39.529 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-14T14:10:39.530 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-14T14:10:39.530 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: Manager daemon x is now available 2023-12-14T14:10:39.530 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:39.530 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:39.530 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-14T14:10:39.530 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-14T14:10:39.530 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: [14/Dec/2023:14:10:38] ENGINE Bus STARTING 2023-12-14T14:10:39.530 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:39 smithi119 ceph-mon[43834]: [14/Dec/2023:14:10:38] ENGINE Serving on https://172.21.15.69:7150 2023-12-14T14:10:39.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 -- 172.21.15.69:0/419431502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100cc0 msgr2=0x7f5870107580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:39.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 --2- 172.21.15.69:0/419431502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100cc0 0x7f5870107580 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f586800b0a0 tx=0x7f586800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 -- 172.21.15.69:0/419431502 shutdown_connections 2023-12-14T14:10:39.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 --2- 172.21.15.69:0/419431502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100cc0 0x7f5870107580 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 --2- 172.21.15.69:0/419431502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58700ff140 0x7f58700ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 --2- 172.21.15.69:0/419431502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5870100330 0x7f5870100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 -- 172.21.15.69:0/419431502 >> 172.21.15.69:0/419431502 conn(0x7f58700fa720 msgr2=0x7f58700fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:39.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 -- 172.21.15.69:0/419431502 shutdown_connections 2023-12-14T14:10:39.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 -- 172.21.15.69:0/419431502 wait complete. 2023-12-14T14:10:39.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 Processor -- start 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.537+0000 7f58748ad700 1 -- start start 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f58748ad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58700ff140 0x7f5870198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f58748ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100330 0x7f5870198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f58748ad700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5870100cc0 0x7f587019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f58748ad700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587019fe80 con 0x7f5870100330 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f58748ad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587019ffc0 con 0x7f58700ff140 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f58748ad700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58701a0150 con 0x7f5870100cc0 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100330 0x7f5870198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58700ff140 0x7f5870198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100330 0x7f5870198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44638/0 (socket says 172.21.15.69:44638) 2023-12-14T14:10:39.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586dd9b700 1 -- 172.21.15.69:0/818687008 learned_addr learned my addr 172.21.15.69:0/818687008 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:39.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586dd9b700 1 -- 172.21.15.69:0/818687008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5870100cc0 msgr2=0x7f587019f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:39.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586dd9b700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5870100cc0 0x7f587019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586dd9b700 1 -- 172.21.15.69:0/818687008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58700ff140 msgr2=0x7f5870198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:39.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586dd9b700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58700ff140 0x7f5870198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586dd9b700 1 -- 172.21.15.69:0/818687008 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868009d00 con 0x7f5870100330 2023-12-14T14:10:39.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f586dd9b700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100330 0x7f5870198840 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f586400e9a0 tx=0x7f586400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:39.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f585f7fe700 1 -- 172.21.15.69:0/818687008 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864009790 con 0x7f5870100330 2023-12-14T14:10:39.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f585f7fe700 1 -- 172.21.15.69:0/818687008 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f586400cbd0 con 0x7f5870100330 2023-12-14T14:10:39.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587010bc70 con 0x7f5870100330 2023-12-14T14:10:39.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.538+0000 7f585f7fe700 1 -- 172.21.15.69:0/818687008 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864018680 con 0x7f5870100330 2023-12-14T14:10:39.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.539+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587010bae0 con 0x7f5870100330 2023-12-14T14:10:39.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.539+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58701a0840 con 0x7f5870100330 2023-12-14T14:10:39.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.541+0000 7f585f7fe700 1 -- 172.21.15.69:0/818687008 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7f586400cd40 con 0x7f5870100330 2023-12-14T14:10:39.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.541+0000 7f585f7fe700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f58580a0f50 0x7f58580a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:39.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.542+0000 7f585f7fe700 1 -- 172.21.15.69:0/818687008 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f5864014070 con 0x7f5870100330 2023-12-14T14:10:39.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.542+0000 7f586e59c700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f58580a0f50 0x7f58580a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:39.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.542+0000 7f586e59c700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f58580a0f50 0x7f58580a3400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5870100190 tx=0x7f5860009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:39.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.546+0000 7f585f7fe700 1 -- 172.21.15.69:0/818687008 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5864051730 con 0x7f5870100330 2023-12-14T14:10:39.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: mgrmap e19: x(active, since 6m), standbys: z, y 2023-12-14T14:10:39.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: Active manager daemon x restarted 2023-12-14T14:10:39.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: Activating manager daemon x 2023-12-14T14:10:39.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: osdmap e85: 12 total, 12 up, 12 in 2023-12-14T14:10:39.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: mgrmap e20: x(active, starting, since 0.0156141s), standbys: z, y 2023-12-14T14:10:39.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T14:10:39.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:10:39.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: Manager daemon x is now available 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:39.589 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:39.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-14T14:10:39.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-14T14:10:39.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: [14/Dec/2023:14:10:38] ENGINE Bus STARTING 2023-12-14T14:10:39.590 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:39 smithi069 ceph-mon[42034]: [14/Dec/2023:14:10:38] ENGINE Serving on https://172.21.15.69:7150 2023-12-14T14:10:39.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: mgrmap e19: x(active, since 6m), standbys: z, y 2023-12-14T14:10:39.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: Active manager daemon x restarted 2023-12-14T14:10:39.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: Activating manager daemon x 2023-12-14T14:10:39.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: osdmap e85: 12 total, 12 up, 12 in 2023-12-14T14:10:39.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: mgrmap e20: x(active, starting, since 0.0156141s), standbys: z, y 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T14:10:39.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T14:10:39.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: Manager daemon x is now available 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-14T14:10:39.651 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: [14/Dec/2023:14:10:38] ENGINE Bus STARTING 2023-12-14T14:10:39.652 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:39 smithi081 ceph-mon[43371]: [14/Dec/2023:14:10:38] ENGINE Serving on https://172.21.15.69:7150 2023-12-14T14:10:39.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.795+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 --> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f58701072f0 con 0x7f58580a0f50 2023-12-14T14:10:39.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.850+0000 7f585f7fe700 1 -- 172.21.15.69:0/818687008 <== mgr.15411 v2:172.21.15.69:6800/4150820502 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f58701072f0 con 0x7f58580a0f50 2023-12-14T14:10:39.850 INFO:teuthology.orchestra.run.smithi069.stdout:Retention added to path / 2023-12-14T14:10:39.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f58580a0f50 msgr2=0x7f58580a3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f58580a0f50 0x7f58580a3400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5870100190 tx=0x7f5860009260 comp rx=0 tx=0).stop 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100330 msgr2=0x7f5870198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100330 0x7f5870198840 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f586400e9a0 tx=0x7f586400ecb0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 shutdown_connections 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f58580a0f50 0x7f58580a3400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5870100cc0 0x7f587019f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58700ff140 0x7f5870198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 --2- 172.21.15.69:0/818687008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5870100330 0x7f5870198840 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 >> 172.21.15.69:0/818687008 conn(0x7f58700fa720 msgr2=0x7f5870105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:39.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 shutdown_connections 2023-12-14T14:10:39.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:39.854+0000 7f58748ad700 1 -- 172.21.15.69:0/818687008 wait complete. 2023-12-14T14:10:39.867 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-12-14T14:10:40.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 -- 172.21.15.69:0/4225087079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1035e0 msgr2=0x7fd84c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 --2- 172.21.15.69:0/4225087079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1035e0 0x7fd84c1059c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd840009990 tx=0x7fd840009ca0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 -- 172.21.15.69:0/4225087079 shutdown_connections 2023-12-14T14:10:40.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 --2- 172.21.15.69:0/4225087079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd84c105f00 0x7fd84c108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 --2- 172.21.15.69:0/4225087079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd84c100cc0 0x7fd84c1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 --2- 172.21.15.69:0/4225087079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1035e0 0x7fd84c1059c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 -- 172.21.15.69:0/4225087079 >> 172.21.15.69:0/4225087079 conn(0x7fd84c0fa740 msgr2=0x7fd84c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 -- 172.21.15.69:0/4225087079 shutdown_connections 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 -- 172.21.15.69:0/4225087079 wait complete. 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.003+0000 7fd8514c8700 1 Processor -- start 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd8514c8700 1 -- start start 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd8514c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c100cc0 0x7fd84c195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd8514c8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd84c1035e0 0x7fd84c1964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd8514c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd84c105f00 0x7fd84c19d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:40.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd8514c8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c19db30 con 0x7fd84c105f00 2023-12-14T14:10:40.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd8514c8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c19dc70 con 0x7fd84c100cc0 2023-12-14T14:10:40.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd8514c8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c19de00 con 0x7fd84c1035e0 2023-12-14T14:10:40.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c100cc0 0x7fd84c195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:40.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd84c105f00 0x7fd84c19d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:40.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84a7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd84c1035e0 0x7fd84c1964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:40.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c100cc0 0x7fd84c195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:38246/0 (socket says 172.21.15.69:38246) 2023-12-14T14:10:40.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84affd700 1 -- 172.21.15.69:0/3451962978 learned_addr learned my addr 172.21.15.69:0/3451962978 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:40.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84b7fe700 1 -- 172.21.15.69:0/3451962978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd84c1035e0 msgr2=0x7fd84c1964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84b7fe700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd84c1035e0 0x7fd84c1964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84b7fe700 1 -- 172.21.15.69:0/3451962978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c100cc0 msgr2=0x7fd84c195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84b7fe700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c100cc0 0x7fd84c195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84b7fe700 1 -- 172.21.15.69:0/3451962978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400095f0 con 0x7fd84c105f00 2023-12-14T14:10:40.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84affd700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c100cc0 0x7fd84c195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:10:40.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.004+0000 7fd84a7fc700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd84c1035e0 0x7fd84c1964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:10:40.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.005+0000 7fd84b7fe700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd84c105f00 0x7fd84c19d560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd84400efc0 tx=0x7fd84400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:40.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.005+0000 7fd833fff700 1 -- 172.21.15.69:0/3451962978 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844018070 con 0x7fd84c105f00 2023-12-14T14:10:40.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.005+0000 7fd833fff700 1 -- 172.21.15.69:0/3451962978 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd84400f040 con 0x7fd84c105f00 2023-12-14T14:10:40.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.005+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c10bc50 con 0x7fd84c105f00 2023-12-14T14:10:40.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.005+0000 7fd833fff700 1 -- 172.21.15.69:0/3451962978 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84400cd40 con 0x7fd84c105f00 2023-12-14T14:10:40.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.005+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c10bac0 con 0x7fd84c105f00 2023-12-14T14:10:40.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.006+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c0fc2b0 con 0x7fd84c105f00 2023-12-14T14:10:40.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.010+0000 7fd833fff700 1 -- 172.21.15.69:0/3451962978 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7fd844003a00 con 0x7fd84c105f00 2023-12-14T14:10:40.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.010+0000 7fd833fff700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd8340a0f50 0x7fd8340a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:40.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.010+0000 7fd833fff700 1 -- 172.21.15.69:0/3451962978 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fd8440ccb60 con 0x7fd84c105f00 2023-12-14T14:10:40.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.010+0000 7fd84affd700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd8340a0f50 0x7fd8340a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:40.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.011+0000 7fd84affd700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd8340a0f50 0x7fd8340a3400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd83c011550 tx=0x7fd83c009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:40.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.013+0000 7fd833fff700 1 -- 172.21.15.69:0/3451962978 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd844096550 con 0x7fd84c105f00 2023-12-14T14:10:40.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.238+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 --> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fd84c061a30 con 0x7fd8340a0f50 2023-12-14T14:10:40.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.252+0000 7fd833fff700 1 -- 172.21.15.69:0/3451962978 <== mgr.15411 v2:172.21.15.69:6800/4150820502 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7fd84c061a30 con 0x7fd8340a0f50 2023-12-14T14:10:40.252 INFO:teuthology.orchestra.run.smithi069.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-12-14T00:00:00", "created": "2023-12-14T14:10:39", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-12-14T14:10:40.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd8340a0f50 msgr2=0x7fd8340a3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd8340a0f50 0x7fd8340a3400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd83c011550 tx=0x7fd83c009260 comp rx=0 tx=0).stop 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd84c105f00 msgr2=0x7fd84c19d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd84c105f00 0x7fd84c19d560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd84400efc0 tx=0x7fd84400c3a0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 shutdown_connections 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd8340a0f50 0x7fd8340a3400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd84c105f00 0x7fd84c19d560 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c100cc0 0x7fd84c195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 --2- 172.21.15.69:0/3451962978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd84c1035e0 0x7fd84c1964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.254+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 >> 172.21.15.69:0/3451962978 conn(0x7fd84c0fa740 msgr2=0x7fd84c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.255+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 shutdown_connections 2023-12-14T14:10:40.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.255+0000 7fd8514c8700 1 -- 172.21.15.69:0/3451962978 wait complete. 2023-12-14T14:10:40.266 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-12-14T14:10:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.404+0000 7f017c60e700 1 -- 172.21.15.69:0/996798560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 msgr2=0x7f01741075b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.404+0000 7f017c60e700 1 --2- 172.21.15.69:0/996798560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 0x7f01741075b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f016c00b0a0 tx=0x7f016c00b3b0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.404+0000 7f017c60e700 1 -- 172.21.15.69:0/996798560 shutdown_connections 2023-12-14T14:10:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.404+0000 7f017c60e700 1 --2- 172.21.15.69:0/996798560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 0x7f01741075b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.404+0000 7f017c60e700 1 --2- 172.21.15.69:0/996798560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01740ff170 0x7f01740ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.404+0000 7f017c60e700 1 --2- 172.21.15.69:0/996798560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0174100360 0x7f01741007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.404+0000 7f017c60e700 1 -- 172.21.15.69:0/996798560 >> 172.21.15.69:0/996798560 conn(0x7f01740fa770 msgr2=0x7f01740fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.404+0000 7f017c60e700 1 -- 172.21.15.69:0/996798560 shutdown_connections 2023-12-14T14:10:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.404+0000 7f017c60e700 1 -- 172.21.15.69:0/996798560 wait complete. 2023-12-14T14:10:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017c60e700 1 Processor -- start 2023-12-14T14:10:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017c60e700 1 -- start start 2023-12-14T14:10:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017c60e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01740ff170 0x7f0174069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017c60e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0174100360 0x7f017419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017c60e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 0x7f017419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017c60e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017419dc20 con 0x7f0174100cf0 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017c60e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017419dd90 con 0x7f01740ff170 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017c60e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017419df50 con 0x7f0174100360 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017abab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 0x7f017419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017a3aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01740ff170 0x7f0174069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017a3aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01740ff170 0x7f0174069d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:38252/0 (socket says 172.21.15.69:38252) 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017abab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 0x7f017419d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44680/0 (socket says 172.21.15.69:44680) 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017a3aa700 1 -- 172.21.15.69:0/2733152414 learned_addr learned my addr 172.21.15.69:0/2733152414 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f0179ba9700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0174100360 0x7f017419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:40.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017abab700 1 -- 172.21.15.69:0/2733152414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0174100360 msgr2=0x7f017419ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017abab700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0174100360 0x7f017419ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017abab700 1 -- 172.21.15.69:0/2733152414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01740ff170 msgr2=0x7f0174069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017abab700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01740ff170 0x7f0174069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017abab700 1 -- 172.21.15.69:0/2733152414 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c009d00 con 0x7f0174100cf0 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.405+0000 7f017a3aa700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01740ff170 0x7f0174069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.406+0000 7f017abab700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 0x7f017419d450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f016c00b0a0 tx=0x7f016c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.406+0000 7f016b7fe700 1 -- 172.21.15.69:0/2733152414 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c00e040 con 0x7f0174100cf0 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.406+0000 7f016b7fe700 1 -- 172.21.15.69:0/2733152414 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f016c00bde0 con 0x7f0174100cf0 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.406+0000 7f016b7fe700 1 -- 172.21.15.69:0/2733152414 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c01b6b0 con 0x7f0174100cf0 2023-12-14T14:10:40.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.406+0000 7f017c60e700 1 -- 172.21.15.69:0/2733152414 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017410aae0 con 0x7f0174100cf0 2023-12-14T14:10:40.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.406+0000 7f017c60e700 1 -- 172.21.15.69:0/2733152414 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017410a950 con 0x7f0174100cf0 2023-12-14T14:10:40.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.407+0000 7f01697fa700 1 -- 172.21.15.69:0/2733152414 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0174068060 con 0x7f0174100cf0 2023-12-14T14:10:40.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.408+0000 7f016b7fe700 1 -- 172.21.15.69:0/2733152414 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7f016c01d480 con 0x7f0174100cf0 2023-12-14T14:10:40.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.408+0000 7f016b7fe700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f01600a0f50 0x7f01600a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:10:40.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.409+0000 7f016b7fe700 1 -- 172.21.15.69:0/2733152414 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f016c0ce630 con 0x7f0174100cf0 2023-12-14T14:10:40.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.409+0000 7f017a3aa700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f01600a0f50 0x7f01600a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:10:40.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.409+0000 7f017a3aa700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f01600a0f50 0x7f01600a3400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0170005950 tx=0x7f0170009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:10:40.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.412+0000 7f016b7fe700 1 -- 172.21.15.69:0/2733152414 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f016c098020 con 0x7f0174100cf0 2023-12-14T14:10:40.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: [14/Dec/2023:14:10:38] ENGINE Serving on http://172.21.15.69:8765 2023-12-14T14:10:40.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: [14/Dec/2023:14:10:38] ENGINE Bus STARTED 2023-12-14T14:10:40.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: mgrmap e21: x(active, since 1.02244s), standbys: z, y 2023-12-14T14:10:40.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:40.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:10:40.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:40 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.645+0000 7f01697fa700 1 -- 172.21.15.69:0/2733152414 --> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0174060f30 con 0x7f01600a0f50 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: [14/Dec/2023:14:10:38] ENGINE Serving on http://172.21.15.69:8765 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: [14/Dec/2023:14:10:38] ENGINE Bus STARTED 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: mgrmap e21: x(active, since 1.02244s), standbys: z, y 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:40 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.653+0000 7f016b7fe700 1 -- 172.21.15.69:0/2733152414 <== mgr.15411 v2:172.21.15.69:6800/4150820502 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f0174060f30 con 0x7f01600a0f50 2023-12-14T14:10:40.652 INFO:teuthology.orchestra.run.smithi069.stdout:/ 1M 6M3h 2023-12-14T14:10:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 -- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f01600a0f50 msgr2=0x7f01600a3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f01600a0f50 0x7f01600a3400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0170005950 tx=0x7f0170009260 comp rx=0 tx=0).stop 2023-12-14T14:10:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 -- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 msgr2=0x7f017419d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:10:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 0x7f017419d450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f016c00b0a0 tx=0x7f016c007f30 comp rx=0 tx=0).stop 2023-12-14T14:10:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 -- 172.21.15.69:0/2733152414 shutdown_connections 2023-12-14T14:10:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f01600a0f50 0x7f01600a3400 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0174100cf0 0x7f017419d450 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01740ff170 0x7f0174069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 --2- 172.21.15.69:0/2733152414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0174100360 0x7f017419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:10:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.655+0000 7f01697fa700 1 -- 172.21.15.69:0/2733152414 >> 172.21.15.69:0/2733152414 conn(0x7f01740fa770 msgr2=0x7f0174103790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:10:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.656+0000 7f01697fa700 1 -- 172.21.15.69:0/2733152414 shutdown_connections 2023-12-14T14:10:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:10:40.656+0000 7f01697fa700 1 -- 172.21.15.69:0/2733152414 wait complete. 2023-12-14T14:10:40.667 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-12-14T14:10:40.698 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-12-14T14:10:40.737 INFO:teuthology.run_tasks:Running task workunit... 2023-12-14T14:10:40.749 INFO:tasks.workunit:Pulling workunits from ref bf026da9d69000f3d4a9d16360156095d6612a2d 2023-12-14T14:10:40.750 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-14T14:10:40.750 INFO:tasks.workunit:timeout=3h 2023-12-14T14:10:40.750 INFO:tasks.workunit:cleanup=True 2023-12-14T14:10:40.750 DEBUG:teuthology.orchestra.run.smithi069:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-14T14:10:40.769 INFO:teuthology.orchestra.run.smithi069.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-14T14:10:40.769 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-14T14:10:40.769 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2023-12-14T14:10:40.769 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T14:10:40.769 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-14T14:10:40.769 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 14:09:16.971537506 +0000 2023-12-14T14:10:40.769 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 14:09:16.971537506 +0000 2023-12-14T14:10:40.769 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 14:10:24.137616937 +0000 2023-12-14T14:10:40.770 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2023-12-14 14:09:16.971537506 +0000 2023-12-14T14:10:40.770 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-14T14:10:40.770 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-14T14:10:40.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: [14/Dec/2023:14:10:38] ENGINE Serving on http://172.21.15.69:8765 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: [14/Dec/2023:14:10:38] ENGINE Bus STARTED 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: mgrmap e21: x(active, since 1.02244s), standbys: z, y 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:40 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:40.846 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/chrisphoffman/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bf026da9d69000f3d4a9d16360156095d6612a2d 2023-12-14T14:10:40.904 INFO:tasks.workunit.client.0.smithi069.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-14T14:10:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:10:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi119 to 182.4M 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: Unable to set osd_memory_target on smithi119 to 191357644: error parsing value: Value '191357644' is below minimum 939524096 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi081 to 182.5M 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.028 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.028 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.028 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:10:42.028 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:10:42.028 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:41 smithi119 ceph-mon[43834]: mgrmap e22: x(active, since 3s), standbys: z, y 2023-12-14T14:10:42.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:42.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:42.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:10:42.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:42.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi119 to 182.4M 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: Unable to set osd_memory_target on smithi119 to 191357644: error parsing value: Value '191357644' is below minimum 939524096 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi081 to 182.5M 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.089 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:10:42.089 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:10:42.089 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:41 smithi069 ceph-mon[42034]: mgrmap e22: x(active, since 3s), standbys: z, y 2023-12-14T14:10:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:10:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:10:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi119 to 182.4M 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: Unable to set osd_memory_target on smithi119 to 191357644: error parsing value: Value '191357644' is below minimum 939524096 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi081 to 182.5M 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:10:42.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:10:42.151 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:10:42.151 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:41 smithi081 ceph-mon[43371]: mgrmap e22: x(active, since 3s), standbys: z, y 2023-12-14T14:10:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi069 to 182.4M 2023-12-14T14:10:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Unable to set osd_memory_target on smithi069 to 191311769: error parsing value: Value '191311769' is below minimum 939524096 2023-12-14T14:10:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:10:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi069:/etc/ceph/ceph.conf 2023-12-14T14:10:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi081:/etc/ceph/ceph.conf 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi069:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi081:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi069:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi081:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:10:43.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:10:43.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi069 to 182.4M 2023-12-14T14:10:43.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Unable to set osd_memory_target on smithi069 to 191311769: error parsing value: Value '191311769' is below minimum 939524096 2023-12-14T14:10:43.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:10:43.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi069:/etc/ceph/ceph.conf 2023-12-14T14:10:43.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi081:/etc/ceph/ceph.conf 2023-12-14T14:10:43.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-14T14:10:43.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi069:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:10:43.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi081:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:10:43.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi069:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi081:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:43.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:10:43.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:10:43.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi069 to 182.4M 2023-12-14T14:10:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Unable to set osd_memory_target on smithi069 to 191311769: error parsing value: Value '191311769' is below minimum 939524096 2023-12-14T14:10:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:10:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi069:/etc/ceph/ceph.conf 2023-12-14T14:10:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi081:/etc/ceph/ceph.conf 2023-12-14T14:10:43.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-14T14:10:43.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi069:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:10:43.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi081:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:10:43.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-14T14:10:43.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:10:43.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:10:43.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2023-12-14T14:10:43.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi069:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:10:43.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi081:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:10:43.149 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: Updating smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:10:43.150 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:10:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:43 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:10:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:43 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:10:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:43 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:10:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:43 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:10:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:43 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:10:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:43 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:10:44.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:43 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:10:44.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:43 smithi119 ceph-mon[43834]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:10:44.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:43 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:10:44.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:43 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:10:44.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:43 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:10:44.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:43 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:10:44.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:43 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:10:44.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:43 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:10:44.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:43 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:10:44.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:43 smithi069 ceph-mon[42034]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:10:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:43 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:10:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:43 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:10:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:43 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:10:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:43 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:10:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:43 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:10:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:43 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:10:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:43 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:10:44.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:43 smithi081 ceph-mon[43371]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T14:10:46.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:45 smithi119 ceph-mon[43834]: pgmap v6: 97 pgs: 97 active+clean; 1.3 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 94 KiB/s wr, 11 op/s 2023-12-14T14:10:46.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:45 smithi069 ceph-mon[42034]: pgmap v6: 97 pgs: 97 active+clean; 1.3 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 94 KiB/s wr, 11 op/s 2023-12-14T14:10:46.148 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:45 smithi081 ceph-mon[43371]: pgmap v6: 97 pgs: 97 active+clean; 1.3 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 94 KiB/s wr, 11 op/s 2023-12-14T14:10:47.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:47 smithi119 ceph-mon[43834]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 132 KiB/s wr, 51 op/s 2023-12-14T14:10:47.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:47 smithi069 ceph-mon[42034]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 132 KiB/s wr, 51 op/s 2023-12-14T14:10:47.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:47 smithi081 ceph-mon[43371]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 132 KiB/s wr, 51 op/s 2023-12-14T14:10:49.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:49 smithi081 ceph-mon[43371]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 40 op/s 2023-12-14T14:10:49.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:49 smithi119 ceph-mon[43834]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 40 op/s 2023-12-14T14:10:49.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:49 smithi069 ceph-mon[42034]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 40 op/s 2023-12-14T14:10:51.650 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:51 smithi081 ceph-mon[43371]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 84 KiB/s wr, 35 op/s 2023-12-14T14:10:51.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:51 smithi119 ceph-mon[43834]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 84 KiB/s wr, 35 op/s 2023-12-14T14:10:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:51 smithi069 ceph-mon[42034]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 84 KiB/s wr, 35 op/s 2023-12-14T14:10:53.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:53 smithi081 ceph-mon[43371]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 32 op/s 2023-12-14T14:10:53.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:53 smithi119 ceph-mon[43834]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 32 op/s 2023-12-14T14:10:53.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:53 smithi069 ceph-mon[42034]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 32 op/s 2023-12-14T14:10:55.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:55 smithi081 ceph-mon[43371]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 33 op/s 2023-12-14T14:10:55.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:55 smithi119 ceph-mon[43834]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 33 op/s 2023-12-14T14:10:55.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:55 smithi069 ceph-mon[42034]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 33 op/s 2023-12-14T14:10:57.524 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:57 smithi119 ceph-mon[43834]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 KiB/s wr, 30 op/s 2023-12-14T14:10:57.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:57 smithi069 ceph-mon[42034]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 KiB/s wr, 30 op/s 2023-12-14T14:10:57.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:57 smithi081 ceph-mon[43371]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 KiB/s wr, 30 op/s 2023-12-14T14:10:59.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:10:59 smithi081 ceph-mon[43371]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:10:59.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:10:59 smithi119 ceph-mon[43834]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:10:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:10:59 smithi069 ceph-mon[42034]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T14:11:01.188 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:11:01.216 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:11:00 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:11:00.859+0000 7f2276f1d700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:11:01.216 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:11:00 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:11:00.859+0000 7f2276f1d700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:11:01.216 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:11:00 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:11:00.859+0000 7f2276f1d700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:11:01.216 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:11:00 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:11:00.859+0000 7f2276f1d700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:11:01.216 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:11:00 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:11:00.859+0000 7f2276f1d700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T14:11:01.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.323+0000 7f44112d3700 1 -- 172.21.15.69:0/2378915603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c100e50 msgr2=0x7f440c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.323+0000 7f44112d3700 1 --2- 172.21.15.69:0/2378915603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c100e50 0x7f440c104e10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f44000099c0 tx=0x7f4400009cd0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.324+0000 7f44112d3700 1 -- 172.21.15.69:0/2378915603 shutdown_connections 2023-12-14T14:11:01.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.324+0000 7f44112d3700 1 --2- 172.21.15.69:0/2378915603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f440c1054f0 0x7f440c10d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.324+0000 7f44112d3700 1 --2- 172.21.15.69:0/2378915603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f440c1004b0 0x7f440c100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.324+0000 7f44112d3700 1 --2- 172.21.15.69:0/2378915603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c100e50 0x7f440c104e10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.324+0000 7f44112d3700 1 -- 172.21.15.69:0/2378915603 >> 172.21.15.69:0/2378915603 conn(0x7f440c0fbd40 msgr2=0x7f440c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.324+0000 7f44112d3700 1 -- 172.21.15.69:0/2378915603 shutdown_connections 2023-12-14T14:11:01.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.324+0000 7f44112d3700 1 -- 172.21.15.69:0/2378915603 wait complete. 2023-12-14T14:11:01.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.324+0000 7f44112d3700 1 Processor -- start 2023-12-14T14:11:01.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f44112d3700 1 -- start start 2023-12-14T14:11:01.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f44112d3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c1004b0 0x7f440c196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f44112d3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f440c100e50 0x7f440c196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f44112d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f440c1054f0 0x7f440c19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f44112d3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c19b3f0 con 0x7f440c1004b0 2023-12-14T14:11:01.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f44112d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c19b560 con 0x7f440c1054f0 2023-12-14T14:11:01.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f44112d3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c19b720 con 0x7f440c100e50 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c1004b0 0x7f440c196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c1004b0 0x7f440c196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42478/0 (socket says 172.21.15.69:42478) 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440affd700 1 -- 172.21.15.69:0/3033945126 learned_addr learned my addr 172.21.15.69:0/3033945126 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440b7fe700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f440c1054f0 0x7f440c19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440a7fc700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f440c100e50 0x7f440c196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440affd700 1 -- 172.21.15.69:0/3033945126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f440c100e50 msgr2=0x7f440c196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440affd700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f440c100e50 0x7f440c196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440affd700 1 -- 172.21.15.69:0/3033945126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f440c1054f0 msgr2=0x7f440c19adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440affd700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f440c1054f0 0x7f440c19adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440affd700 1 -- 172.21.15.69:0/3033945126 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000095f0 con 0x7f440c1004b0 2023-12-14T14:11:01.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.325+0000 7f440b7fe700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f440c1054f0 0x7f440c19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.326+0000 7f440affd700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c1004b0 0x7f440c196410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00d950 tx=0x7f43fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.326+0000 7f43f3fff700 1 -- 172.21.15.69:0/3033945126 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc009b40 con 0x7f440c1004b0 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.326+0000 7f43f3fff700 1 -- 172.21.15.69:0/3033945126 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43fc009ca0 con 0x7f440c1004b0 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.326+0000 7f44112d3700 1 -- 172.21.15.69:0/3033945126 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c1102c0 con 0x7f440c1004b0 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.326+0000 7f43f3fff700 1 -- 172.21.15.69:0/3033945126 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc00f620 con 0x7f440c1004b0 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.326+0000 7f44112d3700 1 -- 172.21.15.69:0/3033945126 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c110130 con 0x7f440c1004b0 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.328+0000 7f43f3fff700 1 -- 172.21.15.69:0/3033945126 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f43fc010460 con 0x7f440c1004b0 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.329+0000 7f43f3fff700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f43f40a13d0 0x7f43f40a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.329+0000 7f440a7fc700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f43f40a13d0 0x7f43f40a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.329+0000 7f43f3fff700 1 -- 172.21.15.69:0/3033945126 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f43fc0cd1e0 con 0x7f440c1004b0 2023-12-14T14:11:01.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.329+0000 7f440a7fc700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f43f40a13d0 0x7f43f40a3880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f440000b580 tx=0x7f4400005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.329+0000 7f441d461b80 1 Processor -- start 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f441d461b80 1 -- start start 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f441d461b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739380 0x561503739750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f441d461b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 0x561503744610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f441d461b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503744b50 0x561503746f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f441d461b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615036235e0 con 0x561503744b50 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f441d461b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561503692870 con 0x561503739c90 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f441d461b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56150368bd00 con 0x561503739380 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503744b50 0x561503746f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503744b50 0x561503746f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42484/0 (socket says 172.21.15.69:42484) 2023-12-14T14:11:01.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440b7fe700 1 -- 172.21.15.69:0/3919305867 learned_addr learned my addr 172.21.15.69:0/3919305867 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440affd700 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739380 0x561503739750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440a7fc700 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 0x561503744610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440b7fe700 1 -- 172.21.15.69:0/3919305867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739380 msgr2=0x561503739750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440b7fe700 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739380 0x561503739750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440b7fe700 1 -- 172.21.15.69:0/3919305867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 msgr2=0x561503744610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440b7fe700 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 0x561503744610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440b7fe700 1 -- 172.21.15.69:0/3919305867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56150350d3b0 con 0x561503744b50 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440affd700 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739380 0x561503739750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f440b7fe700 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503744b50 0x561503746f30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4404009dd0 tx=0x7f44040077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fff8800e278328a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.330+0000 7f43f17fa700 1 -- 172.21.15.69:0/3919305867 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404018070 con 0x561503744b50 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f43f17fa700 1 -- 172.21.15.69:0/3919305867 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f440400f050 con 0x561503744b50 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f43f17fa700 1 -- 172.21.15.69:0/3919305867 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404005a40 con 0x561503744b50 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f441d461b80 1 -- 172.21.15.69:0/3919305867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503744b50 msgr2=0x561503746f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f441d461b80 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503744b50 0x561503746f30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4404009dd0 tx=0x7f44040077e0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f441d461b80 1 -- 172.21.15.69:0/3919305867 shutdown_connections 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f441d461b80 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503744b50 0x561503746f30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f441d461b80 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739380 0x561503739750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f441d461b80 1 --2- 172.21.15.69:0/3919305867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 0x561503744610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f441d461b80 1 -- 172.21.15.69:0/3919305867 >> 172.21.15.69:0/3919305867 conn(0x56150372fca0 msgr2=0x5615037357e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f441d461b80 1 -- 172.21.15.69:0/3919305867 shutdown_connections 2023-12-14T14:11:01.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.331+0000 7f441d461b80 1 -- 172.21.15.69:0/3919305867 wait complete. 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f441d461b80 1 -- start start 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f441d461b80 1 Processor -- start 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f441d461b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f441d461b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 0x561503741780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f441d461b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503744b50 0x561503741d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f441d461b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561503627f90 con 0x561503739380 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f441d461b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561503627c30 con 0x561503744b50 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f441d461b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56150350f6a0 con 0x561503739c90 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f441d461b80 10 client.0 _ll_register_callbacks cb 0x56150364b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42492/0 (socket says 172.21.15.69:42492) 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440affd700 1 -- 172.21.15.69:0/2322158290 learned_addr learned my addr 172.21.15.69:0/2322158290 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440a7fc700 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 0x561503741780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440b7fe700 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503744b50 0x561503741d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440affd700 1 -- 172.21.15.69:0/2322158290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 msgr2=0x561503741780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440affd700 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 0x561503741780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440affd700 1 -- 172.21.15.69:0/2322158290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503744b50 msgr2=0x561503741d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440affd700 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503744b50 0x561503741d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440affd700 1 -- 172.21.15.69:0/2322158290 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4404009a00 con 0x561503739380 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.332+0000 7f440b7fe700 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503744b50 0x561503741d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f440affd700 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f43fc096b90 tx=0x7f43fc099a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbbe9914cda7ada server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f43eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f43eeff5700 1 -- 172.21.15.69:0/2322158290 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc010910 con 0x561503739380 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f43eeff5700 1 -- 172.21.15.69:0/2322158290 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f43fc0a2570 con 0x561503739380 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f441d461b80 1 -- 172.21.15.69:0/2322158290 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56150372d2b0 con 0x561503739380 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f43eeff5700 1 -- 172.21.15.69:0/2322158290 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43fc0cad10 con 0x561503739380 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f441d461b80 10 client.15510 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f441d461b80 1 -- 172.21.15.69:0/2322158290 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x561503652170 con 0x561503739380 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f43eeff5700 1 -- 172.21.15.69:0/2322158290 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56150372d2b0 con 0x561503739380 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f43eeff5700 1 -- 172.21.15.69:0/2322158290 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f43fc0a20e0 con 0x561503739380 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f441d461b80 10 client.15510 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:01.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f441d461b80 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f441d461b80 20 client.15510 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f441d461b80 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x561503754330 0x561503756710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f441d461b80 4 client.15510 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.333+0000 7f441d461b80 1 -- 172.21.15.69:0/2322158290 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561503684ce0 con 0x561503754330 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.334+0000 7f440a7fc700 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x561503754330 0x561503756710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.334+0000 7f43eeff5700 10 client.15510 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.334+0000 7f440a7fc700 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x561503754330 0x561503756710 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e1c3a712624d73 server_cookie=fa9f8dc697afa3bd in_seq=0 out_seq=0 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f43eeff5700 1 -- 172.21.15.69:0/2322158290 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561503684ce0 con 0x561503754330 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f43eeff5700 10 client.15510 handle_command_reply: tid=0 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 client.15510 shutdown 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 -- 172.21.15.69:0/2322158290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 msgr2=0x5615037444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f43fc096b90 tx=0x7f43fc099a80 comp rx=0 tx=0).stop 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 -- 172.21.15.69:0/2322158290 shutdown_connections 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x561503754330 0x561503756710 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503744b50 0x561503741d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 --2- 172.21.15.69:0/2322158290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 0x561503741780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f43eeff5700 0 client.15510 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 -- 172.21.15.69:0/2322158290 >> 172.21.15.69:0/2322158290 conn(0x56150372fca0 msgr2=0x5615037353d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 -- 172.21.15.69:0/2322158290 shutdown_connections 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 1 -- 172.21.15.69:0/2322158290 wait complete. 2023-12-14T14:11:01.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.335+0000 7f441d461b80 20 client.15510 trim_cache size 0 max 16384 2023-12-14T14:11:01.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f441d461b80 1 Processor -- start 2023-12-14T14:11:01.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f441d461b80 1 -- start start 2023-12-14T14:11:01.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f441d461b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56150372fca0 0x561503743f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f441d461b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f441d461b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 0x56150373cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f441d461b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56150373a5b0 con 0x561503739380 2023-12-14T14:11:01.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f441d461b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561503742320 con 0x561503739c90 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f441d461b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56150373fd00 con 0x56150372fca0 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f440a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f440a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42494/0 (socket says 172.21.15.69:42494) 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.352+0000 7f440a7fc700 1 -- 172.21.15.69:0/697594818 learned_addr learned my addr 172.21.15.69:0/697594818 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440b7fe700 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 0x56150373cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440affd700 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56150372fca0 0x561503743f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440a7fc700 1 -- 172.21.15.69:0/697594818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56150372fca0 msgr2=0x561503743f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440a7fc700 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56150372fca0 0x561503743f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440a7fc700 1 -- 172.21.15.69:0/697594818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 msgr2=0x56150373cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440a7fc700 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 0x56150373cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440a7fc700 1 -- 172.21.15.69:0/697594818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561503651ec0 con 0x561503739380 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440affd700 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56150372fca0 0x561503743f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440b7fe700 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 0x56150373cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f440a7fc700 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f44000099c0 tx=0x7f4400022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5961b002d34fcc26 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f43f1ffb700 1 -- 172.21.15.69:0/697594818 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400034c50 con 0x561503739380 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f43f1ffb700 1 -- 172.21.15.69:0/697594818 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f440002c040 con 0x561503739380 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.353+0000 7f43f1ffb700 1 -- 172.21.15.69:0/697594818 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000bbc0 con 0x561503739380 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 -- 172.21.15.69:0/697594818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 msgr2=0x5615037444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f44000099c0 tx=0x7f4400022000 comp rx=0 tx=0).stop 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 -- 172.21.15.69:0/697594818 shutdown_connections 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561503739c90 0x56150373cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56150372fca0 0x561503743f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 --2- 172.21.15.69:0/697594818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x5615037444d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 -- 172.21.15.69:0/697594818 >> 172.21.15.69:0/697594818 conn(0x561503747200 msgr2=0x561503750860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 -- 172.21.15.69:0/697594818 shutdown_connections 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 -- 172.21.15.69:0/697594818 wait complete. 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 -- start start 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 Processor -- start 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56150372fca0 0x56150374b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x561503749ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 0x56150374a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56150374a710 con 0x561503739380 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56150374a880 con 0x56150372fca0 2023-12-14T14:11:01.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615037a81a0 con 0x561503739c90 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f441d461b80 10 client.0 _ll_register_callbacks cb 0x7f43fc099ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f440a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x561503749ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.354+0000 7f440affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56150372fca0 0x56150374b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x561503749ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42506/0 (socket says 172.21.15.69:42506) 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56150372fca0 0x56150374b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:36760/0 (socket says 172.21.15.69:36760) 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440a7fc700 1 -- 172.21.15.69:0/1370096840 learned_addr learned my addr 172.21.15.69:0/1370096840 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440b7fe700 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 0x56150374a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440a7fc700 1 -- 172.21.15.69:0/1370096840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 msgr2=0x56150374a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440a7fc700 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 0x56150374a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440a7fc700 1 -- 172.21.15.69:0/1370096840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56150372fca0 msgr2=0x56150374b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440a7fc700 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56150372fca0 0x56150374b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440a7fc700 1 -- 172.21.15.69:0/1370096840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c10d900 con 0x561503739380 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440b7fe700 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 0x56150374a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f440a7fc700 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x561503749ac0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f44000098e0 tx=0x7f4400035a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e5edbd4921c910 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f43eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f43eeff5700 1 -- 172.21.15.69:0/1370096840 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400034250 con 0x561503739380 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f43eeff5700 1 -- 172.21.15.69:0/1370096840 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f44000343b0 con 0x561503739380 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f441d461b80 1 -- 172.21.15.69:0/1370096840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f440400f050 con 0x561503739380 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f43eeff5700 1 -- 172.21.15.69:0/1370096840 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4400034570 con 0x561503739380 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f441d461b80 10 client.15516 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f441d461b80 1 -- 172.21.15.69:0/1370096840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5615036389a0 con 0x561503739380 2023-12-14T14:11:01.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.355+0000 7f43eeff5700 1 -- 172.21.15.69:0/1370096840 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f440400f050 con 0x561503739380 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f43eeff5700 1 -- 172.21.15.69:0/1370096840 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4400003ca0 con 0x561503739380 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f441d461b80 10 client.15516 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f441d461b80 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f441d461b80 20 client.15516 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f441d461b80 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x561503744b50 0x5615037ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f441d461b80 4 client.15516 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f441d461b80 1 -- 172.21.15.69:0/1370096840 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561503684a00 con 0x561503744b50 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f440affd700 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x561503744b50 0x5615037ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f43eeff5700 10 client.15516 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f440affd700 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x561503744b50 0x5615037ab2c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22509f5b2cda47cd server_cookie=2f13653e086ab182 in_seq=0 out_seq=0 2023-12-14T14:11:01.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f43eeff5700 1 -- 172.21.15.69:0/1370096840 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561503684a00 con 0x561503744b50 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f43eeff5700 10 client.15516 handle_command_reply: tid=0 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.356+0000 7f441d461b80 1 client.15516 shutdown 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 -- 172.21.15.69:0/1370096840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 msgr2=0x561503749ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x561503749ac0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f44000098e0 tx=0x7f4400035a60 comp rx=0 tx=0).stop 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 -- 172.21.15.69:0/1370096840 shutdown_connections 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x561503744b50 0x5615037ab2c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561503739c90 0x56150374a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56150372fca0 0x56150374b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f43eeff5700 0 client.15516 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 --2- 172.21.15.69:0/1370096840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561503739380 0x561503749ac0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 -- 172.21.15.69:0/1370096840 >> 172.21.15.69:0/1370096840 conn(0x561503747200 msgr2=0x56150373cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 -- 172.21.15.69:0/1370096840 shutdown_connections 2023-12-14T14:11:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 1 -- 172.21.15.69:0/1370096840 wait complete. 2023-12-14T14:11:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f441d461b80 20 client.15516 trim_cache size 0 max 16384 2023-12-14T14:11:01.367 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:11:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:11:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:11:01.367 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:11:01.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 -- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f43f40a13d0 msgr2=0x7f43f40a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f43f40a13d0 0x7f43f40a3880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f440000b580 tx=0x7f4400005fb0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 -- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c1004b0 msgr2=0x7f440c196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c1004b0 0x7f440c196410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00d950 tx=0x7f43fc00dd10 comp rx=0 tx=0).stop 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 -- 172.21.15.69:0/3033945126 shutdown_connections 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f43f40a13d0 0x7f43f40a3880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f440c1054f0 0x7f440c19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f440c1004b0 0x7f440c196410 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 --2- 172.21.15.69:0/3033945126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f440c100e50 0x7f440c196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 -- 172.21.15.69:0/3033945126 >> 172.21.15.69:0/3033945126 conn(0x7f440c0fbd40 msgr2=0x7f440c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 -- 172.21.15.69:0/3033945126 shutdown_connections 2023-12-14T14:11:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.357+0000 7f44112d3700 1 -- 172.21.15.69:0/3033945126 wait complete. 2023-12-14T14:11:01.370 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:11:01.371 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:11:01.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.535+0000 7f1c61107700 1 -- 172.21.15.69:0/3061688220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c0ffd30 msgr2=0x7f1c5c103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.535+0000 7f1c61107700 1 --2- 172.21.15.69:0/3061688220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c0ffd30 0x7f1c5c103cf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1c500099c0 tx=0x7f1c50009cd0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.535+0000 7f1c61107700 1 -- 172.21.15.69:0/3061688220 shutdown_connections 2023-12-14T14:11:01.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.535+0000 7f1c61107700 1 --2- 172.21.15.69:0/3061688220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5c1043d0 0x7f1c5c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.535+0000 7f1c61107700 1 --2- 172.21.15.69:0/3061688220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c5c0ff390 0x7f1c5c0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.535+0000 7f1c61107700 1 --2- 172.21.15.69:0/3061688220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c0ffd30 0x7f1c5c103cf0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.535+0000 7f1c61107700 1 -- 172.21.15.69:0/3061688220 >> 172.21.15.69:0/3061688220 conn(0x7f1c5c076370 msgr2=0x7f1c5c076770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.535+0000 7f1c61107700 1 -- 172.21.15.69:0/3061688220 shutdown_connections 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.535+0000 7f1c61107700 1 -- 172.21.15.69:0/3061688220 wait complete. 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.536+0000 7f1c61107700 1 Processor -- start 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.536+0000 7f1c61107700 1 -- start start 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.536+0000 7f1c61107700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5c0ff390 0x7f1c5c100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.536+0000 7f1c61107700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c5c0ffd30 0x7f1c5c1012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.536+0000 7f1c61107700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c1043d0 0x7f1c5c1a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.536+0000 7f1c61107700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c101b00 con 0x7f1c5c1043d0 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.536+0000 7f1c61107700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c1a4b90 con 0x7f1c5c0ff390 2023-12-14T14:11:01.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.536+0000 7f1c61107700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c1a4cd0 con 0x7f1c5c0ffd30 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5b59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c1043d0 0x7f1c5c1a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5b59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c1043d0 0x7f1c5c1a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42528/0 (socket says 172.21.15.69:42528) 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5b59e700 1 -- 172.21.15.69:0/1432418425 learned_addr learned my addr 172.21.15.69:0/1432418425 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5a59c700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c5c0ffd30 0x7f1c5c1012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5ad9d700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5c0ff390 0x7f1c5c100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5b59e700 1 -- 172.21.15.69:0/1432418425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c5c0ffd30 msgr2=0x7f1c5c1012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5b59e700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c5c0ffd30 0x7f1c5c1012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5b59e700 1 -- 172.21.15.69:0/1432418425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5c0ff390 msgr2=0x7f1c5c100d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5b59e700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5c0ff390 0x7f1c5c100d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5b59e700 1 -- 172.21.15.69:0/1432418425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c500095f0 con 0x7f1c5c1043d0 2023-12-14T14:11:01.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c5b59e700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c1043d0 0x7f1c5c1a4650 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1c54007ee0 tx=0x7f1c5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c43fff700 1 -- 172.21.15.69:0/1432418425 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400dd20 con 0x7f1c5c1043d0 2023-12-14T14:11:01.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c10f1a0 con 0x7f1c5c1043d0 2023-12-14T14:11:01.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c43fff700 1 -- 172.21.15.69:0/1432418425 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c5400f040 con 0x7f1c5c1043d0 2023-12-14T14:11:01.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c43fff700 1 -- 172.21.15.69:0/1432418425 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540048a0 con 0x7f1c5c1043d0 2023-12-14T14:11:01.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.537+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c10f010 con 0x7f1c5c1043d0 2023-12-14T14:11:01.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.538+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c10f330 con 0x7f1c5c1043d0 2023-12-14T14:11:01.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.540+0000 7f1c43fff700 1 -- 172.21.15.69:0/1432418425 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f1c54003a00 con 0x7f1c5c1043d0 2023-12-14T14:11:01.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.540+0000 7f1c43fff700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c440a1350 0x7f1c440a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.540+0000 7f1c5ad9d700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c440a1350 0x7f1c440a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.541+0000 7f1c43fff700 1 -- 172.21.15.69:0/1432418425 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f1c540ccea0 con 0x7f1c5c1043d0 2023-12-14T14:11:01.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.541+0000 7f1c5ad9d700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c440a1350 0x7f1c440a3800 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c005950 tx=0x7f1c4c00b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.543+0000 7f1c43fff700 1 -- 172.21.15.69:0/1432418425 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1c54096120 con 0x7f1c5c1043d0 2023-12-14T14:11:01.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:01 smithi069 ceph-mon[42034]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T14:11:01.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:01 smithi081 ceph-mon[43371]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T14:11:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:01 smithi119 ceph-mon[43834]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T14:11:01.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.785+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c5c0679f0 con 0x7f1c5c1043d0 2023-12-14T14:11:01.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.786+0000 7f1c43fff700 1 -- 172.21.15.69:0/1432418425 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f1c54099740 con 0x7f1c5c1043d0 2023-12-14T14:11:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:11:01.786 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:11:01.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c440a1350 msgr2=0x7f1c440a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c440a1350 0x7f1c440a3800 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c005950 tx=0x7f1c4c00b410 comp rx=0 tx=0).stop 2023-12-14T14:11:01.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c1043d0 msgr2=0x7f1c5c1a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c1043d0 0x7f1c5c1a4650 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1c54007ee0 tx=0x7f1c5400d3b0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 shutdown_connections 2023-12-14T14:11:01.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c440a1350 0x7f1c440a3800 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c5c1043d0 0x7f1c5c1a4650 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5c0ff390 0x7f1c5c100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 --2- 172.21.15.69:0/1432418425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c5c0ffd30 0x7f1c5c1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 >> 172.21.15.69:0/1432418425 conn(0x7f1c5c076370 msgr2=0x7f1c5c067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 shutdown_connections 2023-12-14T14:11:01.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.788+0000 7f1c61107700 1 -- 172.21.15.69:0/1432418425 wait complete. 2023-12-14T14:11:01.790 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:11:01.801 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.928+0000 7f526a100700 1 -- 172.21.15.69:0/22221891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f526410acf0 msgr2=0x7f526410d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.928+0000 7f526a100700 1 --2- 172.21.15.69:0/22221891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f526410acf0 0x7f526410d0d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b0a0 tx=0x7f525c00b3b0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.928+0000 7f526a100700 1 -- 172.21.15.69:0/22221891 shutdown_connections 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.928+0000 7f526a100700 1 --2- 172.21.15.69:0/22221891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f526410acf0 0x7f526410d0d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.928+0000 7f526a100700 1 --2- 172.21.15.69:0/22221891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52640ff430 0x7f52640ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.928+0000 7f526a100700 1 --2- 172.21.15.69:0/22221891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52640ffd40 0x7f526410a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.928+0000 7f526a100700 1 -- 172.21.15.69:0/22221891 >> 172.21.15.69:0/22221891 conn(0x7f52640749c0 msgr2=0x7f5264074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.928+0000 7f526a100700 1 -- 172.21.15.69:0/22221891 shutdown_connections 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.928+0000 7f526a100700 1 -- 172.21.15.69:0/22221891 wait complete. 2023-12-14T14:11:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f526a100700 1 Processor -- start 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f526a100700 1 -- start start 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f526a100700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52640ff430 0x7f5264196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f526a100700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52640ffd40 0x7f5264196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f526a100700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f526410acf0 0x7f526419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f526a100700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526419b400 con 0x7f52640ff430 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f526a100700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526419b570 con 0x7f526410acf0 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f526a100700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526419b730 con 0x7f52640ffd40 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f52637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52640ff430 0x7f5264196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f52637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52640ff430 0x7f5264196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42540/0 (socket says 172.21.15.69:42540) 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f52637fe700 1 -- 172.21.15.69:0/41667675 learned_addr learned my addr 172.21.15.69:0/41667675 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f5262ffd700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52640ffd40 0x7f5264196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f5263fff700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f526410acf0 0x7f526419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f52637fe700 1 -- 172.21.15.69:0/41667675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52640ffd40 msgr2=0x7f5264196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f52637fe700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52640ffd40 0x7f5264196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f52637fe700 1 -- 172.21.15.69:0/41667675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f526410acf0 msgr2=0x7f526419adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f52637fe700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f526410acf0 0x7f526419adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.929+0000 7f52637fe700 1 -- 172.21.15.69:0/41667675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c009d00 con 0x7f52640ff430 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.930+0000 7f52637fe700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52640ff430 0x7f5264196420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f525800e9a0 tx=0x7f525800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.930+0000 7f5260ff9700 1 -- 172.21.15.69:0/41667675 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258009790 con 0x7f52640ff430 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.930+0000 7f5260ff9700 1 -- 172.21.15.69:0/41667675 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f525800cbd0 con 0x7f52640ff430 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.930+0000 7f5260ff9700 1 -- 172.21.15.69:0/41667675 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258018680 con 0x7f52640ff430 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.930+0000 7f526a100700 1 -- 172.21.15.69:0/41667675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52641102f0 con 0x7f52640ff430 2023-12-14T14:11:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.930+0000 7f526a100700 1 -- 172.21.15.69:0/41667675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5264110160 con 0x7f52640ff430 2023-12-14T14:11:01.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.932+0000 7f5260ff9700 1 -- 172.21.15.69:0/41667675 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f525800cd40 con 0x7f52640ff430 2023-12-14T14:11:01.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.932+0000 7f5260ff9700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f524c0a13d0 0x7f524c0a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.933+0000 7f5262ffd700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f524c0a13d0 0x7f524c0a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.933+0000 7f5260ff9700 1 -- 172.21.15.69:0/41667675 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f5258014070 con 0x7f52640ff430 2023-12-14T14:11:01.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.933+0000 7f5262ffd700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f524c0a13d0 0x7f524c0a3880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5264197a30 tx=0x7f5254009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f527628eb80 1 Processor -- start 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f527628eb80 1 -- start start 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f527628eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df8e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f527628eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df99610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f527628eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 0x56527df9bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f527628eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527de785e0 con 0x56527df8e380 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f527628eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527dee7870 con 0x56527df99b50 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f527628eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527dee0d00 con 0x56527df8ec90 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f52637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df8e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f52637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df8e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42552/0 (socket says 172.21.15.69:42552) 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f52637fe700 1 -- 172.21.15.69:0/2909222223 learned_addr learned my addr 172.21.15.69:0/2909222223 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.934+0000 7f5262ffd700 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df99610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f5263fff700 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 0x56527df9bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f52637fe700 1 -- 172.21.15.69:0/2909222223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 msgr2=0x56527df99610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f52637fe700 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df99610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f52637fe700 1 -- 172.21.15.69:0/2909222223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 msgr2=0x56527df9bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f52637fe700 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 0x56527df9bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f52637fe700 1 -- 172.21.15.69:0/2909222223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56527dd623b0 con 0x56527df8e380 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f5262ffd700 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df99610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f52637fe700 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df8e750 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f525809a0b0 tx=0x7f525809a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcac42e5f00e127 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f5249ffb700 1 -- 172.21.15.69:0/2909222223 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525809a380 con 0x56527df8e380 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f5249ffb700 1 -- 172.21.15.69:0/2909222223 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f525809a4e0 con 0x56527df8e380 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.935+0000 7f5249ffb700 1 -- 172.21.15.69:0/2909222223 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580a2340 con 0x56527df8e380 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 -- 172.21.15.69:0/2909222223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 msgr2=0x56527df8e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df8e750 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f525809a0b0 tx=0x7f525809a120 comp rx=0 tx=0).stop 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 -- 172.21.15.69:0/2909222223 shutdown_connections 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 0x56527df9bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df8e750 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 --2- 172.21.15.69:0/2909222223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df99610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 -- 172.21.15.69:0/2909222223 >> 172.21.15.69:0/2909222223 conn(0x56527df84ca0 msgr2=0x56527df8a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 -- 172.21.15.69:0/2909222223 shutdown_connections 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 -- 172.21.15.69:0/2909222223 wait complete. 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 -- start start 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.936+0000 7f527628eb80 1 Processor -- start 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f527628eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8e380 0x56527df994f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f527628eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df96810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f527628eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df99b50 0x56527df96e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f527628eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527de7cf90 con 0x56527df99b50 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f527628eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527de7cc30 con 0x56527df8e380 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f527628eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527dd646a0 con 0x56527df8ec90 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f527628eb80 10 client.0 _ll_register_callbacks cb 0x56527dea0910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5263fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df99b50 0x56527df96e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f52637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8e380 0x56527df994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5263fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df99b50 0x56527df96e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42566/0 (socket says 172.21.15.69:42566) 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5263fff700 1 -- 172.21.15.69:0/1841743292 learned_addr learned my addr 172.21.15.69:0/1841743292 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5262ffd700 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df96810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5263fff700 1 -- 172.21.15.69:0/1841743292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 msgr2=0x56527df96810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5263fff700 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df96810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5263fff700 1 -- 172.21.15.69:0/1841743292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8e380 msgr2=0x56527df994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5263fff700 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8e380 0x56527df994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5263fff700 1 -- 172.21.15.69:0/1841743292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5264110160 con 0x56527df99b50 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5262ffd700 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df96810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f52637fe700 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8e380 0x56527df994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5263fff700 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df99b50 0x56527df96e40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b780 tx=0x7f525c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5949122e3395281 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5242ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5242ffd700 1 -- 172.21.15.69:0/1841743292 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00e040 con 0x56527df99b50 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f5242ffd700 1 -- 172.21.15.69:0/1841743292 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f525c0074e0 con 0x56527df99b50 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.937+0000 7f527628eb80 1 -- 172.21.15.69:0/1841743292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56527df822b0 con 0x56527df99b50 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f5242ffd700 1 -- 172.21.15.69:0/1841743292 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f525c004e60 con 0x56527df99b50 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f527628eb80 10 client.15534 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f527628eb80 1 -- 172.21.15.69:0/1841743292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56527dea7170 con 0x56527df99b50 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f5242ffd700 1 -- 172.21.15.69:0/1841743292 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56527df822b0 con 0x56527df99b50 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f5242ffd700 1 -- 172.21.15.69:0/1841743292 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f525c019050 con 0x56527df99b50 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f527628eb80 10 client.15534 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f527628eb80 10 client.15534 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f527628eb80 20 client.15534 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f527628eb80 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56527dfa9560 0x56527dfab970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f527628eb80 4 client.15534 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f527628eb80 1 -- 172.21.15.69:0/1841743292 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56527ded9ce0 con 0x56527dfa9560 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.938+0000 7f52637fe700 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56527dfa9560 0x56527dfab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.939+0000 7f5242ffd700 10 client.15534 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.939+0000 7f52637fe700 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56527dfa9560 0x56527dfab970 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5193e07c40dd3dc server_cookie=9457787c23f2ab8c in_seq=0 out_seq=0 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.939+0000 7f5242ffd700 1 -- 172.21.15.69:0/1841743292 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56527ded9ce0 con 0x56527dfa9560 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.939+0000 7f5242ffd700 10 client.15534 handle_command_reply: tid=0 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.939+0000 7f527628eb80 1 client.15534 shutdown 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.939+0000 7f527628eb80 1 -- 172.21.15.69:0/1841743292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df99b50 msgr2=0x56527df96e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.939+0000 7f527628eb80 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df99b50 0x56527df96e40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b780 tx=0x7f525c00bce0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f527628eb80 1 -- 172.21.15.69:0/1841743292 shutdown_connections 2023-12-14T14:11:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f527628eb80 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56527dfa9560 0x56527dfab970 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f527628eb80 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df99b50 0x56527df96e40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f527628eb80 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8e380 0x56527df994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f527628eb80 1 --2- 172.21.15.69:0/1841743292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8ec90 0x56527df96810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f527628eb80 1 -- 172.21.15.69:0/1841743292 >> 172.21.15.69:0/1841743292 conn(0x56527df84ca0 msgr2=0x56527df8a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f5242ffd700 0 client.15534 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:11:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f527628eb80 1 -- 172.21.15.69:0/1841743292 shutdown_connections 2023-12-14T14:11:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f527628eb80 1 -- 172.21.15.69:0/1841743292 wait complete. 2023-12-14T14:11:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.940+0000 7f527628eb80 20 client.15534 trim_cache size 0 max 16384 2023-12-14T14:11:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.952+0000 7f527628eb80 1 Processor -- start 2023-12-14T14:11:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.952+0000 7f527628eb80 1 -- start start 2023-12-14T14:11:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f527628eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df99020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f527628eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8ec90 0x56527df91b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f527628eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df99b50 0x56527df92090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f527628eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527df8f5b0 con 0x56527df8e380 2023-12-14T14:11:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f527628eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527df8b3b0 con 0x56527df8ec90 2023-12-14T14:11:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f527628eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527df94db0 con 0x56527df99b50 2023-12-14T14:11:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f52637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df99020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f52637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df99020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42568/0 (socket says 172.21.15.69:42568) 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f52637fe700 1 -- 172.21.15.69:0/2712194350 learned_addr learned my addr 172.21.15.69:0/2712194350 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f5262ffd700 1 --2- 172.21.15.69:0/2712194350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8ec90 0x56527df91b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f5263fff700 1 --2- 172.21.15.69:0/2712194350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df99b50 0x56527df92090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f52637fe700 1 -- 172.21.15.69:0/2712194350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df99b50 msgr2=0x56527df92090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f52637fe700 1 --2- 172.21.15.69:0/2712194350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df99b50 0x56527df92090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f52637fe700 1 -- 172.21.15.69:0/2712194350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8ec90 msgr2=0x56527df91b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f52637fe700 1 --2- 172.21.15.69:0/2712194350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8ec90 0x56527df91b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f52637fe700 1 -- 172.21.15.69:0/2712194350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56527df864e0 con 0x56527df8e380 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f52637fe700 1 --2- 172.21.15.69:0/2712194350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df99020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f525800f010 tx=0x7f525800efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b112de2dd960cc server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f524a7fc700 1 -- 172.21.15.69:0/2712194350 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580ca790 con 0x56527df8e380 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f524a7fc700 1 -- 172.21.15.69:0/2712194350 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5258096480 con 0x56527df8e380 2023-12-14T14:11:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.953+0000 7f524a7fc700 1 -- 172.21.15.69:0/2712194350 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258099470 con 0x56527df8e380 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 -- 172.21.15.69:0/2712194350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 msgr2=0x56527df99020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 --2- 172.21.15.69:0/2712194350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df99020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f525800f010 tx=0x7f525800efa0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 -- 172.21.15.69:0/2712194350 shutdown_connections 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 --2- 172.21.15.69:0/2712194350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df99b50 0x56527df92090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 --2- 172.21.15.69:0/2712194350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8e380 0x56527df99020 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 --2- 172.21.15.69:0/2712194350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df8ec90 0x56527df91b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 -- 172.21.15.69:0/2712194350 >> 172.21.15.69:0/2712194350 conn(0x56527df84ca0 msgr2=0x56527dfab570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 -- 172.21.15.69:0/2712194350 shutdown_connections 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 -- 172.21.15.69:0/2712194350 wait complete. 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.954+0000 7f527628eb80 1 -- start start 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f527628eb80 1 Processor -- start 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f527628eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8e380 0x56527dfa0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f527628eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8ec90 0x56527df9e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f527628eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 0x56527df9edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f527628eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527df9f4c0 con 0x56527df8ec90 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f527628eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527dffc3e0 con 0x56527df99b50 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f527628eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56527dffc520 con 0x56527df8e380 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f527628eb80 10 client.0 _ll_register_callbacks cb 0x7f5258005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f5262ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8ec90 0x56527df9e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f5262ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8ec90 0x56527df9e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42574/0 (socket says 172.21.15.69:42574) 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f5262ffd700 1 -- 172.21.15.69:0/233698209 learned_addr learned my addr 172.21.15.69:0/233698209 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f52637fe700 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8e380 0x56527dfa0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f5263fff700 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 0x56527df9edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f5262ffd700 1 -- 172.21.15.69:0/233698209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8e380 msgr2=0x56527dfa0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f5262ffd700 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8e380 0x56527dfa0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f5262ffd700 1 -- 172.21.15.69:0/233698209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 msgr2=0x56527df9edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f5262ffd700 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 0x56527df9edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.955+0000 7f5262ffd700 1 -- 172.21.15.69:0/233698209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56527dd623b0 con 0x56527df8ec90 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f5262ffd700 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8ec90 0x56527df9e670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x56527df8bb90 tx=0x7f52540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524ec13617c8c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f5242ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f5242ffd700 1 -- 172.21.15.69:0/233698209 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254025070 con 0x56527df8ec90 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f5242ffd700 1 -- 172.21.15.69:0/233698209 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f5254018070 con 0x56527df8ec90 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f527628eb80 1 -- 172.21.15.69:0/233698209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56527ded9a00 con 0x56527df8ec90 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f5242ffd700 1 -- 172.21.15.69:0/233698209 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f525402a460 con 0x56527df8ec90 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f527628eb80 10 client.15540 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f527628eb80 1 -- 172.21.15.69:0/233698209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56527dd0eb60 con 0x56527df8ec90 2023-12-14T14:11:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f5242ffd700 1 -- 172.21.15.69:0/233698209 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56527ded9a00 con 0x56527df8ec90 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f5242ffd700 1 -- 172.21.15.69:0/233698209 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f525401f820 con 0x56527df8ec90 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f527628eb80 10 client.15540 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f527628eb80 10 client.15540 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f527628eb80 20 client.15540 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f527628eb80 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56527dffdc50 0x56527e000060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f527628eb80 4 client.15540 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.956+0000 7f527628eb80 1 -- 172.21.15.69:0/233698209 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56527dd2fcf0 con 0x56527dffdc50 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f52637fe700 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56527dffdc50 0x56527e000060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f5242ffd700 10 client.15540 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f52637fe700 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56527dffdc50 0x56527e000060 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2178c6ff7abee9fd server_cookie=18fdeb6a28dde793 in_seq=0 out_seq=0 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f5242ffd700 1 -- 172.21.15.69:0/233698209 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56527dd2fcf0 con 0x56527dffdc50 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f5242ffd700 10 client.15540 handle_command_reply: tid=0 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 client.15540 shutdown 2023-12-14T14:11:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 -- 172.21.15.69:0/233698209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8ec90 msgr2=0x56527df9e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8ec90 0x56527df9e670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x56527df8bb90 tx=0x7f52540047c0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 -- 172.21.15.69:0/233698209 shutdown_connections 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56527df99b50 0x56527df9edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56527df8e380 0x56527dfa0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56527dffdc50 0x56527e000060 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 --2- 172.21.15.69:0/233698209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56527df8ec90 0x56527df9e670 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f5242ffd700 0 client.15540 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 -- 172.21.15.69:0/233698209 >> 172.21.15.69:0/233698209 conn(0x56527df84ca0 msgr2=0x56527df91b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 -- 172.21.15.69:0/233698209 shutdown_connections 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.957+0000 7f527628eb80 1 -- 172.21.15.69:0/233698209 wait complete. 2023-12-14T14:11:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f527628eb80 20 client.15540 trim_cache size 0 max 16384 2023-12-14T14:11:01.966 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:11:01.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 -- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f524c0a13d0 msgr2=0x7f524c0a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f524c0a13d0 0x7f524c0a3880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5264197a30 tx=0x7f5254009260 comp rx=0 tx=0).stop 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 -- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52640ff430 msgr2=0x7f5264196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52640ff430 0x7f5264196420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f525800e9a0 tx=0x7f525800ed60 comp rx=0 tx=0).stop 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 -- 172.21.15.69:0/41667675 shutdown_connections 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f524c0a13d0 0x7f524c0a3880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f526410acf0 0x7f526419adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52640ff430 0x7f5264196420 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 --2- 172.21.15.69:0/41667675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52640ffd40 0x7f5264196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 -- 172.21.15.69:0/41667675 >> 172.21.15.69:0/41667675 conn(0x7f52640749c0 msgr2=0x7f52640fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 -- 172.21.15.69:0/41667675 shutdown_connections 2023-12-14T14:11:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:01.958+0000 7f526a100700 1 -- 172.21.15.69:0/41667675 wait complete. 2023-12-14T14:11:01.970 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:11:02.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 -- 172.21.15.69:0/1889324755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d700ff9b0 msgr2=0x7f0d700ffe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 --2- 172.21.15.69:0/1889324755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d700ff9b0 0x7f0d700ffe20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009990 tx=0x7f0d60009ca0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 -- 172.21.15.69:0/1889324755 shutdown_connections 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 --2- 172.21.15.69:0/1889324755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d7010a880 0x7f0d7010cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 --2- 172.21.15.69:0/1889324755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d700760f0 0x7f0d700ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 --2- 172.21.15.69:0/1889324755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d700ff9b0 0x7f0d700ffe20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 -- 172.21.15.69:0/1889324755 >> 172.21.15.69:0/1889324755 conn(0x7f0d70074a60 msgr2=0x7f0d70074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 -- 172.21.15.69:0/1889324755 shutdown_connections 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 -- 172.21.15.69:0/1889324755 wait complete. 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 Processor -- start 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.096+0000 7f0d76510700 1 -- start start 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d76510700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d700760f0 0x7f0d70196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d76510700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d700ff9b0 0x7f0d70196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d76510700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d7010a880 0x7f0d7019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d76510700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7019b300 con 0x7f0d7010a880 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d76510700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7019b470 con 0x7f0d700ff9b0 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d76510700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7019b630 con 0x7f0d700760f0 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d74aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d7010a880 0x7f0d7019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d74aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d7010a880 0x7f0d7019acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42586/0 (socket says 172.21.15.69:42586) 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d74aad700 1 -- 172.21.15.69:0/1024826219 learned_addr learned my addr 172.21.15.69:0/1024826219 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d700760f0 0x7f0d70196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d700ff9b0 0x7f0d70196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d74aad700 1 -- 172.21.15.69:0/1024826219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d700760f0 msgr2=0x7f0d70196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d74aad700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d700760f0 0x7f0d70196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d74aad700 1 -- 172.21.15.69:0/1024826219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d700ff9b0 msgr2=0x7f0d70196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d74aad700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d700ff9b0 0x7f0d70196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d74aad700 1 -- 172.21.15.69:0/1024826219 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600095f0 con 0x7f0d7010a880 2023-12-14T14:11:02.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d700760f0 0x7f0d70196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:02.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d700ff9b0 0x7f0d70196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:02.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d74aad700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d7010a880 0x7f0d7019acc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800ef90 tx=0x7f0d6800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d6d7fa700 1 -- 172.21.15.69:0/1024826219 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68018070 con 0x7f0d7010a880 2023-12-14T14:11:02.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d6d7fa700 1 -- 172.21.15.69:0/1024826219 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d6800f040 con 0x7f0d7010a880 2023-12-14T14:11:02.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.097+0000 7f0d76510700 1 -- 172.21.15.69:0/1024826219 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d70110270 con 0x7f0d7010a880 2023-12-14T14:11:02.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.098+0000 7f0d6d7fa700 1 -- 172.21.15.69:0/1024826219 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68003ea0 con 0x7f0d7010a880 2023-12-14T14:11:02.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.098+0000 7f0d76510700 1 -- 172.21.15.69:0/1024826219 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d701100e0 con 0x7f0d7010a880 2023-12-14T14:11:02.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.100+0000 7f0d6d7fa700 1 -- 172.21.15.69:0/1024826219 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f0d6800cb00 con 0x7f0d7010a880 2023-12-14T14:11:02.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.100+0000 7f0d6d7fa700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0d580a1350 0x7f0d580a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.100+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0d580a1350 0x7f0d580a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.100+0000 7f0d6d7fa700 1 -- 172.21.15.69:0/1024826219 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f0d680ccb10 con 0x7f0d7010a880 2023-12-14T14:11:02.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.101+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0d580a1350 0x7f0d580a3800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d64005950 tx=0x7f0d640058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.101+0000 7f0d8269eb80 1 Processor -- start 2023-12-14T14:11:02.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.101+0000 7f0d8269eb80 1 -- start start 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.101+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 0x55c7da134750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.101+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 0x55c7da13f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.101+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da141f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.101+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da01e5e0 con 0x55c7da13fb50 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.101+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da08d870 con 0x55c7da134c90 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.101+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da086d00 con 0x55c7da134380 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d74aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d6ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 0x55c7da134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d74aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da141f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42596/0 (socket says 172.21.15.69:42596) 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d74aad700 1 -- 172.21.15.69:0/3960514083 learned_addr learned my addr 172.21.15.69:0/3960514083 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 0x55c7da13f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d74aad700 1 -- 172.21.15.69:0/3960514083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 msgr2=0x55c7da134750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d74aad700 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 0x55c7da134750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d74aad700 1 -- 172.21.15.69:0/3960514083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 msgr2=0x55c7da13f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d74aad700 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 0x55c7da13f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d74aad700 1 -- 172.21.15.69:0/3960514083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7d9f083b0 con 0x55c7da13fb50 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 0x55c7da13f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 0x55c7da134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d74aad700 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da141f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0d68099ad0 tx=0x7f0d68099700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2732a1903ef108 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d567fc700 1 -- 172.21.15.69:0/3960514083 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6801b320 con 0x55c7da13fb50 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d567fc700 1 -- 172.21.15.69:0/3960514083 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d68099b40 con 0x55c7da13fb50 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.102+0000 7f0d567fc700 1 -- 172.21.15.69:0/3960514083 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68098000 con 0x55c7da13fb50 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3960514083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 msgr2=0x55c7da141f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da141f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0d68099ad0 tx=0x7f0d68099700 comp rx=0 tx=0).stop 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3960514083 shutdown_connections 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da141f30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 0x55c7da134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/3960514083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 0x55c7da13f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3960514083 >> 172.21.15.69:0/3960514083 conn(0x55c7da12aca0 msgr2=0x55c7da1307e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3960514083 shutdown_connections 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3960514083 wait complete. 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.103+0000 7f0d8269eb80 1 -- start start 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d8269eb80 1 Processor -- start 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da134380 0x55c7da13f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 0x55c7da13c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da13fb50 0x55c7da13ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da022f90 con 0x55c7da134380 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da022c30 con 0x55c7da13fb50 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7d9f0a6a0 con 0x55c7da134c90 2023-12-14T14:11:02.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d8269eb80 10 client.0 _ll_register_callbacks cb 0x55c7da046910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da134380 0x55c7da13f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da134380 0x55c7da13f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42598/0 (socket says 172.21.15.69:42598) 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6ffff700 1 -- 172.21.15.69:0/974838003 learned_addr learned my addr 172.21.15.69:0/974838003 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d74aad700 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da13fb50 0x55c7da13ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 0x55c7da13c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6ffff700 1 -- 172.21.15.69:0/974838003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 msgr2=0x55c7da13c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 0x55c7da13c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6ffff700 1 -- 172.21.15.69:0/974838003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da13fb50 msgr2=0x55c7da13ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da13fb50 0x55c7da13ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6ffff700 1 -- 172.21.15.69:0/974838003 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d701100e0 con 0x55c7da134380 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d74aad700 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da13fb50 0x55c7da13ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 0x55c7da13c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:02.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da134380 0x55c7da13f540 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0d640042e0 tx=0x7f0d64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac0bc669c22fe1f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.104+0000 7f0d4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/974838003 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64017040 con 0x55c7da134380 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/974838003 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f0d64003d10 con 0x55c7da134380 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d8269eb80 1 -- 172.21.15.69:0/974838003 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7da1282b0 con 0x55c7da134380 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/974838003 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d64011440 con 0x55c7da134380 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d8269eb80 10 client.15552 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d8269eb80 1 -- 172.21.15.69:0/974838003 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55c7da04d170 con 0x55c7da134380 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/974838003 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c7da1282b0 con 0x55c7da134380 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/974838003 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0d640204a0 con 0x55c7da134380 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d8269eb80 10 client.15552 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d8269eb80 10 client.15552 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d8269eb80 20 client.15552 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c7da14f390 0x55c7da1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d8269eb80 4 client.15552 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d8269eb80 1 -- 172.21.15.69:0/974838003 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7da07fce0 con 0x55c7da14f390 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.105+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c7da14f390 0x55c7da1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.106+0000 7f0d4f7fe700 10 client.15552 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.106+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c7da14f390 0x55c7da1517a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c66e79a0e42fa5ec server_cookie=ba1bacb6f5645dfd in_seq=0 out_seq=0 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.106+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/974838003 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c7da07fce0 con 0x55c7da14f390 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.106+0000 7f0d4f7fe700 10 client.15552 handle_command_reply: tid=0 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.106+0000 7f0d8269eb80 1 client.15552 shutdown 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 -- 172.21.15.69:0/974838003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da134380 msgr2=0x55c7da13f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da134380 0x55c7da13f540 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0d640042e0 tx=0x7f0d64004750 comp rx=0 tx=0).stop 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 -- 172.21.15.69:0/974838003 shutdown_connections 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da13fb50 0x55c7da13ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c7da14f390 0x55c7da1517a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da134380 0x55c7da13f540 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/974838003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 0x55c7da13c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 -- 172.21.15.69:0/974838003 >> 172.21.15.69:0/974838003 conn(0x55c7da12aca0 msgr2=0x55c7da130370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d4f7fe700 0 client.15552 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:11:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 -- 172.21.15.69:0/974838003 shutdown_connections 2023-12-14T14:11:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 1 -- 172.21.15.69:0/974838003 wait complete. 2023-12-14T14:11:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.107+0000 7f0d8269eb80 20 client.15552 trim_cache size 0 max 16384 2023-12-14T14:11:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d8269eb80 1 Processor -- start 2023-12-14T14:11:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d8269eb80 1 -- start start 2023-12-14T14:11:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 0x55c7da1513a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 0x55c7da13f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da13f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da130d60 con 0x55c7da13fb50 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da137690 con 0x55c7da134c90 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da14b3e0 con 0x55c7da134380 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d74aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da13f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d74aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da13f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42614/0 (socket says 172.21.15.69:42614) 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d74aad700 1 -- 172.21.15.69:0/3268273796 learned_addr learned my addr 172.21.15.69:0/3268273796 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/3268273796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 0x55c7da13f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/3268273796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 0x55c7da1513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d74aad700 1 -- 172.21.15.69:0/3268273796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 msgr2=0x55c7da1513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d74aad700 1 --2- 172.21.15.69:0/3268273796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 0x55c7da1513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d74aad700 1 -- 172.21.15.69:0/3268273796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 msgr2=0x55c7da13f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.121+0000 7f0d74aad700 1 --2- 172.21.15.69:0/3268273796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 0x55c7da13f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d74aad700 1 -- 172.21.15.69:0/3268273796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7da04cec0 con 0x55c7da13fb50 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d74aad700 1 --2- 172.21.15.69:0/3268273796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da13f540 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009fd0 tx=0x7f0d68009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6ce3ac8ffbc63b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d56ffd700 1 -- 172.21.15.69:0/3268273796 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680ca120 con 0x55c7da13fb50 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d56ffd700 1 -- 172.21.15.69:0/3268273796 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d6801b320 con 0x55c7da13fb50 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d56ffd700 1 -- 172.21.15.69:0/3268273796 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68097f70 con 0x55c7da13fb50 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3268273796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 msgr2=0x55c7da13f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/3268273796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da13f540 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009fd0 tx=0x7f0d68009e70 comp rx=0 tx=0).stop 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3268273796 shutdown_connections 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/3268273796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da13f540 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/3268273796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134380 0x55c7da1513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/3268273796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134c90 0x55c7da13f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3268273796 >> 172.21.15.69:0/3268273796 conn(0x55c7da12aca0 msgr2=0x55c7da14acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3268273796 shutdown_connections 2023-12-14T14:11:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.122+0000 7f0d8269eb80 1 -- 172.21.15.69:0/3268273796 wait complete. 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d8269eb80 1 -- start start 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d8269eb80 1 Processor -- start 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134380 0x55c7da146720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 0x55c7da144510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d8269eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da144a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da145140 con 0x55c7da13fb50 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da1452b0 con 0x55c7da134380 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d8269eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7da1a2250 con 0x55c7da134c90 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d8269eb80 10 client.0 _ll_register_callbacks cb 0x7f0d6400fcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d74aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d74aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42628/0 (socket says 172.21.15.69:42628) 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d74aad700 1 -- 172.21.15.69:0/197807040 learned_addr learned my addr 172.21.15.69:0/197807040 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134380 0x55c7da146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.123+0000 7f0d6f7fe700 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 0x55c7da144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d74aad700 1 -- 172.21.15.69:0/197807040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 msgr2=0x55c7da144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d74aad700 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 0x55c7da144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d74aad700 1 -- 172.21.15.69:0/197807040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134380 msgr2=0x55c7da146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d74aad700 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134380 0x55c7da146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d74aad700 1 -- 172.21.15.69:0/197807040 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7d9f083b0 con 0x55c7da13fb50 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d74aad700 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da144a50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0d68004eb0 tx=0x7f0d68099780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bed15d2c4e7a49 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/197807040 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6809db70 con 0x55c7da13fb50 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/197807040 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f0d68099030 con 0x55c7da13fb50 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d8269eb80 1 -- 172.21.15.69:0/197807040 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d68099b40 con 0x55c7da13fb50 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/197807040 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d680991f0 con 0x55c7da13fb50 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d8269eb80 10 client.15558 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:02.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d8269eb80 1 -- 172.21.15.69:0/197807040 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55c7da0339a0 con 0x55c7da13fb50 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/197807040 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d68099b40 con 0x55c7da13fb50 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/197807040 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0d68098aa0 con 0x55c7da13fb50 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d8269eb80 10 client.15558 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d8269eb80 10 client.15558 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d8269eb80 20 client.15558 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c7da1a33f0 0x55c7da1a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d8269eb80 4 client.15558 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.124+0000 7f0d8269eb80 1 -- 172.21.15.69:0/197807040 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c7da07fa00 con 0x55c7da1a33f0 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.125+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c7da1a33f0 0x55c7da1a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.125+0000 7f0d6ffff700 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c7da1a33f0 0x55c7da1a57d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=67a309c66326b09 server_cookie=bfcfdeec512c47ce in_seq=0 out_seq=0 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.125+0000 7f0d4f7fe700 10 client.15558 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.125+0000 7f0d4f7fe700 1 -- 172.21.15.69:0/197807040 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c7da07fa00 con 0x55c7da1a33f0 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.125+0000 7f0d4f7fe700 10 client.15558 handle_command_reply: tid=0 2023-12-14T14:11:02.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.125+0000 7f0d8269eb80 1 client.15558 shutdown 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.125+0000 7f0d8269eb80 1 -- 172.21.15.69:0/197807040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 msgr2=0x55c7da144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.125+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da144a50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0d68004eb0 tx=0x7f0d68099780 comp rx=0 tx=0).stop 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d8269eb80 1 -- 172.21.15.69:0/197807040 shutdown_connections 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c7da1a33f0 0x55c7da1a57d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7da13fb50 0x55c7da144a50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d4f7fe700 0 client.15558 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7da134380 0x55c7da146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d8269eb80 1 --2- 172.21.15.69:0/197807040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7da134c90 0x55c7da144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d8269eb80 1 -- 172.21.15.69:0/197807040 >> 172.21.15.69:0/197807040 conn(0x55c7da12aca0 msgr2=0x55c7da1513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d8269eb80 1 -- 172.21.15.69:0/197807040 shutdown_connections 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d8269eb80 1 -- 172.21.15.69:0/197807040 wait complete. 2023-12-14T14:11:02.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d8269eb80 20 client.15558 trim_cache size 0 max 16384 2023-12-14T14:11:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:11:02.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 -- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0d580a1350 msgr2=0x7f0d580a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0d580a1350 0x7f0d580a3800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d64005950 tx=0x7f0d640058e0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 -- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d7010a880 msgr2=0x7f0d7019acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d7010a880 0x7f0d7019acc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800ef90 tx=0x7f0d6800c450 comp rx=0 tx=0).stop 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 -- 172.21.15.69:0/1024826219 shutdown_connections 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0d580a1350 0x7f0d580a3800 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d7010a880 0x7f0d7019acc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d700760f0 0x7f0d70196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 --2- 172.21.15.69:0/1024826219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d700ff9b0 0x7f0d70196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 -- 172.21.15.69:0/1024826219 >> 172.21.15.69:0/1024826219 conn(0x7f0d70074a60 msgr2=0x7f0d70102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 -- 172.21.15.69:0/1024826219 shutdown_connections 2023-12-14T14:11:02.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.126+0000 7f0d76510700 1 -- 172.21.15.69:0/1024826219 wait complete. 2023-12-14T14:11:02.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:11:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.265+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/1267854902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 msgr2=0x7f7eb010a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.265+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/1267854902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 0x7f7eb010a7b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009990 tx=0x7f7e98009ca0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.265+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/1267854902 shutdown_connections 2023-12-14T14:11:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.265+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/1267854902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eb010acf0 0x7f7eb010d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.265+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/1267854902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb00ff430 0x7f7eb00ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.265+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/1267854902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 0x7f7eb010a7b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.265+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/1267854902 >> 172.21.15.69:0/1267854902 conn(0x7f7eb00749c0 msgr2=0x7f7eb0074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.265+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/1267854902 shutdown_connections 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.265+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/1267854902 wait complete. 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb6ccf700 1 Processor -- start 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb6ccf700 1 -- start start 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb6ccf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eb00ff430 0x7f7eb0196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb6ccf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 0x7f7eb01968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb6ccf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb010acf0 0x7f7eb019ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb6ccf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb019b370 con 0x7f7eb00ffd40 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb6ccf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb019b4e0 con 0x7f7eb010acf0 2023-12-14T14:11:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb6ccf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb019b6a0 con 0x7f7eb00ff430 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eaffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 0x7f7eb01968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eaffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 0x7f7eb01968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42646/0 (socket says 172.21.15.69:42646) 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eaffff700 1 -- 172.21.15.69:0/2075880014 learned_addr learned my addr 172.21.15.69:0/2075880014 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb526c700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb010acf0 0x7f7eb019ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eb00ff430 0x7f7eb0196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eaffff700 1 -- 172.21.15.69:0/2075880014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eb00ff430 msgr2=0x7f7eb0196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eaffff700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eb00ff430 0x7f7eb0196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eaffff700 1 -- 172.21.15.69:0/2075880014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb010acf0 msgr2=0x7f7eb019ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eaffff700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb010acf0 0x7f7eb019ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eaffff700 1 -- 172.21.15.69:0/2075880014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea8009c40 con 0x7f7eb00ffd40 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.266+0000 7f7eb526c700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb010acf0 0x7f7eb019ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.267+0000 7f7eaffff700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 0x7f7eb01968d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7e98005910 tx=0x7f7e98005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.267+0000 7f7eadffb700 1 -- 172.21.15.69:0/2075880014 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9801d070 con 0x7f7eb00ffd40 2023-12-14T14:11:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.267+0000 7f7eadffb700 1 -- 172.21.15.69:0/2075880014 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e98022470 con 0x7f7eb00ffd40 2023-12-14T14:11:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.267+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/2075880014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980095f0 con 0x7f7eb00ffd40 2023-12-14T14:11:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.267+0000 7f7eadffb700 1 -- 172.21.15.69:0/2075880014 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98017650 con 0x7f7eb00ffd40 2023-12-14T14:11:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.267+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/2075880014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb0110350 con 0x7f7eb00ffd40 2023-12-14T14:11:02.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.269+0000 7f7eadffb700 1 -- 172.21.15.69:0/2075880014 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f7e980225e0 con 0x7f7eb00ffd40 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7eadffb700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7e9c0a1350 0x7f7e9c0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7eadffb700 1 -- 172.21.15.69:0/2075880014 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f7e980ce240 con 0x7f7eb00ffd40 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7e9c0a1350 0x7f7e9c0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7e9c0a1350 0x7f7e9c0a3800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800f6c0 tx=0x7f7ea800b040 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7ec2e5db80 1 Processor -- start 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7ec2e5db80 1 -- start start 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276de380 0x5639276de750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276dec90 0x5639276eda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276edf60 0x5639276f0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.270+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639275c85e0 con 0x5639276edf60 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563927637870 con 0x5639276de380 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563927630d00 con 0x5639276dec90 2023-12-14T14:11:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eaffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276dec90 0x5639276eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eaffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276dec90 0x5639276eda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:53018/0 (socket says 172.21.15.69:53018) 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eaffff700 1 -- 172.21.15.69:0/425072993 learned_addr learned my addr 172.21.15.69:0/425072993 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276de380 0x5639276de750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eb526c700 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276edf60 0x5639276f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eaffff700 1 -- 172.21.15.69:0/425072993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276de380 msgr2=0x5639276de750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eaffff700 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276de380 0x5639276de750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eaffff700 1 -- 172.21.15.69:0/425072993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276edf60 msgr2=0x5639276f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eaffff700 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276edf60 0x5639276f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eaffff700 1 -- 172.21.15.69:0/425072993 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639274b23b0 con 0x5639276dec90 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eb526c700 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276edf60 0x5639276f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7eaffff700 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276dec90 0x5639276eda20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e9809af70 tx=0x7f7e98009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21ea93b8d766c2eb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7ea6ffd700 1 -- 172.21.15.69:0/425072993 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9809abd0 con 0x5639276dec90 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7ea6ffd700 1 -- 172.21.15.69:0/425072993 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e9809b270 con 0x5639276dec90 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.271+0000 7f7ea6ffd700 1 -- 172.21.15.69:0/425072993 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98099710 con 0x5639276dec90 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/425072993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276dec90 msgr2=0x5639276eda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276dec90 0x5639276eda20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e9809af70 tx=0x7f7e98009310 comp rx=0 tx=0).stop 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/425072993 shutdown_connections 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276edf60 0x5639276f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276de380 0x5639276de750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/425072993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276dec90 0x5639276eda20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/425072993 >> 172.21.15.69:0/425072993 conn(0x5639276d4ca0 msgr2=0x5639276da7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/425072993 shutdown_connections 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/425072993 wait complete. 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.272+0000 7f7ec2e5db80 1 -- start start 2023-12-14T14:11:02.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7ec2e5db80 1 Processor -- start 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276ee330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 0x5639276ee870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276edf60 0x5639276eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639275ccf90 con 0x5639276de380 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639275ccc30 con 0x5639276dec90 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639274b46a0 con 0x5639276edf60 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7ec2e5db80 10 client.0 _ll_register_callbacks cb 0x5639275f0910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eb4a6b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276ee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eb4a6b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276ee330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42674/0 (socket says 172.21.15.69:42674) 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eb4a6b700 1 -- 172.21.15.69:0/164425925 learned_addr learned my addr 172.21.15.69:0/164425925 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eb526c700 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276edf60 0x5639276eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eaffff700 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 0x5639276ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eb4a6b700 1 -- 172.21.15.69:0/164425925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276edf60 msgr2=0x5639276eedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276edf60 0x5639276eedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eb4a6b700 1 -- 172.21.15.69:0/164425925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 msgr2=0x5639276ee870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 0x5639276ee870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.273+0000 7f7eb4a6b700 1 -- 172.21.15.69:0/164425925 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb0110350 con 0x5639276de380 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276ee330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004a30 tx=0x7f7ea8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4fee9be2372683 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7e8ffff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7e8ffff700 1 -- 172.21.15.69:0/164425925 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea800e040 con 0x5639276de380 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7e8ffff700 1 -- 172.21.15.69:0/164425925 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f7ea8015d90 con 0x5639276de380 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/164425925 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639276d22b0 con 0x5639276de380 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7e8ffff700 1 -- 172.21.15.69:0/164425925 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ea8017440 con 0x5639276de380 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7ec2e5db80 10 client.15570 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/164425925 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5639275f7170 con 0x5639276de380 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7e8ffff700 1 -- 172.21.15.69:0/164425925 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5639276d22b0 con 0x5639276de380 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7e8ffff700 1 -- 172.21.15.69:0/164425925 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7ea80235d0 con 0x5639276de380 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7ec2e5db80 10 client.15570 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7ec2e5db80 10 client.15570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7ec2e5db80 20 client.15570 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5639276fd5a0 0x5639276ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7ec2e5db80 4 client.15570 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.274+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/164425925 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563927629ce0 con 0x5639276fd5a0 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.275+0000 7f7eaffff700 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5639276fd5a0 0x5639276ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.275+0000 7f7e8ffff700 10 client.15570 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.275+0000 7f7eaffff700 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5639276fd5a0 0x5639276ff9b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d58133ced4fe19 server_cookie=53123fa059d6e1b4 in_seq=0 out_seq=0 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7e8ffff700 1 -- 172.21.15.69:0/164425925 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563927629ce0 con 0x5639276fd5a0 2023-12-14T14:11:02.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7e8ffff700 10 client.15570 handle_command_reply: tid=0 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 client.15570 shutdown 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/164425925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 msgr2=0x5639276ee330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276ee330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004a30 tx=0x7f7ea8004ad0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/164425925 shutdown_connections 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5639276fd5a0 0x5639276ff9b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276edf60 0x5639276eedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276ee330 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7e8ffff700 0 client.15570 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/164425925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 0x5639276ee870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/164425925 >> 172.21.15.69:0/164425925 conn(0x5639276d4ca0 msgr2=0x5639276da3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/164425925 shutdown_connections 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/164425925 wait complete. 2023-12-14T14:11:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.276+0000 7f7ec2e5db80 20 client.15570 trim_cache size 0 max 16384 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7ec2e5db80 1 Processor -- start 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7ec2e5db80 1 -- start start 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276de380 0x5639276f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276dec90 0x5639276d99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276edf60 0x5639276e8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639276f9450 con 0x5639276dec90 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639276df390 con 0x5639276edf60 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639276df5b0 con 0x5639276de380 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eaffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276dec90 0x5639276d99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eaffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276dec90 0x5639276d99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42680/0 (socket says 172.21.15.69:42680) 2023-12-14T14:11:02.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eaffff700 1 -- 172.21.15.69:0/3131818981 learned_addr learned my addr 172.21.15.69:0/3131818981 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eb526c700 1 --2- 172.21.15.69:0/3131818981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276edf60 0x5639276e8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eaffff700 1 -- 172.21.15.69:0/3131818981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276de380 msgr2=0x5639276f8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eaffff700 1 --2- 172.21.15.69:0/3131818981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276de380 0x5639276f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eaffff700 1 -- 172.21.15.69:0/3131818981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276edf60 msgr2=0x5639276e8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eaffff700 1 --2- 172.21.15.69:0/3131818981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276edf60 0x5639276e8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eaffff700 1 -- 172.21.15.69:0/3131818981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639276edbc0 con 0x5639276dec90 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eb526c700 1 --2- 172.21.15.69:0/3131818981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276edf60 0x5639276e8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7eaffff700 1 --2- 172.21.15.69:0/3131818981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276dec90 0x5639276d99d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800f740 tx=0x7f7e9801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effa65f78092e856 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.289+0000 7f7ea77fe700 1 -- 172.21.15.69:0/3131818981 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9809abd0 con 0x5639276dec90 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ea77fe700 1 -- 172.21.15.69:0/3131818981 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e980a3630 con 0x5639276dec90 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ea77fe700 1 -- 172.21.15.69:0/3131818981 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9809b4d0 con 0x5639276dec90 2023-12-14T14:11:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/3131818981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276dec90 msgr2=0x5639276d99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/3131818981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276dec90 0x5639276d99d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800f740 tx=0x7f7e9801a040 comp rx=0 tx=0).stop 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/3131818981 shutdown_connections 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/3131818981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276edf60 0x5639276e8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/3131818981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276de380 0x5639276f8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/3131818981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276dec90 0x5639276d99d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/3131818981 >> 172.21.15.69:0/3131818981 conn(0x5639276d4ca0 msgr2=0x5639276e79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/3131818981 shutdown_connections 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/3131818981 wait complete. 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 -- start start 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.290+0000 7f7ec2e5db80 1 Processor -- start 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276efba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 0x5639276f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7ec2e5db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276edf60 0x5639276f0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563927750570 con 0x5639276de380 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639277506e0 con 0x5639276dec90 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7ec2e5db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639277508a0 con 0x5639276edf60 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7ec2e5db80 10 client.0 _ll_register_callbacks cb 0x7f7ea80043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eb4a6b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eb4a6b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276efba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42682/0 (socket says 172.21.15.69:42682) 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eb4a6b700 1 -- 172.21.15.69:0/1468481546 learned_addr learned my addr 172.21.15.69:0/1468481546 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eaffff700 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 0x5639276f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eb4a6b700 1 -- 172.21.15.69:0/1468481546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276edf60 msgr2=0x5639276f0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276edf60 0x5639276f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eb4a6b700 1 -- 172.21.15.69:0/1468481546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 msgr2=0x5639276f00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 0x5639276f00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eb4a6b700 1 -- 172.21.15.69:0/1468481546 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639274b23b0 con 0x5639276de380 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7eb4a6b700 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276efba0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004a00 tx=0x7f7ea800f4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbacedf2fdd91d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7e8ffff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7e8ffff700 1 -- 172.21.15.69:0/1468481546 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea800e040 con 0x5639276de380 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7e8ffff700 1 -- 172.21.15.69:0/1468481546 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f7ea80235f0 con 0x5639276de380 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.291+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/1468481546 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e9809b270 con 0x5639276de380 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7e8ffff700 1 -- 172.21.15.69:0/1468481546 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ea80237b0 con 0x5639276de380 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7ec2e5db80 10 client.15576 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/1468481546 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56392745eb60 con 0x5639276de380 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7e8ffff700 1 -- 172.21.15.69:0/1468481546 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e9809b270 con 0x5639276de380 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7e8ffff700 1 -- 172.21.15.69:0/1468481546 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7ea802b780 con 0x5639276de380 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7ec2e5db80 10 client.15576 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7ec2e5db80 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7ec2e5db80 20 client.15576 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563927751f50 0x563927754360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7ec2e5db80 4 client.15576 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/1468481546 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563927629a00 con 0x563927751f50 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7eaffff700 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563927751f50 0x563927754360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7e8ffff700 10 client.15576 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.292+0000 7f7eaffff700 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563927751f50 0x563927754360 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64f597fe5bc69939 server_cookie=ff1defe0906b51dd in_seq=0 out_seq=0 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7e8ffff700 1 -- 172.21.15.69:0/1468481546 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563927629a00 con 0x563927751f50 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7e8ffff700 10 client.15576 handle_command_reply: tid=0 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 client.15576 shutdown 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/1468481546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 msgr2=0x5639276efba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276efba0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004a00 tx=0x7f7ea800f4d0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/1468481546 shutdown_connections 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563927751f50 0x563927754360 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639276edf60 0x5639276f0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7e8ffff700 0 client.15576 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:02.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639276de380 0x5639276efba0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 --2- 172.21.15.69:0/1468481546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639276dec90 0x5639276f00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/1468481546 >> 172.21.15.69:0/1468481546 conn(0x5639276d4ca0 msgr2=0x5639276e8450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/1468481546 shutdown_connections 2023-12-14T14:11:02.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 1 -- 172.21.15.69:0/1468481546 wait complete. 2023-12-14T14:11:02.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7ec2e5db80 20 client.15576 trim_cache size 0 max 16384 2023-12-14T14:11:02.302 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:11:02.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7e9c0a1350 msgr2=0x7f7e9c0a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7e9c0a1350 0x7f7e9c0a3800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800f6c0 tx=0x7f7ea800b040 comp rx=0 tx=0).stop 2023-12-14T14:11:02.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 msgr2=0x7f7eb01968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:02.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.293+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 0x7f7eb01968d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7e98005910 tx=0x7f7e98005720 comp rx=0 tx=0).stop 2023-12-14T14:11:02.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.294+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/2075880014 shutdown_connections 2023-12-14T14:11:02.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.294+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7e9c0a1350 0x7f7e9c0a3800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.294+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb010acf0 0x7f7eb019ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.294+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eb00ff430 0x7f7eb0196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.294+0000 7f7eb6ccf700 1 --2- 172.21.15.69:0/2075880014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7eb00ffd40 0x7f7eb01968d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:02.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.294+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/2075880014 >> 172.21.15.69:0/2075880014 conn(0x7f7eb00749c0 msgr2=0x7f7eb00fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:02.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.294+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/2075880014 shutdown_connections 2023-12-14T14:11:02.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:02.294+0000 7f7eb6ccf700 1 -- 172.21.15.69:0/2075880014 wait complete. 2023-12-14T14:11:02.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:02 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1432418425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:11:02.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:02 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1432418425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:11:02.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:02 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1432418425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:11:03.306 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:11:03.307 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:11:03.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.440+0000 7f4d62050700 1 -- 172.21.15.69:0/2441766296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c0ff6e0 msgr2=0x7f4d5c0ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.440+0000 7f4d62050700 1 --2- 172.21.15.69:0/2441766296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c0ff6e0 0x7f4d5c0ffab0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000aad0 tx=0x7f4d5000ade0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.440+0000 7f4d62050700 1 -- 172.21.15.69:0/2441766296 shutdown_connections 2023-12-14T14:11:03.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.440+0000 7f4d62050700 1 --2- 172.21.15.69:0/2441766296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c104d70 0x7f4d5c10b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.440+0000 7f4d62050700 1 --2- 172.21.15.69:0/2441766296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c0ff6e0 0x7f4d5c0ffab0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.441+0000 7f4d62050700 1 --2- 172.21.15.69:0/2441766296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d5c100080 0x7f4d5c104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.441+0000 7f4d62050700 1 -- 172.21.15.69:0/2441766296 >> 172.21.15.69:0/2441766296 conn(0x7f4d5c074a60 msgr2=0x7f4d5c074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.441+0000 7f4d62050700 1 -- 172.21.15.69:0/2441766296 shutdown_connections 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.441+0000 7f4d62050700 1 -- 172.21.15.69:0/2441766296 wait complete. 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.441+0000 7f4d62050700 1 Processor -- start 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.441+0000 7f4d62050700 1 -- start start 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d62050700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d5c0ff6e0 0x7f4d5c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d62050700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c100080 0x7f4d5c1968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d62050700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c104d70 0x7f4d5c19ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d62050700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c19b380 con 0x7f4d5c104d70 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d62050700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c19b4f0 con 0x7f4d5c100080 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d62050700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c19b6b0 con 0x7f4d5c0ff6e0 2023-12-14T14:11:03.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c104d70 0x7f4d5c19ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c104d70 0x7f4d5c19ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42696/0 (socket says 172.21.15.69:42696) 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5bfff700 1 -- 172.21.15.69:0/422398012 learned_addr learned my addr 172.21.15.69:0/422398012 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5affd700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c100080 0x7f4d5c1968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d5c0ff6e0 0x7f4d5c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5bfff700 1 -- 172.21.15.69:0/422398012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d5c0ff6e0 msgr2=0x7f4d5c1963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d5c0ff6e0 0x7f4d5c1963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5bfff700 1 -- 172.21.15.69:0/422398012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c100080 msgr2=0x7f4d5c1968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c100080 0x7f4d5c1968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5bfff700 1 -- 172.21.15.69:0/422398012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5000a700 con 0x7f4d5c104d70 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d5c0ff6e0 0x7f4d5c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:03.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c104d70 0x7f4d5c19ad40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d54007ee0 tx=0x7f4d5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d58ff9700 1 -- 172.21.15.69:0/422398012 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400ddd0 con 0x7f4d5c104d70 2023-12-14T14:11:03.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d58ff9700 1 -- 172.21.15.69:0/422398012 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d5400f040 con 0x7f4d5c104d70 2023-12-14T14:11:03.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d62050700 1 -- 172.21.15.69:0/422398012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c10e110 con 0x7f4d5c104d70 2023-12-14T14:11:03.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d58ff9700 1 -- 172.21.15.69:0/422398012 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540048e0 con 0x7f4d5c104d70 2023-12-14T14:11:03.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.442+0000 7f4d62050700 1 -- 172.21.15.69:0/422398012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c10df80 con 0x7f4d5c104d70 2023-12-14T14:11:03.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.444+0000 7f4d58ff9700 1 -- 172.21.15.69:0/422398012 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f4d54003a00 con 0x7f4d5c104d70 2023-12-14T14:11:03.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.445+0000 7f4d58ff9700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d440a13e0 0x7f4d440a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.445+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d440a13e0 0x7f4d440a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.445+0000 7f4d58ff9700 1 -- 172.21.15.69:0/422398012 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4d540cc890 con 0x7f4d5c104d70 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.445+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d440a13e0 0x7f4d440a3890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d50000c00 tx=0x7f4d5000af60 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d6e1deb80 1 Processor -- start 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d6e1deb80 1 -- start start 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882400 0x55a6e98827d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 0x55a6e988d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e988dbd0 0x55a6e988ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e976c660 con 0x55a6e988dbd0 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e97db8f0 con 0x55a6e9882d10 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e97d4d80 con 0x55a6e9882400 2023-12-14T14:11:03.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e988dbd0 0x55a6e988ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.446+0000 7f4d5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e988dbd0 0x55a6e988ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42710/0 (socket says 172.21.15.69:42710) 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d5bfff700 1 -- 172.21.15.69:0/4230644267 learned_addr learned my addr 172.21.15.69:0/4230644267 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/4230644267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882400 0x55a6e98827d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d5affd700 1 --2- 172.21.15.69:0/4230644267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 0x55a6e988d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d5bfff700 1 -- 172.21.15.69:0/4230644267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882400 msgr2=0x55a6e98827d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/4230644267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882400 0x55a6e98827d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d5bfff700 1 -- 172.21.15.69:0/4230644267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 msgr2=0x55a6e988d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/4230644267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 0x55a6e988d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d5bfff700 1 -- 172.21.15.69:0/4230644267 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6e9656430 con 0x55a6e988dbd0 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/4230644267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e988dbd0 0x55a6e988ffb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d54099450 tx=0x7f4d5400dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3212a20d0250356b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d41ffb700 1 -- 172.21.15.69:0/4230644267 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54099750 con 0x55a6e988dbd0 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d41ffb700 1 -- 172.21.15.69:0/4230644267 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d5409d780 con 0x55a6e988dbd0 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.447+0000 7f4d41ffb700 1 -- 172.21.15.69:0/4230644267 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540999b0 con 0x55a6e988dbd0 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/4230644267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e988dbd0 msgr2=0x55a6e988ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/4230644267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e988dbd0 0x55a6e988ffb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d54099450 tx=0x7f4d5400dfd0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/4230644267 shutdown_connections 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/4230644267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e988dbd0 0x55a6e988ffb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/4230644267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882400 0x55a6e98827d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/4230644267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 0x55a6e988d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/4230644267 >> 172.21.15.69:0/4230644267 conn(0x55a6e9878d20 msgr2=0x55a6e987e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/4230644267 shutdown_connections 2023-12-14T14:11:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/4230644267 wait complete. 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 -- start start 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.448+0000 7f4d6e1deb80 1 Processor -- start 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e988d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 0x55a6e988a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e988dbd0 0x55a6e988b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e9771010 con 0x55a6e9882400 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e9770cb0 con 0x55a6e9882d10 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e9658720 con 0x55a6e988dbd0 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 10 client.0 _ll_register_callbacks cb 0x55a6e9794990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e988d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e988d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42712/0 (socket says 172.21.15.69:42712) 2023-12-14T14:11:03.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5b7fe700 1 -- 172.21.15.69:0/2317018529 learned_addr learned my addr 172.21.15.69:0/2317018529 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e988dbd0 0x55a6e988b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5b7fe700 1 -- 172.21.15.69:0/2317018529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e988dbd0 msgr2=0x55a6e988b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e988dbd0 0x55a6e988b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5b7fe700 1 -- 172.21.15.69:0/2317018529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 msgr2=0x55a6e988a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5affd700 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 0x55a6e988a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 0x55a6e988a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5b7fe700 1 -- 172.21.15.69:0/2317018529 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c10df80 con 0x55a6e9882400 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e988d660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4d50006010 tx=0x7f4d5000a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2e2397f78f7ca8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d3affd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d3affd700 1 -- 172.21.15.69:0/2317018529 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000e450 con 0x55a6e9882400 2023-12-14T14:11:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d3affd700 1 -- 172.21.15.69:0/2317018529 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4d50012070 con 0x55a6e9882400 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/2317018529 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6e9876330 con 0x55a6e9882400 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d3affd700 1 -- 172.21.15.69:0/2317018529 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d5000e5b0 con 0x55a6e9882400 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 10 client.15588 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.449+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/2317018529 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55a6e979b1f0 con 0x55a6e9882400 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d3affd700 1 -- 172.21.15.69:0/2317018529 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a6e9876330 con 0x55a6e9882400 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d3affd700 1 -- 172.21.15.69:0/2317018529 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d50034020 con 0x55a6e9882400 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d6e1deb80 10 client.15588 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d6e1deb80 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d6e1deb80 20 client.15588 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55a6e989d4d0 0x55a6e989f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d6e1deb80 4 client.15588 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:03.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/2317018529 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6e97cdd60 con 0x55a6e989d4d0 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d5affd700 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55a6e989d4d0 0x55a6e989f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d5affd700 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55a6e989d4d0 0x55a6e989f8e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b096d12e3a39ea server_cookie=c19419debe11fbc in_seq=0 out_seq=0 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.450+0000 7f4d3affd700 10 client.15588 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d3affd700 1 -- 172.21.15.69:0/2317018529 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a6e97cdd60 con 0x55a6e989d4d0 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d3affd700 10 client.15588 handle_command_reply: tid=0 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 client.15588 shutdown 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/2317018529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 msgr2=0x55a6e988d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e988d660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4d50006010 tx=0x7f4d5000a420 comp rx=0 tx=0).stop 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/2317018529 shutdown_connections 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55a6e989d4d0 0x55a6e989f8e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e988dbd0 0x55a6e988b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e988d660 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/2317018529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882d10 0x55a6e988a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d3affd700 0 client.15588 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/2317018529 >> 172.21.15.69:0/2317018529 conn(0x55a6e9878d20 msgr2=0x55a6e987e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/2317018529 shutdown_connections 2023-12-14T14:11:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.451+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/2317018529 wait complete. 2023-12-14T14:11:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.452+0000 7f4d6e1deb80 20 client.15588 trim_cache size 0 max 16384 2023-12-14T14:11:03.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d6e1deb80 1 Processor -- start 2023-12-14T14:11:03.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d6e1deb80 1 -- start start 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9878d20 0x55a6e988a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882400 0x55a6e988d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882d10 0x55a6e988d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e9899fc0 con 0x55a6e9882d10 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e98864c0 con 0x55a6e9882400 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e987d200 con 0x55a6e9878d20 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882d10 0x55a6e988d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882d10 0x55a6e988d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42724/0 (socket says 172.21.15.69:42724) 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d5bfff700 1 -- 172.21.15.69:0/1422930448 learned_addr learned my addr 172.21.15.69:0/1422930448 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.470+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9878d20 0x55a6e988a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d5affd700 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882400 0x55a6e988d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d5bfff700 1 -- 172.21.15.69:0/1422930448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9878d20 msgr2=0x55a6e988a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9878d20 0x55a6e988a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d5bfff700 1 -- 172.21.15.69:0/1422930448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882400 msgr2=0x55a6e988d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882400 0x55a6e988d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d5bfff700 1 -- 172.21.15.69:0/1422930448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6e979af40 con 0x55a6e9882d10 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9878d20 0x55a6e988a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882d10 0x55a6e988d660 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f80 tx=0x7f4d5400df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b36601550facc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d427fc700 1 -- 172.21.15.69:0/1422930448 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540b3020 con 0x55a6e9882d10 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d427fc700 1 -- 172.21.15.69:0/1422930448 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d540c9de0 con 0x55a6e9882d10 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.471+0000 7f4d427fc700 1 -- 172.21.15.69:0/1422930448 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54003d40 con 0x55a6e9882d10 2023-12-14T14:11:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/1422930448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882d10 msgr2=0x55a6e988d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882d10 0x55a6e988d660 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f80 tx=0x7f4d5400df30 comp rx=0 tx=0).stop 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/1422930448 shutdown_connections 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882d10 0x55a6e988d660 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9878d20 0x55a6e988a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/1422930448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9882400 0x55a6e988d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/1422930448 >> 172.21.15.69:0/1422930448 conn(0x55a6e9890280 msgr2=0x55a6e988a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/1422930448 shutdown_connections 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/1422930448 wait complete. 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 -- start start 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 Processor -- start 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9878d20 0x55a6e98936a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e9893be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882d10 0x55a6e98eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e98eb950 con 0x55a6e9882400 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e98ebac0 con 0x55a6e9878d20 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6e98ebc80 con 0x55a6e9882d10 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.472+0000 7f4d6e1deb80 10 client.0 _ll_register_callbacks cb 0x7f4d5000cec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e9893be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e9893be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42732/0 (socket says 172.21.15.69:42732) 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9878d20 0x55a6e98936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5affd700 1 -- 172.21.15.69:0/666803194 learned_addr learned my addr 172.21.15.69:0/666803194 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5bfff700 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882d10 0x55a6e98eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5affd700 1 -- 172.21.15.69:0/666803194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882d10 msgr2=0x55a6e98eb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5affd700 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882d10 0x55a6e98eb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5affd700 1 -- 172.21.15.69:0/666803194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9878d20 msgr2=0x55a6e98936a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5affd700 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9878d20 0x55a6e98936a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5affd700 1 -- 172.21.15.69:0/666803194 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6e979b1f0 con 0x55a6e9882400 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9878d20 0x55a6e98936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d5affd700 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e9893be0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c073280 tx=0x7f4d4c01a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86357609a6dd5074 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d3affd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d3affd700 1 -- 172.21.15.69:0/666803194 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c018040 con 0x55a6e9882400 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/666803194 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d5409d780 con 0x55a6e9882400 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d3affd700 1 -- 172.21.15.69:0/666803194 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4d4c00b900 con 0x55a6e9882400 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d3affd700 1 -- 172.21.15.69:0/666803194 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d4c00bac0 con 0x55a6e9882400 2023-12-14T14:11:03.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d6e1deb80 10 client.15594 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/666803194 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55a6e9656430 con 0x55a6e9882400 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.473+0000 7f4d3affd700 1 -- 172.21.15.69:0/666803194 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d5409d780 con 0x55a6e9882400 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d3affd700 1 -- 172.21.15.69:0/666803194 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d4c012450 con 0x55a6e9882400 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d6e1deb80 10 client.15594 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d6e1deb80 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d6e1deb80 20 client.15594 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55a6e988dbd0 0x55a6e98f5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d6e1deb80 4 client.15594 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/666803194 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a6e97cda80 con 0x55a6e988dbd0 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55a6e988dbd0 0x55a6e98f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d5b7fe700 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55a6e988dbd0 0x55a6e98f5590 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56e986e09f873e24 server_cookie=9af0eaff11e6d52f in_seq=0 out_seq=0 2023-12-14T14:11:03.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.474+0000 7f4d3affd700 10 client.15594 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.475+0000 7f4d3affd700 1 -- 172.21.15.69:0/666803194 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a6e97cda80 con 0x55a6e988dbd0 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.475+0000 7f4d3affd700 10 client.15594 handle_command_reply: tid=0 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 client.15594 shutdown 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/666803194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 msgr2=0x55a6e9893be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e9893be0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c073280 tx=0x7f4d4c01a500 comp rx=0 tx=0).stop 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/666803194 shutdown_connections 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55a6e988dbd0 0x55a6e98f5590 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a6e9882d10 0x55a6e98eb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a6e9878d20 0x55a6e98936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 --2- 172.21.15.69:0/666803194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a6e9882400 0x55a6e9893be0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/666803194 >> 172.21.15.69:0/666803194 conn(0x55a6e9890280 msgr2=0x55a6e9884b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d3affd700 0 client.15594 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:03.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/666803194 shutdown_connections 2023-12-14T14:11:03.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 1 -- 172.21.15.69:0/666803194 wait complete. 2023-12-14T14:11:03.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d6e1deb80 20 client.15594 trim_cache size 0 max 16384 2023-12-14T14:11:03.484 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:11:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:11:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "d03a9b76-315d-48de-8f8f-4e455a9f49b1", 2023-12-14T14:11:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:11:03.484 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:11:03.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d62050700 1 -- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d440a13e0 msgr2=0x7f4d440a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d62050700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d440a13e0 0x7f4d440a3890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d50000c00 tx=0x7f4d5000af60 comp rx=0 tx=0).stop 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d62050700 1 -- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c104d70 msgr2=0x7f4d5c19ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.476+0000 7f4d62050700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c104d70 0x7f4d5c19ad40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d54007ee0 tx=0x7f4d5400d3b0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.477+0000 7f4d62050700 1 -- 172.21.15.69:0/422398012 shutdown_connections 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.477+0000 7f4d62050700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d440a13e0 0x7f4d440a3890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.477+0000 7f4d62050700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d5c104d70 0x7f4d5c19ad40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.477+0000 7f4d62050700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d5c0ff6e0 0x7f4d5c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.477+0000 7f4d62050700 1 --2- 172.21.15.69:0/422398012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c100080 0x7f4d5c1968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.477+0000 7f4d62050700 1 -- 172.21.15.69:0/422398012 >> 172.21.15.69:0/422398012 conn(0x7f4d5c074a60 msgr2=0x7f4d5c102670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.477+0000 7f4d62050700 1 -- 172.21.15.69:0/422398012 shutdown_connections 2023-12-14T14:11:03.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.477+0000 7f4d62050700 1 -- 172.21.15.69:0/422398012 wait complete. 2023-12-14T14:11:03.489 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:11:03.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:03 smithi069 ceph-mon[42034]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:03.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.616+0000 7f4c4156b700 1 -- 172.21.15.69:0/2144915945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c1043f0 msgr2=0x7f4c3c10bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.616+0000 7f4c4156b700 1 --2- 172.21.15.69:0/2144915945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c1043f0 0x7f4c3c10bfc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400b0d0 tx=0x7f4c3400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 -- 172.21.15.69:0/2144915945 shutdown_connections 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 --2- 172.21.15.69:0/2144915945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c1043f0 0x7f4c3c10bfc0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 --2- 172.21.15.69:0/2144915945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c3c0ff3b0 0x7f4c3c0ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 --2- 172.21.15.69:0/2144915945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c3c0ffd50 0x7f4c3c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 -- 172.21.15.69:0/2144915945 >> 172.21.15.69:0/2144915945 conn(0x7f4c3c075f70 msgr2=0x7f4c3c076370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 -- 172.21.15.69:0/2144915945 shutdown_connections 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 -- 172.21.15.69:0/2144915945 wait complete. 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 Processor -- start 2023-12-14T14:11:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 -- start start 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c3c0ff3b0 0x7f4c3c100db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.617+0000 7f4c4156b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c0ffd50 0x7f4c3c1012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c4156b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c3c1043f0 0x7f4c3c1a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c4156b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c101b20 con 0x7f4c3c0ffd50 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c4156b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c1a4b60 con 0x7f4c3c0ff3b0 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c4156b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c1a4ca0 con 0x7f4c3c1043f0 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c0ffd50 0x7f4c3c1012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c0ffd50 0x7f4c3c1012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42738/0 (socket says 172.21.15.69:42738) 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3a7fc700 1 -- 172.21.15.69:0/3084158480 learned_addr learned my addr 172.21.15.69:0/3084158480 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c3c1043f0 0x7f4c3c1a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3affd700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c3c0ff3b0 0x7f4c3c100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3a7fc700 1 -- 172.21.15.69:0/3084158480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c3c1043f0 msgr2=0x7f4c3c1a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c3c1043f0 0x7f4c3c1a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3a7fc700 1 -- 172.21.15.69:0/3084158480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c3c0ff3b0 msgr2=0x7f4c3c100db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c3c0ff3b0 0x7f4c3c100db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3a7fc700 1 -- 172.21.15.69:0/3084158480 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34009d00 con 0x7f4c3c0ffd50 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3affd700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c3c0ff3b0 0x7f4c3c100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c0ffd50 0x7f4c3c1012f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00c9b0 tx=0x7f4c2c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c23fff700 1 -- 172.21.15.69:0/3084158480 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c007aa0 con 0x7f4c3c0ffd50 2023-12-14T14:11:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c23fff700 1 -- 172.21.15.69:0/3084158480 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c2c007c00 con 0x7f4c3c0ffd50 2023-12-14T14:11:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c4156b700 1 -- 172.21.15.69:0/3084158480 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c10f1c0 con 0x7f4c3c0ffd50 2023-12-14T14:11:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c23fff700 1 -- 172.21.15.69:0/3084158480 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c018660 con 0x7f4c3c0ffd50 2023-12-14T14:11:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.618+0000 7f4c4156b700 1 -- 172.21.15.69:0/3084158480 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3c10f030 con 0x7f4c3c0ffd50 2023-12-14T14:11:03.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.620+0000 7f4c23fff700 1 -- 172.21.15.69:0/3084158480 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f4c2c00f450 con 0x7f4c3c0ffd50 2023-12-14T14:11:03.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.621+0000 7f4c23fff700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c240a13e0 0x7f4c240a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.621+0000 7f4c23fff700 1 -- 172.21.15.69:0/3084158480 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4c2c0ccdd0 con 0x7f4c3c0ffd50 2023-12-14T14:11:03.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.621+0000 7f4c3affd700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c240a13e0 0x7f4c240a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.621+0000 7f4c3affd700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c240a13e0 0x7f4c240a3890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c30005d90 tx=0x7f4c30005d00 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c4d6f9b80 1 Processor -- start 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c4d6f9b80 1 -- start start 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3c380 0x55e84ed3c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3cc90 0x55e84ed47610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed49f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ec265e0 con 0x55e84ed47b50 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ec95870 con 0x55e84ed3c380 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ec8ed00 con 0x55e84ed3cc90 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed49f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed49f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42748/0 (socket says 172.21.15.69:42748) 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3b7fe700 1 -- 172.21.15.69:0/60787385 learned_addr learned my addr 172.21.15.69:0/60787385 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3affd700 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3c380 0x55e84ed3c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3cc90 0x55e84ed47610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3b7fe700 1 -- 172.21.15.69:0/60787385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3cc90 msgr2=0x55e84ed47610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3cc90 0x55e84ed47610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3b7fe700 1 -- 172.21.15.69:0/60787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3c380 msgr2=0x55e84ed3c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3c380 0x55e84ed3c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3b7fe700 1 -- 172.21.15.69:0/60787385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e84eb103b0 con 0x55e84ed47b50 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3cc90 0x55e84ed47610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.622+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed49f30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009200 tx=0x7f4c34009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59889f914b26f6ff server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c217fa700 1 -- 172.21.15.69:0/60787385 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3400e070 con 0x55e84ed47b50 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c217fa700 1 -- 172.21.15.69:0/60787385 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c340079a0 con 0x55e84ed47b50 2023-12-14T14:11:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c217fa700 1 -- 172.21.15.69:0/60787385 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34005540 con 0x55e84ed47b50 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/60787385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 msgr2=0x55e84ed49f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed49f30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009200 tx=0x7f4c34009230 comp rx=0 tx=0).stop 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/60787385 shutdown_connections 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed49f30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3c380 0x55e84ed3c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/60787385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3cc90 0x55e84ed47610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/60787385 >> 172.21.15.69:0/60787385 conn(0x55e84ed32ca0 msgr2=0x55e84ed387e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/60787385 shutdown_connections 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.623+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/60787385 wait complete. 2023-12-14T14:11:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c4d6f9b80 1 -- start start 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c4d6f9b80 1 Processor -- start 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed47500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed44d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ec2af90 con 0x55e84ed3c380 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ec2ac30 con 0x55e84ed3cc90 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84eb126a0 con 0x55e84ed47b50 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c4d6f9b80 10 client.0 _ll_register_callbacks cb 0x55e84ec4e910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed47500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed47500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42760/0 (socket says 172.21.15.69:42760) 2023-12-14T14:11:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3affd700 1 -- 172.21.15.69:0/536840526 learned_addr learned my addr 172.21.15.69:0/536840526 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed44d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3affd700 1 -- 172.21.15.69:0/536840526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 msgr2=0x55e84ed44d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3affd700 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed44d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3affd700 1 -- 172.21.15.69:0/536840526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 msgr2=0x55e84ed447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3affd700 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3affd700 1 -- 172.21.15.69:0/536840526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3c10c800 con 0x55e84ed3c380 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.624+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed44d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c3affd700 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed47500 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4c300117f0 tx=0x7f4c300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd5d0d915ae19fd server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c1eff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c1eff5700 1 -- 172.21.15.69:0/536840526 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c300106d0 con 0x55e84ed3c380 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c1eff5700 1 -- 172.21.15.69:0/536840526 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4c30010830 con 0x55e84ed3c380 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/536840526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e84ed302b0 con 0x55e84ed3c380 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c1eff5700 1 -- 172.21.15.69:0/536840526 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c300109f0 con 0x55e84ed3c380 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c4d6f9b80 10 client.15606 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/536840526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55e84ec55170 con 0x55e84ed3c380 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c1eff5700 1 -- 172.21.15.69:0/536840526 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e84ed302b0 con 0x55e84ed3c380 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c1eff5700 1 -- 172.21.15.69:0/536840526 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c30025020 con 0x55e84ed3c380 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c4d6f9b80 10 client.15606 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c4d6f9b80 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c4d6f9b80 20 client.15606 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:03.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e84ed57370 0x55e84ed59780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c4d6f9b80 4 client.15606 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.625+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/536840526 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e84ec87ce0 con 0x55e84ed57370 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.626+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e84ed57370 0x55e84ed59780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.626+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e84ed57370 0x55e84ed59780 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de5c2ff3f3332d1b server_cookie=97f969070ed95874 in_seq=0 out_seq=0 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.626+0000 7f4c1eff5700 10 client.15606 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c1eff5700 1 -- 172.21.15.69:0/536840526 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e84ec87ce0 con 0x55e84ed57370 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c1eff5700 10 client.15606 handle_command_reply: tid=0 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 client.15606 shutdown 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/536840526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 msgr2=0x55e84ed47500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed47500 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4c300117f0 tx=0x7f4c300047c0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/536840526 shutdown_connections 2023-12-14T14:11:03.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e84ed57370 0x55e84ed59780 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed44d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c1eff5700 0 client.15606 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:03.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed47500 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/536840526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/536840526 >> 172.21.15.69:0/536840526 conn(0x55e84ed32ca0 msgr2=0x55e84ed383d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/536840526 shutdown_connections 2023-12-14T14:11:03.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/536840526 wait complete. 2023-12-14T14:11:03.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.627+0000 7f4c4d6f9b80 20 client.15606 trim_cache size 0 max 16384 2023-12-14T14:11:03.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c4d6f9b80 1 Processor -- start 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c4d6f9b80 1 -- start start 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed46fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed47500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed3fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ed3d0b0 con 0x55e84ed3c380 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ed38d20 con 0x55e84ed3cc90 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ed42d10 con 0x55e84ed47b50 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed46fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed46fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42762/0 (socket says 172.21.15.69:42762) 2023-12-14T14:11:03.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3affd700 1 -- 172.21.15.69:0/175984527 learned_addr learned my addr 172.21.15.69:0/175984527 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed3fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed47500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3affd700 1 -- 172.21.15.69:0/175984527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 msgr2=0x55e84ed3fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3affd700 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed3fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3affd700 1 -- 172.21.15.69:0/175984527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 msgr2=0x55e84ed47500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3affd700 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed47500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3affd700 1 -- 172.21.15.69:0/175984527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e84ec54ec0 con 0x55e84ed3c380 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed3fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.644+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed47500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:03.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c3affd700 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed46fc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4c30000c00 tx=0x7f4c30009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5999ecef2abe6e3d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c21ffb700 1 -- 172.21.15.69:0/175984527 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c300274d0 con 0x55e84ed3c380 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c21ffb700 1 -- 172.21.15.69:0/175984527 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c30027bd0 con 0x55e84ed3c380 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c21ffb700 1 -- 172.21.15.69:0/175984527 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30030b40 con 0x55e84ed3c380 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/175984527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 msgr2=0x55e84ed46fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed46fc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4c30000c00 tx=0x7f4c30009530 comp rx=0 tx=0).stop 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/175984527 shutdown_connections 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed47b50 0x55e84ed3fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed3c380 0x55e84ed46fc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/175984527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed47500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/175984527 >> 172.21.15.69:0/175984527 conn(0x55e84ed32ca0 msgr2=0x55e84ed53800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/175984527 shutdown_connections 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.645+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/175984527 wait complete. 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c4d6f9b80 1 -- start start 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c4d6f9b80 1 Processor -- start 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3c380 0x55e84ed4e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed4c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c4d6f9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed4cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ed4d270 con 0x55e84ed47b50 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ed4d3b0 con 0x55e84ed3cc90 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c4d6f9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84ed4d570 con 0x55e84ed3c380 2023-12-14T14:11:03.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c4d6f9b80 10 client.0 _ll_register_callbacks cb 0x7f4c3000ef60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed4cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed4cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42774/0 (socket says 172.21.15.69:42774) 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3b7fe700 1 -- 172.21.15.69:0/960244984 learned_addr learned my addr 172.21.15.69:0/960244984 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3a7fc700 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed4c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3affd700 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3c380 0x55e84ed4e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3b7fe700 1 -- 172.21.15.69:0/960244984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3c380 msgr2=0x55e84ed4e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3c380 0x55e84ed4e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3b7fe700 1 -- 172.21.15.69:0/960244984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 msgr2=0x55e84ed4c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed4c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3b7fe700 1 -- 172.21.15.69:0/960244984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e84ec55170 con 0x55e84ed47b50 2023-12-14T14:11:03.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3affd700 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3c380 0x55e84ed4e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c3b7fe700 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed4cd30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009fd0 tx=0x7f4c34009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daff492df04ae11 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.646+0000 7f4c1eff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c1eff5700 1 -- 172.21.15.69:0/960244984 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3400e040 con 0x55e84ed47b50 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c1eff5700 1 -- 172.21.15.69:0/960244984 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4c34029070 con 0x55e84ed47b50 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/960244984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c340079a0 con 0x55e84ed47b50 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c1eff5700 1 -- 172.21.15.69:0/960244984 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c340050b0 con 0x55e84ed47b50 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c4d6f9b80 10 client.15612 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/960244984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55e84ec3b9a0 con 0x55e84ed47b50 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c1eff5700 1 -- 172.21.15.69:0/960244984 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c340079a0 con 0x55e84ed47b50 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c1eff5700 1 -- 172.21.15.69:0/960244984 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c34019050 con 0x55e84ed47b50 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c4d6f9b80 10 client.15612 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:03.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c4d6f9b80 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c4d6f9b80 20 client.15612 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e84edac270 0x55e84edae650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c4d6f9b80 4 client.15612 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/960244984 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e84ec87a00 con 0x55e84edac270 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.647+0000 7f4c3affd700 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e84edac270 0x55e84edae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c1eff5700 10 client.15612 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c3affd700 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e84edac270 0x55e84edae650 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3029f73d65ddc77 server_cookie=9e53ba771ca17afe in_seq=0 out_seq=0 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c1eff5700 1 -- 172.21.15.69:0/960244984 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e84ec87a00 con 0x55e84edac270 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c1eff5700 10 client.15612 handle_command_reply: tid=0 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 client.15612 shutdown 2023-12-14T14:11:03.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/960244984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 msgr2=0x55e84ed4cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed4cd30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009fd0 tx=0x7f4c34009530 comp rx=0 tx=0).stop 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/960244984 shutdown_connections 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e84edac270 0x55e84edae650 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e84ed47b50 0x55e84ed4cd30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e84ed3c380 0x55e84ed4e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c1eff5700 0 client.15612 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 --2- 172.21.15.69:0/960244984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e84ed3cc90 0x55e84ed4c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/960244984 >> 172.21.15.69:0/960244984 conn(0x55e84ed32ca0 msgr2=0x55e84ed3fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/960244984 shutdown_connections 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 1 -- 172.21.15.69:0/960244984 wait complete. 2023-12-14T14:11:03.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.648+0000 7f4c4d6f9b80 20 client.15612 trim_cache size 0 max 16384 2023-12-14T14:11:03.659 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:11:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:11:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:11:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "d03a9b76-315d-48de-8f8f-4e455a9f49b1": { 2023-12-14T14:11:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:11:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "d03a9b76-315d-48de-8f8f-4e455a9f49b1", 2023-12-14T14:11:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:11:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:11:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:11:03.660 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:11:03.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 -- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c240a13e0 msgr2=0x7f4c240a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c240a13e0 0x7f4c240a3890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c30005d90 tx=0x7f4c30005d00 comp rx=0 tx=0).stop 2023-12-14T14:11:03.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 -- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c0ffd50 msgr2=0x7f4c3c1012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:03.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c0ffd50 0x7f4c3c1012f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00c9b0 tx=0x7f4c2c00ccc0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 -- 172.21.15.69:0/3084158480 shutdown_connections 2023-12-14T14:11:03.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c240a13e0 0x7f4c240a3890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c3c1043f0 0x7f4c3c1a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c3c0ff3b0 0x7f4c3c100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 --2- 172.21.15.69:0/3084158480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c3c0ffd50 0x7f4c3c1012f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:03.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 -- 172.21.15.69:0/3084158480 >> 172.21.15.69:0/3084158480 conn(0x7f4c3c075f70 msgr2=0x7f4c3c069020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:03.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 -- 172.21.15.69:0/3084158480 shutdown_connections 2023-12-14T14:11:03.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:03.649+0000 7f4c4156b700 1 -- 172.21.15.69:0/3084158480 wait complete. 2023-12-14T14:11:03.662 INFO:tasks.cephfs.filesystem:scrub status for tag:d03a9b76-315d-48de-8f8f-4e455a9f49b1 - {'path': '/', 'tag': 'd03a9b76-315d-48de-8f8f-4e455a9f49b1', 'options': 'recursive,force'} 2023-12-14T14:11:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:03 smithi119 ceph-mon[43834]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:03.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:03 smithi081 ceph-mon[43371]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:04.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:04 smithi119 ceph-mon[43834]: mgrmap e23: x(active, since 25s), standbys: z, y 2023-12-14T14:11:04.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:04 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:11:04.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:04 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:04.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:04 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:11:04.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:04 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:04.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:04 smithi069 ceph-mon[42034]: mgrmap e23: x(active, since 25s), standbys: z, y 2023-12-14T14:11:04.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:04 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:11:04.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:04 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:04.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:04 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:11:04.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:04 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:04 smithi081 ceph-mon[43371]: mgrmap e23: x(active, since 25s), standbys: z, y 2023-12-14T14:11:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:04 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:11:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:04 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:04 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:11:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:04 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:05.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:05 smithi119 ceph-mon[43834]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 18 op/s 2023-12-14T14:11:05.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:05 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:11:05.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:05 smithi069 ceph-mon[42034]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 18 op/s 2023-12-14T14:11:05.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:05 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:11:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:05 smithi081 ceph-mon[43371]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 18 op/s 2023-12-14T14:11:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:05 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:11:07.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:07 smithi119 ceph-mon[43834]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-12-14T14:11:07.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:07 smithi069 ceph-mon[42034]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-12-14T14:11:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:07 smithi081 ceph-mon[43371]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-12-14T14:11:09.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:09 smithi081 ceph-mon[43371]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-12-14T14:11:09.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:09 smithi119 ceph-mon[43834]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-12-14T14:11:09.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:09 smithi069 ceph-mon[42034]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-12-14T14:11:11.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:11 smithi081 ceph-mon[43371]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-12-14T14:11:11.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:11 smithi119 ceph-mon[43834]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-12-14T14:11:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:11 smithi069 ceph-mon[42034]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-12-14T14:11:13.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:13 smithi119 ceph-mon[43834]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-12-14T14:11:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:13 smithi069 ceph-mon[42034]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-12-14T14:11:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:13 smithi081 ceph-mon[43371]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-12-14T14:11:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:15 smithi119 ceph-mon[43834]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-12-14T14:11:15.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:15 smithi069 ceph-mon[42034]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-12-14T14:11:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:15 smithi081 ceph-mon[43371]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-12-14T14:11:17.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:17 smithi119 ceph-mon[43834]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2023-12-14T14:11:17.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:17 smithi069 ceph-mon[42034]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2023-12-14T14:11:17.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:17 smithi081 ceph-mon[43371]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2023-12-14T14:11:19.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:19 smithi081 ceph-mon[43371]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 5 op/s 2023-12-14T14:11:19.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:19 smithi119 ceph-mon[43834]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 5 op/s 2023-12-14T14:11:19.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:19 smithi069 ceph-mon[42034]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 5 op/s 2023-12-14T14:11:21.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:21 smithi119 ceph-mon[43834]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 7 op/s 2023-12-14T14:11:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:21 smithi069 ceph-mon[42034]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 7 op/s 2023-12-14T14:11:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:21 smithi081 ceph-mon[43371]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 7 op/s 2023-12-14T14:11:23.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:23 smithi119 ceph-mon[43834]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2023-12-14T14:11:23.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:23 smithi069 ceph-mon[42034]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2023-12-14T14:11:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:23 smithi081 ceph-mon[43371]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2023-12-14T14:11:25.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:25 smithi119 ceph-mon[43834]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-14T14:11:25.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:25 smithi069 ceph-mon[42034]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-14T14:11:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:25 smithi081 ceph-mon[43371]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-14T14:11:27.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:27 smithi069 ceph-mon[42034]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 6 op/s 2023-12-14T14:11:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:27 smithi081 ceph-mon[43371]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 6 op/s 2023-12-14T14:11:27.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:27 smithi119 ceph-mon[43834]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 6 op/s 2023-12-14T14:11:29.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:29 smithi081 ceph-mon[43371]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-14T14:11:29.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:29 smithi119 ceph-mon[43834]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-14T14:11:29.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:29 smithi069 ceph-mon[42034]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-14T14:11:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:31 smithi119 ceph-mon[43834]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-12-14T14:11:31.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:31 smithi069 ceph-mon[42034]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-12-14T14:11:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:31 smithi081 ceph-mon[43371]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-12-14T14:11:33.663 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:11:33.693 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:33 smithi069 ceph-mon[42034]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:33.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:33 smithi119 ceph-mon[43834]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:33.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.808+0000 7f25ab51a700 1 -- 172.21.15.69:0/880611011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a4101430 msgr2=0x7f25a4101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.808+0000 7f25ab51a700 1 --2- 172.21.15.69:0/880611011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a4101430 0x7f25a4101800 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009990 tx=0x7f25a0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.808+0000 7f25ab51a700 1 -- 172.21.15.69:0/880611011 shutdown_connections 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.808+0000 7f25ab51a700 1 --2- 172.21.15.69:0/880611011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a410a800 0x7f25a410cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.808+0000 7f25ab51a700 1 --2- 172.21.15.69:0/880611011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a4101430 0x7f25a4101800 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.808+0000 7f25ab51a700 1 --2- 172.21.15.69:0/880611011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a4101d40 0x7f25a410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.808+0000 7f25ab51a700 1 -- 172.21.15.69:0/880611011 >> 172.21.15.69:0/880611011 conn(0x7f25a40763a0 msgr2=0x7f25a40767a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.808+0000 7f25ab51a700 1 -- 172.21.15.69:0/880611011 shutdown_connections 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.809+0000 7f25ab51a700 1 -- 172.21.15.69:0/880611011 wait complete. 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.809+0000 7f25ab51a700 1 Processor -- start 2023-12-14T14:11:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.809+0000 7f25ab51a700 1 -- start start 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25ab51a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a4101430 0x7f25a4194140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25ab51a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a4101d40 0x7f25a4194680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25ab51a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a410a800 0x7f25a4198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25ab51a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4199120 con 0x7f25a410a800 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25ab51a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4199290 con 0x7f25a4101d40 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25ab51a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4199450 con 0x7f25a4101430 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a9ab7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a410a800 0x7f25a4198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a9ab7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a410a800 0x7f25a4198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58462/0 (socket says 172.21.15.69:58462) 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a9ab7700 1 -- 172.21.15.69:0/791570929 learned_addr learned my addr 172.21.15.69:0/791570929 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a8ab5700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a4101d40 0x7f25a4194680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a92b6700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a4101430 0x7f25a4194140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a9ab7700 1 -- 172.21.15.69:0/791570929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a4101430 msgr2=0x7f25a4194140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:33.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a4101430 0x7f25a4194140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a9ab7700 1 -- 172.21.15.69:0/791570929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a4101d40 msgr2=0x7f25a4194680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:33.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a4101d40 0x7f25a4194680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a9ab7700 1 -- 172.21.15.69:0/791570929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00095f0 con 0x7f25a410a800 2023-12-14T14:11:33.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a410a800 0x7f25a4198ae0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f259c007f10 tx=0x7f259c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:33.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.810+0000 7f259a7fc700 1 -- 172.21.15.69:0/791570929 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c017070 con 0x7f25a410a800 2023-12-14T14:11:33.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.811+0000 7f25ab51a700 1 -- 172.21.15.69:0/791570929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a410e110 con 0x7f25a410a800 2023-12-14T14:11:33.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.811+0000 7f25ab51a700 1 -- 172.21.15.69:0/791570929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a410df80 con 0x7f25a410a800 2023-12-14T14:11:33.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.812+0000 7f259a7fc700 1 -- 172.21.15.69:0/791570929 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f259c00f040 con 0x7f25a410a800 2023-12-14T14:11:33.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.812+0000 7f259a7fc700 1 -- 172.21.15.69:0/791570929 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0054b0 con 0x7f25a410a800 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.814+0000 7f259a7fc700 1 -- 172.21.15.69:0/791570929 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f259c0056f0 con 0x7f25a410a800 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.814+0000 7f259a7fc700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f25900a1460 0x7f25900a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.814+0000 7f259a7fc700 1 -- 172.21.15.69:0/791570929 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f259c0cc4e0 con 0x7f25a410a800 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.814+0000 7f25a92b6700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f25900a1460 0x7f25900a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.815+0000 7f25a92b6700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f25900a1460 0x7f25900a3910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25a000b2e0 tx=0x7f25a0005fd0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.815+0000 7f25b76a8b80 1 Processor -- start 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25b76a8b80 1 -- start start 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1ec750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ecc90 0x55eeff1f7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff0d65e0 con 0x55eeff1ecc90 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff145870 con 0x55eeff1f7b50 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff13ed00 con 0x55eeff1ec380 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a92b6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1ec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a92b6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1ec750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:41962/0 (socket says 172.21.15.69:41962) 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a92b6700 1 -- 172.21.15.69:0/3930985714 learned_addr learned my addr 172.21.15.69:0/3930985714 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/3930985714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a92b6700 1 -- 172.21.15.69:0/3930985714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 msgr2=0x55eeff1f9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a92b6700 1 --2- 172.21.15.69:0/3930985714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a92b6700 1 -- 172.21.15.69:0/3930985714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ecc90 msgr2=0x55eeff1f7610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-14T14:11:33.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a92b6700 1 --2- 172.21.15.69:0/3930985714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ecc90 0x55eeff1f7610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a92b6700 1 -- 172.21.15.69:0/3930985714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eefefc03b0 con 0x55eeff1ec380 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.816+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/3930985714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.817+0000 7f25a92b6700 1 --2- 172.21.15.69:0/3930985714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1ec750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25a0015000 tx=0x7f25a0020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3548819f014a8eea server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.817+0000 7f258f7fe700 1 -- 172.21.15.69:0/3930985714 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a002b070 con 0x55eeff1ec380 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.817+0000 7f258f7fe700 1 -- 172.21.15.69:0/3930985714 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25a001e040 con 0x55eeff1ec380 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.817+0000 7f258f7fe700 1 -- 172.21.15.69:0/3930985714 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a000f700 con 0x55eeff1ec380 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 -- 172.21.15.69:0/3930985714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 msgr2=0x55eeff1ec750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/3930985714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1ec750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25a0015000 tx=0x7f25a0020000 comp rx=0 tx=0).stop 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 -- 172.21.15.69:0/3930985714 shutdown_connections 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/3930985714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/3930985714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1ec750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/3930985714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ecc90 0x55eeff1f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 -- 172.21.15.69:0/3930985714 >> 172.21.15.69:0/3930985714 conn(0x55eeff1e2ca0 msgr2=0x55eeff1e87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 -- 172.21.15.69:0/3930985714 shutdown_connections 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 -- 172.21.15.69:0/3930985714 wait complete. 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 -- start start 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.818+0000 7f25b76a8b80 1 Processor -- start 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 0x55eeff1f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ecc90 0x55eeff1f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff0daf90 con 0x55eeff1ec380 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff0dac30 con 0x55eeff1f7b50 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eefefc26a0 con 0x55eeff1ecc90 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25b76a8b80 10 client.0 _ll_register_callbacks cb 0x55eeff0fe910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a9ab7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a9ab7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:46876/0 (socket says 172.21.15.69:46876) 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a9ab7700 1 -- 172.21.15.69:0/2778938172 learned_addr learned my addr 172.21.15.69:0/2778938172 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a8ab5700 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ecc90 0x55eeff1f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a9ab7700 1 -- 172.21.15.69:0/2778938172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ecc90 msgr2=0x55eeff1f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ecc90 0x55eeff1f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a9ab7700 1 -- 172.21.15.69:0/2778938172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 msgr2=0x55eeff1f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:33.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 0x55eeff1f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a9ab7700 1 -- 172.21.15.69:0/2778938172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a410d8e0 con 0x55eeff1f7b50 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f4c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f259c007ee0 tx=0x7f259c09a0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd33ebde42b7d915 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.819+0000 7f258cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f258cff9700 1 -- 172.21.15.69:0/2778938172 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0999c0 con 0x55eeff1f7b50 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f258cff9700 1 -- 172.21.15.69:0/2778938172 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f259c0a2720 con 0x55eeff1f7b50 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f25b76a8b80 1 -- 172.21.15.69:0/2778938172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eeff1e02b0 con 0x55eeff1f7b50 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f258cff9700 1 -- 172.21.15.69:0/2778938172 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f259c0c3bd0 con 0x55eeff1f7b50 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f25b76a8b80 10 client.25187 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f25b76a8b80 1 -- 172.21.15.69:0/2778938172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55eeff105170 con 0x55eeff1f7b50 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f258cff9700 1 -- 172.21.15.69:0/2778938172 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eeff1e02b0 con 0x55eeff1f7b50 2023-12-14T14:11:33.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f258cff9700 1 -- 172.21.15.69:0/2778938172 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f259c0c9dd0 con 0x55eeff1f7b50 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f25b76a8b80 10 client.25187 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f25b76a8b80 10 client.25187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f25b76a8b80 20 client.25187 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55eeff2074a0 0x55eeff2098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f25b76a8b80 4 client.25187 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.820+0000 7f25b76a8b80 1 -- 172.21.15.69:0/2778938172 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eeff137ce0 con 0x55eeff2074a0 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.821+0000 7f25a92b6700 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55eeff2074a0 0x55eeff2098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.821+0000 7f258cff9700 10 client.25187 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.821+0000 7f25a92b6700 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55eeff2074a0 0x55eeff2098b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f7e6a3e2aeacea7 server_cookie=dbd2b39adcd3adc7 in_seq=0 out_seq=0 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f258cff9700 1 -- 172.21.15.69:0/2778938172 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55eeff137ce0 con 0x55eeff2074a0 2023-12-14T14:11:33.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f258cff9700 10 client.25187 handle_command_reply: tid=0 2023-12-14T14:11:33.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 client.25187 shutdown 2023-12-14T14:11:33.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 -- 172.21.15.69:0/2778938172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 msgr2=0x55eeff1f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:33.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f4c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f259c007ee0 tx=0x7f259c09a0c0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 -- 172.21.15.69:0/2778938172 shutdown_connections 2023-12-14T14:11:33.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55eeff2074a0 0x55eeff2098b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1f4c80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f258cff9700 0 client.25187 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:33.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 0x55eeff1f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/2778938172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ecc90 0x55eeff1f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 -- 172.21.15.69:0/2778938172 >> 172.21.15.69:0/2778938172 conn(0x55eeff1e2ca0 msgr2=0x55eeff1e83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:33.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 -- 172.21.15.69:0/2778938172 shutdown_connections 2023-12-14T14:11:33.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 1 -- 172.21.15.69:0/2778938172 wait complete. 2023-12-14T14:11:33.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.822+0000 7f25b76a8b80 20 client.25187 trim_cache size 0 max 16384 2023-12-14T14:11:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.854+0000 7f25b76a8b80 1 Processor -- start 2023-12-14T14:11:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.854+0000 7f25b76a8b80 1 -- start start 2023-12-14T14:11:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.854+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 0x55eeff1f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.854+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1ecc90 0x55eeff1ef9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.854+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1f7b50 0x55eeff1eff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.854+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff1e75f0 con 0x55eeff1ec380 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.854+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff203ee0 con 0x55eeff1ecc90 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.854+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff1e2850 con 0x55eeff1f7b50 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a92b6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 0x55eeff1f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a92b6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 0x55eeff1f9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58470/0 (socket says 172.21.15.69:58470) 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a92b6700 1 -- 172.21.15.69:0/602379335 learned_addr learned my addr 172.21.15.69:0/602379335 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/602379335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1f7b50 0x55eeff1eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a92b6700 1 -- 172.21.15.69:0/602379335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1f7b50 msgr2=0x55eeff1eff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a92b6700 1 --2- 172.21.15.69:0/602379335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1f7b50 0x55eeff1eff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a92b6700 1 -- 172.21.15.69:0/602379335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1ecc90 msgr2=0x55eeff1ef9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a92b6700 1 --2- 172.21.15.69:0/602379335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1ecc90 0x55eeff1ef9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a92b6700 1 -- 172.21.15.69:0/602379335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeff104ec0 con 0x55eeff1ec380 2023-12-14T14:11:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.855+0000 7f25a92b6700 1 --2- 172.21.15.69:0/602379335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 0x55eeff1f9f30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f25a0005f50 tx=0x7f25a0004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402aed3d03d0130d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.856+0000 7f258ffff700 1 -- 172.21.15.69:0/602379335 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0029040 con 0x55eeff1ec380 2023-12-14T14:11:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.856+0000 7f258ffff700 1 -- 172.21.15.69:0/602379335 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25a00385c0 con 0x55eeff1ec380 2023-12-14T14:11:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.856+0000 7f258ffff700 1 -- 172.21.15.69:0/602379335 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a002b040 con 0x55eeff1ec380 2023-12-14T14:11:33.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 -- 172.21.15.69:0/602379335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 msgr2=0x55eeff1f9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:33.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/602379335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 0x55eeff1f9f30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f25a0005f50 tx=0x7f25a0004e00 comp rx=0 tx=0).stop 2023-12-14T14:11:33.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 -- 172.21.15.69:0/602379335 shutdown_connections 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/602379335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1f7b50 0x55eeff1eff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/602379335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ec380 0x55eeff1f9f30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/602379335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1ecc90 0x55eeff1ef9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 -- 172.21.15.69:0/602379335 >> 172.21.15.69:0/602379335 conn(0x55eeff1e2ca0 msgr2=0x55eeff2037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 -- 172.21.15.69:0/602379335 shutdown_connections 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 -- 172.21.15.69:0/602379335 wait complete. 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 -- start start 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.857+0000 7f25b76a8b80 1 Processor -- start 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1fe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ecc90 0x55eeff1fe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25b76a8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1fc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff1fcf30 con 0x55eeff1ecc90 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff1fd0a0 con 0x55eeff1f7b50 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25b76a8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeff1fd1e0 con 0x55eeff1ec380 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25b76a8b80 10 client.0 _ll_register_callbacks cb 0x7f259c09a2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25a92b6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1fe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25a92b6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1fe2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:41980/0 (socket says 172.21.15.69:41980) 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25a92b6700 1 -- 172.21.15.69:0/1467666922 learned_addr learned my addr 172.21.15.69:0/1467666922 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.858+0000 7f25a9ab7700 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f25a92b6700 1 -- 172.21.15.69:0/1467666922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 msgr2=0x55eeff1fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f25a92b6700 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1fc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f25a92b6700 1 -- 172.21.15.69:0/1467666922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ecc90 msgr2=0x55eeff1fe830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f25a92b6700 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ecc90 0x55eeff1fe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f25a92b6700 1 -- 172.21.15.69:0/1467666922 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eefefc03b0 con 0x55eeff1ec380 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f25a92b6700 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1fe2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25a00098e0 tx=0x7f25a0005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3117d2cce1c28bea server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f258cff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f258cff9700 1 -- 172.21.15.69:0/1467666922 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a002b040 con 0x55eeff1ec380 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f25b76a8b80 1 -- 172.21.15.69:0/1467666922 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25a001e040 con 0x55eeff1ec380 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f258cff9700 1 -- 172.21.15.69:0/1467666922 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f25a0038d80 con 0x55eeff1ec380 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f258cff9700 1 -- 172.21.15.69:0/1467666922 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25a0004580 con 0x55eeff1ec380 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f25b76a8b80 10 client.25138 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:33.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.859+0000 7f25b76a8b80 1 -- 172.21.15.69:0/1467666922 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55eeff0eb9a0 con 0x55eeff1ec380 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f258cff9700 1 -- 172.21.15.69:0/1467666922 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25a001e040 con 0x55eeff1ec380 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f258cff9700 1 -- 172.21.15.69:0/1467666922 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f25a0037040 con 0x55eeff1ec380 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f25b76a8b80 10 client.25138 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f25b76a8b80 10 client.25138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f25b76a8b80 20 client.25138 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55eeff2520a0 0x55eeff2544b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f25b76a8b80 4 client.25138 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f25b76a8b80 1 -- 172.21.15.69:0/1467666922 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55eeff137a00 con 0x55eeff2520a0 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f25a8ab5700 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55eeff2520a0 0x55eeff2544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f258cff9700 10 client.25138 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:33.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.860+0000 7f25a8ab5700 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55eeff2520a0 0x55eeff2544b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=293acc30017c4377 server_cookie=f3c339665cd1d74e in_seq=0 out_seq=0 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f258cff9700 1 -- 172.21.15.69:0/1467666922 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55eeff137a00 con 0x55eeff2520a0 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f258cff9700 10 client.25138 handle_command_reply: tid=0 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 client.25138 shutdown 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 -- 172.21.15.69:0/1467666922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 msgr2=0x55eeff1fe2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1fe2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25a00098e0 tx=0x7f25a0005a00 comp rx=0 tx=0).stop 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 -- 172.21.15.69:0/1467666922 shutdown_connections 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55eeff2520a0 0x55eeff2544b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eeff1f7b50 0x55eeff1fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f258cff9700 0 client.25138 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eeff1ec380 0x55eeff1fe2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 --2- 172.21.15.69:0/1467666922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eeff1ecc90 0x55eeff1fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 -- 172.21.15.69:0/1467666922 >> 172.21.15.69:0/1467666922 conn(0x55eeff1e2ca0 msgr2=0x55eeff1ef9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:33.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 -- 172.21.15.69:0/1467666922 shutdown_connections 2023-12-14T14:11:33.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 1 -- 172.21.15.69:0/1467666922 wait complete. 2023-12-14T14:11:33.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.861+0000 7f25b76a8b80 20 client.25138 trim_cache size 0 max 16384 2023-12-14T14:11:33.867 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:11:33.867 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:11:33.867 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:11:33.867 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:11:33.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 -- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f25900a1460 msgr2=0x7f25900a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:33.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f25900a1460 0x7f25900a3910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25a000b2e0 tx=0x7f25a0005fd0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 -- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a410a800 msgr2=0x7f25a4198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:33.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a410a800 0x7f25a4198ae0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f259c007f10 tx=0x7f259c00d3b0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 -- 172.21.15.69:0/791570929 shutdown_connections 2023-12-14T14:11:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f25900a1460 0x7f25900a3910 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25a410a800 0x7f25a4198ae0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a4101430 0x7f25a4194140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 --2- 172.21.15.69:0/791570929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a4101d40 0x7f25a4194680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.863+0000 7f25ab51a700 1 -- 172.21.15.69:0/791570929 >> 172.21.15.69:0/791570929 conn(0x7f25a40763a0 msgr2=0x7f25a41021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.864+0000 7f25ab51a700 1 -- 172.21.15.69:0/791570929 shutdown_connections 2023-12-14T14:11:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:33.864+0000 7f25ab51a700 1 -- 172.21.15.69:0/791570929 wait complete. 2023-12-14T14:11:33.878 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:11:33.878 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:11:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:33 smithi081 ceph-mon[43371]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:34.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.060+0000 7f31fd728700 1 -- 172.21.15.69:0/1931774541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 msgr2=0x7f31f80ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.060+0000 7f31fd728700 1 --2- 172.21.15.69:0/1931774541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 0x7f31f80ff760 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f31e80099c0 tx=0x7f31e8009cd0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.061+0000 7f31fd728700 1 -- 172.21.15.69:0/1931774541 shutdown_connections 2023-12-14T14:11:34.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.061+0000 7f31fd728700 1 --2- 172.21.15.69:0/1931774541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f81043d0 0x7f31f810bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.061+0000 7f31fd728700 1 --2- 172.21.15.69:0/1931774541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 0x7f31f80ff760 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.061+0000 7f31fd728700 1 --2- 172.21.15.69:0/1931774541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31f80ffd30 0x7f31f8103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.061+0000 7f31fd728700 1 -- 172.21.15.69:0/1931774541 >> 172.21.15.69:0/1931774541 conn(0x7f31f8076370 msgr2=0x7f31f8076770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.061+0000 7f31fd728700 1 -- 172.21.15.69:0/1931774541 shutdown_connections 2023-12-14T14:11:34.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.061+0000 7f31fd728700 1 -- 172.21.15.69:0/1931774541 wait complete. 2023-12-14T14:11:34.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.061+0000 7f31fd728700 1 Processor -- start 2023-12-14T14:11:34.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31fd728700 1 -- start start 2023-12-14T14:11:34.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31fd728700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 0x7f31f81952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31fd728700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31f80ffd30 0x7f31f8195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31fd728700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f81043d0 0x7f31f8199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31fd728700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f819a2b0 con 0x7f31f80ff390 2023-12-14T14:11:34.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31fd728700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f819a420 con 0x7f31f81043d0 2023-12-14T14:11:34.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31fd728700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f819a5e0 con 0x7f31f80ffd30 2023-12-14T14:11:34.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31f6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 0x7f31f81952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31f6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 0x7f31f81952d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58492/0 (socket says 172.21.15.69:58492) 2023-12-14T14:11:34.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31f6ffd700 1 -- 172.21.15.69:0/2038513420 learned_addr learned my addr 172.21.15.69:0/2038513420 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31f77fe700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f81043d0 0x7f31f8199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.062+0000 7f31f67fc700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31f80ffd30 0x7f31f8195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31f6ffd700 1 -- 172.21.15.69:0/2038513420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31f80ffd30 msgr2=0x7f31f8195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31f6ffd700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31f80ffd30 0x7f31f8195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31f6ffd700 1 -- 172.21.15.69:0/2038513420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f81043d0 msgr2=0x7f31f8199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31f6ffd700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f81043d0 0x7f31f8199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31f6ffd700 1 -- 172.21.15.69:0/2038513420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80095f0 con 0x7f31f80ff390 2023-12-14T14:11:34.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31f6ffd700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 0x7f31f81952d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f31e800b580 tx=0x7f31e800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31dffff700 1 -- 172.21.15.69:0/2038513420 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e801d070 con 0x7f31f80ff390 2023-12-14T14:11:34.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f810f190 con 0x7f31f80ff390 2023-12-14T14:11:34.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31dffff700 1 -- 172.21.15.69:0/2038513420 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31e8005030 con 0x7f31f80ff390 2023-12-14T14:11:34.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31dffff700 1 -- 172.21.15.69:0/2038513420 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8004ad0 con 0x7f31f80ff390 2023-12-14T14:11:34.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.063+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f810f000 con 0x7f31f80ff390 2023-12-14T14:11:34.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.064+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f810f320 con 0x7f31f80ff390 2023-12-14T14:11:34.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.066+0000 7f31dffff700 1 -- 172.21.15.69:0/2038513420 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f31e8005410 con 0x7f31f80ff390 2023-12-14T14:11:34.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.066+0000 7f31dffff700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f31e00a13e0 0x7f31e00a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.066+0000 7f31dffff700 1 -- 172.21.15.69:0/2038513420 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f31e80ce0a0 con 0x7f31f80ff390 2023-12-14T14:11:34.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.066+0000 7f31f67fc700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f31e00a13e0 0x7f31e00a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.067+0000 7f31f67fc700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f31e00a13e0 0x7f31e00a3890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f31f81968e0 tx=0x7f31ec009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.072+0000 7f31dffff700 1 -- 172.21.15.69:0/2038513420 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f31e8097330 con 0x7f31f80ff390 2023-12-14T14:11:34.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.399+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31f8196730 con 0x7f31f80ff390 2023-12-14T14:11:34.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.399+0000 7f31dffff700 1 -- 172.21.15.69:0/2038513420 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f31e809a950 con 0x7f31f80ff390 2023-12-14T14:11:34.399 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:11:34.399 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:11:34.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.402+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f31e00a13e0 msgr2=0x7f31e00a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.402+0000 7f31fd728700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f31e00a13e0 0x7f31e00a3890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f31f81968e0 tx=0x7f31ec009260 comp rx=0 tx=0).stop 2023-12-14T14:11:34.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.402+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 msgr2=0x7f31f81952d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.402+0000 7f31fd728700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 0x7f31f81952d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f31e800b580 tx=0x7f31e800f690 comp rx=0 tx=0).stop 2023-12-14T14:11:34.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.403+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 shutdown_connections 2023-12-14T14:11:34.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.403+0000 7f31fd728700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f31e00a13e0 0x7f31e00a3890 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.403+0000 7f31fd728700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f81043d0 0x7f31f8199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.403+0000 7f31fd728700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31f80ff390 0x7f31f81952d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.403+0000 7f31fd728700 1 --2- 172.21.15.69:0/2038513420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31f80ffd30 0x7f31f8195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.403+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 >> 172.21.15.69:0/2038513420 conn(0x7f31f8076370 msgr2=0x7f31f80fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.403+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 shutdown_connections 2023-12-14T14:11:34.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.403+0000 7f31fd728700 1 -- 172.21.15.69:0/2038513420 wait complete. 2023-12-14T14:11:34.404 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:11:34.419 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:11:34.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.557+0000 7fdbf2064700 1 -- 172.21.15.69:0/1487226863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104410 msgr2=0x7fdbec10bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.557+0000 7fdbf2064700 1 --2- 172.21.15.69:0/1487226863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104410 0x7fdbec10bfe0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400b0d0 tx=0x7fdbe400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.557+0000 7fdbf2064700 1 -- 172.21.15.69:0/1487226863 shutdown_connections 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.557+0000 7fdbf2064700 1 --2- 172.21.15.69:0/1487226863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104410 0x7fdbec10bfe0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.557+0000 7fdbf2064700 1 --2- 172.21.15.69:0/1487226863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbec0ff3d0 0x7fdbec0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.557+0000 7fdbf2064700 1 --2- 172.21.15.69:0/1487226863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec0ffd70 0x7fdbec103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.557+0000 7fdbf2064700 1 -- 172.21.15.69:0/1487226863 >> 172.21.15.69:0/1487226863 conn(0x7fdbec076230 msgr2=0x7fdbec076630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.557+0000 7fdbf2064700 1 -- 172.21.15.69:0/1487226863 shutdown_connections 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.557+0000 7fdbf2064700 1 -- 172.21.15.69:0/1487226863 wait complete. 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.558+0000 7fdbf2064700 1 Processor -- start 2023-12-14T14:11:34.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.558+0000 7fdbf2064700 1 -- start start 2023-12-14T14:11:34.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.558+0000 7fdbf2064700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec0ff3d0 0x7fdbec195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbf2064700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0ffd70 0x7fdbec195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbf2064700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbec104410 0x7fdbec199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbf2064700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec19a2e0 con 0x7fdbec0ffd70 2023-12-14T14:11:34.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbf2064700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec19a450 con 0x7fdbec0ff3d0 2023-12-14T14:11:34.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbf2064700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec19a610 con 0x7fdbec104410 2023-12-14T14:11:34.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0ffd70 0x7fdbec195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0ffd70 0x7fdbec195840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58518/0 (socket says 172.21.15.69:58518) 2023-12-14T14:11:34.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeaffd700 1 -- 172.21.15.69:0/892814250 learned_addr learned my addr 172.21.15.69:0/892814250 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec0ff3d0 0x7fdbec195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbebfff700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbec104410 0x7fdbec199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeaffd700 1 -- 172.21.15.69:0/892814250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbec104410 msgr2=0x7fdbec199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbec104410 0x7fdbec199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeaffd700 1 -- 172.21.15.69:0/892814250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec0ff3d0 msgr2=0x7fdbec195300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec0ff3d0 0x7fdbec195300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeaffd700 1 -- 172.21.15.69:0/892814250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4009d00 con 0x7fdbec0ffd70 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec0ff3d0 0x7fdbec195300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0ffd70 0x7fdbec195840 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000d950 tx=0x7fdbe000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbe8ff9700 1 -- 172.21.15.69:0/892814250 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe000bb60 con 0x7fdbec0ffd70 2023-12-14T14:11:34.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbf2064700 1 -- 172.21.15.69:0/892814250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec10f1e0 con 0x7fdbec0ffd70 2023-12-14T14:11:34.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbe8ff9700 1 -- 172.21.15.69:0/892814250 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbe000de30 con 0x7fdbec0ffd70 2023-12-14T14:11:34.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.559+0000 7fdbe8ff9700 1 -- 172.21.15.69:0/892814250 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00054e0 con 0x7fdbec0ffd70 2023-12-14T14:11:34.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.560+0000 7fdbf2064700 1 -- 172.21.15.69:0/892814250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec10f050 con 0x7fdbec0ffd70 2023-12-14T14:11:34.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.563+0000 7fdbe8ff9700 1 -- 172.21.15.69:0/892814250 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fdbe0004750 con 0x7fdbec0ffd70 2023-12-14T14:11:34.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.563+0000 7fdbe8ff9700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdbd40a13e0 0x7fdbd40a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.564+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdbd40a13e0 0x7fdbd40a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.564+0000 7fdbe8ff9700 1 -- 172.21.15.69:0/892814250 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fdbe00cc850 con 0x7fdbec0ffd70 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.564+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdbd40a13e0 0x7fdbd40a3890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc005fd0 tx=0x7fdbdc005e30 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.564+0000 7fdbfe1f2b80 1 Processor -- start 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.564+0000 7fdbfe1f2b80 1 -- start start 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 0x5653d0315750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0322f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d01ff5e0 con 0x5653d0315c90 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d026e870 con 0x5653d0320b50 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d0267d00 con 0x5653d0315380 2023-12-14T14:11:34.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58530/0 (socket says 172.21.15.69:58530) 2023-12-14T14:11:34.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeaffd700 1 -- 172.21.15.69:0/1281340966 learned_addr learned my addr 172.21.15.69:0/1281340966 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbebfff700 1 --2- 172.21.15.69:0/1281340966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0322f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/1281340966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 0x5653d0315750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeaffd700 1 -- 172.21.15.69:0/1281340966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 msgr2=0x5653d0315750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/1281340966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 0x5653d0315750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeaffd700 1 -- 172.21.15.69:0/1281340966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 msgr2=0x5653d0322f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/1281340966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0322f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeaffd700 1 -- 172.21.15.69:0/1281340966 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653d00e93b0 con 0x5653d0315c90 2023-12-14T14:11:34.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.565+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/1281340966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320610 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0099410 tx=0x7fdbe00992d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d869fab8cc27c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.566+0000 7fdbd1ffb700 1 -- 172.21.15.69:0/1281340966 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe009d740 con 0x5653d0315c90 2023-12-14T14:11:34.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.566+0000 7fdbd1ffb700 1 -- 172.21.15.69:0/1281340966 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbe00a1b60 con 0x5653d0315c90 2023-12-14T14:11:34.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.566+0000 7fdbd1ffb700 1 -- 172.21.15.69:0/1281340966 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0098e40 con 0x5653d0315c90 2023-12-14T14:11:34.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.566+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1281340966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 msgr2=0x5653d0320610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.566+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1281340966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320610 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0099410 tx=0x7fdbe00992d0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.566+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1281340966 shutdown_connections 2023-12-14T14:11:34.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.566+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1281340966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0322f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.566+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1281340966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 0x5653d0315750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.566+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1281340966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320610 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.567+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1281340966 >> 172.21.15.69:0/1281340966 conn(0x5653d030bca0 msgr2=0x5653d03117e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.567+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1281340966 shutdown_connections 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.567+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1281340966 wait complete. 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.567+0000 7fdbfe1f2b80 1 -- start start 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.567+0000 7fdbfe1f2b80 1 Processor -- start 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.567+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315380 0x5653d0320550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315c90 0x5653d031d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d031de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d0203f90 con 0x5653d0315380 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d0203c30 con 0x5653d0320b50 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d00eb6a0 con 0x5653d0315c90 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbfe1f2b80 10 client.0 _ll_register_callbacks cb 0x5653d0227910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315380 0x5653d0320550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315380 0x5653d0320550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58538/0 (socket says 172.21.15.69:58538) 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeb7fe700 1 -- 172.21.15.69:0/1932889683 learned_addr learned my addr 172.21.15.69:0/1932889683 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315c90 0x5653d031d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeb7fe700 1 -- 172.21.15.69:0/1932889683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315c90 msgr2=0x5653d031d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbebfff700 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d031de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315c90 0x5653d031d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeb7fe700 1 -- 172.21.15.69:0/1932889683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 msgr2=0x5653d031de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d031de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeb7fe700 1 -- 172.21.15.69:0/1932889683 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec10f050 con 0x5653d0315380 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315c90 0x5653d031d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbebfff700 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d031de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315380 0x5653d0320550 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc010990 tx=0x7fdbdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8910c69eb47edd74 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbcaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbcaffd700 1 -- 172.21.15.69:0/1932889683 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc01da50 con 0x5653d0315380 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbcaffd700 1 -- 172.21.15.69:0/1932889683 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fdbdc01dbb0 con 0x5653d0315380 2023-12-14T14:11:34.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.568+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1932889683 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653d03092b0 con 0x5653d0315380 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbcaffd700 1 -- 172.21.15.69:0/1932889683 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbdc01dd70 con 0x5653d0315380 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbfe1f2b80 10 client.15639 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1932889683 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5653d022e170 con 0x5653d0315380 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbcaffd700 1 -- 172.21.15.69:0/1932889683 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5653d03092b0 con 0x5653d0315380 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbcaffd700 1 -- 172.21.15.69:0/1932889683 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdbdc0265b0 con 0x5653d0315380 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbfe1f2b80 10 client.15639 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbfe1f2b80 10 client.15639 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbfe1f2b80 20 client.15639 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5653d0334820 0x5653d0336c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbfe1f2b80 4 client.15639 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:34.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.569+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1932889683 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653d0260ce0 con 0x5653d0334820 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.570+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5653d0334820 0x5653d0336c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.570+0000 7fdbcaffd700 10 client.15639 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.570+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5653d0334820 0x5653d0336c30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f1e4f4b8156efe5 server_cookie=45c7bf07627f1b32 in_seq=0 out_seq=0 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbcaffd700 1 -- 172.21.15.69:0/1932889683 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5653d0260ce0 con 0x5653d0334820 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbcaffd700 10 client.15639 handle_command_reply: tid=0 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 client.15639 shutdown 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1932889683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315380 msgr2=0x5653d0320550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315380 0x5653d0320550 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc010990 tx=0x7fdbdc004750 comp rx=0 tx=0).stop 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1932889683 shutdown_connections 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d031de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5653d0334820 0x5653d0336c30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315380 0x5653d0320550 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/1932889683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315c90 0x5653d031d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1932889683 >> 172.21.15.69:0/1932889683 conn(0x5653d030bca0 msgr2=0x5653d03113d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbcaffd700 0 client.15639 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:11:34.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1932889683 shutdown_connections 2023-12-14T14:11:34.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/1932889683 wait complete. 2023-12-14T14:11:34.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.571+0000 7fdbfe1f2b80 20 client.15639 trim_cache size 0 max 16384 2023-12-14T14:11:34.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.584+0000 7fdbfe1f2b80 1 Processor -- start 2023-12-14T14:11:34.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.584+0000 7fdbfe1f2b80 1 -- start start 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.584+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 0x5653d0318270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.584+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.584+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0320550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.584+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d031e9e0 con 0x5653d0315c90 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.584+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d0260d10 con 0x5653d0320b50 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.584+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d03165b0 con 0x5653d0315380 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0320550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0320550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:46966/0 (socket says 172.21.15.69:46966) 2023-12-14T14:11:34.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58552/0 (socket says 172.21.15.69:58552) 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbebfff700 1 -- 172.21.15.69:0/2436572355 learned_addr learned my addr 172.21.15.69:0/2436572355 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/2436572355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 0x5653d0318270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbeaffd700 1 -- 172.21.15.69:0/2436572355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 msgr2=0x5653d0318270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/2436572355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 0x5653d0318270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbeaffd700 1 -- 172.21.15.69:0/2436572355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 msgr2=0x5653d0320550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/2436572355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0320550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbeaffd700 1 -- 172.21.15.69:0/2436572355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653d022dec0 con 0x5653d0315c90 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbebfff700 1 --2- 172.21.15.69:0/2436572355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0320550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/2436572355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320010 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0096180 tx=0x7fdbe0084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf8654f3ba8cd1a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbd27fc700 1 -- 172.21.15.69:0/2436572355 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe009d7c0 con 0x5653d0315c90 2023-12-14T14:11:34.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbd27fc700 1 -- 172.21.15.69:0/2436572355 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbe000bcc0 con 0x5653d0315c90 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.585+0000 7fdbd27fc700 1 -- 172.21.15.69:0/2436572355 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0098e60 con 0x5653d0315c90 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/2436572355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 msgr2=0x5653d0320010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/2436572355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320010 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0096180 tx=0x7fdbe0084040 comp rx=0 tx=0).stop 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/2436572355 shutdown_connections 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/2436572355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0320b50 0x5653d0320550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/2436572355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0315380 0x5653d0318270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/2436572355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d0320010 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/2436572355 >> 172.21.15.69:0/2436572355 conn(0x5653d030bca0 msgr2=0x5653d0318bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/2436572355 shutdown_connections 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/2436572355 wait complete. 2023-12-14T14:11:34.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.586+0000 7fdbfe1f2b80 1 -- start start 2023-12-14T14:11:34.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbfe1f2b80 1 Processor -- start 2023-12-14T14:11:34.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0315380 0x5653d0329360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d03298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbfe1f2b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0320b50 0x5653d03876c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d032a0f0 con 0x5653d0315c90 2023-12-14T14:11:34.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d0387c00 con 0x5653d0315380 2023-12-14T14:11:34.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbfe1f2b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d0387d40 con 0x5653d0320b50 2023-12-14T14:11:34.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbfe1f2b80 10 client.0 _ll_register_callbacks cb 0x5653d0227910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:34.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d03298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d03298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58558/0 (socket says 172.21.15.69:58558) 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbeaffd700 1 -- 172.21.15.69:0/133248420 learned_addr learned my addr 172.21.15.69:0/133248420 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0315380 0x5653d0329360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbebfff700 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0320b50 0x5653d03876c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbeaffd700 1 -- 172.21.15.69:0/133248420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0320b50 msgr2=0x5653d03876c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0320b50 0x5653d03876c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbeaffd700 1 -- 172.21.15.69:0/133248420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0315380 msgr2=0x5653d0329360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0315380 0x5653d0329360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.587+0000 7fdbeaffd700 1 -- 172.21.15.69:0/133248420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec10c820 con 0x5653d0315c90 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.588+0000 7fdbeaffd700 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d03298a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00996a0 tx=0x7fdbe000bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb6e99cdc6d28e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.588+0000 7fdbcaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.588+0000 7fdbcaffd700 1 -- 172.21.15.69:0/133248420 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe009d7c0 con 0x5653d0315c90 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.588+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/133248420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653d0260a00 con 0x5653d0315c90 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.588+0000 7fdbcaffd700 1 -- 172.21.15.69:0/133248420 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fdbe00b78a0 con 0x5653d0315c90 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.588+0000 7fdbcaffd700 1 -- 172.21.15.69:0/133248420 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbe000bcc0 con 0x5653d0315c90 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.588+0000 7fdbfe1f2b80 10 client.15645 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.588+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/133248420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7fdbe00b1040 con 0x5653d0315c90 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.588+0000 7fdbcaffd700 1 -- 172.21.15.69:0/133248420 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5653d0260a00 con 0x5653d0315c90 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbcaffd700 1 -- 172.21.15.69:0/133248420 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdbe00a16d0 con 0x5653d0315c90 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbfe1f2b80 10 client.15645 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbfe1f2b80 10 client.15645 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbfe1f2b80 20 client.15645 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5653d0388fe0 0x5653d038b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbfe1f2b80 4 client.15645 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/133248420 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5653d00b6cf0 con 0x5653d0388fe0 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5653d0388fe0 0x5653d038b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbcaffd700 10 client.15645 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.589+0000 7fdbeb7fe700 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5653d0388fe0 0x5653d038b3c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48bd684df32161c2 server_cookie=12e4a98ff8de08a8 in_seq=0 out_seq=0 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbcaffd700 1 -- 172.21.15.69:0/133248420 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5653d00b6cf0 con 0x5653d0388fe0 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbcaffd700 10 client.15645 handle_command_reply: tid=0 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 client.15645 shutdown 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/133248420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 msgr2=0x5653d03298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d03298a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00996a0 tx=0x7fdbe000bf70 comp rx=0 tx=0).stop 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/133248420 shutdown_connections 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d0320b50 0x5653d03876c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653d0315380 0x5653d0329360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5653d0388fe0 0x5653d038b3c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 --2- 172.21.15.69:0/133248420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653d0315c90 0x5653d03298a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbcaffd700 0 client.15645 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:11:34.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/133248420 >> 172.21.15.69:0/133248420 conn(0x5653d030bca0 msgr2=0x5653d031d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/133248420 shutdown_connections 2023-12-14T14:11:34.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 1 -- 172.21.15.69:0/133248420 wait complete. 2023-12-14T14:11:34.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.590+0000 7fdbfe1f2b80 20 client.15645 trim_cache size 0 max 16384 2023-12-14T14:11:34.597 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:11:34.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 -- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdbd40a13e0 msgr2=0x7fdbd40a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdbd40a13e0 0x7fdbd40a3890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc005fd0 tx=0x7fdbdc005e30 comp rx=0 tx=0).stop 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 -- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0ffd70 msgr2=0x7fdbec195840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0ffd70 0x7fdbec195840 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000d950 tx=0x7fdbe000dd10 comp rx=0 tx=0).stop 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 -- 172.21.15.69:0/892814250 shutdown_connections 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdbd40a13e0 0x7fdbd40a3890 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbec104410 0x7fdbec199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec0ff3d0 0x7fdbec195300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 --2- 172.21.15.69:0/892814250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0ffd70 0x7fdbec195840 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 -- 172.21.15.69:0/892814250 >> 172.21.15.69:0/892814250 conn(0x7fdbec076230 msgr2=0x7fdbec102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 -- 172.21.15.69:0/892814250 shutdown_connections 2023-12-14T14:11:34.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.591+0000 7fdbf2064700 1 -- 172.21.15.69:0/892814250 wait complete. 2023-12-14T14:11:34.602 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:11:34.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 -- 172.21.15.69:0/534676415 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101d60 msgr2=0x7fa37810a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 --2- 172.21.15.69:0/534676415 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101d60 0x7fa37810a250 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009990 tx=0x7fa36c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 -- 172.21.15.69:0/534676415 shutdown_connections 2023-12-14T14:11:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 --2- 172.21.15.69:0/534676415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa37810a790 0x7fa37810cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 --2- 172.21.15.69:0/534676415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa378101450 0x7fa378101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 --2- 172.21.15.69:0/534676415 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101d60 0x7fa37810a250 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 -- 172.21.15.69:0/534676415 >> 172.21.15.69:0/534676415 conn(0x7fa378076230 msgr2=0x7fa378076630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 -- 172.21.15.69:0/534676415 shutdown_connections 2023-12-14T14:11:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 -- 172.21.15.69:0/534676415 wait complete. 2023-12-14T14:11:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.734+0000 7fa37e120700 1 Processor -- start 2023-12-14T14:11:34.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa37e120700 1 -- start start 2023-12-14T14:11:34.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa37e120700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101450 0x7fa378196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa37e120700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa378101d60 0x7fa378196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa37e120700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa37810a790 0x7fa37819ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa37e120700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37819b320 con 0x7fa378101450 2023-12-14T14:11:34.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa37e120700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37819b490 con 0x7fa37810a790 2023-12-14T14:11:34.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa37e120700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37819b650 con 0x7fa378101d60 2023-12-14T14:11:34.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa3777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101450 0x7fa378196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa3777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101450 0x7fa378196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58576/0 (socket says 172.21.15.69:58576) 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa3777fe700 1 -- 172.21.15.69:0/151515655 learned_addr learned my addr 172.21.15.69:0/151515655 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa377fff700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa37810a790 0x7fa37819ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa376ffd700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa378101d60 0x7fa378196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa3777fe700 1 -- 172.21.15.69:0/151515655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa378101d60 msgr2=0x7fa378196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa3777fe700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa378101d60 0x7fa378196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa3777fe700 1 -- 172.21.15.69:0/151515655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa37810a790 msgr2=0x7fa37819ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa3777fe700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa37810a790 0x7fa37819ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.735+0000 7fa3777fe700 1 -- 172.21.15.69:0/151515655 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0095f0 con 0x7fa378101450 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.736+0000 7fa3777fe700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101450 0x7fa378196340 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa36800d980 tx=0x7fa36800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.736+0000 7fa374ff9700 1 -- 172.21.15.69:0/151515655 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368004a30 con 0x7fa378101450 2023-12-14T14:11:34.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.736+0000 7fa37e120700 1 -- 172.21.15.69:0/151515655 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa378110230 con 0x7fa378101450 2023-12-14T14:11:34.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.736+0000 7fa374ff9700 1 -- 172.21.15.69:0/151515655 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3680054e0 con 0x7fa378101450 2023-12-14T14:11:34.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.736+0000 7fa374ff9700 1 -- 172.21.15.69:0/151515655 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800fbc0 con 0x7fa378101450 2023-12-14T14:11:34.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.736+0000 7fa37e120700 1 -- 172.21.15.69:0/151515655 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3781100a0 con 0x7fa378101450 2023-12-14T14:11:34.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.740+0000 7fa374ff9700 1 -- 172.21.15.69:0/151515655 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fa368004c20 con 0x7fa378101450 2023-12-14T14:11:34.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.741+0000 7fa38a2aeb80 1 Processor -- start 2023-12-14T14:11:34.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.741+0000 7fa374ff9700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa3600a13e0 0x7fa3600a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.741+0000 7fa38a2aeb80 1 -- start start 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.741+0000 7fa374ff9700 1 -- 172.21.15.69:0/151515655 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa368005650 con 0x7fa378101450 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7df750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7dfc90 0x558b5c7ea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7eab50 0x558b5c7ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c6c95e0 con 0x558b5c7df380 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c738870 con 0x558b5c7eab50 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c731d00 con 0x558b5c7dfc90 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa377fff700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa3600a13e0 0x7fa3600a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa377fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7eab50 0x558b5c7ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa377fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7eab50 0x558b5c7ecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:47006/0 (socket says 172.21.15.69:47006) 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa377fff700 1 -- 172.21.15.69:0/3318403354 learned_addr learned my addr 172.21.15.69:0/3318403354 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.742+0000 7fa376ffd700 1 --2- 172.21.15.69:0/3318403354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7dfc90 0x558b5c7ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa3777fe700 1 --2- 172.21.15.69:0/3318403354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7df750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa376ffd700 1 -- 172.21.15.69:0/3318403354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7eab50 msgr2=0x558b5c7ecf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa376ffd700 1 --2- 172.21.15.69:0/3318403354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7eab50 0x558b5c7ecf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa376ffd700 1 -- 172.21.15.69:0/3318403354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 msgr2=0x558b5c7df750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa376ffd700 1 --2- 172.21.15.69:0/3318403354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7df750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa376ffd700 1 -- 172.21.15.69:0/3318403354 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b5c5b33b0 con 0x558b5c7dfc90 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa377fff700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa3600a13e0 0x7fa3600a3890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa370009cd0 tx=0x7fa370004320 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa376ffd700 1 --2- 172.21.15.69:0/3318403354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7dfc90 0x558b5c7ea610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00b5c0 tx=0x7fa36c005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f96fc07449e08e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa35dffb700 1 -- 172.21.15.69:0/3318403354 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c01d050 con 0x558b5c7dfc90 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa35dffb700 1 -- 172.21.15.69:0/3318403354 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa36c01e040 con 0x558b5c7dfc90 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.743+0000 7fa35dffb700 1 -- 172.21.15.69:0/3318403354 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0050b0 con 0x558b5c7dfc90 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/3318403354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7dfc90 msgr2=0x558b5c7ea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/3318403354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7dfc90 0x558b5c7ea610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00b5c0 tx=0x7fa36c005e80 comp rx=0 tx=0).stop 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/3318403354 shutdown_connections 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/3318403354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7eab50 0x558b5c7ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/3318403354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7df750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/3318403354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7dfc90 0x558b5c7ea610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/3318403354 >> 172.21.15.69:0/3318403354 conn(0x558b5c7d5ca0 msgr2=0x558b5c7db7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/3318403354 shutdown_connections 2023-12-14T14:11:34.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/3318403354 wait complete. 2023-12-14T14:11:34.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.744+0000 7fa38a2aeb80 1 -- start start 2023-12-14T14:11:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa38a2aeb80 1 Processor -- start 2023-12-14T14:11:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7df380 0x558b5c7ea570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 0x558b5c7e7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7eab50 0x558b5c7e7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c6cdf90 con 0x558b5c7eab50 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c6cdc30 con 0x558b5c7dfc90 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c5b56a0 con 0x558b5c7df380 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa38a2aeb80 10 client.0 _ll_register_callbacks cb 0x558b5c6f1910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa377fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7eab50 0x558b5c7e7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa377fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7eab50 0x558b5c7e7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58602/0 (socket says 172.21.15.69:58602) 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa377fff700 1 -- 172.21.15.69:0/2000498949 learned_addr learned my addr 172.21.15.69:0/2000498949 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.745+0000 7fa3777fe700 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7df380 0x558b5c7ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa376ffd700 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 0x558b5c7e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa3777fe700 1 -- 172.21.15.69:0/2000498949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 msgr2=0x558b5c7e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa3777fe700 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 0x558b5c7e7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa3777fe700 1 -- 172.21.15.69:0/2000498949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7eab50 msgr2=0x558b5c7e7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa3777fe700 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7eab50 0x558b5c7e7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa3777fe700 1 -- 172.21.15.69:0/2000498949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37810d890 con 0x558b5c7df380 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa376ffd700 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 0x558b5c7e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa3777fe700 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7df380 0x558b5c7ea570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3680c9650 tx=0x7fa368099030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19638f484919e027 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa356ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa356ffd700 1 -- 172.21.15.69:0/2000498949 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680b0070 con 0x558b5c7df380 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2000498949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b5c7d32b0 con 0x558b5c7df380 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa356ffd700 1 -- 172.21.15.69:0/2000498949 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa368099370 con 0x558b5c7df380 2023-12-14T14:11:34.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa356ffd700 1 -- 172.21.15.69:0/2000498949 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa368014070 con 0x558b5c7df380 2023-12-14T14:11:34.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa38a2aeb80 10 client.25168 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:34.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.746+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2000498949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x558b5c6f8170 con 0x558b5c7df380 2023-12-14T14:11:34.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.747+0000 7fa356ffd700 1 -- 172.21.15.69:0/2000498949 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558b5c7d32b0 con 0x558b5c7df380 2023-12-14T14:11:34.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.747+0000 7fa356ffd700 1 -- 172.21.15.69:0/2000498949 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3680a0ec0 con 0x558b5c7df380 2023-12-14T14:11:34.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.747+0000 7fa38a2aeb80 10 client.25168 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:34.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.747+0000 7fa38a2aeb80 10 client.25168 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:11:34.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.747+0000 7fa38a2aeb80 20 client.25168 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:34.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.747+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x558b5c7fa3d0 0x558b5c7fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.747+0000 7fa38a2aeb80 4 client.25168 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.747+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2000498949 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b5c72ace0 con 0x558b5c7fa3d0 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.747+0000 7fa376ffd700 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x558b5c7fa3d0 0x558b5c7fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.748+0000 7fa376ffd700 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x558b5c7fa3d0 0x558b5c7fc7e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=870f671aec38f4e3 server_cookie=dfd8354057c2dc3e in_seq=0 out_seq=0 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.748+0000 7fa356ffd700 10 client.25168 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.748+0000 7fa356ffd700 1 -- 172.21.15.69:0/2000498949 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558b5c72ace0 con 0x558b5c7fa3d0 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.748+0000 7fa356ffd700 10 client.25168 handle_command_reply: tid=0 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.748+0000 7fa38a2aeb80 1 client.25168 shutdown 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.748+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2000498949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7df380 msgr2=0x558b5c7ea570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.748+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7df380 0x558b5c7ea570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3680c9650 tx=0x7fa368099030 comp rx=0 tx=0).stop 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.748+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2000498949 shutdown_connections 2023-12-14T14:11:34.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.749+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x558b5c7fa3d0 0x558b5c7fc7e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.749+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7eab50 0x558b5c7e7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.749+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7df380 0x558b5c7ea570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.749+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2000498949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 0x558b5c7e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.749+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2000498949 >> 172.21.15.69:0/2000498949 conn(0x558b5c7d5ca0 msgr2=0x558b5c7db3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.749+0000 7fa356ffd700 0 client.25168 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:11:34.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.749+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2000498949 shutdown_connections 2023-12-14T14:11:34.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.749+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2000498949 wait complete. 2023-12-14T14:11:34.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.749+0000 7fa38a2aeb80 20 client.25168 trim_cache size 0 max 16384 2023-12-14T14:11:34.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa38a2aeb80 1 Processor -- start 2023-12-14T14:11:34.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa38a2aeb80 1 -- start start 2023-12-14T14:11:34.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7df380 0x558b5c7f1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7dfc90 0x558b5c7f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 0x558b5c7ea030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c7e8a70 con 0x558b5c7dfc90 2023-12-14T14:11:34.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c7e36e0 con 0x558b5c7df380 2023-12-14T14:11:34.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c7f1b70 con 0x558b5c7eab50 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa376ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7dfc90 0x558b5c7f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa3777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7df380 0x558b5c7f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa376ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7dfc90 0x558b5c7f67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58604/0 (socket says 172.21.15.69:58604) 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa376ffd700 1 -- 172.21.15.69:0/711881887 learned_addr learned my addr 172.21.15.69:0/711881887 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa377fff700 1 --2- 172.21.15.69:0/711881887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 0x558b5c7ea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa3777fe700 1 -- 172.21.15.69:0/711881887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 msgr2=0x558b5c7ea030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa3777fe700 1 --2- 172.21.15.69:0/711881887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 0x558b5c7ea030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa3777fe700 1 -- 172.21.15.69:0/711881887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7dfc90 msgr2=0x558b5c7f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa3777fe700 1 --2- 172.21.15.69:0/711881887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7dfc90 0x558b5c7f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa3777fe700 1 -- 172.21.15.69:0/711881887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b5c6f7ec0 con 0x558b5c7df380 2023-12-14T14:11:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.762+0000 7fa376ffd700 1 --2- 172.21.15.69:0/711881887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7dfc90 0x558b5c7f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.763+0000 7fa3777fe700 1 --2- 172.21.15.69:0/711881887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7df380 0x558b5c7f1630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa368098c00 tx=0x7fa368010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb113e6865ef5760 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.763+0000 7fa35e7fc700 1 -- 172.21.15.69:0/711881887 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680b0020 con 0x558b5c7df380 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.763+0000 7fa35e7fc700 1 -- 172.21.15.69:0/711881887 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3680a1350 con 0x558b5c7df380 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.763+0000 7fa35e7fc700 1 -- 172.21.15.69:0/711881887 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680a0fe0 con 0x558b5c7df380 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.763+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/711881887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7df380 msgr2=0x558b5c7f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.763+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/711881887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7df380 0x558b5c7f1630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa368098c00 tx=0x7fa368010000 comp rx=0 tx=0).stop 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.764+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/711881887 shutdown_connections 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.764+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/711881887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 0x558b5c7ea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.764+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/711881887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7df380 0x558b5c7f1630 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.764+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/711881887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7dfc90 0x558b5c7f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.764+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/711881887 >> 172.21.15.69:0/711881887 conn(0x558b5c7d5ca0 msgr2=0x558b5c7d9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.764+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/711881887 shutdown_connections 2023-12-14T14:11:34.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.764+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/711881887 wait complete. 2023-12-14T14:11:34.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.764+0000 7fa38a2aeb80 1 -- start start 2023-12-14T14:11:34.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.764+0000 7fa38a2aeb80 1 Processor -- start 2023-12-14T14:11:34.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 0x558b5c7ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa38a2aeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 0x558b5c847260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c8477a0 con 0x558b5c7df380 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c847910 con 0x558b5c7dfc90 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa38a2aeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5c847ad0 con 0x558b5c7eab50 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa38a2aeb80 10 client.0 _ll_register_callbacks cb 0x7fa368098a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa3777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa3777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7ef2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58616/0 (socket says 172.21.15.69:58616) 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa3777fe700 1 -- 172.21.15.69:0/2271632488 learned_addr learned my addr 172.21.15.69:0/2271632488 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa376ffd700 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 0x558b5c7ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa377fff700 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 0x558b5c847260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa3777fe700 1 -- 172.21.15.69:0/2271632488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 msgr2=0x558b5c847260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa3777fe700 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 0x558b5c847260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa3777fe700 1 -- 172.21.15.69:0/2271632488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 msgr2=0x558b5c7ef7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa3777fe700 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 0x558b5c7ef7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa3777fe700 1 -- 172.21.15.69:0/2271632488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b5c5b33b0 con 0x558b5c7df380 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa3777fe700 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7ef2b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa3680c9ee0 tx=0x7fa368098910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144d3da8e4e1a454 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa356ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.765+0000 7fa356ffd700 1 -- 172.21.15.69:0/2271632488 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368014030 con 0x558b5c7df380 2023-12-14T14:11:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa356ffd700 1 -- 172.21.15.69:0/2271632488 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa368015070 con 0x558b5c7df380 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2271632488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa36c01e040 con 0x558b5c7df380 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa356ffd700 1 -- 172.21.15.69:0/2271632488 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3680b0040 con 0x558b5c7df380 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa38a2aeb80 10 client.15663 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2271632488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x558b5c6f8170 con 0x558b5c7df380 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa356ffd700 1 -- 172.21.15.69:0/2271632488 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa36c01e040 con 0x558b5c7df380 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa356ffd700 1 -- 172.21.15.69:0/2271632488 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa368004f20 con 0x558b5c7df380 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa38a2aeb80 10 client.15663 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa38a2aeb80 10 client.15663 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa38a2aeb80 20 client.15663 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x558b5c84ed70 0x558b5c851180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa38a2aeb80 4 client.15663 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.766+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2271632488 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558b5c72aa00 con 0x558b5c84ed70 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa376ffd700 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x558b5c84ed70 0x558b5c851180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa356ffd700 10 client.15663 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa376ffd700 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x558b5c84ed70 0x558b5c851180 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d4a133a9f4288d1 server_cookie=d96f09c0ac1a0450 in_seq=0 out_seq=0 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa356ffd700 1 -- 172.21.15.69:0/2271632488 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558b5c72aa00 con 0x558b5c84ed70 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa356ffd700 10 client.15663 handle_command_reply: tid=0 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa38a2aeb80 1 client.15663 shutdown 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2271632488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 msgr2=0x558b5c7ef2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7ef2b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa3680c9ee0 tx=0x7fa368098910 comp rx=0 tx=0).stop 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2271632488 shutdown_connections 2023-12-14T14:11:34.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b5c7eab50 0x558b5c847260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x558b5c84ed70 0x558b5c851180 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558b5c7df380 0x558b5c7ef2b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa38a2aeb80 1 --2- 172.21.15.69:0/2271632488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558b5c7dfc90 0x558b5c7ef7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa356ffd700 0 client.15663 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:11:34.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.767+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2271632488 >> 172.21.15.69:0/2271632488 conn(0x558b5c7d5ca0 msgr2=0x558b5c7f67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2271632488 shutdown_connections 2023-12-14T14:11:34.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa38a2aeb80 1 -- 172.21.15.69:0/2271632488 wait complete. 2023-12-14T14:11:34.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa38a2aeb80 20 client.15663 trim_cache size 0 max 16384 2023-12-14T14:11:34.776 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:11:34.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 -- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa3600a13e0 msgr2=0x7fa3600a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa3600a13e0 0x7fa3600a3890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa370009cd0 tx=0x7fa370004320 comp rx=0 tx=0).stop 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 -- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101450 msgr2=0x7fa378196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101450 0x7fa378196340 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa36800d980 tx=0x7fa36800dc90 comp rx=0 tx=0).stop 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 -- 172.21.15.69:0/151515655 shutdown_connections 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa3600a13e0 0x7fa3600a3890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa37810a790 0x7fa37819ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa378101450 0x7fa378196340 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 --2- 172.21.15.69:0/151515655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa378101d60 0x7fa378196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 -- 172.21.15.69:0/151515655 >> 172.21.15.69:0/151515655 conn(0x7fa378076230 msgr2=0x7fa3780fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 -- 172.21.15.69:0/151515655 shutdown_connections 2023-12-14T14:11:34.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.768+0000 7fa37e120700 1 -- 172.21.15.69:0/151515655 wait complete. 2023-12-14T14:11:34.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:34 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2038513420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:11:34.780 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:34 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2038513420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:11:34.781 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:11:34.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:34 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2038513420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:11:34.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.919+0000 7fe7b646a700 1 -- 172.21.15.69:0/2350468972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 msgr2=0x7fe7b010a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.919+0000 7fe7b646a700 1 --2- 172.21.15.69:0/2350468972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 0x7fe7b010a300 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009990 tx=0x7fe7a4009ca0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.919+0000 7fe7b646a700 1 -- 172.21.15.69:0/2350468972 shutdown_connections 2023-12-14T14:11:34.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.919+0000 7fe7b646a700 1 --2- 172.21.15.69:0/2350468972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b010a840 0x7fe7b010cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.919+0000 7fe7b646a700 1 --2- 172.21.15.69:0/2350468972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0101320 0x7fe7b01016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.919+0000 7fe7b646a700 1 --2- 172.21.15.69:0/2350468972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 0x7fe7b010a300 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.919+0000 7fe7b646a700 1 -- 172.21.15.69:0/2350468972 >> 172.21.15.69:0/2350468972 conn(0x7fe7b0076000 msgr2=0x7fe7b0076400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.919+0000 7fe7b646a700 1 -- 172.21.15.69:0/2350468972 shutdown_connections 2023-12-14T14:11:34.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.919+0000 7fe7b646a700 1 -- 172.21.15.69:0/2350468972 wait complete. 2023-12-14T14:11:34.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7b646a700 1 Processor -- start 2023-12-14T14:11:34.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7b646a700 1 -- start start 2023-12-14T14:11:34.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7b646a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0101320 0x7fe7b01963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7b646a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 0x7fe7b01968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7b646a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b010a840 0x7fe7b019ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7b646a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b019b380 con 0x7fe7b0101c30 2023-12-14T14:11:34.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7b646a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b019b4f0 con 0x7fe7b010a840 2023-12-14T14:11:34.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7b646a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b019b6b0 con 0x7fe7b0101320 2023-12-14T14:11:34.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 0x7fe7b01968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 0x7fe7b01968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58624/0 (socket says 172.21.15.69:58624) 2023-12-14T14:11:34.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7af7fe700 1 -- 172.21.15.69:0/1090468485 learned_addr learned my addr 172.21.15.69:0/1090468485 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.920+0000 7fe7affff700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0101320 0x7fe7b01963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7b4a07700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b010a840 0x7fe7b019ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7af7fe700 1 -- 172.21.15.69:0/1090468485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0101320 msgr2=0x7fe7b01963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0101320 0x7fe7b01963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7af7fe700 1 -- 172.21.15.69:0/1090468485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b010a840 msgr2=0x7fe7b019ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b010a840 0x7fe7b019ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7af7fe700 1 -- 172.21.15.69:0/1090468485 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a40095f0 con 0x7fe7b0101c30 2023-12-14T14:11:34.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7b4a07700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b010a840 0x7fe7b019ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:34.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 0x7fe7b01968e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40095c0 tx=0x7fe7a400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7ad7fa700 1 -- 172.21.15.69:0/1090468485 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a401d070 con 0x7fe7b0101c30 2023-12-14T14:11:34.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7ad7fa700 1 -- 172.21.15.69:0/1090468485 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7a4005050 con 0x7fe7b0101c30 2023-12-14T14:11:34.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7b646a700 1 -- 172.21.15.69:0/1090468485 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b0110310 con 0x7fe7b0101c30 2023-12-14T14:11:34.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7ad7fa700 1 -- 172.21.15.69:0/1090468485 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4004b30 con 0x7fe7b0101c30 2023-12-14T14:11:34.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.921+0000 7fe7b646a700 1 -- 172.21.15.69:0/1090468485 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b0110180 con 0x7fe7b0101c30 2023-12-14T14:11:34.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.924+0000 7fe7ad7fa700 1 -- 172.21.15.69:0/1090468485 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fe7a4004c90 con 0x7fe7b0101c30 2023-12-14T14:11:34.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.925+0000 7fe7c25f8b80 1 Processor -- start 2023-12-14T14:11:34.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.925+0000 7fe7ad7fa700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7980a13e0 0x7fe7980a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.925+0000 7fe7ad7fa700 1 -- 172.21.15.69:0/1090468485 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fe7a40cde60 con 0x7fe7b0101c30 2023-12-14T14:11:34.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.925+0000 7fe7c25f8b80 1 -- start start 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.925+0000 7fe7b4a07700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7980a13e0 0x7fe7980a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d27b90 0x55d671d27f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 0x55d671d25140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 0x55d671d3e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671c095e0 con 0x55d671d27b90 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671c78870 con 0x55d671d3bdd0 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671c71d00 con 0x55d671d284a0 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7b4a07700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7980a13e0 0x7fe7980a3890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009550 tx=0x7fe7a80077e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7b4a07700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 0x55d671d3e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7b4a07700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 0x55d671d3e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:47074/0 (socket says 172.21.15.69:47074) 2023-12-14T14:11:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7b4a07700 1 -- 172.21.15.69:0/102328128 learned_addr learned my addr 172.21.15.69:0/102328128 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7affff700 1 --2- 172.21.15.69:0/102328128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d27b90 0x55d671d27f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7b4a07700 1 -- 172.21.15.69:0/102328128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 msgr2=0x55d671d25140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7b4a07700 1 --2- 172.21.15.69:0/102328128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 0x55d671d25140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7b4a07700 1 -- 172.21.15.69:0/102328128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d27b90 msgr2=0x55d671d27f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7b4a07700 1 --2- 172.21.15.69:0/102328128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d27b90 0x55d671d27f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.926+0000 7fe7b4a07700 1 -- 172.21.15.69:0/102328128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d671af33b0 con 0x55d671d3bdd0 2023-12-14T14:11:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.927+0000 7fe7b4a07700 1 --2- 172.21.15.69:0/102328128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 0x55d671d3e1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7a801b400 tx=0x7fe7a8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a98d54d8d5480b30 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.927+0000 7fe7967fc700 1 -- 172.21.15.69:0/102328128 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a801be60 con 0x55d671d3bdd0 2023-12-14T14:11:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.927+0000 7fe7967fc700 1 -- 172.21.15.69:0/102328128 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7a801c8e0 con 0x55d671d3bdd0 2023-12-14T14:11:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.927+0000 7fe7967fc700 1 -- 172.21.15.69:0/102328128 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8024890 con 0x55d671d3bdd0 2023-12-14T14:11:34.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/102328128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 msgr2=0x55d671d3e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/102328128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 0x55d671d3e1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7a801b400 tx=0x7fe7a8017000 comp rx=0 tx=0).stop 2023-12-14T14:11:34.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/102328128 shutdown_connections 2023-12-14T14:11:34.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/102328128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 0x55d671d3e1b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/102328128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d27b90 0x55d671d27f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/102328128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 0x55d671d25140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/102328128 >> 172.21.15.69:0/102328128 conn(0x55d671d15ca0 msgr2=0x55d671d1b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/102328128 shutdown_connections 2023-12-14T14:11:34.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/102328128 wait complete. 2023-12-14T14:11:34.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.928+0000 7fe7c25f8b80 1 -- start start 2023-12-14T14:11:34.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7c25f8b80 1 Processor -- start 2023-12-14T14:11:34.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d27b90 0x55d671d3c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 0x55d671d47220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671c0df90 con 0x55d671d3bdd0 2023-12-14T14:11:34.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671c0dc30 con 0x55d671d27b90 2023-12-14T14:11:34.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671af56a0 con 0x55d671d284a0 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7c25f8b80 10 client.0 _ll_register_callbacks cb 0x55d671c31910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:42110/0 (socket says 172.21.15.69:42110) 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.929+0000 7fe7af7fe700 1 -- 172.21.15.69:0/749531907 learned_addr learned my addr 172.21.15.69:0/749531907 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe7b4a07700 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 0x55d671d47220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe7af7fe700 1 -- 172.21.15.69:0/749531907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d27b90 msgr2=0x55d671d3c1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d27b90 0x55d671d3c1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe7af7fe700 1 -- 172.21.15.69:0/749531907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 msgr2=0x55d671d47220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 0x55d671d47220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe7af7fe700 1 -- 172.21.15.69:0/749531907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a8007d90 con 0x55d671d284a0 2023-12-14T14:11:34.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40cbbf0 tx=0x7fe7a4005710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afa0c42708db699d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe78f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe78f7fe700 1 -- 172.21.15.69:0/749531907 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a409a4a0 con 0x55d671d284a0 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe78f7fe700 1 -- 172.21.15.69:0/749531907 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fe7a40a3170 con 0x55d671d284a0 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.930+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/749531907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d671d132b0 con 0x55d671d284a0 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.931+0000 7fe78f7fe700 1 -- 172.21.15.69:0/749531907 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a40a2ce0 con 0x55d671d284a0 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.932+0000 7fe7c25f8b80 10 client.25177 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.932+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/749531907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d671c38170 con 0x55d671d284a0 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.932+0000 7fe78f7fe700 1 -- 172.21.15.69:0/749531907 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d671d132b0 con 0x55d671d284a0 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.933+0000 7fe78f7fe700 1 -- 172.21.15.69:0/749531907 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe7a409e030 con 0x55d671d284a0 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.933+0000 7fe7c25f8b80 10 client.25177 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.933+0000 7fe7c25f8b80 10 client.25177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.933+0000 7fe7c25f8b80 20 client.25177 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.933+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d671d5c0e0 0x55d671d5e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.933+0000 7fe7c25f8b80 4 client.25177 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.933+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/749531907 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d671c6ace0 con 0x55d671d5c0e0 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.933+0000 7fe7affff700 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d671d5c0e0 0x55d671d5e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.934+0000 7fe78f7fe700 10 client.25177 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.934+0000 7fe7affff700 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d671d5c0e0 0x55d671d5e4c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb7b02d704069ad4 server_cookie=4f7471e38df1ae5c in_seq=0 out_seq=0 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.935+0000 7fe78f7fe700 1 -- 172.21.15.69:0/749531907 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d671c6ace0 con 0x55d671d5c0e0 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.935+0000 7fe78f7fe700 10 client.25177 handle_command_reply: tid=0 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.935+0000 7fe7c25f8b80 1 client.25177 shutdown 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.935+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/749531907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 msgr2=0x55d671d3c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.935+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40cbbf0 tx=0x7fe7a4005710 comp rx=0 tx=0).stop 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/749531907 shutdown_connections 2023-12-14T14:11:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d671d5c0e0 0x55d671d5e4c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 0x55d671d47220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d27b90 0x55d671d3c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/749531907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/749531907 >> 172.21.15.69:0/749531907 conn(0x55d671d15ca0 msgr2=0x55d671d1b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe78f7fe700 0 client.25177 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/749531907 shutdown_connections 2023-12-14T14:11:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/749531907 wait complete. 2023-12-14T14:11:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.936+0000 7fe7c25f8b80 20 client.25177 trim_cache size 0 max 16384 2023-12-14T14:11:34.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.958+0000 7fe7c25f8b80 1 Processor -- start 2023-12-14T14:11:34.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.958+0000 7fe7c25f8b80 1 -- start start 2023-12-14T14:11:34.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.958+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.958+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.958+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 0x55d671d1fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.958+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671d22db0 con 0x55d671d3bdd0 2023-12-14T14:11:34.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.958+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671d206a0 con 0x55d671d284a0 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.958+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671d5eaa0 con 0x55d671d27b90 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7affff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7b4a07700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 0x55d671d1fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7affff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:42112/0 (socket says 172.21.15.69:42112) 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7affff700 1 -- 172.21.15.69:0/1182320212 learned_addr learned my addr 172.21.15.69:0/1182320212 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7affff700 1 -- 172.21.15.69:0/1182320212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d284a0 msgr2=0x55d671d3c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7affff700 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7affff700 1 -- 172.21.15.69:0/1182320212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 msgr2=0x55d671d1fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7affff700 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 0x55d671d1fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7affff700 1 -- 172.21.15.69:0/1182320212 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d671d174e0 con 0x55d671d27b90 2023-12-14T14:11:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7b4a07700 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 0x55d671d1fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:11:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.959+0000 7fe7affff700 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3c1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005f20 tx=0x7fe7a000a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b448621727454fe server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe796ffd700 1 -- 172.21.15.69:0/1182320212 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0017040 con 0x55d671d27b90 2023-12-14T14:11:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe796ffd700 1 -- 172.21.15.69:0/1182320212 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7a0011440 con 0x55d671d27b90 2023-12-14T14:11:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe796ffd700 1 -- 172.21.15.69:0/1182320212 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0010690 con 0x55d671d27b90 2023-12-14T14:11:34.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/1182320212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 msgr2=0x55d671d3c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3c1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005f20 tx=0x7fe7a000a300 comp rx=0 tx=0).stop 2023-12-14T14:11:34.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/1182320212 shutdown_connections 2023-12-14T14:11:34.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d3bdd0 0x55d671d1fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3c1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/1182320212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d284a0 0x55d671d3c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/1182320212 >> 172.21.15.69:0/1182320212 conn(0x55d671d15ca0 msgr2=0x55d671d587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/1182320212 shutdown_connections 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.960+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/1182320212 wait complete. 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.961+0000 7fe7c25f8b80 1 -- start start 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.961+0000 7fe7c25f8b80 1 Processor -- start 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d284a0 0x55d671d3d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7c25f8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 0x55d671da8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671da94b0 con 0x55d671d284a0 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671da9620 con 0x55d671d3bdd0 2023-12-14T14:11:34.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7c25f8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671da97e0 con 0x55d671d27b90 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7c25f8b80 10 client.0 _ll_register_callbacks cb 0x7fe7a409ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7affff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d284a0 0x55d671d3d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7affff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:42122/0 (socket says 172.21.15.69:42122) 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7affff700 1 -- 172.21.15.69:0/3771277365 learned_addr learned my addr 172.21.15.69:0/3771277365 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7af7fe700 1 -- 172.21.15.69:0/3771277365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 msgr2=0x55d671d3d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7af7fe700 1 -- 172.21.15.69:0/3771277365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 msgr2=0x55d671da8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 0x55d671da8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7af7fe700 1 -- 172.21.15.69:0/3771277365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d671af33b0 con 0x55d671d284a0 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.962+0000 7fe7affff700 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:11:34.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe7af7fe700 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d284a0 0x55d671d3d890 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4005f50 tx=0x7fe7a4099360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01c7234b6ad46a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe78f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe78f7fe700 1 -- 172.21.15.69:0/3771277365 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40b3430 con 0x55d671d284a0 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe78f7fe700 1 -- 172.21.15.69:0/3771277365 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fe7a40a3170 con 0x55d671d284a0 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/3771277365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7a801c8e0 con 0x55d671d284a0 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe78f7fe700 1 -- 172.21.15.69:0/3771277365 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a40970f0 con 0x55d671d284a0 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe7c25f8b80 10 client.15681 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/3771277365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7fe7a000a880 con 0x55d671d284a0 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe78f7fe700 1 -- 172.21.15.69:0/3771277365 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7a801c8e0 con 0x55d671d284a0 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.963+0000 7fe78f7fe700 1 -- 172.21.15.69:0/3771277365 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe7a4005430 con 0x55d671d284a0 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.964+0000 7fe7c25f8b80 10 client.15681 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:34.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.964+0000 7fe7c25f8b80 10 client.15681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.964+0000 7fe7c25f8b80 20 client.15681 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.964+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d671db0be0 0x55d671db2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.964+0000 7fe7c25f8b80 4 client.15681 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.964+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/3771277365 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d671c6aa00 con 0x55d671db0be0 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.964+0000 7fe7affff700 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d671db0be0 0x55d671db2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.964+0000 7fe78f7fe700 10 client.15681 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.964+0000 7fe7affff700 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d671db0be0 0x55d671db2ff0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d35448e137aca3f server_cookie=d5296bb9d01d404 in_seq=0 out_seq=0 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe78f7fe700 1 -- 172.21.15.69:0/3771277365 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d671c6aa00 con 0x55d671db0be0 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe78f7fe700 10 client.15681 handle_command_reply: tid=0 2023-12-14T14:11:34.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 client.15681 shutdown 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/3771277365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d284a0 msgr2=0x55d671d3d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d284a0 0x55d671d3d890 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4005f50 tx=0x7fe7a4099360 comp rx=0 tx=0).stop 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/3771277365 shutdown_connections 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d671db0be0 0x55d671db2ff0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d671d3bdd0 0x55d671da8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d671d27b90 0x55d671d3d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 --2- 172.21.15.69:0/3771277365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d671d284a0 0x55d671d3d890 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe78f7fe700 0 client.15681 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/3771277365 >> 172.21.15.69:0/3771277365 conn(0x55d671d15ca0 msgr2=0x55d671d3c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/3771277365 shutdown_connections 2023-12-14T14:11:34.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 1 -- 172.21.15.69:0/3771277365 wait complete. 2023-12-14T14:11:34.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.965+0000 7fe7c25f8b80 20 client.15681 trim_cache size 0 max 16384 2023-12-14T14:11:34.972 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:11:34.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 -- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7980a13e0 msgr2=0x7fe7980a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7980a13e0 0x7fe7980a3890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009550 tx=0x7fe7a80077e0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 -- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 msgr2=0x7fe7b01968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:34.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 0x7fe7b01968e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40095c0 tx=0x7fe7a400f690 comp rx=0 tx=0).stop 2023-12-14T14:11:34.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 -- 172.21.15.69:0/1090468485 shutdown_connections 2023-12-14T14:11:34.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7980a13e0 0x7fe7980a3890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b010a840 0x7fe7b019ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0101320 0x7fe7b01963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 --2- 172.21.15.69:0/1090468485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7b0101c30 0x7fe7b01968e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:34.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 -- 172.21.15.69:0/1090468485 >> 172.21.15.69:0/1090468485 conn(0x7fe7b0076000 msgr2=0x7fe7b01043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:34.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 -- 172.21.15.69:0/1090468485 shutdown_connections 2023-12-14T14:11:34.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:34.967+0000 7fe7b646a700 1 -- 172.21.15.69:0/1090468485 wait complete. 2023-12-14T14:11:35.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:35 smithi119 ceph-mon[43834]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:11:35.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:35 smithi069 ceph-mon[42034]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:11:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:35 smithi081 ceph-mon[43371]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:11:35.982 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:11:35.982 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:11:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.120+0000 7fdddf5d6700 1 -- 172.21.15.69:0/221029393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddd80680c0 msgr2=0x7fddd8068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.120+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/221029393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddd80680c0 0x7fddd8068490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddd40098f0 tx=0x7fddd4009c00 comp rx=0 tx=0).stop 2023-12-14T14:11:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.120+0000 7fdddf5d6700 1 -- 172.21.15.69:0/221029393 shutdown_connections 2023-12-14T14:11:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.120+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/221029393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd81054d0 0x7fddd810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.120+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/221029393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddd80680c0 0x7fddd8068490 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.120+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/221029393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddd8068a60 0x7fddd8104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.120+0000 7fdddf5d6700 1 -- 172.21.15.69:0/221029393 >> 172.21.15.69:0/221029393 conn(0x7fddd8075fd0 msgr2=0x7fddd80763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.120+0000 7fdddf5d6700 1 -- 172.21.15.69:0/221029393 shutdown_connections 2023-12-14T14:11:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.121+0000 7fdddf5d6700 1 -- 172.21.15.69:0/221029393 wait complete. 2023-12-14T14:11:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.121+0000 7fdddf5d6700 1 Processor -- start 2023-12-14T14:11:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.121+0000 7fdddf5d6700 1 -- start start 2023-12-14T14:11:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fdddf5d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddd80680c0 0x7fddd8196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fdddf5d6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd8068a60 0x7fddd8196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fdddf5d6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddd81054d0 0x7fddd819ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fdddf5d6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd819b420 con 0x7fddd81054d0 2023-12-14T14:11:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fdddf5d6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd819b590 con 0x7fddd80680c0 2023-12-14T14:11:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fdddf5d6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd819b750 con 0x7fddd8068a60 2023-12-14T14:11:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddddb73700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddd81054d0 0x7fddd819ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddddb73700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddd81054d0 0x7fddd819ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58696/0 (socket says 172.21.15.69:58696) 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddddb73700 1 -- 172.21.15.69:0/2652269102 learned_addr learned my addr 172.21.15.69:0/2652269102 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fdddcb71700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd8068a60 0x7fddd8196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fdddd372700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddd80680c0 0x7fddd8196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddddb73700 1 -- 172.21.15.69:0/2652269102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd8068a60 msgr2=0x7fddd8196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddddb73700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd8068a60 0x7fddd8196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddddb73700 1 -- 172.21.15.69:0/2652269102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddd80680c0 msgr2=0x7fddd8196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddddb73700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddd80680c0 0x7fddd8196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddddb73700 1 -- 172.21.15.69:0/2652269102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc80095f0 con 0x7fddd81054d0 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddddb73700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddd81054d0 0x7fddd819ade0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fddd0007ee0 tx=0x7fddd000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.122+0000 7fddce7fc700 1 -- 172.21.15.69:0/2652269102 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0017070 con 0x7fddd81054d0 2023-12-14T14:11:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.123+0000 7fdddf5d6700 1 -- 172.21.15.69:0/2652269102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd4009520 con 0x7fddd81054d0 2023-12-14T14:11:36.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.123+0000 7fdddf5d6700 1 -- 172.21.15.69:0/2652269102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd81102e0 con 0x7fddd81054d0 2023-12-14T14:11:36.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.123+0000 7fddce7fc700 1 -- 172.21.15.69:0/2652269102 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddd000f040 con 0x7fddd81054d0 2023-12-14T14:11:36.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.123+0000 7fddce7fc700 1 -- 172.21.15.69:0/2652269102 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0005530 con 0x7fddd81054d0 2023-12-14T14:11:36.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.127+0000 7fddeb764b80 1 Processor -- start 2023-12-14T14:11:36.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.127+0000 7fddeb764b80 1 -- start start 2023-12-14T14:11:36.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 0x555e72d3c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 0x555e72d3cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d50270 0x555e72d52650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fddeb764b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72c26660 con 0x555e72d3c940 2023-12-14T14:11:36.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fddeb764b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72c958f0 con 0x555e72d3de70 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fddeb764b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72c8ed80 con 0x555e72d50270 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fdddcb71700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d50270 0x555e72d52650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fdddcb71700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d50270 0x555e72d52650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:42156/0 (socket says 172.21.15.69:42156) 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fdddcb71700 1 -- 172.21.15.69:0/1389618955 learned_addr learned my addr 172.21.15.69:0/1389618955 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fdddcb71700 1 --2- 172.21.15.69:0/1389618955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 0x555e72d3c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fdddcb71700 1 -- 172.21.15.69:0/1389618955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 msgr2=0x555e72d3c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fdddcb71700 1 --2- 172.21.15.69:0/1389618955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 0x555e72d3c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fdddcb71700 1 -- 172.21.15.69:0/1389618955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 msgr2=0x555e72d3cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fdddcb71700 1 --2- 172.21.15.69:0/1389618955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 0x555e72d3cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.128+0000 7fdddcb71700 1 -- 172.21.15.69:0/1389618955 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e72b10430 con 0x555e72d50270 2023-12-14T14:11:36.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.129+0000 7fdddcb71700 1 --2- 172.21.15.69:0/1389618955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d50270 0x555e72d52650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddc80119b0 tx=0x7fddc80099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a684863df32726c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.129+0000 7fddc37fe700 1 -- 172.21.15.69:0/1389618955 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc80110f0 con 0x555e72d50270 2023-12-14T14:11:36.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.129+0000 7fddc37fe700 1 -- 172.21.15.69:0/1389618955 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddc8004510 con 0x555e72d50270 2023-12-14T14:11:36.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.129+0000 7fddc37fe700 1 -- 172.21.15.69:0/1389618955 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8003d30 con 0x555e72d50270 2023-12-14T14:11:36.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.129+0000 7fddeb764b80 1 -- 172.21.15.69:0/1389618955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d50270 msgr2=0x555e72d52650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.129+0000 7fddeb764b80 1 --2- 172.21.15.69:0/1389618955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d50270 0x555e72d52650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddc80119b0 tx=0x7fddc80099f0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.130+0000 7fddce7fc700 1 -- 172.21.15.69:0/2652269102 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fddd0004ad0 con 0x7fddd81054d0 2023-12-14T14:11:36.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.130+0000 7fddeb764b80 1 -- 172.21.15.69:0/1389618955 shutdown_connections 2023-12-14T14:11:36.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.130+0000 7fddeb764b80 1 --2- 172.21.15.69:0/1389618955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d50270 0x555e72d52650 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.130+0000 7fddeb764b80 1 --2- 172.21.15.69:0/1389618955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 0x555e72d3c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.130+0000 7fddeb764b80 1 --2- 172.21.15.69:0/1389618955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 0x555e72d3cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.130+0000 7fddeb764b80 1 -- 172.21.15.69:0/1389618955 >> 172.21.15.69:0/1389618955 conn(0x555e72d32d20 msgr2=0x555e72d38860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.130+0000 7fddeb764b80 1 -- 172.21.15.69:0/1389618955 shutdown_connections 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.130+0000 7fddeb764b80 1 -- 172.21.15.69:0/1389618955 wait complete. 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.130+0000 7fddeb764b80 1 -- start start 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddeb764b80 1 Processor -- start 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddce7fc700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fddc40a1370 0x7fddc40a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddce7fc700 1 -- 172.21.15.69:0/2652269102 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fddd00cc4c0 con 0x7fddd81054d0 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 0x555e72d49660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3de70 0x555e72d49ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 0x555e72d4f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddeb764b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72c2b010 con 0x555e72d3c940 2023-12-14T14:11:36.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddeb764b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72c2acb0 con 0x555e72d50270 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddeb764b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72b12720 con 0x555e72d3de70 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddeb764b80 10 client.0 _ll_register_callbacks cb 0x555e72c4e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fdddcb71700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fddc40a1370 0x7fddc40a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fddddb73700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 0x555e72d4f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fdddd372700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 0x555e72d49660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fdddd372700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 0x555e72d49660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58714/0 (socket says 172.21.15.69:58714) 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fdddd372700 1 -- 172.21.15.69:0/3623810908 learned_addr learned my addr 172.21.15.69:0/3623810908 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.131+0000 7fdddcb71700 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3de70 0x555e72d49ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fdddcb71700 1 -- 172.21.15.69:0/3623810908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 msgr2=0x555e72d4f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fdddcb71700 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 0x555e72d4f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fdddcb71700 1 -- 172.21.15.69:0/3623810908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 msgr2=0x555e72d49660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fdddcb71700 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 0x555e72d49660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fdddcb71700 1 -- 172.21.15.69:0/3623810908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc8019040 con 0x555e72d3de70 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fdddcb71700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fddc40a1370 0x7fddc40a3820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009a60 tx=0x7fddc8025000 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fdddcb71700 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3de70 0x555e72d49ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddc8005920 tx=0x7fddc8023a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e9e67f308fd1ef4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fddc0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3623810908 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8003780 con 0x555e72d3de70 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3623810908 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fddc80210e0 con 0x555e72d3de70 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fddeb764b80 1 -- 172.21.15.69:0/3623810908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e72d30330 con 0x555e72d3de70 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3623810908 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddc80212e0 con 0x555e72d3de70 2023-12-14T14:11:36.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fddeb764b80 10 client.25195 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.132+0000 7fddeb764b80 1 -- 172.21.15.69:0/3623810908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x555e72c551f0 con 0x555e72d3de70 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.133+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3623810908 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555e72d30330 con 0x555e72d3de70 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.133+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3623810908 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fddc8004b30 con 0x555e72d3de70 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.133+0000 7fddeb764b80 10 client.25195 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.133+0000 7fddeb764b80 10 client.25195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.133+0000 7fddeb764b80 20 client.25195 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.133+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x555e72d684e0 0x555e72d6a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.133+0000 7fddeb764b80 4 client.25195 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.133+0000 7fddeb764b80 1 -- 172.21.15.69:0/3623810908 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e72c87d60 con 0x555e72d684e0 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.133+0000 7fdddd372700 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x555e72d684e0 0x555e72d6a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fdddd372700 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x555e72d684e0 0x555e72d6a8f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5a74bc0fe23667e server_cookie=12bd2479b4570c7e in_seq=0 out_seq=0 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddc0ff9700 10 client.25195 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3623810908 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555e72c87d60 con 0x555e72d684e0 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddc0ff9700 10 client.25195 handle_command_reply: tid=0 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddeb764b80 1 client.25195 shutdown 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddeb764b80 1 -- 172.21.15.69:0/3623810908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3de70 msgr2=0x555e72d49ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3de70 0x555e72d49ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddc8005920 tx=0x7fddc8023a20 comp rx=0 tx=0).stop 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddeb764b80 1 -- 172.21.15.69:0/3623810908 shutdown_connections 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x555e72d684e0 0x555e72d6a8f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 0x555e72d4f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3c940 0x555e72d49660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddc0ff9700 0 client.25195 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:36.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3623810908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3de70 0x555e72d49ba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.134+0000 7fddeb764b80 1 -- 172.21.15.69:0/3623810908 >> 172.21.15.69:0/3623810908 conn(0x555e72d32d20 msgr2=0x555e72d38450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.135+0000 7fddeb764b80 1 -- 172.21.15.69:0/3623810908 shutdown_connections 2023-12-14T14:11:36.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.135+0000 7fddeb764b80 1 -- 172.21.15.69:0/3623810908 wait complete. 2023-12-14T14:11:36.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.135+0000 7fddeb764b80 20 client.25195 trim_cache size 0 max 16384 2023-12-14T14:11:36.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.156+0000 7fddeb764b80 1 Processor -- start 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.156+0000 7fddeb764b80 1 -- start start 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.156+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 0x555e72d443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.156+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3de70 0x555e72d4f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.156+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 0x555e72d43180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.156+0000 7fddeb764b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72d52680 con 0x555e72d3de70 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.156+0000 7fddeb764b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72d42820 con 0x555e72d50270 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.156+0000 7fddeb764b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72d40110 con 0x555e72d3c940 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.156+0000 7fdddcb71700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3de70 0x555e72d4f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddcb71700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3de70 0x555e72d4f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58716/0 (socket says 172.21.15.69:58716) 2023-12-14T14:11:36.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddcb71700 1 -- 172.21.15.69:0/2961672188 learned_addr learned my addr 172.21.15.69:0/2961672188 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddd372700 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 0x555e72d443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fddddb73700 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 0x555e72d43180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddcb71700 1 -- 172.21.15.69:0/2961672188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 msgr2=0x555e72d443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddcb71700 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 0x555e72d443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddcb71700 1 -- 172.21.15.69:0/2961672188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 msgr2=0x555e72d43180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddcb71700 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 0x555e72d43180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddcb71700 1 -- 172.21.15.69:0/2961672188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e72d37280 con 0x555e72d3de70 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddd372700 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 0x555e72d443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fdddcb71700 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3de70 0x555e72d4f2a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fddc8000c00 tx=0x7fddc8005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1586a4f69f562a7c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fddc3fff700 1 -- 172.21.15.69:0/2961672188 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8003780 con 0x555e72d3de70 2023-12-14T14:11:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fddc3fff700 1 -- 172.21.15.69:0/2961672188 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddc8005d20 con 0x555e72d3de70 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.157+0000 7fddc3fff700 1 -- 172.21.15.69:0/2961672188 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc80046e0 con 0x555e72d3de70 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 -- 172.21.15.69:0/2961672188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3de70 msgr2=0x555e72d4f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3de70 0x555e72d4f2a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fddc8000c00 tx=0x7fddc8005a90 comp rx=0 tx=0).stop 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 -- 172.21.15.69:0/2961672188 shutdown_connections 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d50270 0x555e72d43180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 0x555e72d443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 --2- 172.21.15.69:0/2961672188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d3de70 0x555e72d4f2a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 -- 172.21.15.69:0/2961672188 >> 172.21.15.69:0/2961672188 conn(0x555e72d32d20 msgr2=0x555e72d42a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 -- 172.21.15.69:0/2961672188 shutdown_connections 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 -- 172.21.15.69:0/2961672188 wait complete. 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 -- start start 2023-12-14T14:11:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.158+0000 7fddeb764b80 1 Processor -- start 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 0x555e72db5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 0x555e72db6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddeb764b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d50270 0x555e72db0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddeb764b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72db0970 con 0x555e72d50270 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddeb764b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72db0ae0 con 0x555e72d3de70 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddeb764b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72db0ca0 con 0x555e72d3c940 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddeb764b80 10 client.0 _ll_register_callbacks cb 0x7fddc80114a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddddb73700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d50270 0x555e72db0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddddb73700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d50270 0x555e72db0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58730/0 (socket says 172.21.15.69:58730) 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddddb73700 1 -- 172.21.15.69:0/3303152999 learned_addr learned my addr 172.21.15.69:0/3303152999 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fdddcb71700 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 0x555e72db6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fdddd372700 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 0x555e72db5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddddb73700 1 -- 172.21.15.69:0/3303152999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 msgr2=0x555e72db5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddddb73700 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 0x555e72db5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddddb73700 1 -- 172.21.15.69:0/3303152999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 msgr2=0x555e72db6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddddb73700 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 0x555e72db6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.159+0000 7fddddb73700 1 -- 172.21.15.69:0/3303152999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e72c551f0 con 0x555e72d50270 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddddb73700 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d50270 0x555e72db0390 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fddd0099310 tx=0x7fddd000d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c179df294a70da7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddc0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3303152999 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd009d3b0 con 0x555e72d50270 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3303152999 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fddd00a17d0 con 0x555e72d50270 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddeb764b80 1 -- 172.21.15.69:0/3303152999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fddc8004510 con 0x555e72d50270 2023-12-14T14:11:36.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3303152999 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddd009d150 con 0x555e72d50270 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddeb764b80 10 client.15696 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddeb764b80 1 -- 172.21.15.69:0/3303152999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x555e72abcbe0 con 0x555e72d50270 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3303152999 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddc8004510 con 0x555e72d50270 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3303152999 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fddd00a13d0 con 0x555e72d50270 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddeb764b80 10 client.15696 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddeb764b80 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddeb764b80 20 client.15696 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x555e72dbdeb0 0x555e72dc02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddeb764b80 4 client.15696 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.160+0000 7fddeb764b80 1 -- 172.21.15.69:0/3303152999 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555e72c87a80 con 0x555e72dbdeb0 2023-12-14T14:11:36.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.161+0000 7fdddd372700 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x555e72dbdeb0 0x555e72dc02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.161+0000 7fdddd372700 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x555e72dbdeb0 0x555e72dc02c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d2b338349e11ec server_cookie=9834a278ee5d49a5 in_seq=0 out_seq=0 2023-12-14T14:11:36.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.161+0000 7fddc0ff9700 10 client.15696 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:36.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.162+0000 7fddc0ff9700 1 -- 172.21.15.69:0/3303152999 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555e72c87a80 con 0x555e72dbdeb0 2023-12-14T14:11:36.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.162+0000 7fddc0ff9700 10 client.15696 handle_command_reply: tid=0 2023-12-14T14:11:36.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.162+0000 7fddeb764b80 1 client.15696 shutdown 2023-12-14T14:11:36.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 -- 172.21.15.69:0/3303152999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d50270 msgr2=0x555e72db0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d50270 0x555e72db0390 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fddd0099310 tx=0x7fddd000d830 comp rx=0 tx=0).stop 2023-12-14T14:11:36.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 -- 172.21.15.69:0/3303152999 shutdown_connections 2023-12-14T14:11:36.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x555e72dbdeb0 0x555e72dc02c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555e72d50270 0x555e72db0390 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555e72d3c940 0x555e72db5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 --2- 172.21.15.69:0/3303152999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e72d3de70 0x555e72db6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 -- 172.21.15.69:0/3303152999 >> 172.21.15.69:0/3303152999 conn(0x555e72d32d20 msgr2=0x555e72d43300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddc0ff9700 0 client.15696 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:36.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 -- 172.21.15.69:0/3303152999 shutdown_connections 2023-12-14T14:11:36.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 1 -- 172.21.15.69:0/3303152999 wait complete. 2023-12-14T14:11:36.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.163+0000 7fddeb764b80 20 client.15696 trim_cache size 0 max 16384 2023-12-14T14:11:36.170 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:11:36.171 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:11:36.171 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "09be56d5-c215-4041-a070-18721faa3adb", 2023-12-14T14:11:36.171 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:11:36.171 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:11:36.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 -- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fddc40a1370 msgr2=0x7fddc40a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fddc40a1370 0x7fddc40a3820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009a60 tx=0x7fddc8025000 comp rx=0 tx=0).stop 2023-12-14T14:11:36.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 -- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddd81054d0 msgr2=0x7fddd819ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddd81054d0 0x7fddd819ade0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fddd0007ee0 tx=0x7fddd000d3b0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 -- 172.21.15.69:0/2652269102 shutdown_connections 2023-12-14T14:11:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fddc40a1370 0x7fddc40a3820 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddd81054d0 0x7fddd819ade0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddd80680c0 0x7fddd8196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 --2- 172.21.15.69:0/2652269102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd8068a60 0x7fddd8196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 -- 172.21.15.69:0/2652269102 >> 172.21.15.69:0/2652269102 conn(0x7fddd8075fd0 msgr2=0x7fddd8103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 -- 172.21.15.69:0/2652269102 shutdown_connections 2023-12-14T14:11:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.164+0000 7fdddf5d6700 1 -- 172.21.15.69:0/2652269102 wait complete. 2023-12-14T14:11:36.177 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:11:36.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.322+0000 7fb460e53700 1 -- 172.21.15.69:0/1561514342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 msgr2=0x7fb45c0ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.322+0000 7fb460e53700 1 --2- 172.21.15.69:0/1561514342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 0x7fb45c0ffab0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00aad0 tx=0x7fb44c00ade0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.322+0000 7fb460e53700 1 -- 172.21.15.69:0/1561514342 shutdown_connections 2023-12-14T14:11:36.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.322+0000 7fb460e53700 1 --2- 172.21.15.69:0/1561514342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb45c104d70 0x7fb45c10b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.322+0000 7fb460e53700 1 --2- 172.21.15.69:0/1561514342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 0x7fb45c0ffab0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.322+0000 7fb460e53700 1 --2- 172.21.15.69:0/1561514342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb45c100080 0x7fb45c104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.322+0000 7fb460e53700 1 -- 172.21.15.69:0/1561514342 >> 172.21.15.69:0/1561514342 conn(0x7fb45c074a60 msgr2=0x7fb45c074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.323+0000 7fb460e53700 1 -- 172.21.15.69:0/1561514342 shutdown_connections 2023-12-14T14:11:36.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.323+0000 7fb460e53700 1 -- 172.21.15.69:0/1561514342 wait complete. 2023-12-14T14:11:36.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.323+0000 7fb460e53700 1 Processor -- start 2023-12-14T14:11:36.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb460e53700 1 -- start start 2023-12-14T14:11:36.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb460e53700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 0x7fb45c1941b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb460e53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb45c100080 0x7fb45c1946f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb460e53700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb45c104d70 0x7fb45c198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb460e53700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c199190 con 0x7fb45c0ff6e0 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb460e53700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c199300 con 0x7fb45c100080 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb460e53700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c1994c0 con 0x7fb45c104d70 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 0x7fb45c1941b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 0x7fb45c1941b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45594/0 (socket says 172.21.15.69:45594) 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45a59c700 1 -- 172.21.15.69:0/498773146 learned_addr learned my addr 172.21.15.69:0/498773146 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb459d9b700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb45c100080 0x7fb45c1946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb45c104d70 0x7fb45c198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45a59c700 1 -- 172.21.15.69:0/498773146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb45c104d70 msgr2=0x7fb45c198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45a59c700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb45c104d70 0x7fb45c198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45a59c700 1 -- 172.21.15.69:0/498773146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb45c100080 msgr2=0x7fb45c1946f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45a59c700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb45c100080 0x7fb45c1946f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45a59c700 1 -- 172.21.15.69:0/498773146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c00a700 con 0x7fb45c0ff6e0 2023-12-14T14:11:36.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.324+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb45c104d70 0x7fb45c198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:11:36.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.325+0000 7fb45a59c700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 0x7fb45c1941b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00afd0 tx=0x7fb44c00e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.325+0000 7fb4537fe700 1 -- 172.21.15.69:0/498773146 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00ed90 con 0x7fb45c0ff6e0 2023-12-14T14:11:36.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.325+0000 7fb4537fe700 1 -- 172.21.15.69:0/498773146 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb44c01d940 con 0x7fb45c0ff6e0 2023-12-14T14:11:36.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.325+0000 7fb4537fe700 1 -- 172.21.15.69:0/498773146 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c004120 con 0x7fb45c0ff6e0 2023-12-14T14:11:36.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.326+0000 7fb460e53700 1 -- 172.21.15.69:0/498773146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c10e120 con 0x7fb45c0ff6e0 2023-12-14T14:11:36.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.326+0000 7fb460e53700 1 -- 172.21.15.69:0/498773146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c10df90 con 0x7fb45c0ff6e0 2023-12-14T14:11:36.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.328+0000 7fb4537fe700 1 -- 172.21.15.69:0/498773146 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fb44c01d480 con 0x7fb45c0ff6e0 2023-12-14T14:11:36.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.329+0000 7fb4537fe700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb4480a1460 0x7fb4480a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.329+0000 7fb459d9b700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb4480a1460 0x7fb4480a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.329+0000 7fb4537fe700 1 -- 172.21.15.69:0/498773146 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fb44c012070 con 0x7fb45c0ff6e0 2023-12-14T14:11:36.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.330+0000 7fb459d9b700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb4480a1460 0x7fb4480a3910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb45c1957c0 tx=0x7fb444009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.330+0000 7fb46cfe1b80 1 Processor -- start 2023-12-14T14:11:36.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.330+0000 7fb46cfe1b80 1 -- start start 2023-12-14T14:11:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 0x55f13c866750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c871610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c873f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c7505e0 con 0x55f13c871b50 2023-12-14T14:11:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c7bf870 con 0x55f13c866380 2023-12-14T14:11:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c7b8d00 con 0x55f13c866c90 2023-12-14T14:11:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c873f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c873f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45598/0 (socket says 172.21.15.69:45598) 2023-12-14T14:11:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45ad9d700 1 -- 172.21.15.69:0/1135356179 learned_addr learned my addr 172.21.15.69:0/1135356179 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45a59c700 1 --2- 172.21.15.69:0/1135356179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 0x55f13c866750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb459d9b700 1 --2- 172.21.15.69:0/1135356179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c871610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45ad9d700 1 -- 172.21.15.69:0/1135356179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 msgr2=0x55f13c871610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/1135356179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c871610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45ad9d700 1 -- 172.21.15.69:0/1135356179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 msgr2=0x55f13c866750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/1135356179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 0x55f13c866750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45ad9d700 1 -- 172.21.15.69:0/1135356179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f13c63a3b0 con 0x55f13c871b50 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.331+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/1135356179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c873f30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb454009cd0 tx=0x7fb454007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e38d3ba30ff64f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.332+0000 7fb450ff9700 1 -- 172.21.15.69:0/1135356179 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454014400 con 0x55f13c871b50 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.332+0000 7fb450ff9700 1 -- 172.21.15.69:0/1135356179 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb454014a20 con 0x55f13c871b50 2023-12-14T14:11:36.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.332+0000 7fb450ff9700 1 -- 172.21.15.69:0/1135356179 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454013a20 con 0x55f13c871b50 2023-12-14T14:11:36.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1135356179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 msgr2=0x55f13c873f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1135356179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c873f30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb454009cd0 tx=0x7fb454007500 comp rx=0 tx=0).stop 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1135356179 shutdown_connections 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1135356179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c873f30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1135356179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 0x55f13c866750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1135356179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c871610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1135356179 >> 172.21.15.69:0/1135356179 conn(0x55f13c85cca0 msgr2=0x55f13c8627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1135356179 shutdown_connections 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1135356179 wait complete. 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 -- start start 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.333+0000 7fb46cfe1b80 1 Processor -- start 2023-12-14T14:11:36.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c866380 0x55f13c8714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c86e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c871b50 0x55f13c86ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c754f90 con 0x55f13c866380 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c754c30 con 0x55f13c871b50 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c63c6a0 con 0x55f13c866c90 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb46cfe1b80 10 client.0 _ll_register_callbacks cb 0x55f13c778910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c871b50 0x55f13c86ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c871b50 0x55f13c86ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:60834/0 (socket says 172.21.15.69:60834) 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb45ad9d700 1 -- 172.21.15.69:0/226209454 learned_addr learned my addr 172.21.15.69:0/226209454 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb459d9b700 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c86e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb45ad9d700 1 -- 172.21.15.69:0/226209454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 msgr2=0x55f13c86e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c86e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb45ad9d700 1 -- 172.21.15.69:0/226209454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c866380 msgr2=0x55f13c8714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c866380 0x55f13c8714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.334+0000 7fb45ad9d700 1 -- 172.21.15.69:0/226209454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb454009900 con 0x55f13c871b50 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.335+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c871b50 0x55f13c86ee10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb454008fd0 tx=0x7fb4540095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03f8b6ed6bd5d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.335+0000 7fb441ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.335+0000 7fb441ffb700 1 -- 172.21.15.69:0/226209454 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454014400 con 0x55f13c871b50 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.335+0000 7fb441ffb700 1 -- 172.21.15.69:0/226209454 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fb454014560 con 0x55f13c871b50 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.335+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/226209454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f13c85a2b0 con 0x55f13c871b50 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.335+0000 7fb441ffb700 1 -- 172.21.15.69:0/226209454 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb454014720 con 0x55f13c871b50 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.335+0000 7fb46cfe1b80 10 client.25271 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.335+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/226209454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55f13c77f170 con 0x55f13c871b50 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.336+0000 7fb441ffb700 1 -- 172.21.15.69:0/226209454 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f13c85a2b0 con 0x55f13c871b50 2023-12-14T14:11:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.336+0000 7fb441ffb700 1 -- 172.21.15.69:0/226209454 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb454023020 con 0x55f13c871b50 2023-12-14T14:11:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.336+0000 7fb46cfe1b80 10 client.25271 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.336+0000 7fb46cfe1b80 10 client.25271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.336+0000 7fb46cfe1b80 20 client.25271 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.336+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f13c87b2e0 0x55f13c87d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.336+0000 7fb46cfe1b80 4 client.25271 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:11:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.336+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/226209454 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f13c7b1ce0 con 0x55f13c87b2e0 2023-12-14T14:11:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.337+0000 7fb45a59c700 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f13c87b2e0 0x55f13c87d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.337+0000 7fb45a59c700 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f13c87b2e0 0x55f13c87d6f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c982799b03f4d6fe server_cookie=ebcac4286b013135 in_seq=0 out_seq=0 2023-12-14T14:11:36.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.337+0000 7fb441ffb700 10 client.25271 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:36.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.337+0000 7fb441ffb700 1 -- 172.21.15.69:0/226209454 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f13c7b1ce0 con 0x55f13c87b2e0 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.338+0000 7fb441ffb700 10 client.25271 handle_command_reply: tid=0 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.338+0000 7fb46cfe1b80 1 client.25271 shutdown 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/226209454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c871b50 msgr2=0x55f13c86ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c871b50 0x55f13c86ee10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb454008fd0 tx=0x7fb4540095e0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/226209454 shutdown_connections 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f13c87b2e0 0x55f13c87d6f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c871b50 0x55f13c86ee10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c866380 0x55f13c8714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/226209454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c86e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/226209454 >> 172.21.15.69:0/226209454 conn(0x55f13c85cca0 msgr2=0x55f13c8623d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb441ffb700 0 client.25271 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:36.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/226209454 shutdown_connections 2023-12-14T14:11:36.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/226209454 wait complete. 2023-12-14T14:11:36.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.339+0000 7fb46cfe1b80 20 client.25271 trim_cache size 0 max 16384 2023-12-14T14:11:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.365+0000 7fb46cfe1b80 1 Processor -- start 2023-12-14T14:11:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.365+0000 7fb46cfe1b80 1 -- start start 2023-12-14T14:11:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 0x55f13c87d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c869b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c86a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c86cdb0 con 0x55f13c871b50 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c86a6c0 con 0x55f13c866380 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c869270 con 0x55f13c866c90 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c86a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 0x55f13c87d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c86a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45602/0 (socket says 172.21.15.69:45602) 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45ad9d700 1 -- 172.21.15.69:0/1851177955 learned_addr learned my addr 172.21.15.69:0/1851177955 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb459d9b700 1 --2- 172.21.15.69:0/1851177955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c869b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45a59c700 1 -- 172.21.15.69:0/1851177955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 msgr2=0x55f13c869b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45a59c700 1 --2- 172.21.15.69:0/1851177955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c869b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45a59c700 1 -- 172.21.15.69:0/1851177955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 msgr2=0x55f13c86a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45a59c700 1 --2- 172.21.15.69:0/1851177955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c86a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45a59c700 1 -- 172.21.15.69:0/1851177955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f13c77eec0 con 0x55f13c866380 2023-12-14T14:11:36.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.366+0000 7fb45a59c700 1 --2- 172.21.15.69:0/1851177955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 0x55f13c87d2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0ce5c0 tx=0x7fb44c005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f609a2560ce10c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.367+0000 7fb4517fa700 1 -- 172.21.15.69:0/1851177955 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0bc2c0 con 0x55f13c866380 2023-12-14T14:11:36.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.367+0000 7fb4517fa700 1 -- 172.21.15.69:0/1851177955 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb44c0cee90 con 0x55f13c866380 2023-12-14T14:11:36.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.367+0000 7fb4517fa700 1 -- 172.21.15.69:0/1851177955 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00dc80 con 0x55f13c866380 2023-12-14T14:11:36.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1851177955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 msgr2=0x55f13c87d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1851177955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 0x55f13c87d2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0ce5c0 tx=0x7fb44c005960 comp rx=0 tx=0).stop 2023-12-14T14:11:36.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1851177955 shutdown_connections 2023-12-14T14:11:36.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1851177955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c86a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1851177955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866380 0x55f13c87d2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1851177955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866c90 0x55f13c869b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1851177955 >> 172.21.15.69:0/1851177955 conn(0x55f13c85cca0 msgr2=0x55f13c877890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1851177955 shutdown_connections 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1851177955 wait complete. 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 -- start start 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 Processor -- start 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866380 0x55f13c880810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866c90 0x55f13c880d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c881290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c8e5540 con 0x55f13c871b50 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c8e56b0 con 0x55f13c866c90 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.368+0000 7fb46cfe1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c8e5870 con 0x55f13c866380 2023-12-14T14:11:36.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb46cfe1b80 10 client.0 _ll_register_callbacks cb 0x7fb44c09a240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c881290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c881290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45614/0 (socket says 172.21.15.69:45614) 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb45ad9d700 1 -- 172.21.15.69:0/1256100965 learned_addr learned my addr 172.21.15.69:0/1256100965 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb459d9b700 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866c90 0x55f13c880d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb45ad9d700 1 -- 172.21.15.69:0/1256100965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866380 msgr2=0x55f13c880810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866380 0x55f13c880810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb45ad9d700 1 -- 172.21.15.69:0/1256100965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866c90 msgr2=0x55f13c880d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866c90 0x55f13c880d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb45ad9d700 1 -- 172.21.15.69:0/1256100965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c01a040 con 0x55f13c871b50 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb459d9b700 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866c90 0x55f13c880d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:11:36.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb45ad9d700 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c881290 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb454007540 tx=0x7fb454005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa4fda5137e6b0c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb441ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb441ffb700 1 -- 172.21.15.69:0/1256100965 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454006000 con 0x55f13c871b50 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.369+0000 7fb441ffb700 1 -- 172.21.15.69:0/1256100965 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fb454005540 con 0x55f13c871b50 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1256100965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb454014a20 con 0x55f13c871b50 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb441ffb700 1 -- 172.21.15.69:0/1256100965 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb454014400 con 0x55f13c871b50 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb46cfe1b80 10 client.15711 fetch_fsmap learned FSMap version 22 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1256100965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55f13c7659a0 con 0x55f13c871b50 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb441ffb700 1 -- 172.21.15.69:0/1256100965 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb454014a20 con 0x55f13c871b50 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb441ffb700 1 -- 172.21.15.69:0/1256100965 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb454007570 con 0x55f13c871b50 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb46cfe1b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb46cfe1b80 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb46cfe1b80 20 client.15711 populate_metadata read hostname 'smithi069' 2023-12-14T14:11:36.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f13c8e6b50 0x55f13c8e8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb46cfe1b80 4 client.15711 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1256100965 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f13c7b1a00 con 0x55f13c8e6b50 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.370+0000 7fb45a59c700 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f13c8e6b50 0x55f13c8e8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb441ffb700 10 client.15711 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb45a59c700 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f13c8e6b50 0x55f13c8e8f60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad3cb6ada50a558a server_cookie=c9bba0685354f57a in_seq=0 out_seq=0 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb441ffb700 1 -- 172.21.15.69:0/1256100965 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f13c7b1a00 con 0x55f13c8e6b50 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb441ffb700 10 client.15711 handle_command_reply: tid=0 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 client.15711 shutdown 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1256100965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 msgr2=0x55f13c881290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c881290 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb454007540 tx=0x7fb454005a60 comp rx=0 tx=0).stop 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1256100965 shutdown_connections 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f13c8e6b50 0x55f13c8e8f60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f13c871b50 0x55f13c881290 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f13c866380 0x55f13c880810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 --2- 172.21.15.69:0/1256100965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c866c90 0x55f13c880d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb441ffb700 0 client.15711 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1256100965 >> 172.21.15.69:0/1256100965 conn(0x55f13c85cca0 msgr2=0x55f13c87d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1256100965 shutdown_connections 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 1 -- 172.21.15.69:0/1256100965 wait complete. 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.371+0000 7fb46cfe1b80 20 client.15711 trim_cache size 0 max 16384 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:11:36.378 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:11:36.379 INFO:teuthology.orchestra.run.smithi069.stdout: "09be56d5-c215-4041-a070-18721faa3adb": { 2023-12-14T14:11:36.379 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:11:36.379 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "09be56d5-c215-4041-a070-18721faa3adb", 2023-12-14T14:11:36.379 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:11:36.379 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:11:36.379 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:11:36.379 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 -- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb4480a1460 msgr2=0x7fb4480a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb4480a1460 0x7fb4480a3910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb45c1957c0 tx=0x7fb444009260 comp rx=0 tx=0).stop 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 -- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 msgr2=0x7fb45c1941b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 0x7fb45c1941b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00afd0 tx=0x7fb44c00e6e0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 -- 172.21.15.69:0/498773146 shutdown_connections 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb4480a1460 0x7fb4480a3910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb45c104d70 0x7fb45c198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45c0ff6e0 0x7fb45c1941b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 --2- 172.21.15.69:0/498773146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb45c100080 0x7fb45c1946f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:11:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 -- 172.21.15.69:0/498773146 >> 172.21.15.69:0/498773146 conn(0x7fb45c074a60 msgr2=0x7fb45c102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:11:36.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 -- 172.21.15.69:0/498773146 shutdown_connections 2023-12-14T14:11:36.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:11:36.372+0000 7fb460e53700 1 -- 172.21.15.69:0/498773146 wait complete. 2023-12-14T14:11:36.388 INFO:tasks.cephfs.filesystem:scrub status for tag:09be56d5-c215-4041-a070-18721faa3adb - {'path': '/', 'tag': '09be56d5-c215-4041-a070-18721faa3adb', 'options': 'recursive,force'} 2023-12-14T14:11:37.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:37 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:11:37.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:37 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:37.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:37 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:11:37.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:37 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:37.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:37 smithi069 ceph-mon[42034]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:37 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:11:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:37 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:37 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:11:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:37 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:37 smithi081 ceph-mon[43371]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:37.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:37 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:11:37.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:37 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:37.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:37 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:11:37.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:37 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:11:37.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:37 smithi119 ceph-mon[43834]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:39.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:39 smithi119 ceph-mon[43834]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:39.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:39 smithi069 ceph-mon[42034]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:39 smithi081 ceph-mon[43371]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:11:40.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:40 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:11:40.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:40 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:11:40.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:40 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:11:41.716 INFO:tasks.workunit.client.0.smithi069.stderr:Note: switching to 'bf026da9d69000f3d4a9d16360156095d6612a2d'. 2023-12-14T14:11:41.716 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T14:11:41.716 INFO:tasks.workunit.client.0.smithi069.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-14T14:11:41.716 INFO:tasks.workunit.client.0.smithi069.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-14T14:11:41.716 INFO:tasks.workunit.client.0.smithi069.stderr:state without impacting any branches by switching back to a branch. 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr: git switch -c 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr:Or undo this operation with: 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr: git switch - 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T14:11:41.717 INFO:tasks.workunit.client.0.smithi069.stderr:HEAD is now at bf026da9d69 doc/cephfs: Update docs to match remove functionality and respective vxattrs 2023-12-14T14:11:41.719 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-14T14:11:41.742 INFO:tasks.workunit.client.0.smithi069.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-14T14:11:41.744 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-14T14:11:41.744 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-14T14:11:41.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:41 smithi119 ceph-mon[43834]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:11:41.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:41 smithi069 ceph-mon[42034]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:11:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:41 smithi081 ceph-mon[43371]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:11:42.268 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-14T14:11:42.334 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-14T14:11:42.372 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-14T14:11:42.374 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-14T14:11:42.374 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-14T14:11:42.411 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-14T14:11:42.415 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:11:42.415 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-14T14:11:42.472 INFO:tasks.workunit:Running workunits matching fs/misc on client.0... 2023-12-14T14:11:42.473 INFO:tasks.workunit:Running workunit fs/misc/acl.sh... 2023-12-14T14:11:42.473 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/acl.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2023-12-14T14:11:42.535 INFO:tasks.workunit.client.0.smithi069.stderr:+ set -e 2023-12-14T14:11:42.535 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir -p testdir 2023-12-14T14:11:42.537 INFO:tasks.workunit.client.0.smithi069.stderr:+ cd testdir 2023-12-14T14:11:42.537 INFO:tasks.workunit.client.0.smithi069.stderr:+ set +e 2023-12-14T14:11:42.537 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfacl -d -m u:nobody:rw . 2023-12-14T14:11:42.544 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T14:11:42.544 INFO:tasks.workunit.client.0.smithi069.stderr:+ set -e 2023-12-14T14:11:42.544 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=0 2023-12-14T14:11:42.544 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 -lt 100 ']' 2023-12-14T14:11:42.544 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 0 + 1 2023-12-14T14:11:42.545 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=1 2023-12-14T14:11:42.545 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:42.547 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:42.547 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:42.551 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:42.551 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:42.552 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:42.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:42 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:11:42.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:42 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:11:42.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:42 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:11:43.328 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:43.329 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:43.554 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:43.554 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:43.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:43 smithi069 ceph-mon[42034]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:11:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:43 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:11:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:43 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:11:43.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:43 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:11:43.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:43.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:43.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 1 -lt 100 ']' 2023-12-14T14:11:43.588 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 1 + 1 2023-12-14T14:11:43.621 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=2 2023-12-14T14:11:43.621 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:43.654 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:43.654 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:43.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:43.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:43.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:43.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:43 smithi119 ceph-mon[43834]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:11:43.813 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:43 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:11:43.813 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:43 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:11:43.813 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:43 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:11:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:43 smithi081 ceph-mon[43371]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:11:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:43 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:11:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:43 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:11:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:43 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:11:44.095 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:44.095 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:44.220 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:44.220 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:44.240 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:44.240 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:44.240 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -lt 100 ']' 2023-12-14T14:11:44.240 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 2 + 1 2023-12-14T14:11:44.268 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=3 2023-12-14T14:11:44.268 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:44.295 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:44.295 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:44.296 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:44.296 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:44.296 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:44.676 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:44 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:11:44.676 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:44 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:11:44.676 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:44 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:11:44.676 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:44 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:11:44.753 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:44.753 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:44.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:44 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:11:44.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:44 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:11:44.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:44 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:11:44.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:44 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:11:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:44 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:11:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:44 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:11:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:44 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:11:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:44 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:11:44.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:44.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:44.944 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:44.944 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:44.944 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 3 -lt 100 ']' 2023-12-14T14:11:44.944 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 3 + 1 2023-12-14T14:11:44.976 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=4 2023-12-14T14:11:44.976 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:45.019 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:45.020 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:45.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:45.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:45.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:45.436 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:45.436 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:45.578 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:45.578 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:45.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:45 smithi069 ceph-mon[42034]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T14:11:45.586 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:45.586 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:45.586 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 4 -lt 100 ']' 2023-12-14T14:11:45.586 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 4 + 1 2023-12-14T14:11:45.617 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=5 2023-12-14T14:11:45.617 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:45.653 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:45.653 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:45.654 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:45.654 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:45.654 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:45.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:45 smithi119 ceph-mon[43834]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T14:11:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:45 smithi081 ceph-mon[43371]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T14:11:45.986 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:45.986 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:46.095 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:46.095 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:46.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:46.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:46.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 5 -lt 100 ']' 2023-12-14T14:11:46.102 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 5 + 1 2023-12-14T14:11:46.134 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=6 2023-12-14T14:11:46.134 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:46.161 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:46.161 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:46.162 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:46.162 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:46.162 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:46.536 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:46.536 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:46.661 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:46.662 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:46.668 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:46.668 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:46.669 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 6 -lt 100 ']' 2023-12-14T14:11:46.669 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 6 + 1 2023-12-14T14:11:46.701 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=7 2023-12-14T14:11:46.701 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:46.714 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:46.714 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:46.716 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:46.716 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:46.716 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:47.178 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:47.178 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:47.309 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:47.309 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:47.327 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:47.327 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:47.327 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 7 -lt 100 ']' 2023-12-14T14:11:47.328 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 7 + 1 2023-12-14T14:11:47.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:47 smithi069 ceph-mon[42034]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-12-14T14:11:47.357 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=8 2023-12-14T14:11:47.358 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:47.366 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:47.366 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:47.367 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:47.367 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:47.367 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:47 smithi081 ceph-mon[43371]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-12-14T14:11:47.736 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:47.736 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:47 smithi119 ceph-mon[43834]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-12-14T14:11:47.861 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:47.861 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:47.868 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:47.868 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:47.868 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 8 -lt 100 ']' 2023-12-14T14:11:47.868 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 8 + 1 2023-12-14T14:11:47.900 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=9 2023-12-14T14:11:47.900 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:47.936 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:47.936 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:47.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:47.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:47.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:48.328 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:48.328 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:48.461 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:48.462 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:48.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:48.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:48.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 9 -lt 100 ']' 2023-12-14T14:11:48.469 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 9 + 1 2023-12-14T14:11:48.500 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=10 2023-12-14T14:11:48.501 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:48.536 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:48.536 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:48.536 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:48.537 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:48.537 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:49.127 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:49.127 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:49.269 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:49.270 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:49.276 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:49.276 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:49.276 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 10 -lt 100 ']' 2023-12-14T14:11:49.276 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 10 + 1 2023-12-14T14:11:49.300 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=11 2023-12-14T14:11:49.300 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:49.336 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:49.336 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:49.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:49.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:49.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:49.682 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:49 smithi069 ceph-mon[42034]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-12-14T14:11:49.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:49 smithi119 ceph-mon[43834]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-12-14T14:11:49.794 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:49.794 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:49 smithi081 ceph-mon[43371]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-12-14T14:11:49.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:49.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:49.943 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:49.943 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:49.943 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 11 -lt 100 ']' 2023-12-14T14:11:49.943 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 11 + 1 2023-12-14T14:11:49.968 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=12 2023-12-14T14:11:49.968 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:50.002 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:50.002 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:50.003 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:50.003 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:50.003 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:50.419 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:50.419 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:50.561 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:50.561 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:50.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:50.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:50.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 12 -lt 100 ']' 2023-12-14T14:11:50.568 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 12 + 1 2023-12-14T14:11:50.608 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=13 2023-12-14T14:11:50.608 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:50.651 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:50.651 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:50.652 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:50.652 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:50.652 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:51.044 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:51.044 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:51.227 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:51.228 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:51.268 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:51.269 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:51.269 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 13 -lt 100 ']' 2023-12-14T14:11:51.269 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 13 + 1 2023-12-14T14:11:51.308 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=14 2023-12-14T14:11:51.308 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:51.335 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:51.336 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:51.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:51.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:51.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:51.682 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:51 smithi069 ceph-mon[42034]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2023-12-14T14:11:51.752 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:51.752 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:51.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:51 smithi119 ceph-mon[43834]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2023-12-14T14:11:51.869 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:51.869 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:51.876 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:51.876 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:51.876 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 14 -lt 100 ']' 2023-12-14T14:11:51.876 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 14 + 1 2023-12-14T14:11:51.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:51 smithi081 ceph-mon[43371]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2023-12-14T14:11:51.908 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=15 2023-12-14T14:11:51.908 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:51.943 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:51.943 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:51.944 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:51.945 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:51.945 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:52.285 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:52.285 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:52.410 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:52.410 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:52.419 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:52.419 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:52.420 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 15 -lt 100 ']' 2023-12-14T14:11:52.420 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 15 + 1 2023-12-14T14:11:52.449 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=16 2023-12-14T14:11:52.449 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:52.485 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:52.485 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:52.486 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:52.486 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:52.486 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:52.885 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:52.885 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:53.027 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:53.027 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:53.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:53.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:53.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 16 -lt 100 ']' 2023-12-14T14:11:53.034 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 16 + 1 2023-12-14T14:11:53.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=17 2023-12-14T14:11:53.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:53.093 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:53.094 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:53.094 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:53.095 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:53.095 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:53.552 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:53.552 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:53.694 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:53.694 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:53.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:53.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:53.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 17 -lt 100 ']' 2023-12-14T14:11:53.703 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 17 + 1 2023-12-14T14:11:53.733 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=18 2023-12-14T14:11:53.734 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:53.768 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:53.768 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:53.769 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:53.769 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:53.769 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:53.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:53 smithi119 ceph-mon[43834]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2023-12-14T14:11:53.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:53 smithi069 ceph-mon[42034]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2023-12-14T14:11:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:53 smithi081 ceph-mon[43371]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2023-12-14T14:11:54.269 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:54.269 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:54.410 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:54.410 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:54.418 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:54.418 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:54.418 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 18 -lt 100 ']' 2023-12-14T14:11:54.418 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 18 + 1 2023-12-14T14:11:54.449 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=19 2023-12-14T14:11:54.450 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:54.484 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:54.485 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:54.486 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:54.486 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:54.486 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:54.993 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:54.993 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:55.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:55.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:55.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:55.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:55.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 19 -lt 100 ']' 2023-12-14T14:11:55.126 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 19 + 1 2023-12-14T14:11:55.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=20 2023-12-14T14:11:55.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:55.192 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:55.193 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:55.194 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:55.194 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:55.194 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:55.643 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:55.643 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:55.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:55 smithi119 ceph-mon[43834]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 9 op/s 2023-12-14T14:11:55.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:55.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:55.800 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:55.800 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:55.800 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 20 -lt 100 ']' 2023-12-14T14:11:55.800 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 20 + 1 2023-12-14T14:11:55.832 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=21 2023-12-14T14:11:55.832 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:55 smithi069 ceph-mon[42034]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 9 op/s 2023-12-14T14:11:55.859 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:55.859 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:55.860 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:55.860 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:55.860 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:55 smithi081 ceph-mon[43371]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 9 op/s 2023-12-14T14:11:56.268 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:56.268 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:56.393 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:56.393 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:56.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:56.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:56.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 21 -lt 100 ']' 2023-12-14T14:11:56.402 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 21 + 1 2023-12-14T14:11:56.432 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=22 2023-12-14T14:11:56.433 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:56.467 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:56.468 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:56.468 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:56.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:56.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:56.876 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:56.876 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:57.010 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:57.010 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:57.017 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:57.017 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:57.017 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 22 -lt 100 ']' 2023-12-14T14:11:57.017 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 22 + 1 2023-12-14T14:11:57.049 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=23 2023-12-14T14:11:57.049 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:57.092 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:57.092 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:57.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:57.093 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:57.093 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:57.485 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:57.485 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:57.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:57 smithi069 ceph-mon[42034]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-12-14T14:11:57.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:57 smithi081 ceph-mon[43371]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-12-14T14:11:57.718 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:57.718 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:57.726 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:57.726 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:57.726 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 23 -lt 100 ']' 2023-12-14T14:11:57.726 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 23 + 1 2023-12-14T14:11:57.757 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=24 2023-12-14T14:11:57.757 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:57.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:57 smithi119 ceph-mon[43834]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-12-14T14:11:57.792 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:57.792 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:57.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:57.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:57.794 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:58.184 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:58.184 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:58.284 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:58.285 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:58.292 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:58.292 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:58.292 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 24 -lt 100 ']' 2023-12-14T14:11:58.292 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 24 + 1 2023-12-14T14:11:58.315 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=25 2023-12-14T14:11:58.315 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:58.342 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:58.343 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:58.343 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:58.344 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:58.344 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:58.759 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:58.759 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:58.876 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:58.876 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:58.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:58.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:58.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 25 -lt 100 ']' 2023-12-14T14:11:58.885 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 25 + 1 2023-12-14T14:11:58.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=26 2023-12-14T14:11:58.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:58.959 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:58.959 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:58.960 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:58.960 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:58.960 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:59.401 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:59.401 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:59.543 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:11:59.543 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:11:59.550 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:59.550 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:11:59.550 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 26 -lt 100 ']' 2023-12-14T14:11:59.550 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 26 + 1 2023-12-14T14:11:59.582 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=27 2023-12-14T14:11:59.582 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:11:59.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:11:59 smithi069 ceph-mon[42034]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-12-14T14:11:59.618 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:11:59.618 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:11:59.619 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:11:59.619 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:11:59.619 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:11:59.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:11:59 smithi119 ceph-mon[43834]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-12-14T14:11:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:11:59 smithi081 ceph-mon[43371]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-12-14T14:12:00.142 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:00.142 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:00.293 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:00.293 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:00.300 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:00.300 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:00.300 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 27 -lt 100 ']' 2023-12-14T14:12:00.300 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 27 + 1 2023-12-14T14:12:00.331 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=28 2023-12-14T14:12:00.332 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:00.366 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:00.366 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:00.367 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:00.367 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:00.367 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:00.834 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:00.834 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:00.959 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:00.959 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:00.966 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:00.966 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:00.966 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 28 -lt 100 ']' 2023-12-14T14:12:00.967 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 28 + 1 2023-12-14T14:12:00.990 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=29 2023-12-14T14:12:00.990 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:01.025 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:01.025 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:01.026 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:01.026 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:01.026 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:01.442 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:01.442 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:01.576 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:01.576 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:01.583 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:01.583 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:01.584 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 29 -lt 100 ']' 2023-12-14T14:12:01.584 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 29 + 1 2023-12-14T14:12:01.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:01 smithi069 ceph-mon[42034]: pgmap v44: 97 pgs: 97 active+clean; 1.5 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 9 op/s 2023-12-14T14:12:01.618 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=30 2023-12-14T14:12:01.618 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:01.650 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:01.650 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:01.651 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:01.651 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:01.652 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:01 smithi119 ceph-mon[43834]: pgmap v44: 97 pgs: 97 active+clean; 1.5 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 9 op/s 2023-12-14T14:12:01.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:01 smithi081 ceph-mon[43371]: pgmap v44: 97 pgs: 97 active+clean; 1.5 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 9 op/s 2023-12-14T14:12:02.125 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:02.125 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:02.309 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:02.309 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:02.316 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:02.316 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:02.316 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 30 -lt 100 ']' 2023-12-14T14:12:02.316 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 30 + 1 2023-12-14T14:12:02.340 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=31 2023-12-14T14:12:02.340 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:02.374 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:02.374 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:02.375 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:02.376 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:02.376 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:02.800 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:02.801 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:02.959 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:02.959 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:02.967 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:02.967 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:02.967 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 31 -lt 100 ']' 2023-12-14T14:12:02.967 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 31 + 1 2023-12-14T14:12:02.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=32 2023-12-14T14:12:02.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:03.024 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:03.025 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:03.026 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:03.026 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:03.026 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:03.467 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:03.467 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:03.609 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:03.609 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:03.616 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:03.616 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:03.616 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 32 -lt 100 ']' 2023-12-14T14:12:03.616 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 32 + 1 2023-12-14T14:12:03.640 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=33 2023-12-14T14:12:03.640 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:03.666 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:03.666 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:03.667 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:03.667 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:03.667 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:03.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:03 smithi119 ceph-mon[43834]: pgmap v45: 97 pgs: 97 active+clean; 1.5 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-12-14T14:12:03.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:03 smithi069 ceph-mon[42034]: pgmap v45: 97 pgs: 97 active+clean; 1.5 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-12-14T14:12:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:03 smithi081 ceph-mon[43371]: pgmap v45: 97 pgs: 97 active+clean; 1.5 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-12-14T14:12:04.200 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:04.200 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:04.384 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:04.384 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:04.393 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:04.393 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:04.393 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 33 -lt 100 ']' 2023-12-14T14:12:04.393 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 33 + 1 2023-12-14T14:12:04.423 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=34 2023-12-14T14:12:04.423 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:04.458 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:04.459 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:04.459 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:04.459 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:04.460 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:04.883 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:04.883 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:05.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:05.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:05.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:05.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:05.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 34 -lt 100 ']' 2023-12-14T14:12:05.040 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 34 + 1 2023-12-14T14:12:05.064 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=35 2023-12-14T14:12:05.064 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:05.091 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:05.091 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:05.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:05.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:05.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:05.516 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:05.517 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:05.650 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:05.650 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:05.658 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:05.658 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:05.658 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 35 -lt 100 ']' 2023-12-14T14:12:05.658 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 35 + 1 2023-12-14T14:12:05.689 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=36 2023-12-14T14:12:05.689 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:05.740 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:05.740 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:05.741 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:05.742 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:05.742 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:05.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:05 smithi119 ceph-mon[43834]: pgmap v46: 97 pgs: 97 active+clean; 1.6 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 49 KiB/s wr, 22 op/s 2023-12-14T14:12:05.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:05 smithi069 ceph-mon[42034]: pgmap v46: 97 pgs: 97 active+clean; 1.6 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 49 KiB/s wr, 22 op/s 2023-12-14T14:12:05.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:05 smithi081 ceph-mon[43371]: pgmap v46: 97 pgs: 97 active+clean; 1.6 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 49 KiB/s wr, 22 op/s 2023-12-14T14:12:06.158 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:06.158 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:06.317 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:06.317 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:06.349 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:06.349 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:06.349 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 36 -lt 100 ']' 2023-12-14T14:12:06.349 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 36 + 1 2023-12-14T14:12:06.390 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:12:06.405 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=37 2023-12-14T14:12:06.406 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:06.466 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:06.466 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:06.467 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:06.467 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:06.467 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:06.999 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:07.000 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:07.081 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:07.081 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:07.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:07.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:07.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 37 -lt 100 ']' 2023-12-14T14:12:07.086 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 37 + 1 2023-12-14T14:12:07.122 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=38 2023-12-14T14:12:07.122 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:07.170 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:07.170 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:07.171 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:07.171 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:07.171 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:07.573 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:07 smithi069 ceph-mon[42034]: pgmap v47: 97 pgs: 97 active+clean; 1.6 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 40 KiB/s wr, 19 op/s 2023-12-14T14:12:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:07 smithi081 ceph-mon[43371]: pgmap v47: 97 pgs: 97 active+clean; 1.6 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 40 KiB/s wr, 19 op/s 2023-12-14T14:12:07.691 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:07.691 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:07.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:07 smithi119 ceph-mon[43834]: pgmap v47: 97 pgs: 97 active+clean; 1.6 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 40 KiB/s wr, 19 op/s 2023-12-14T14:12:07.816 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:07.816 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:07.824 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:07.825 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:07.825 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 38 -lt 100 ']' 2023-12-14T14:12:07.825 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 38 + 1 2023-12-14T14:12:07.864 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=39 2023-12-14T14:12:07.864 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:07.914 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:07.915 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:07.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:07.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:07.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:08.691 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:08.692 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:08.866 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:08.866 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:08.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:08.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:08.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 39 -lt 100 ']' 2023-12-14T14:12:08.874 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 39 + 1 2023-12-14T14:12:08.905 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=40 2023-12-14T14:12:08.905 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:08.950 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:08.950 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:08.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:08.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:08.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:09.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.305+0000 7fa6afdd8700 1 -- 172.21.15.69:0/4038142042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a80ff6e0 msgr2=0x7fa6a80ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:09.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.305+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/4038142042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a80ff6e0 0x7fa6a80ffab0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c240 tx=0x7fa69800c550 comp rx=0 tx=0).stop 2023-12-14T14:12:09.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.306+0000 7fa6afdd8700 1 -- 172.21.15.69:0/4038142042 shutdown_connections 2023-12-14T14:12:09.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.306+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/4038142042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6a8104d70 0x7fa6a810b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.306+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/4038142042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a80ff6e0 0x7fa6a80ffab0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.306+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/4038142042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8100080 0x7fa6a8104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.306+0000 7fa6afdd8700 1 -- 172.21.15.69:0/4038142042 >> 172.21.15.69:0/4038142042 conn(0x7fa6a8074a60 msgr2=0x7fa6a8074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.306+0000 7fa6afdd8700 1 -- 172.21.15.69:0/4038142042 shutdown_connections 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.306+0000 7fa6afdd8700 1 -- 172.21.15.69:0/4038142042 wait complete. 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.306+0000 7fa6afdd8700 1 Processor -- start 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.306+0000 7fa6afdd8700 1 -- start start 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6afdd8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6a80ff6e0 0x7fa6a8196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6afdd8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a8100080 0x7fa6a81969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6afdd8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8104d70 0x7fa6a819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6afdd8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a819b460 con 0x7fa6a8100080 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6afdd8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a819b5d0 con 0x7fa6a80ff6e0 2023-12-14T14:12:09.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6afdd8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a819b790 con 0x7fa6a8104d70 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6ad373700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a8100080 0x7fa6a81969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6ad373700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a8100080 0x7fa6a81969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60276/0 (socket says 172.21.15.69:60276) 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6ad373700 1 -- 172.21.15.69:0/865566606 learned_addr learned my addr 172.21.15.69:0/865566606 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6adb74700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6a80ff6e0 0x7fa6a8196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6ae375700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8104d70 0x7fa6a819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6ad373700 1 -- 172.21.15.69:0/865566606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8104d70 msgr2=0x7fa6a819ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6ad373700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8104d70 0x7fa6a819ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6ad373700 1 -- 172.21.15.69:0/865566606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6a80ff6e0 msgr2=0x7fa6a8196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6ad373700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6a80ff6e0 0x7fa6a8196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.307+0000 7fa6ad373700 1 -- 172.21.15.69:0/865566606 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69800ae10 con 0x7fa6a8100080 2023-12-14T14:12:09.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.308+0000 7fa6ad373700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a8100080 0x7fa6a81969c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00e910 tx=0x7fa69c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:09.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.308+0000 7fa6a6ffd700 1 -- 172.21.15.69:0/865566606 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c004a30 con 0x7fa6a8100080 2023-12-14T14:12:09.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.308+0000 7fa6a6ffd700 1 -- 172.21.15.69:0/865566606 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa69c0054e0 con 0x7fa6a8100080 2023-12-14T14:12:09.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.308+0000 7fa6afdd8700 1 -- 172.21.15.69:0/865566606 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a810e120 con 0x7fa6a8100080 2023-12-14T14:12:09.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.308+0000 7fa6a6ffd700 1 -- 172.21.15.69:0/865566606 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c00cc40 con 0x7fa6a8100080 2023-12-14T14:12:09.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.308+0000 7fa6afdd8700 1 -- 172.21.15.69:0/865566606 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a810df90 con 0x7fa6a8100080 2023-12-14T14:12:09.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.310+0000 7fa6a6ffd700 1 -- 172.21.15.69:0/865566606 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fa69c005000 con 0x7fa6a8100080 2023-12-14T14:12:09.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.311+0000 7fa6a6ffd700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa6900a13e0 0x7fa6900a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.311+0000 7fa6a6ffd700 1 -- 172.21.15.69:0/865566606 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa69c014070 con 0x7fa6a8100080 2023-12-14T14:12:09.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.311+0000 7fa6adb74700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa6900a13e0 0x7fa6900a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.312+0000 7fa6adb74700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa6900a13e0 0x7fa6900a3890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c8e0 tx=0x7fa69800c190 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:09.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.371+0000 7fa6bbf66b80 1 Processor -- start 2023-12-14T14:12:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.371+0000 7fa6bbf66b80 1 -- start start 2023-12-14T14:12:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310dd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310ddc90 0x5628310e8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 0x5628310eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562830fc75e0 con 0x5628310dd380 2023-12-14T14:12:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562831036870 con 0x5628310ddc90 2023-12-14T14:12:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56283102fd00 con 0x5628310e8b50 2023-12-14T14:12:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6adb74700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6adb74700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310dd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60292/0 (socket says 172.21.15.69:60292) 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6adb74700 1 -- 172.21.15.69:0/1268950837 learned_addr learned my addr 172.21.15.69:0/1268950837 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6ad373700 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310ddc90 0x5628310e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6ae375700 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 0x5628310eaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6ad373700 1 -- 172.21.15.69:0/1268950837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 msgr2=0x5628310eaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6ad373700 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 0x5628310eaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6ad373700 1 -- 172.21.15.69:0/1268950837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 msgr2=0x5628310dd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6ad373700 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310dd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6ad373700 1 -- 172.21.15.69:0/1268950837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562830eb13b0 con 0x5628310ddc90 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.372+0000 7fa6adb74700 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.373+0000 7fa6ad373700 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310ddc90 0x5628310e8610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0ca860 tx=0x7fa69c099a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c9f431aa56250f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:09.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.373+0000 7fa68ffff700 1 -- 172.21.15.69:0/1268950837 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0cc040 con 0x5628310ddc90 2023-12-14T14:12:09.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.373+0000 7fa68ffff700 1 -- 172.21.15.69:0/1268950837 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa69c09e140 con 0x5628310ddc90 2023-12-14T14:12:09.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.373+0000 7fa68ffff700 1 -- 172.21.15.69:0/1268950837 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c004b90 con 0x5628310ddc90 2023-12-14T14:12:09.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/1268950837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310ddc90 msgr2=0x5628310e8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310ddc90 0x5628310e8610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0ca860 tx=0x7fa69c099a70 comp rx=0 tx=0).stop 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/1268950837 shutdown_connections 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 0x5628310eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/1268950837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310ddc90 0x5628310e8610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/1268950837 >> 172.21.15.69:0/1268950837 conn(0x5628310d3ca0 msgr2=0x5628310d97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/1268950837 shutdown_connections 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/1268950837 wait complete. 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 -- start start 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.374+0000 7fa6bbf66b80 1 Processor -- start 2023-12-14T14:12:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.375+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310dd380 0x5628310e8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.375+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310e5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.375+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 0x5628310e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.375+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562830fcbf90 con 0x5628310ddc90 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.375+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562830fcbc30 con 0x5628310e8b50 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.375+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562830eb36a0 con 0x5628310dd380 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.375+0000 7fa6bbf66b80 10 client.0 _ll_register_callbacks cb 0x562830fef910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.375+0000 7fa6ad373700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6ad373700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310e5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60300/0 (socket says 172.21.15.69:60300) 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6ad373700 1 -- 172.21.15.69:0/3761972240 learned_addr learned my addr 172.21.15.69:0/3761972240 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6adb74700 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310dd380 0x5628310e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6ae375700 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 0x5628310e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6adb74700 1 -- 172.21.15.69:0/3761972240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 msgr2=0x5628310e5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6adb74700 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 0x5628310e5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6adb74700 1 -- 172.21.15.69:0/3761972240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 msgr2=0x5628310e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6adb74700 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6adb74700 1 -- 172.21.15.69:0/3761972240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a810df90 con 0x5628310dd380 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6ad373700 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6adb74700 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310dd380 0x5628310e8570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa698000f80 tx=0x7fa69800aaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5cc35e62c9fa1dd server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa68d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa68d7fa700 1 -- 172.21.15.69:0/3761972240 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69800f050 con 0x5628310dd380 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa68d7fa700 1 -- 172.21.15.69:0/3761972240 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa698023040 con 0x5628310dd380 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.376+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/3761972240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628310d12b0 con 0x5628310dd380 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa68d7fa700 1 -- 172.21.15.69:0/3761972240 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa698008040 con 0x5628310dd380 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa6bbf66b80 10 client.25225 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/3761972240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x562830ff6170 con 0x5628310dd380 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa68d7fa700 1 -- 172.21.15.69:0/3761972240 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5628310d12b0 con 0x5628310dd380 2023-12-14T14:12:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa68d7fa700 1 -- 172.21.15.69:0/3761972240 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa698005210 con 0x5628310dd380 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa6bbf66b80 10 client.25225 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa6bbf66b80 10 client.25225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa6bbf66b80 20 client.25225 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5628310f83a0 0x5628310fa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa6bbf66b80 4 client.25225 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/3761972240 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562831028ce0 con 0x5628310f83a0 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.377+0000 7fa6ad373700 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5628310f83a0 0x5628310fa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.378+0000 7fa6ad373700 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5628310f83a0 0x5628310fa7b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b51259eb3b544780 server_cookie=f62d6b59e713e4ab in_seq=0 out_seq=0 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.378+0000 7fa68d7fa700 10 client.25225 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.378+0000 7fa68d7fa700 1 -- 172.21.15.69:0/3761972240 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562831028ce0 con 0x5628310f83a0 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.378+0000 7fa68d7fa700 10 client.25225 handle_command_reply: tid=0 2023-12-14T14:12:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.378+0000 7fa6bbf66b80 1 client.25225 shutdown 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/3761972240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310dd380 msgr2=0x5628310e8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310dd380 0x5628310e8570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa698000f80 tx=0x7fa69800aaf0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/3761972240 shutdown_connections 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5628310f83a0 0x5628310fa7b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 0x5628310e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310dd380 0x5628310e8570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa68d7fa700 0 client.25225 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/3761972240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/3761972240 >> 172.21.15.69:0/3761972240 conn(0x5628310d3ca0 msgr2=0x5628310d93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/3761972240 shutdown_connections 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/3761972240 wait complete. 2023-12-14T14:12:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.379+0000 7fa6bbf66b80 20 client.25225 trim_cache size 0 max 16384 2023-12-14T14:12:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6bbf66b80 1 Processor -- start 2023-12-14T14:12:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6bbf66b80 1 -- start start 2023-12-14T14:12:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310ef690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310ddc90 0x5628310d7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 0x5628310f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628310d8470 con 0x5628310dd380 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628310d55d0 con 0x5628310e8b50 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628310d5790 con 0x5628310ddc90 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6adb74700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6adb74700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310ef690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60316/0 (socket says 172.21.15.69:60316) 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6adb74700 1 -- 172.21.15.69:0/2635295082 learned_addr learned my addr 172.21.15.69:0/2635295082 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6ae375700 1 --2- 172.21.15.69:0/2635295082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 0x5628310f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.397+0000 7fa6ad373700 1 --2- 172.21.15.69:0/2635295082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310ddc90 0x5628310d7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.398+0000 7fa6adb74700 1 -- 172.21.15.69:0/2635295082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310ddc90 msgr2=0x5628310d7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.398+0000 7fa6adb74700 1 --2- 172.21.15.69:0/2635295082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310ddc90 0x5628310d7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.398+0000 7fa6adb74700 1 -- 172.21.15.69:0/2635295082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 msgr2=0x5628310f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.398+0000 7fa6adb74700 1 --2- 172.21.15.69:0/2635295082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 0x5628310f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.398+0000 7fa6adb74700 1 -- 172.21.15.69:0/2635295082 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562830ff5ec0 con 0x5628310dd380 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.398+0000 7fa6adb74700 1 --2- 172.21.15.69:0/2635295082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310ef690 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa698005a70 tx=0x7fa698005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50458108451ffee5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.398+0000 7fa6a4ff9700 1 -- 172.21.15.69:0/2635295082 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69800f040 con 0x5628310dd380 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.398+0000 7fa6a4ff9700 1 -- 172.21.15.69:0/2635295082 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa698033440 con 0x5628310dd380 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.398+0000 7fa6a4ff9700 1 -- 172.21.15.69:0/2635295082 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69801c690 con 0x5628310dd380 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/2635295082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 msgr2=0x5628310ef690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/2635295082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310ef690 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa698005a70 tx=0x7fa698005aa0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/2635295082 shutdown_connections 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/2635295082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310e8b50 0x5628310f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/2635295082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310dd380 0x5628310ef690 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/2635295082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310ddc90 0x5628310d7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/2635295082 >> 172.21.15.69:0/2635295082 conn(0x5628310d3ca0 msgr2=0x5628310ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/2635295082 shutdown_connections 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/2635295082 wait complete. 2023-12-14T14:12:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 -- start start 2023-12-14T14:12:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.399+0000 7fa6bbf66b80 1 Processor -- start 2023-12-14T14:12:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310dd380 0x5628310ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6bbf66b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 0x5628310ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56283114b260 con 0x5628310ddc90 2023-12-14T14:12:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56283114b3a0 con 0x5628310dd380 2023-12-14T14:12:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6bbf66b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56283114b530 con 0x5628310e8b50 2023-12-14T14:12:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6bbf66b80 10 client.0 _ll_register_callbacks cb 0x7fa69800a4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6ad373700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6ad373700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310ed0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60330/0 (socket says 172.21.15.69:60330) 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6ad373700 1 -- 172.21.15.69:0/5123617 learned_addr learned my addr 172.21.15.69:0/5123617 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6adb74700 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310dd380 0x5628310ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.400+0000 7fa6ae375700 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 0x5628310ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6ad373700 1 -- 172.21.15.69:0/5123617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 msgr2=0x5628310ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6ad373700 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 0x5628310ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6ad373700 1 -- 172.21.15.69:0/5123617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310dd380 msgr2=0x5628310ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6ad373700 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310dd380 0x5628310ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6ad373700 1 -- 172.21.15.69:0/5123617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562830ff6170 con 0x5628310ddc90 2023-12-14T14:12:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6ae375700 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 0x5628310ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6ad373700 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310ed0b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa69c099e10 tx=0x7fa69c09a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2eec228866379f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa68d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa68d7fa700 1 -- 172.21.15.69:0/5123617 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0cc040 con 0x5628310ddc90 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa68d7fa700 1 -- 172.21.15.69:0/5123617 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa69c0b7070 con 0x5628310ddc90 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/5123617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa69c09e140 con 0x5628310ddc90 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa68d7fa700 1 -- 172.21.15.69:0/5123617 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa69c0ca7a0 con 0x5628310ddc90 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6bbf66b80 10 client.15729 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/5123617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x562830fdc9a0 con 0x5628310ddc90 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa68d7fa700 1 -- 172.21.15.69:0/5123617 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa69c09e140 con 0x5628310ddc90 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.401+0000 7fa68d7fa700 1 -- 172.21.15.69:0/5123617 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa69c0b8340 con 0x5628310ddc90 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa6bbf66b80 10 client.15729 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa6bbf66b80 10 client.15729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa6bbf66b80 20 client.15729 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56283114c990 0x56283114eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa6bbf66b80 4 client.15729 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/5123617 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562831028a00 con 0x56283114c990 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa6adb74700 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56283114c990 0x56283114eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa68d7fa700 10 client.15729 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa6adb74700 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56283114c990 0x56283114eda0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a40241df105edce2 server_cookie=bbebffd49624c086 in_seq=0 out_seq=0 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa68d7fa700 1 -- 172.21.15.69:0/5123617 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562831028a00 con 0x56283114c990 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.402+0000 7fa68d7fa700 10 client.15729 handle_command_reply: tid=0 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 client.15729 shutdown 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/5123617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 msgr2=0x5628310ed0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310ed0b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa69c099e10 tx=0x7fa69c09a290 comp rx=0 tx=0).stop 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/5123617 shutdown_connections 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56283114c990 0x56283114eda0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628310e8b50 0x5628310ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628310dd380 0x5628310ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 --2- 172.21.15.69:0/5123617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628310ddc90 0x5628310ed0b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa68d7fa700 0 client.15729 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/5123617 >> 172.21.15.69:0/5123617 conn(0x5628310d3ca0 msgr2=0x5628310d7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/5123617 shutdown_connections 2023-12-14T14:12:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 1 -- 172.21.15.69:0/5123617 wait complete. 2023-12-14T14:12:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6bbf66b80 20 client.15729 trim_cache size 0 max 16384 2023-12-14T14:12:09.408 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:12:09.408 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:12:09.408 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:12:09.408 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:12:09.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6afdd8700 1 -- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa6900a13e0 msgr2=0x7fa6900a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:09.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa6900a13e0 0x7fa6900a3890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c8e0 tx=0x7fa69800c190 comp rx=0 tx=0).stop 2023-12-14T14:12:09.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6afdd8700 1 -- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a8100080 msgr2=0x7fa6a81969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:09.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.403+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a8100080 0x7fa6a81969c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00e910 tx=0x7fa69c00ec20 comp rx=0 tx=0).stop 2023-12-14T14:12:09.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.404+0000 7fa6afdd8700 1 -- 172.21.15.69:0/865566606 shutdown_connections 2023-12-14T14:12:09.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.404+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa6900a13e0 0x7fa6900a3890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.404+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8104d70 0x7fa6a819ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.404+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6a80ff6e0 0x7fa6a8196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.404+0000 7fa6afdd8700 1 --2- 172.21.15.69:0/865566606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6a8100080 0x7fa6a81969c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:09.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.404+0000 7fa6afdd8700 1 -- 172.21.15.69:0/865566606 >> 172.21.15.69:0/865566606 conn(0x7fa6a8074a60 msgr2=0x7fa6a81029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:09.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.404+0000 7fa6afdd8700 1 -- 172.21.15.69:0/865566606 shutdown_connections 2023-12-14T14:12:09.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:09.404+0000 7fa6afdd8700 1 -- 172.21.15.69:0/865566606 wait complete. 2023-12-14T14:12:09.465 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:12:09.465 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:12:09.649 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:09.649 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:09.763 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:09.763 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:09.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:09 smithi119 ceph-mon[43834]: pgmap v48: 97 pgs: 97 active+clean; 1.6 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 40 KiB/s wr, 19 op/s 2023-12-14T14:12:09.781 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:09.782 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:09.782 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 40 -lt 100 ']' 2023-12-14T14:12:09.782 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 40 + 1 2023-12-14T14:12:09.822 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=41 2023-12-14T14:12:09.822 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:09.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:09 smithi069 ceph-mon[42034]: pgmap v48: 97 pgs: 97 active+clean; 1.6 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 40 KiB/s wr, 19 op/s 2023-12-14T14:12:09.842 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:09.842 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:09.843 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:09.843 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:09.843 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:09 smithi081 ceph-mon[43371]: pgmap v48: 97 pgs: 97 active+clean; 1.6 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 40 KiB/s wr, 19 op/s 2023-12-14T14:12:10.333 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:10.333 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:10.474 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:10.474 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:10.490 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:10.490 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:10.490 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 41 -lt 100 ']' 2023-12-14T14:12:10.490 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 41 + 1 2023-12-14T14:12:10.547 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=42 2023-12-14T14:12:10.547 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:10.581 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:10.581 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:10.582 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:10.582 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:10.582 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:11.541 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:11.541 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:11.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:11 smithi069 ceph-mon[42034]: pgmap v49: 97 pgs: 97 active+clean; 1.8 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 23 op/s 2023-12-14T14:12:11.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:11 smithi119 ceph-mon[43834]: pgmap v49: 97 pgs: 97 active+clean; 1.8 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 23 op/s 2023-12-14T14:12:11.791 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:11.791 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:11.799 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:11.799 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:11.799 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 42 -lt 100 ']' 2023-12-14T14:12:11.799 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 42 + 1 2023-12-14T14:12:11.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=43 2023-12-14T14:12:11.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:11.882 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:11.883 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:11.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:11.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:11.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:11.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:11 smithi081 ceph-mon[43371]: pgmap v49: 97 pgs: 97 active+clean; 1.8 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 23 op/s 2023-12-14T14:12:12.457 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:12.457 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:12.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:12 smithi069 ceph-mon[42034]: mgrmap e24: x(active, since 93s), standbys: z, y 2023-12-14T14:12:12.607 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:12.607 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:12.624 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:12.624 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:12.624 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 43 -lt 100 ']' 2023-12-14T14:12:12.624 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 43 + 1 2023-12-14T14:12:12.666 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=44 2023-12-14T14:12:12.666 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:12.707 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:12.707 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:12.708 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:12.709 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:12.709 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:12.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:12 smithi119 ceph-mon[43834]: mgrmap e24: x(active, since 93s), standbys: z, y 2023-12-14T14:12:12.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:12 smithi081 ceph-mon[43371]: mgrmap e24: x(active, since 93s), standbys: z, y 2023-12-14T14:12:12.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.930+0000 7f1a7daa8700 1 -- 172.21.15.69:0/1774465870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780ff8c0 msgr2=0x7f1a7810c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:12.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.930+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/1774465870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780ff8c0 0x7f1a7810c620 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009990 tx=0x7f1a68009ca0 comp rx=0 tx=0).stop 2023-12-14T14:12:12.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.930+0000 7f1a7daa8700 1 -- 172.21.15.69:0/1774465870 shutdown_connections 2023-12-14T14:12:12.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.930+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/1774465870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a7810cb60 0x7f1a7810ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:12.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.930+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/1774465870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a780fefb0 0x7f1a780ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:12.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.930+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/1774465870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780ff8c0 0x7f1a7810c620 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:12.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.930+0000 7f1a7daa8700 1 -- 172.21.15.69:0/1774465870 >> 172.21.15.69:0/1774465870 conn(0x7f1a78076370 msgr2=0x7f1a78076770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:12.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.930+0000 7f1a7daa8700 1 -- 172.21.15.69:0/1774465870 shutdown_connections 2023-12-14T14:12:12.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.931+0000 7f1a7daa8700 1 -- 172.21.15.69:0/1774465870 wait complete. 2023-12-14T14:12:12.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.931+0000 7f1a7daa8700 1 Processor -- start 2023-12-14T14:12:12.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a7daa8700 1 -- start start 2023-12-14T14:12:12.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a7daa8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780fefb0 0x7f1a7819e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:12.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a7daa8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a780ff8c0 0x7f1a7819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a7daa8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7810cb60 0x7f1a78198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a7daa8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78198be0 con 0x7f1a780fefb0 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a7daa8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78198d50 con 0x7f1a7810cb60 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a7daa8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78198f10 con 0x7f1a780ff8c0 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780fefb0 0x7f1a7819e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780fefb0 0x7f1a7819e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60336/0 (socket says 172.21.15.69:60336) 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a777fe700 1 -- 172.21.15.69:0/4014477429 learned_addr learned my addr 172.21.15.69:0/4014477429 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a77fff700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7810cb60 0x7f1a78198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a76ffd700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a780ff8c0 0x7f1a7819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a777fe700 1 -- 172.21.15.69:0/4014477429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a780ff8c0 msgr2=0x7f1a7819ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a777fe700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a780ff8c0 0x7f1a7819ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a777fe700 1 -- 172.21.15.69:0/4014477429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7810cb60 msgr2=0x7f1a78198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a777fe700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7810cb60 0x7f1a78198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:12.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.932+0000 7f1a777fe700 1 -- 172.21.15.69:0/4014477429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a680095f0 con 0x7f1a780fefb0 2023-12-14T14:12:12.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.933+0000 7f1a777fe700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780fefb0 0x7f1a7819e500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000ef10 tx=0x7f1a7000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:12.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.933+0000 7f1a74ff9700 1 -- 172.21.15.69:0/4014477429 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000c9c0 con 0x7f1a780fefb0 2023-12-14T14:12:12.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.933+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a78112460 con 0x7f1a780fefb0 2023-12-14T14:12:12.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.933+0000 7f1a74ff9700 1 -- 172.21.15.69:0/4014477429 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a7000f040 con 0x7f1a780fefb0 2023-12-14T14:12:12.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.933+0000 7f1a74ff9700 1 -- 172.21.15.69:0/4014477429 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70014480 con 0x7f1a780fefb0 2023-12-14T14:12:12.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.933+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a781122d0 con 0x7f1a780fefb0 2023-12-14T14:12:12.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.935+0000 7f1a74ff9700 1 -- 172.21.15.69:0/4014477429 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1a70007690 con 0x7f1a780fefb0 2023-12-14T14:12:12.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.936+0000 7f1a74ff9700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1a600a12c0 0x7f1a600a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:12.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.936+0000 7f1a76ffd700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1a600a12c0 0x7f1a600a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:12.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.936+0000 7f1a74ff9700 1 -- 172.21.15.69:0/4014477429 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f1a700ccfa0 con 0x7f1a780fefb0 2023-12-14T14:12:12.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.937+0000 7f1a76ffd700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1a600a12c0 0x7f1a600a3770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a78077820 tx=0x7f1a68005fd0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:12.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.969+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a781125f0 con 0x7f1a780fefb0 2023-12-14T14:12:12.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:12.974+0000 7f1a74ff9700 1 -- 172.21.15.69:0/4014477429 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1a700963f0 con 0x7f1a780fefb0 2023-12-14T14:12:13.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.215+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a780679f0 con 0x7f1a780fefb0 2023-12-14T14:12:13.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.216+0000 7f1a74ff9700 1 -- 172.21.15.69:0/4014477429 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f1a70099a10 con 0x7f1a780fefb0 2023-12-14T14:12:13.215 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:12:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:12:13.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1a600a12c0 msgr2=0x7f1a600a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1a600a12c0 0x7f1a600a3770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a78077820 tx=0x7f1a68005fd0 comp rx=0 tx=0).stop 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780fefb0 msgr2=0x7f1a7819e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780fefb0 0x7f1a7819e500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000ef10 tx=0x7f1a7000c3a0 comp rx=0 tx=0).stop 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 shutdown_connections 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1a600a12c0 0x7f1a600a3770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7810cb60 0x7f1a78198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a780fefb0 0x7f1a7819e500 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 --2- 172.21.15.69:0/4014477429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a780ff8c0 0x7f1a7819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 >> 172.21.15.69:0/4014477429 conn(0x7f1a78076370 msgr2=0x7f1a780fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 shutdown_connections 2023-12-14T14:12:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:13.218+0000 7f1a7daa8700 1 -- 172.21.15.69:0/4014477429 wait complete. 2023-12-14T14:12:13.219 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:12:13.307 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:12:13.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:13 smithi069 ceph-mon[42034]: pgmap v50: 97 pgs: 97 active+clean; 1.8 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 47 KiB/s wr, 20 op/s 2023-12-14T14:12:13.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:13 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4014477429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:12:13.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:13 smithi119 ceph-mon[43834]: pgmap v50: 97 pgs: 97 active+clean; 1.8 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 47 KiB/s wr, 20 op/s 2023-12-14T14:12:13.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:13 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4014477429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:12:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:13 smithi081 ceph-mon[43371]: pgmap v50: 97 pgs: 97 active+clean; 1.8 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 47 KiB/s wr, 20 op/s 2023-12-14T14:12:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:13 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4014477429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:12:14.306 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:14.307 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:14.621 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:14.621 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:14.698 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:14.698 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:14.698 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 44 -lt 100 ']' 2023-12-14T14:12:14.698 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 44 + 1 2023-12-14T14:12:14.746 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=45 2023-12-14T14:12:14.746 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:14.789 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:14.789 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:14.790 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:14.790 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:14.790 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:15 smithi119 ceph-mon[43834]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 52 KiB/s wr, 24 op/s 2023-12-14T14:12:15.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:15 smithi069 ceph-mon[42034]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 52 KiB/s wr, 24 op/s 2023-12-14T14:12:15.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:15 smithi081 ceph-mon[43371]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 52 KiB/s wr, 24 op/s 2023-12-14T14:12:17.098 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:17.099 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:17.229 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:17.229 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:17.239 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:17.239 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:17.239 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 45 -lt 100 ']' 2023-12-14T14:12:17.239 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 45 + 1 2023-12-14T14:12:17.282 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=46 2023-12-14T14:12:17.282 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:17.355 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:17.355 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:17.356 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:17.356 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:17.356 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:17.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:17 smithi069 ceph-mon[42034]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-12-14T14:12:17.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:17 smithi081 ceph-mon[43371]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-12-14T14:12:17.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:17 smithi119 ceph-mon[43834]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-12-14T14:12:17.990 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:17.990 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:18.231 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:18.232 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:18.238 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:18.238 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:18.238 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 46 -lt 100 ']' 2023-12-14T14:12:18.238 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 46 + 1 2023-12-14T14:12:18.288 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=47 2023-12-14T14:12:18.288 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:18.332 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:18.332 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:18.333 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:18.333 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:18.333 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:19.006 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:19.006 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:19.273 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:19.273 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:19.280 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:19.280 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:19.280 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 47 -lt 100 ']' 2023-12-14T14:12:19.280 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 47 + 1 2023-12-14T14:12:19.312 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=48 2023-12-14T14:12:19.312 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:19.364 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:19.364 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:19.365 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:19.366 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:19.366 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:19.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.670+0000 7ff611bac700 1 -- 172.21.15.69:0/96174621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 msgr2=0x7ff60c0ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:19.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.670+0000 7ff611bac700 1 --2- 172.21.15.69:0/96174621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 0x7ff60c0ff760 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0099c0 tx=0x7ff5fc009cd0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.670+0000 7ff611bac700 1 -- 172.21.15.69:0/96174621 shutdown_connections 2023-12-14T14:12:19.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.670+0000 7ff611bac700 1 --2- 172.21.15.69:0/96174621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff60c1043d0 0x7ff60c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.670+0000 7ff611bac700 1 --2- 172.21.15.69:0/96174621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 0x7ff60c0ff760 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.670+0000 7ff611bac700 1 --2- 172.21.15.69:0/96174621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ffd30 0x7ff60c103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.670+0000 7ff611bac700 1 -- 172.21.15.69:0/96174621 >> 172.21.15.69:0/96174621 conn(0x7ff60c075fd0 msgr2=0x7ff60c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:19.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.670+0000 7ff611bac700 1 -- 172.21.15.69:0/96174621 shutdown_connections 2023-12-14T14:12:19.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.670+0000 7ff611bac700 1 -- 172.21.15.69:0/96174621 wait complete. 2023-12-14T14:12:19.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.671+0000 7ff611bac700 1 Processor -- start 2023-12-14T14:12:19.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.671+0000 7ff611bac700 1 -- start start 2023-12-14T14:12:19.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff611bac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 0x7ff60c1952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff611bac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ffd30 0x7ff60c195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff611bac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff60c1043d0 0x7ff60c199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff611bac700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c19a260 con 0x7ff60c0ff390 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff611bac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c19a3d0 con 0x7ff60c0ffd30 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff611bac700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c19a590 con 0x7ff60c1043d0 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 0x7ff60c1952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 0x7ff60c1952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51700/0 (socket says 172.21.15.69:51700) 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60b7fe700 1 -- 172.21.15.69:0/1572140333 learned_addr learned my addr 172.21.15.69:0/1572140333 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff603fff700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ffd30 0x7ff60c195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60bfff700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff60c1043d0 0x7ff60c199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60b7fe700 1 -- 172.21.15.69:0/1572140333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff60c1043d0 msgr2=0x7ff60c199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff60c1043d0 0x7ff60c199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60b7fe700 1 -- 172.21.15.69:0/1572140333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ffd30 msgr2=0x7ff60c195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:19.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ffd30 0x7ff60c195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60b7fe700 1 -- 172.21.15.69:0/1572140333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0095f0 con 0x7ff60c0ff390 2023-12-14T14:12:19.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60bfff700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff60c1043d0 0x7ff60c199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:19.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.672+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 0x7ff60c1952f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009990 tx=0x7ff5fc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:19.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.673+0000 7ff6097fa700 1 -- 172.21.15.69:0/1572140333 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc01d070 con 0x7ff60c0ff390 2023-12-14T14:12:19.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.673+0000 7ff6097fa700 1 -- 172.21.15.69:0/1572140333 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5fc003f90 con 0x7ff60c0ff390 2023-12-14T14:12:19.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.673+0000 7ff611bac700 1 -- 172.21.15.69:0/1572140333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c10f1e0 con 0x7ff60c0ff390 2023-12-14T14:12:19.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.673+0000 7ff6097fa700 1 -- 172.21.15.69:0/1572140333 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc022cb0 con 0x7ff60c0ff390 2023-12-14T14:12:19.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.673+0000 7ff611bac700 1 -- 172.21.15.69:0/1572140333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c10f050 con 0x7ff60c0ff390 2023-12-14T14:12:19.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.675+0000 7ff6097fa700 1 -- 172.21.15.69:0/1572140333 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff5fc022470 con 0x7ff60c0ff390 2023-12-14T14:12:19.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.676+0000 7ff6097fa700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5f80a1340 0x7ff5f80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.676+0000 7ff603fff700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5f80a1340 0x7ff5f80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.676+0000 7ff6097fa700 1 -- 172.21.15.69:0/1572140333 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7ff5fc0ce160 con 0x7ff60c0ff390 2023-12-14T14:12:19.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.676+0000 7ff603fff700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5f80a1340 0x7ff5f80a37f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff60c196890 tx=0x7ff5f400b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:19.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.763+0000 7ff61dd3ab80 1 Processor -- start 2023-12-14T14:12:19.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.763+0000 7ff61dd3ab80 1 -- start start 2023-12-14T14:12:19.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.763+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcb4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.763+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 0x564f1fcbf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.763+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fcc1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.763+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fb9e5e0 con 0x564f1fcbfb50 2023-12-14T14:12:19.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.763+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fc0d870 con 0x564f1fcb4380 2023-12-14T14:12:19.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.763+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fc06d00 con 0x564f1fcb4c90 2023-12-14T14:12:19.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.763+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fcc1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fcc1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51714/0 (socket says 172.21.15.69:51714) 2023-12-14T14:12:19.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60bfff700 1 -- 172.21.15.69:0/1771209931 learned_addr learned my addr 172.21.15.69:0/1771209931 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:19.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff603fff700 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 0x564f1fcbf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcb4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60bfff700 1 -- 172.21.15.69:0/1771209931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 msgr2=0x564f1fcbf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60bfff700 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 0x564f1fcbf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60bfff700 1 -- 172.21.15.69:0/1771209931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 msgr2=0x564f1fcb4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60bfff700 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcb4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60bfff700 1 -- 172.21.15.69:0/1771209931 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f1fa883b0 con 0x564f1fcbfb50 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcb4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff60bfff700 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fcc1f30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff604009dd0 tx=0x7ff6040077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc28a8f8323acf87 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff601ffb700 1 -- 172.21.15.69:0/1771209931 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604014610 con 0x564f1fcbfb50 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff601ffb700 1 -- 172.21.15.69:0/1771209931 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff60400f050 con 0x564f1fcbfb50 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.764+0000 7ff601ffb700 1 -- 172.21.15.69:0/1771209931 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604013990 con 0x564f1fcbfb50 2023-12-14T14:12:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.765+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1771209931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 msgr2=0x564f1fcc1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.765+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fcc1f30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff604009dd0 tx=0x7ff6040077e0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.765+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1771209931 shutdown_connections 2023-12-14T14:12:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.765+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fcc1f30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.765+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcb4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.765+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1771209931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 0x564f1fcbf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.765+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1771209931 >> 172.21.15.69:0/1771209931 conn(0x564f1fcaaca0 msgr2=0x564f1fcb07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.765+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1771209931 shutdown_connections 2023-12-14T14:12:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.765+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1771209931 wait complete. 2023-12-14T14:12:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.766+0000 7ff61dd3ab80 1 -- start start 2023-12-14T14:12:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.766+0000 7ff61dd3ab80 1 Processor -- start 2023-12-14T14:12:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcbf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fcbc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcbfb50 0x564f1fcbcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fba2f90 con 0x564f1fcb4c90 2023-12-14T14:12:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fba2c30 con 0x564f1fcb4380 2023-12-14T14:12:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fa8a6a0 con 0x564f1fcbfb50 2023-12-14T14:12:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff61dd3ab80 10 client.0 _ll_register_callbacks cb 0x564f1fbc6910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff603fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fcbc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff603fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fcbc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51726/0 (socket says 172.21.15.69:51726) 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff603fff700 1 -- 172.21.15.69:0/1611330833 learned_addr learned my addr 172.21.15.69:0/1611330833 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcbf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff60bfff700 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcbfb50 0x564f1fcbcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff603fff700 1 -- 172.21.15.69:0/1611330833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcbfb50 msgr2=0x564f1fcbcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff603fff700 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcbfb50 0x564f1fcbcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff603fff700 1 -- 172.21.15.69:0/1611330833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 msgr2=0x564f1fcbf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff603fff700 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcbf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff603fff700 1 -- 172.21.15.69:0/1611330833 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff604009a00 con 0x564f1fcb4c90 2023-12-14T14:12:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcbf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff603fff700 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fcbc780 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff60c100100 tx=0x7ff5f40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4c1b780a1324e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.767+0000 7ff5eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.768+0000 7ff5eaffd700 1 -- 172.21.15.69:0/1611330833 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4023070 con 0x564f1fcb4c90 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.768+0000 7ff5eaffd700 1 -- 172.21.15.69:0/1611330833 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7ff5f4017070 con 0x564f1fcb4c90 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.768+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1611330833 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f1fca82b0 con 0x564f1fcb4c90 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.768+0000 7ff5eaffd700 1 -- 172.21.15.69:0/1611330833 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5f4011650 con 0x564f1fcb4c90 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.768+0000 7ff61dd3ab80 10 client.15747 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.768+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1611330833 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x564f1fbcd170 con 0x564f1fcb4c90 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.768+0000 7ff5eaffd700 1 -- 172.21.15.69:0/1611330833 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564f1fca82b0 con 0x564f1fcb4c90 2023-12-14T14:12:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.768+0000 7ff5eaffd700 1 -- 172.21.15.69:0/1611330833 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff5f40277f0 con 0x564f1fcb4c90 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.769+0000 7ff61dd3ab80 10 client.15747 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.769+0000 7ff61dd3ab80 10 client.15747 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.769+0000 7ff61dd3ab80 20 client.15747 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.769+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564f1fccf5d0 0x564f1fcd19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.769+0000 7ff61dd3ab80 4 client.15747 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.769+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1611330833 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f1fbffce0 con 0x564f1fccf5d0 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.769+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564f1fccf5d0 0x564f1fcd19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.769+0000 7ff5eaffd700 10 client.15747 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.769+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564f1fccf5d0 0x564f1fcd19e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5ad8fe854d25a41 server_cookie=9a52ed120b4b270b in_seq=0 out_seq=0 2023-12-14T14:12:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff5eaffd700 1 -- 172.21.15.69:0/1611330833 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564f1fbffce0 con 0x564f1fccf5d0 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff5eaffd700 10 client.15747 handle_command_reply: tid=0 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 client.15747 shutdown 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1611330833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 msgr2=0x564f1fcbc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fcbc780 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff60c100100 tx=0x7ff5f40047c0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1611330833 shutdown_connections 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcbfb50 0x564f1fcbcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcbf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564f1fccf5d0 0x564f1fcd19e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/1611330833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fcbc780 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff5eaffd700 0 client.15747 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:12:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1611330833 >> 172.21.15.69:0/1611330833 conn(0x564f1fcaaca0 msgr2=0x564f1fcb03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:19.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1611330833 shutdown_connections 2023-12-14T14:12:19.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.770+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/1611330833 wait complete. 2023-12-14T14:12:19.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.771+0000 7ff61dd3ab80 20 client.15747 trim_cache size 0 max 16384 2023-12-14T14:12:19.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:19 smithi119 ceph-mon[43834]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-12-14T14:12:19.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.784+0000 7ff61dd3ab80 1 Processor -- start 2023-12-14T14:12:19.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff61dd3ab80 1 -- start start 2023-12-14T14:12:19.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4380 0x564f1fcc6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fccb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcbfb50 0x564f1fccae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fcbad00 con 0x564f1fcb4c90 2023-12-14T14:12:19.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fcb8610 con 0x564f1fcbfb50 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fcc6bd0 con 0x564f1fcb4380 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff603fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fccb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcbfb50 0x564f1fccae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff603fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fccb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51732/0 (socket says 172.21.15.69:51732) 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff603fff700 1 -- 172.21.15.69:0/2072193550 learned_addr learned my addr 172.21.15.69:0/2072193550 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/2072193550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4380 0x564f1fcc6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff603fff700 1 -- 172.21.15.69:0/2072193550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4380 msgr2=0x564f1fcc6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff603fff700 1 --2- 172.21.15.69:0/2072193550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4380 0x564f1fcc6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff603fff700 1 -- 172.21.15.69:0/2072193550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcbfb50 msgr2=0x564f1fccae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff603fff700 1 --2- 172.21.15.69:0/2072193550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcbfb50 0x564f1fccae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff603fff700 1 -- 172.21.15.69:0/2072193550 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f1fbccec0 con 0x564f1fcb4c90 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.785+0000 7ff60bfff700 1 --2- 172.21.15.69:0/2072193550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcbfb50 0x564f1fccae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.786+0000 7ff603fff700 1 --2- 172.21.15.69:0/2072193550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fccb800 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400b510 tx=0x7ff5f4010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdd2699c0af4f09 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.786+0000 7ff6027fc700 1 -- 172.21.15.69:0/2072193550 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4023070 con 0x564f1fcb4c90 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.786+0000 7ff6027fc700 1 -- 172.21.15.69:0/2072193550 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5f4020070 con 0x564f1fcb4c90 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.786+0000 7ff6027fc700 1 -- 172.21.15.69:0/2072193550 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f40119d0 con 0x564f1fcb4c90 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.786+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/2072193550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 msgr2=0x564f1fccb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.786+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/2072193550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fccb800 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400b510 tx=0x7ff5f4010c20 comp rx=0 tx=0).stop 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.787+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/2072193550 shutdown_connections 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.787+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/2072193550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcbfb50 0x564f1fccae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.787+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/2072193550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4380 0x564f1fcc6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.787+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/2072193550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcb4c90 0x564f1fccb800 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.787+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/2072193550 >> 172.21.15.69:0/2072193550 conn(0x564f1fcaaca0 msgr2=0x564f1fcd6300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.787+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/2072193550 shutdown_connections 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.787+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/2072193550 wait complete. 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.787+0000 7ff61dd3ab80 1 -- start start 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.787+0000 7ff61dd3ab80 1 Processor -- start 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcc5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 0x564f1fcc5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff61dd3ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fd22450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fd22990 con 0x564f1fcbfb50 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fd22ad0 con 0x564f1fcb4380 2023-12-14T14:12:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff61dd3ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1fd22c10 con 0x564f1fcb4c90 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff61dd3ab80 10 client.0 _ll_register_callbacks cb 0x7ff5f4010d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fd22450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fd22450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51740/0 (socket says 172.21.15.69:51740) 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60bfff700 1 -- 172.21.15.69:0/3097028932 learned_addr learned my addr 172.21.15.69:0/3097028932 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcc5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff603fff700 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 0x564f1fcc5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60bfff700 1 -- 172.21.15.69:0/3097028932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 msgr2=0x564f1fcc5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60bfff700 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 0x564f1fcc5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60bfff700 1 -- 172.21.15.69:0/3097028932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 msgr2=0x564f1fcc5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60bfff700 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcc5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60bfff700 1 -- 172.21.15.69:0/3097028932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f1fa883b0 con 0x564f1fcbfb50 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcc5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff60bfff700 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fd22450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff604009160 tx=0x7ff6040138e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed609e830f19a76 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.788+0000 7ff5eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff5eaffd700 1 -- 172.21.15.69:0/3097028932 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604024070 con 0x564f1fcbfb50 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff5eaffd700 1 -- 172.21.15.69:0/3097028932 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7ff604013370 con 0x564f1fcbfb50 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/3097028932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff60400f050 con 0x564f1fcbfb50 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff5eaffd700 1 -- 172.21.15.69:0/3097028932 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff604009620 con 0x564f1fcbfb50 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff61dd3ab80 10 client.15753 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/3097028932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x564f1fbcd170 con 0x564f1fcbfb50 2023-12-14T14:12:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff5eaffd700 1 -- 172.21.15.69:0/3097028932 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff60400f050 con 0x564f1fcbfb50 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff5eaffd700 1 -- 172.21.15.69:0/3097028932 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff604004260 con 0x564f1fcbfb50 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff61dd3ab80 10 client.15753 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff61dd3ab80 10 client.15753 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff61dd3ab80 20 client.15753 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564f1fd24330 0x564f1fd26740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff61dd3ab80 4 client.15753 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.789+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/3097028932 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564f1fbffa00 con 0x564f1fd24330 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564f1fd24330 0x564f1fd26740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff5eaffd700 10 client.15753 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff60b7fe700 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564f1fd24330 0x564f1fd26740 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=617a87e760f82a01 server_cookie=c68f8df85b284dd9 in_seq=0 out_seq=0 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff5eaffd700 1 -- 172.21.15.69:0/3097028932 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564f1fbffa00 con 0x564f1fd24330 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff5eaffd700 10 client.15753 handle_command_reply: tid=0 2023-12-14T14:12:19.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff61dd3ab80 1 client.15753 shutdown 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/3097028932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 msgr2=0x564f1fd22450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fd22450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff604009160 tx=0x7ff6040138e0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/3097028932 shutdown_connections 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564f1fd24330 0x564f1fd26740 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1fcbfb50 0x564f1fd22450 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f1fcb4380 0x564f1fcc5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff5eaffd700 0 client.15753 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff61dd3ab80 1 --2- 172.21.15.69:0/3097028932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f1fcb4c90 0x564f1fcc5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.790+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/3097028932 >> 172.21.15.69:0/3097028932 conn(0x564f1fcaaca0 msgr2=0x564f1fccae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/3097028932 shutdown_connections 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff61dd3ab80 1 -- 172.21.15.69:0/3097028932 wait complete. 2023-12-14T14:12:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff61dd3ab80 20 client.15753 trim_cache size 0 max 16384 2023-12-14T14:12:19.800 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 -- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5f80a1340 msgr2=0x7ff5f80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5f80a1340 0x7ff5f80a37f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff60c196890 tx=0x7ff5f400b410 comp rx=0 tx=0).stop 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 -- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 msgr2=0x7ff60c1952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 0x7ff60c1952f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009990 tx=0x7ff5fc005740 comp rx=0 tx=0).stop 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 -- 172.21.15.69:0/1572140333 shutdown_connections 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5f80a1340 0x7ff5f80a37f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff60c1043d0 0x7ff60c199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff60c0ff390 0x7ff60c1952f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 --2- 172.21.15.69:0/1572140333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ffd30 0x7ff60c195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 -- 172.21.15.69:0/1572140333 >> 172.21.15.69:0/1572140333 conn(0x7ff60c075fd0 msgr2=0x7ff60c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:19.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.791+0000 7ff611bac700 1 -- 172.21.15.69:0/1572140333 shutdown_connections 2023-12-14T14:12:19.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:19.792+0000 7ff611bac700 1 -- 172.21.15.69:0/1572140333 wait complete. 2023-12-14T14:12:19.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:19 smithi069 ceph-mon[42034]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-12-14T14:12:19.839 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:12:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:19 smithi081 ceph-mon[43371]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-12-14T14:12:20.256 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:20.256 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:20.362 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:20.362 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:20.388 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:20.388 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:20.388 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 48 -lt 100 ']' 2023-12-14T14:12:20.388 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 48 + 1 2023-12-14T14:12:20.423 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=49 2023-12-14T14:12:20.423 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:20.440 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:20.440 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:20.441 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:20.441 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:20.441 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:20.864 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:20.864 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:20.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:20.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:20.979 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:20.979 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:20.980 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 49 -lt 100 ']' 2023-12-14T14:12:20.980 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 49 + 1 2023-12-14T14:12:21.028 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=50 2023-12-14T14:12:21.028 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:21.071 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:21.071 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:21.072 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:21.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:21.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:21.589 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:21.589 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:21.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:21.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:21.780 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:21.780 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:21.781 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 50 -lt 100 ']' 2023-12-14T14:12:21.781 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 50 + 1 2023-12-14T14:12:21.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=51 2023-12-14T14:12:21.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:21.913 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:21.913 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:21.914 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:21.914 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:21.914 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:22.581 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:22.581 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:22.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:22 smithi069 ceph-mon[42034]: pgmap v54: 97 pgs: 97 active+clean; 1.9 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-12-14T14:12:22.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:22 smithi081 ceph-mon[43371]: pgmap v54: 97 pgs: 97 active+clean; 1.9 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-12-14T14:12:22.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:22.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:22.771 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:22.771 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:22.771 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 51 -lt 100 ']' 2023-12-14T14:12:22.771 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 51 + 1 2023-12-14T14:12:22.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:22 smithi119 ceph-mon[43834]: pgmap v54: 97 pgs: 97 active+clean; 1.9 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-12-14T14:12:22.806 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=52 2023-12-14T14:12:22.806 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:22.848 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:22.848 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:22.849 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:22.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:22.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:23.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.201+0000 7f8e658b9700 1 -- 172.21.15.69:0/4182648360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e600ff4c0 msgr2=0x7f8e600ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:23.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.201+0000 7f8e658b9700 1 --2- 172.21.15.69:0/4182648360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e600ff4c0 0x7f8e600ff890 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b0a0 tx=0x7f8e5000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.202+0000 7f8e658b9700 1 -- 172.21.15.69:0/4182648360 shutdown_connections 2023-12-14T14:12:23.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.202+0000 7f8e658b9700 1 --2- 172.21.15.69:0/4182648360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e6010ad80 0x7f8e6010d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.202+0000 7f8e658b9700 1 --2- 172.21.15.69:0/4182648360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e600ff4c0 0x7f8e600ff890 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.202+0000 7f8e658b9700 1 --2- 172.21.15.69:0/4182648360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e600ffdd0 0x7f8e6010a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.202+0000 7f8e658b9700 1 -- 172.21.15.69:0/4182648360 >> 172.21.15.69:0/4182648360 conn(0x7f8e60074a50 msgr2=0x7f8e60074e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:23.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.202+0000 7f8e658b9700 1 -- 172.21.15.69:0/4182648360 shutdown_connections 2023-12-14T14:12:23.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.202+0000 7f8e658b9700 1 -- 172.21.15.69:0/4182648360 wait complete. 2023-12-14T14:12:23.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.202+0000 7f8e658b9700 1 Processor -- start 2023-12-14T14:12:23.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e658b9700 1 -- start start 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e658b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e600ff4c0 0x7f8e601006a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e658b9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e600ffdd0 0x7f8e60100be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e658b9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e6010ad80 0x7f8e601a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e658b9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e60101410 con 0x7f8e6010ad80 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e658b9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e601a4b90 con 0x7f8e600ff4c0 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e658b9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e601a4cd0 con 0x7f8e600ffdd0 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e6010ad80 0x7f8e601a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e6010ad80 0x7f8e601a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51760/0 (socket says 172.21.15.69:51760) 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5f7fe700 1 -- 172.21.15.69:0/3428762968 learned_addr learned my addr 172.21.15.69:0/3428762968 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e600ffdd0 0x7f8e60100be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5effd700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e600ff4c0 0x7f8e601006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5f7fe700 1 -- 172.21.15.69:0/3428762968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e600ffdd0 msgr2=0x7f8e60100be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e600ffdd0 0x7f8e60100be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5f7fe700 1 -- 172.21.15.69:0/3428762968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e600ff4c0 msgr2=0x7f8e601006a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e600ff4c0 0x7f8e601006a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5f7fe700 1 -- 172.21.15.69:0/3428762968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e50009d00 con 0x7f8e6010ad80 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.203+0000 7f8e5effd700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e600ff4c0 0x7f8e601006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.204+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e6010ad80 0x7f8e601a4650 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800d720 tx=0x7f8e5800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.204+0000 7f8e648b7700 1 -- 172.21.15.69:0/3428762968 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800f890 con 0x7f8e6010ad80 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.204+0000 7f8e648b7700 1 -- 172.21.15.69:0/3428762968 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e58010460 con 0x7f8e6010ad80 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.204+0000 7f8e658b9700 1 -- 172.21.15.69:0/3428762968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e60110390 con 0x7f8e6010ad80 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.204+0000 7f8e648b7700 1 -- 172.21.15.69:0/3428762968 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800e610 con 0x7f8e6010ad80 2023-12-14T14:12:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.204+0000 7f8e658b9700 1 -- 172.21.15.69:0/3428762968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e60110200 con 0x7f8e6010ad80 2023-12-14T14:12:23.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.206+0000 7f8e648b7700 1 -- 172.21.15.69:0/3428762968 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8e580108d0 con 0x7f8e6010ad80 2023-12-14T14:12:23.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.207+0000 7f8e648b7700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8e480a1340 0x7f8e480a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.207+0000 7f8e5effd700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8e480a1340 0x7f8e480a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.207+0000 7f8e648b7700 1 -- 172.21.15.69:0/3428762968 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f8e580cca50 con 0x7f8e6010ad80 2023-12-14T14:12:23.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.207+0000 7f8e5effd700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8e480a1340 0x7f8e480a37f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b830 tx=0x7f8e50006210 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:23.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.287+0000 7f8e71a47b80 1 Processor -- start 2023-12-14T14:12:23.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e71a47b80 1 -- start start 2023-12-14T14:12:23.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49380 0x55ecefe49750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe54610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe56f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefd335e0 con 0x55ecefe49c90 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefda2870 con 0x55ecefe49380 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefd9bd00 con 0x55ecefe54b50 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e5e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe54610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e5e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe54610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51774/0 (socket says 172.21.15.69:51774) 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/1754850104 learned_addr learned my addr 172.21.15.69:0/1754850104 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e5effd700 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49380 0x55ecefe49750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.288+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe56f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/1754850104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 msgr2=0x55ecefe56f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe56f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/1754850104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49380 msgr2=0x55ecefe49750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49380 0x55ecefe49750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/1754850104 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecefc1d3b0 con 0x55ecefe49c90 2023-12-14T14:12:23.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe56f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:23.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe54610 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400ad10 tx=0x7f8e5400f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56954973ebbef6f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:23.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e45ffb700 1 -- 172.21.15.69:0/1754850104 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5400ae60 con 0x55ecefe49c90 2023-12-14T14:12:23.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e45ffb700 1 -- 172.21.15.69:0/1754850104 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e540044f0 con 0x55ecefe49c90 2023-12-14T14:12:23.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.289+0000 7f8e45ffb700 1 -- 172.21.15.69:0/1754850104 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54018690 con 0x55ecefe49c90 2023-12-14T14:12:23.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1754850104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 msgr2=0x55ecefe54610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:23.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe54610 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400ad10 tx=0x7f8e5400f6a0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1754850104 shutdown_connections 2023-12-14T14:12:23.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe56f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49380 0x55ecefe49750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1754850104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe54610 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1754850104 >> 172.21.15.69:0/1754850104 conn(0x55ecefe3fca0 msgr2=0x55ecefe457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:23.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1754850104 shutdown_connections 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1754850104 wait complete. 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.290+0000 7f8e71a47b80 1 -- start start 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e71a47b80 1 Processor -- start 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49380 0x55ecefe544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49c90 0x55ecefe51750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe51cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefd37f90 con 0x55ecefe49380 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefd37c30 con 0x55ecefe49c90 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefc1f6a0 con 0x55ecefe54b50 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e71a47b80 10 client.0 _ll_register_callbacks cb 0x55ecefd5b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e5effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49380 0x55ecefe544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e5f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe51cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e5effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49380 0x55ecefe544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51780/0 (socket says 172.21.15.69:51780) 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.291+0000 7f8e5effd700 1 -- 172.21.15.69:0/4182590160 learned_addr learned my addr 172.21.15.69:0/4182590160 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:23.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.292+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49c90 0x55ecefe51750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.292+0000 7f8e5f7fe700 1 -- 172.21.15.69:0/4182590160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49c90 msgr2=0x55ecefe51750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:23.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.292+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49c90 0x55ecefe51750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.292+0000 7f8e5f7fe700 1 -- 172.21.15.69:0/4182590160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49380 msgr2=0x55ecefe544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:23.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.292+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49380 0x55ecefe544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.292+0000 7f8e5f7fe700 1 -- 172.21.15.69:0/4182590160 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5400a970 con 0x55ecefe54b50 2023-12-14T14:12:23.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.292+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49c90 0x55ecefe51750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:23.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.292+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe51cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e580ca180 tx=0x7f8e58099bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32cf1fb9ad1bcf89 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:23.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.292+0000 7f8e3effd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.295+0000 7f8e3effd700 1 -- 172.21.15.69:0/4182590160 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e580b9040 con 0x55ecefe54b50 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.295+0000 7f8e3effd700 1 -- 172.21.15.69:0/4182590160 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f8e58099f60 con 0x55ecefe54b50 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.295+0000 7f8e71a47b80 1 -- 172.21.15.69:0/4182590160 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecefe3d2b0 con 0x55ecefe54b50 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.295+0000 7f8e3effd700 1 -- 172.21.15.69:0/4182590160 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e580b2220 con 0x55ecefe54b50 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.295+0000 7f8e71a47b80 10 client.25267 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.295+0000 7f8e71a47b80 1 -- 172.21.15.69:0/4182590160 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ecefd62170 con 0x55ecefe54b50 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.295+0000 7f8e3effd700 1 -- 172.21.15.69:0/4182590160 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e580b6080 con 0x55ecefe54b50 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.295+0000 7f8e3effd700 1 -- 172.21.15.69:0/4182590160 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8e580a1bc0 con 0x55ecefe54b50 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.296+0000 7f8e71a47b80 10 client.25267 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.296+0000 7f8e71a47b80 10 client.25267 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.296+0000 7f8e71a47b80 20 client.25267 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:23.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.296+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ecefe644b0 0x55ecefe66890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.296+0000 7f8e71a47b80 4 client.25267 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:23.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.296+0000 7f8e71a47b80 1 -- 172.21.15.69:0/4182590160 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ecefd94ce0 con 0x55ecefe644b0 2023-12-14T14:12:23.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.296+0000 7f8e5effd700 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ecefe644b0 0x55ecefe66890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.296+0000 7f8e5effd700 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ecefe644b0 0x55ecefe66890 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a702ca7db46f7947 server_cookie=a859a88e8b3130c in_seq=0 out_seq=0 2023-12-14T14:12:23.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.296+0000 7f8e3effd700 10 client.25267 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.297+0000 7f8e3effd700 1 -- 172.21.15.69:0/4182590160 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ecefd94ce0 con 0x55ecefe644b0 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.297+0000 7f8e3effd700 10 client.25267 handle_command_reply: tid=0 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.297+0000 7f8e71a47b80 1 client.25267 shutdown 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.297+0000 7f8e71a47b80 1 -- 172.21.15.69:0/4182590160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 msgr2=0x55ecefe51cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.297+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe51cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e580ca180 tx=0x7f8e58099bf0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e71a47b80 1 -- 172.21.15.69:0/4182590160 shutdown_connections 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe54b50 0x55ecefe51cd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ecefe644b0 0x55ecefe66890 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49380 0x55ecefe544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/4182590160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe49c90 0x55ecefe51750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e3effd700 0 client.25267 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:12:23.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e71a47b80 1 -- 172.21.15.69:0/4182590160 >> 172.21.15.69:0/4182590160 conn(0x55ecefe3fca0 msgr2=0x55ecefe45370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:23.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e71a47b80 1 -- 172.21.15.69:0/4182590160 shutdown_connections 2023-12-14T14:12:23.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e71a47b80 1 -- 172.21.15.69:0/4182590160 wait complete. 2023-12-14T14:12:23.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.298+0000 7f8e71a47b80 20 client.25267 trim_cache size 0 max 16384 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.311+0000 7f8e71a47b80 1 Processor -- start 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.311+0000 7f8e71a47b80 1 -- start start 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 0x55ecefe53f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 0x55ecefe51710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefe4a080 con 0x55ecefe49c90 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefe4c540 con 0x55ecefe54b50 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefe46340 con 0x55ecefe49380 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51792/0 (socket says 172.21.15.69:51792) 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/2935374843 learned_addr learned my addr 172.21.15.69:0/2935374843 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 0x55ecefe51710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5effd700 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 0x55ecefe53f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/2935374843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 msgr2=0x55ecefe53f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 0x55ecefe53f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/2935374843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 msgr2=0x55ecefe51710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 0x55ecefe51710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/2935374843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecefe512c0 con 0x55ecefe49c90 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 0x55ecefe51710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.312+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe544a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400ad10 tx=0x7f8e5400ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e92b3d4487b5f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e467fc700 1 -- 172.21.15.69:0/2935374843 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54005e70 con 0x55ecefe49c90 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e467fc700 1 -- 172.21.15.69:0/2935374843 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e54005500 con 0x55ecefe49c90 2023-12-14T14:12:23.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e467fc700 1 -- 172.21.15.69:0/2935374843 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54004d70 con 0x55ecefe49c90 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e71a47b80 1 -- 172.21.15.69:0/2935374843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 msgr2=0x55ecefe544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe544a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400ad10 tx=0x7f8e5400ae80 comp rx=0 tx=0).stop 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e71a47b80 1 -- 172.21.15.69:0/2935374843 shutdown_connections 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 0x55ecefe51710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 0x55ecefe53f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/2935374843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe544a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e71a47b80 1 -- 172.21.15.69:0/2935374843 >> 172.21.15.69:0/2935374843 conn(0x55ecefe3fca0 msgr2=0x55ecefe5fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.313+0000 7f8e71a47b80 1 -- 172.21.15.69:0/2935374843 shutdown_connections 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.314+0000 7f8e71a47b80 1 -- 172.21.15.69:0/2935374843 wait complete. 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.314+0000 7f8e71a47b80 1 -- start start 2023-12-14T14:12:23.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.314+0000 7f8e71a47b80 1 Processor -- start 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 0x55ecefe5b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe5b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e71a47b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 0x55ecefe59450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefe59b60 con 0x55ecefe49c90 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefe59cd0 con 0x55ecefe54b50 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e71a47b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecefe59e90 con 0x55ecefe49380 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e71a47b80 10 client.0 _ll_register_callbacks cb 0x7f8e58099730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe5b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe5b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51802/0 (socket says 172.21.15.69:51802) 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/1447683672 learned_addr learned my addr 172.21.15.69:0/1447683672 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5effd700 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 0x55ecefe5b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5f7fe700 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 0x55ecefe59450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/1447683672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 msgr2=0x55ecefe5b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:23.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 0x55ecefe5b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/1447683672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 msgr2=0x55ecefe59450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 0x55ecefe59450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5e7fc700 1 -- 172.21.15.69:0/1447683672 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ecefd62170 con 0x55ecefe49c90 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e5e7fc700 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe5b640 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8e5401a040 tx=0x7f8e5402db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6919225241c292 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.315+0000 7f8e3effd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e3effd700 1 -- 172.21.15.69:0/1447683672 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54005e70 con 0x55ecefe49c90 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e3effd700 1 -- 172.21.15.69:0/1447683672 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f8e54005670 con 0x55ecefe49c90 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1447683672 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e540044f0 con 0x55ecefe49c90 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e3effd700 1 -- 172.21.15.69:0/1447683672 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e5402dd00 con 0x55ecefe49c90 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e71a47b80 10 client.15771 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1447683672 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ecefc1d3b0 con 0x55ecefe49c90 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e3effd700 1 -- 172.21.15.69:0/1447683672 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e540044f0 con 0x55ecefe49c90 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e3effd700 1 -- 172.21.15.69:0/1447683672 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8e54020050 con 0x55ecefe49c90 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e71a47b80 10 client.15771 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:23.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e71a47b80 10 client.15771 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e71a47b80 20 client.15771 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ecefeb8fa0 0x55ecefebb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e71a47b80 4 client.15771 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.316+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1447683672 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ecefd94a00 con 0x55ecefeb8fa0 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e5effd700 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ecefeb8fa0 0x55ecefebb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e3effd700 10 client.15771 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e5effd700 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ecefeb8fa0 0x55ecefebb380 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a448736610014330 server_cookie=f93d549f6e0be666 in_seq=0 out_seq=0 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e3effd700 1 -- 172.21.15.69:0/1447683672 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ecefd94a00 con 0x55ecefeb8fa0 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e3effd700 10 client.15771 handle_command_reply: tid=0 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 client.15771 shutdown 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1447683672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 msgr2=0x55ecefe5b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe5b640 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8e5401a040 tx=0x7f8e5402db10 comp rx=0 tx=0).stop 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1447683672 shutdown_connections 2023-12-14T14:12:23.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ecefe54b50 0x55ecefe59450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ecefe49380 0x55ecefe5b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ecefeb8fa0 0x55ecefebb380 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 --2- 172.21.15.69:0/1447683672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ecefe49c90 0x55ecefe5b640 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e3effd700 0 client.15771 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:12:23.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1447683672 >> 172.21.15.69:0/1447683672 conn(0x55ecefe3fca0 msgr2=0x55ecefe4ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:23.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.317+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1447683672 shutdown_connections 2023-12-14T14:12:23.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e71a47b80 1 -- 172.21.15.69:0/1447683672 wait complete. 2023-12-14T14:12:23.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e71a47b80 20 client.15771 trim_cache size 0 max 16384 2023-12-14T14:12:23.323 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:12:23.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 -- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8e480a1340 msgr2=0x7f8e480a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:23.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8e480a1340 0x7f8e480a37f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b830 tx=0x7f8e50006210 comp rx=0 tx=0).stop 2023-12-14T14:12:23.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 -- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e6010ad80 msgr2=0x7f8e601a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:23.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e6010ad80 0x7f8e601a4650 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800d720 tx=0x7f8e5800da30 comp rx=0 tx=0).stop 2023-12-14T14:12:23.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 -- 172.21.15.69:0/3428762968 shutdown_connections 2023-12-14T14:12:23.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8e480a1340 0x7f8e480a37f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e6010ad80 0x7f8e601a4650 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e600ff4c0 0x7f8e601006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 --2- 172.21.15.69:0/3428762968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e600ffdd0 0x7f8e60100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:23.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 -- 172.21.15.69:0/3428762968 >> 172.21.15.69:0/3428762968 conn(0x7f8e60074a50 msgr2=0x7f8e600fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:23.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 -- 172.21.15.69:0/3428762968 shutdown_connections 2023-12-14T14:12:23.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:23.318+0000 7f8e658b9700 1 -- 172.21.15.69:0/3428762968 wait complete. 2023-12-14T14:12:23.380 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:12:23.564 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:23.564 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:23.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:23.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:23.662 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:23.662 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:23.662 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 52 -lt 100 ']' 2023-12-14T14:12:23.662 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 52 + 1 2023-12-14T14:12:23.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=53 2023-12-14T14:12:23.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:23.723 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:23.723 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:23.724 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:23.724 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:23.724 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:24.205 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:24.205 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:24.305 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:24.305 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:24.314 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:24.314 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:24.314 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 53 -lt 100 ']' 2023-12-14T14:12:24.314 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 53 + 1 2023-12-14T14:12:24.353 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=54 2023-12-14T14:12:24.353 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:24.420 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:24.420 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:24.422 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:24.422 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:24.422 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:24.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:24 smithi069 ceph-mon[42034]: pgmap v55: 97 pgs: 97 active+clean; 1.9 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-12-14T14:12:24.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:24 smithi081 ceph-mon[43371]: pgmap v55: 97 pgs: 97 active+clean; 1.9 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-12-14T14:12:24.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:24 smithi119 ceph-mon[43834]: pgmap v55: 97 pgs: 97 active+clean; 1.9 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-12-14T14:12:25.005 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:25.005 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:25.447 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:25.447 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:25.496 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:25.496 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:25.496 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 54 -lt 100 ']' 2023-12-14T14:12:25.496 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 54 + 1 2023-12-14T14:12:25.569 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=55 2023-12-14T14:12:25.569 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:25.647 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:25.647 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:25.649 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:25.649 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:25.649 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:26.430 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:26.430 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:26.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:26 smithi069 ceph-mon[42034]: pgmap v56: 97 pgs: 97 active+clean; 2.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 10 op/s 2023-12-14T14:12:26.614 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:26.614 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:26.622 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:26.622 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:26.622 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 55 -lt 100 ']' 2023-12-14T14:12:26.622 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 55 + 1 2023-12-14T14:12:26.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:26 smithi081 ceph-mon[43371]: pgmap v56: 97 pgs: 97 active+clean; 2.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 10 op/s 2023-12-14T14:12:26.678 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=56 2023-12-14T14:12:26.678 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:26.722 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:26.722 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:26.723 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:26.723 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:26.723 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:26.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:26 smithi119 ceph-mon[43834]: pgmap v56: 97 pgs: 97 active+clean; 2.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 10 op/s 2023-12-14T14:12:26.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/4015829668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b240ff400 msgr2=0x7f4b240ff7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:26.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/4015829668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b240ff400 0x7f4b240ff7d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009990 tx=0x7f4b14009ca0 comp rx=0 tx=0).stop 2023-12-14T14:12:26.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/4015829668 shutdown_connections 2023-12-14T14:12:26.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/4015829668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b2410acc0 0x7f4b2410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:26.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/4015829668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b240ff400 0x7f4b240ff7d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:26.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/4015829668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b240ffd10 0x7f4b2410a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:26.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/4015829668 >> 172.21.15.69:0/4015829668 conn(0x7f4b240749f0 msgr2=0x7f4b24074df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:26.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/4015829668 shutdown_connections 2023-12-14T14:12:26.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/4015829668 wait complete. 2023-12-14T14:12:26.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.986+0000 7f4b2a2fa700 1 Processor -- start 2023-12-14T14:12:26.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b2a2fa700 1 -- start start 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b2a2fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b240ff400 0x7f4b241005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b2a2fa700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b240ffd10 0x7f4b24100b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b2a2fa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b2410acc0 0x7f4b241a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b2a2fa700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24101350 con 0x7f4b2410acc0 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b2a2fa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b241a4be0 con 0x7f4b240ff400 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b2a2fa700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b241a4d20 con 0x7f4b240ffd10 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b28897700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b2410acc0 0x7f4b241a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b28897700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b2410acc0 0x7f4b241a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54060/0 (socket says 172.21.15.69:54060) 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b28897700 1 -- 172.21.15.69:0/2415212029 learned_addr learned my addr 172.21.15.69:0/2415212029 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b240ff400 0x7f4b241005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:26.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b240ffd10 0x7f4b24100b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b28897700 1 -- 172.21.15.69:0/2415212029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b240ffd10 msgr2=0x7f4b24100b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b28897700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b240ffd10 0x7f4b24100b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b28897700 1 -- 172.21.15.69:0/2415212029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b240ff400 msgr2=0x7f4b241005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b28897700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b240ff400 0x7f4b241005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.987+0000 7f4b28897700 1 -- 172.21.15.69:0/2415212029 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b140095f0 con 0x7f4b2410acc0 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.988+0000 7f4b28897700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b2410acc0 0x7f4b241a46a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009fd0 tx=0x7f4b1c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.988+0000 7f4b21ffb700 1 -- 172.21.15.69:0/2415212029 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c018070 con 0x7f4b2410acc0 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.988+0000 7f4b21ffb700 1 -- 172.21.15.69:0/2415212029 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b1c00f040 con 0x7f4b2410acc0 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.988+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/2415212029 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b241103a0 con 0x7f4b2410acc0 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.988+0000 7f4b21ffb700 1 -- 172.21.15.69:0/2415212029 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00cdb0 con 0x7f4b2410acc0 2023-12-14T14:12:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.988+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/2415212029 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b24110210 con 0x7f4b2410acc0 2023-12-14T14:12:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.990+0000 7f4b21ffb700 1 -- 172.21.15.69:0/2415212029 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4b1c004ad0 con 0x7f4b2410acc0 2023-12-14T14:12:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.991+0000 7f4b21ffb700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4b100a1340 0x7f4b100a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.991+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4b100a1340 0x7f4b100a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.991+0000 7f4b21ffb700 1 -- 172.21.15.69:0/2415212029 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4b1c0cc6c0 con 0x7f4b2410acc0 2023-12-14T14:12:26.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:26.992+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4b100a1340 0x7f4b100a37f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400b2e0 tx=0x7f4b14005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:27.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.036+0000 7f4b36488b80 1 Processor -- start 2023-12-14T14:12:27.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.036+0000 7f4b36488b80 1 -- start start 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2d5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2e0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 0x5566dd2e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b36488b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd1bf5e0 con 0x5566dd2d5c90 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b36488b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd22e870 con 0x5566dd2e0b50 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b36488b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd227d00 con 0x5566dd2d5380 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2e0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54076/0 (socket says 172.21.15.69:54076) 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b1bfff700 1 -- 172.21.15.69:0/1914372912 learned_addr learned my addr 172.21.15.69:0/1914372912 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:27.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b23fff700 1 --2- 172.21.15.69:0/1914372912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2d5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b28897700 1 --2- 172.21.15.69:0/1914372912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 0x5566dd2e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b1bfff700 1 -- 172.21.15.69:0/1914372912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 msgr2=0x5566dd2d5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:27.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/1914372912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2d5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b1bfff700 1 -- 172.21.15.69:0/1914372912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 msgr2=0x5566dd2e2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:27.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/1914372912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 0x5566dd2e2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b1bfff700 1 -- 172.21.15.69:0/1914372912 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566dd0a93b0 con 0x5566dd2d5c90 2023-12-14T14:12:27.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.037+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/1914372912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2e0610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009cb0 tx=0x7f4b0c0113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45203fb97c19f5a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:27.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b1a7fc700 1 -- 172.21.15.69:0/1914372912 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0097b0 con 0x5566dd2d5c90 2023-12-14T14:12:27.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b1a7fc700 1 -- 172.21.15.69:0/1914372912 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b0c011c60 con 0x5566dd2d5c90 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b1a7fc700 1 -- 172.21.15.69:0/1914372912 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00f730 con 0x5566dd2d5c90 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b36488b80 1 -- 172.21.15.69:0/1914372912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 msgr2=0x5566dd2e0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b36488b80 1 --2- 172.21.15.69:0/1914372912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2e0610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009cb0 tx=0x7f4b0c0113e0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b36488b80 1 -- 172.21.15.69:0/1914372912 shutdown_connections 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b36488b80 1 --2- 172.21.15.69:0/1914372912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 0x5566dd2e2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b36488b80 1 --2- 172.21.15.69:0/1914372912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2d5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b36488b80 1 --2- 172.21.15.69:0/1914372912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2e0610 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b36488b80 1 -- 172.21.15.69:0/1914372912 >> 172.21.15.69:0/1914372912 conn(0x5566dd2cbca0 msgr2=0x5566dd2d17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.038+0000 7f4b36488b80 1 -- 172.21.15.69:0/1914372912 shutdown_connections 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.039+0000 7f4b36488b80 1 -- 172.21.15.69:0/1914372912 wait complete. 2023-12-14T14:12:27.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.039+0000 7f4b36488b80 1 -- start start 2023-12-14T14:12:27.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.039+0000 7f4b36488b80 1 Processor -- start 2023-12-14T14:12:27.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2e0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 0x5566dd2ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b36488b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd1c3f90 con 0x5566dd2d5c90 2023-12-14T14:12:27.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b36488b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd1c3c30 con 0x5566dd2e0b50 2023-12-14T14:12:27.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b36488b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd0ab6a0 con 0x5566dd2d5380 2023-12-14T14:12:27.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b36488b80 10 client.0 _ll_register_callbacks cb 0x5566dd1e7910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:27.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2dd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54078/0 (socket says 172.21.15.69:54078) 2023-12-14T14:12:27.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2e0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b1bfff700 1 -- 172.21.15.69:0/2995158765 learned_addr learned my addr 172.21.15.69:0/2995158765 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b28897700 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 0x5566dd2ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b23fff700 1 -- 172.21.15.69:0/2995158765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 msgr2=0x5566dd2ddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 0x5566dd2ddd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b23fff700 1 -- 172.21.15.69:0/2995158765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 msgr2=0x5566dd2dd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2dd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b23fff700 1 -- 172.21.15.69:0/2995158765 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c009910 con 0x5566dd2d5380 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2e0500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400b6f0 tx=0x7f4b14020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37607eed62d8f541 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.040+0000 7f4b037fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:12:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b037fe700 1 -- 172.21.15.69:0/2995158765 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1402d040 con 0x5566dd2d5380 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b36488b80 1 -- 172.21.15.69:0/2995158765 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566dd2c92b0 con 0x5566dd2d5380 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b037fe700 1 -- 172.21.15.69:0/2995158765 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4b1400f460 con 0x5566dd2d5380 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b037fe700 1 -- 172.21.15.69:0/2995158765 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b1400f620 con 0x5566dd2d5380 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b36488b80 10 client.25285 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b36488b80 1 -- 172.21.15.69:0/2995158765 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5566dd1ee170 con 0x5566dd2d5380 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b037fe700 1 -- 172.21.15.69:0/2995158765 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5566dd2c92b0 con 0x5566dd2d5380 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b037fe700 1 -- 172.21.15.69:0/2995158765 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4b140326a0 con 0x5566dd2d5380 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b36488b80 10 client.25285 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b36488b80 10 client.25285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b36488b80 20 client.25285 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:27.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5566dd2f0420 0x5566dd2f2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b36488b80 4 client.25285 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b36488b80 1 -- 172.21.15.69:0/2995158765 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566dd220ce0 con 0x5566dd2f0420 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.041+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5566dd2f0420 0x5566dd2f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.042+0000 7f4b037fe700 10 client.25285 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.042+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5566dd2f0420 0x5566dd2f2830 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=817480b2098a99c9 server_cookie=ed0f53f8de6a7647 in_seq=0 out_seq=0 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.042+0000 7f4b037fe700 1 -- 172.21.15.69:0/2995158765 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5566dd220ce0 con 0x5566dd2f0420 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b037fe700 10 client.25285 handle_command_reply: tid=0 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 client.25285 shutdown 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 -- 172.21.15.69:0/2995158765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 msgr2=0x5566dd2e0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2e0500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400b6f0 tx=0x7f4b14020000 comp rx=0 tx=0).stop 2023-12-14T14:12:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 -- 172.21.15.69:0/2995158765 shutdown_connections 2023-12-14T14:12:27.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5566dd2f0420 0x5566dd2f2830 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2e0b50 0x5566dd2ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2e0500 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b037fe700 0 client.25285 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:27.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2995158765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5c90 0x5566dd2dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 -- 172.21.15.69:0/2995158765 >> 172.21.15.69:0/2995158765 conn(0x5566dd2cbca0 msgr2=0x5566dd2d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:27.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 -- 172.21.15.69:0/2995158765 shutdown_connections 2023-12-14T14:12:27.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 1 -- 172.21.15.69:0/2995158765 wait complete. 2023-12-14T14:12:27.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.043+0000 7f4b36488b80 20 client.25285 trim_cache size 0 max 16384 2023-12-14T14:12:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.056+0000 7f4b36488b80 1 Processor -- start 2023-12-14T14:12:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.056+0000 7f4b36488b80 1 -- start start 2023-12-14T14:12:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2ec860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 0x5566dd2cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2e0b50 0x5566dd2dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b36488b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd2d9690 con 0x5566dd2e0b50 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b36488b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd2ded20 con 0x5566dd2d5c90 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b36488b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd2d9340 con 0x5566dd2d5380 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b28897700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2e0b50 0x5566dd2dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b28897700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2e0b50 0x5566dd2dffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54086/0 (socket says 172.21.15.69:54086) 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b28897700 1 -- 172.21.15.69:0/160263054 learned_addr learned my addr 172.21.15.69:0/160263054 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b23fff700 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 0x5566dd2cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b28897700 1 -- 172.21.15.69:0/160263054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 msgr2=0x5566dd2ec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b28897700 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2ec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b28897700 1 -- 172.21.15.69:0/160263054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 msgr2=0x5566dd2cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b28897700 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 0x5566dd2cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b28897700 1 -- 172.21.15.69:0/160263054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566dd1edec0 con 0x5566dd2e0b50 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b23fff700 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.057+0000 7f4b28897700 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2e0b50 0x5566dd2dffc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0c9f00 tx=0x7f4b1c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71df624839df3f82 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b1affd700 1 -- 172.21.15.69:0/160263054 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0991c0 con 0x5566dd2e0b50 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b1affd700 1 -- 172.21.15.69:0/160263054 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b1c099860 con 0x5566dd2e0b50 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b1affd700 1 -- 172.21.15.69:0/160263054 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c099ac0 con 0x5566dd2e0b50 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b36488b80 1 -- 172.21.15.69:0/160263054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2e0b50 msgr2=0x5566dd2dffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b36488b80 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2e0b50 0x5566dd2dffc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0c9f00 tx=0x7f4b1c00cf90 comp rx=0 tx=0).stop 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b36488b80 1 -- 172.21.15.69:0/160263054 shutdown_connections 2023-12-14T14:12:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b36488b80 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2e0b50 0x5566dd2dffc0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b36488b80 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2d5380 0x5566dd2ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b36488b80 1 --2- 172.21.15.69:0/160263054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 0x5566dd2cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b36488b80 1 -- 172.21.15.69:0/160263054 >> 172.21.15.69:0/160263054 conn(0x5566dd2cbca0 msgr2=0x5566dd2f7190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b36488b80 1 -- 172.21.15.69:0/160263054 shutdown_connections 2023-12-14T14:12:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.058+0000 7f4b36488b80 1 -- 172.21.15.69:0/160263054 wait complete. 2023-12-14T14:12:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.059+0000 7f4b36488b80 1 -- start start 2023-12-14T14:12:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.059+0000 7f4b36488b80 1 Processor -- start 2023-12-14T14:12:27.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.059+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5380 0x5566dd2e5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.059+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 0x5566dd2e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.059+0000 7f4b36488b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2e0b50 0x5566dd3432e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.059+0000 7f4b36488b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd343820 con 0x5566dd2d5380 2023-12-14T14:12:27.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.059+0000 7f4b36488b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd343960 con 0x5566dd2d5c90 2023-12-14T14:12:27.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.059+0000 7f4b36488b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd343aa0 con 0x5566dd2e0b50 2023-12-14T14:12:27.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.059+0000 7f4b36488b80 10 client.0 _ll_register_callbacks cb 0x7f4b14005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b23fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5380 0x5566dd2e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b23fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5380 0x5566dd2e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54100/0 (socket says 172.21.15.69:54100) 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b23fff700 1 -- 172.21.15.69:0/2238578548 learned_addr learned my addr 172.21.15.69:0/2238578548 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 0x5566dd2e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b28897700 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2e0b50 0x5566dd3432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b23fff700 1 -- 172.21.15.69:0/2238578548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2e0b50 msgr2=0x5566dd3432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2e0b50 0x5566dd3432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b23fff700 1 -- 172.21.15.69:0/2238578548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 msgr2=0x5566dd2e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 0x5566dd2e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b23fff700 1 -- 172.21.15.69:0/2238578548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b24110210 con 0x5566dd2d5380 2023-12-14T14:12:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b28897700 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2e0b50 0x5566dd3432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b23fff700 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5380 0x5566dd2e5860 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009ce0 tx=0x7f4b1400b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3156407b684a77 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b037fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b037fe700 1 -- 172.21.15.69:0/2238578548 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1402d070 con 0x5566dd2d5380 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b037fe700 1 -- 172.21.15.69:0/2238578548 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4b14032430 con 0x5566dd2d5380 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b36488b80 1 -- 172.21.15.69:0/2238578548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b0c011c60 con 0x5566dd2d5380 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b037fe700 1 -- 172.21.15.69:0/2238578548 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b140325f0 con 0x5566dd2d5380 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.060+0000 7f4b36488b80 10 client.15789 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b36488b80 1 -- 172.21.15.69:0/2238578548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5566dd1d49a0 con 0x5566dd2d5380 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b037fe700 1 -- 172.21.15.69:0/2238578548 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b0c011c60 con 0x5566dd2d5380 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b037fe700 1 -- 172.21.15.69:0/2238578548 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4b14024410 con 0x5566dd2d5380 2023-12-14T14:12:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b36488b80 10 client.15789 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b36488b80 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b36488b80 20 client.15789 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5566dd344cb0 0x5566dd347090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b36488b80 4 client.15789 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b36488b80 1 -- 172.21.15.69:0/2238578548 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5566dd220a00 con 0x5566dd344cb0 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5566dd344cb0 0x5566dd347090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b037fe700 10 client.15789 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.061+0000 7f4b1bfff700 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5566dd344cb0 0x5566dd347090 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4856a361bea76f7b server_cookie=ac7a5bbdf8537d08 in_seq=0 out_seq=0 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b037fe700 1 -- 172.21.15.69:0/2238578548 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5566dd220a00 con 0x5566dd344cb0 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b037fe700 10 client.15789 handle_command_reply: tid=0 2023-12-14T14:12:27.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 client.15789 shutdown 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 -- 172.21.15.69:0/2238578548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5380 msgr2=0x5566dd2e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5380 0x5566dd2e5860 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009ce0 tx=0x7f4b1400b310 comp rx=0 tx=0).stop 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 -- 172.21.15.69:0/2238578548 shutdown_connections 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5566dd344cb0 0x5566dd347090 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5566dd2e0b50 0x5566dd3432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b037fe700 0 client.15789 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5566dd2d5380 0x5566dd2e5860 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 --2- 172.21.15.69:0/2238578548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5566dd2d5c90 0x5566dd2e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 -- 172.21.15.69:0/2238578548 >> 172.21.15.69:0/2238578548 conn(0x5566dd2cbca0 msgr2=0x5566dd2d8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 -- 172.21.15.69:0/2238578548 shutdown_connections 2023-12-14T14:12:27.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 1 -- 172.21.15.69:0/2238578548 wait complete. 2023-12-14T14:12:27.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.062+0000 7f4b36488b80 20 client.15789 trim_cache size 0 max 16384 2023-12-14T14:12:27.072 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:12:27.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4b100a1340 msgr2=0x7f4b100a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:27.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4b100a1340 0x7f4b100a37f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400b2e0 tx=0x7f4b14005fb0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b2410acc0 msgr2=0x7f4b241a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:27.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b2410acc0 0x7f4b241a46a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009fd0 tx=0x7f4b1c00ef90 comp rx=0 tx=0).stop 2023-12-14T14:12:27.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/2415212029 shutdown_connections 2023-12-14T14:12:27.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4b100a1340 0x7f4b100a37f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b2410acc0 0x7f4b241a46a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b240ff400 0x7f4b241005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 --2- 172.21.15.69:0/2415212029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b240ffd10 0x7f4b24100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:27.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/2415212029 >> 172.21.15.69:0/2415212029 conn(0x7f4b240749f0 msgr2=0x7f4b240fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:27.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/2415212029 shutdown_connections 2023-12-14T14:12:27.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:27.063+0000 7f4b2a2fa700 1 -- 172.21.15.69:0/2415212029 wait complete. 2023-12-14T14:12:27.288 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:27.288 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:27.463 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:27.464 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:27.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:27.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:27.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 56 -lt 100 ']' 2023-12-14T14:12:27.471 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 56 + 1 2023-12-14T14:12:27.494 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=57 2023-12-14T14:12:27.494 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:27.530 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:27.530 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:27.531 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:27.531 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:27.531 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:27.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:27 smithi069 ceph-mon[42034]: pgmap v57: 97 pgs: 97 active+clean; 2.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-12-14T14:12:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:27 smithi081 ceph-mon[43371]: pgmap v57: 97 pgs: 97 active+clean; 2.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-12-14T14:12:27.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:27 smithi119 ceph-mon[43834]: pgmap v57: 97 pgs: 97 active+clean; 2.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-12-14T14:12:27.880 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:27.880 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:28.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:28.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:28.038 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:28.038 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:28.038 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 57 -lt 100 ']' 2023-12-14T14:12:28.039 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 57 + 1 2023-12-14T14:12:28.069 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=58 2023-12-14T14:12:28.069 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:28.121 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:28.121 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:28.122 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:12:28.122 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:12:28.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:28.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:28.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:28.638 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:28.638 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:28.693 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:28.693 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:28.697 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:28.697 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:28.697 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 58 -lt 100 ']' 2023-12-14T14:12:28.697 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 58 + 1 2023-12-14T14:12:28.736 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=59 2023-12-14T14:12:28.736 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:28.796 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:28.796 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:28.797 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:28.798 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:28.798 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:29.313 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:29.313 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:29.513 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:29.513 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:29.521 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:29.521 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:29.521 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 59 -lt 100 ']' 2023-12-14T14:12:29.521 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 59 + 1 2023-12-14T14:12:29.561 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=60 2023-12-14T14:12:29.562 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:29.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:29 smithi069 ceph-mon[42034]: pgmap v58: 97 pgs: 97 active+clean; 2.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-12-14T14:12:29.595 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:29.596 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:29.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:29.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:29.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:29 smithi119 ceph-mon[43834]: pgmap v58: 97 pgs: 97 active+clean; 2.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-12-14T14:12:29.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:29 smithi081 ceph-mon[43371]: pgmap v58: 97 pgs: 97 active+clean; 2.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-12-14T14:12:30.288 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:30.288 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:30.613 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:30.613 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:30.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:30.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:30.704 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 60 -lt 100 ']' 2023-12-14T14:12:30.704 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 60 + 1 2023-12-14T14:12:30.743 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=61 2023-12-14T14:12:30.744 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:30.771 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:30.771 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:30.772 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:30.772 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:30.772 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:31.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.043+0000 7fb2bbbda700 1 -- 172.21.15.69:0/3648369841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b41043d0 msgr2=0x7fb2b410bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:31.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.043+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/3648369841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b41043d0 0x7fb2b410bfa0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00b0d0 tx=0x7fb2ac00b3e0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.043+0000 7fb2bbbda700 1 -- 172.21.15.69:0/3648369841 shutdown_connections 2023-12-14T14:12:31.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.043+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/3648369841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b41043d0 0x7fb2b410bfa0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.043+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/3648369841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b40ff390 0x7fb2b40ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.043+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/3648369841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40ffd30 0x7fb2b4103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.043+0000 7fb2bbbda700 1 -- 172.21.15.69:0/3648369841 >> 172.21.15.69:0/3648369841 conn(0x7fb2b4075fd0 msgr2=0x7fb2b40763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:31.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.043+0000 7fb2bbbda700 1 -- 172.21.15.69:0/3648369841 shutdown_connections 2023-12-14T14:12:31.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.043+0000 7fb2bbbda700 1 -- 172.21.15.69:0/3648369841 wait complete. 2023-12-14T14:12:31.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2bbbda700 1 Processor -- start 2023-12-14T14:12:31.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2bbbda700 1 -- start start 2023-12-14T14:12:31.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2bbbda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40ff390 0x7fb2b4195410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2bbbda700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b40ffd30 0x7fb2b4195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2bbbda700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b41043d0 0x7fb2b4199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2bbbda700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b419a3f0 con 0x7fb2b40ffd30 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2bbbda700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b419a560 con 0x7fb2b40ff390 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2bbbda700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b419a720 con 0x7fb2b41043d0 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2b9175700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b40ffd30 0x7fb2b4195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2b9175700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b40ffd30 0x7fb2b4195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54120/0 (socket says 172.21.15.69:54120) 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2b9175700 1 -- 172.21.15.69:0/1946070936 learned_addr learned my addr 172.21.15.69:0/1946070936 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2b9976700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40ff390 0x7fb2b4195410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.044+0000 7fb2ba177700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b41043d0 0x7fb2b4199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2b9175700 1 -- 172.21.15.69:0/1946070936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b41043d0 msgr2=0x7fb2b4199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2b9175700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b41043d0 0x7fb2b4199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2b9175700 1 -- 172.21.15.69:0/1946070936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40ff390 msgr2=0x7fb2b4195410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2b9175700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40ff390 0x7fb2b4195410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2b9175700 1 -- 172.21.15.69:0/1946070936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac009d00 con 0x7fb2b40ffd30 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2b9976700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40ff390 0x7fb2b4195410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2b9175700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b40ffd30 0x7fb2b4195950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c8c0 tx=0x7fb2a400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2aaffd700 1 -- 172.21.15.69:0/1946070936 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4004220 con 0x7fb2b40ffd30 2023-12-14T14:12:31.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2aaffd700 1 -- 172.21.15.69:0/1946070936 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2a4004cf0 con 0x7fb2b40ffd30 2023-12-14T14:12:31.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2bbbda700 1 -- 172.21.15.69:0/1946070936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b410f1f0 con 0x7fb2b40ffd30 2023-12-14T14:12:31.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2aaffd700 1 -- 172.21.15.69:0/1946070936 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4003680 con 0x7fb2b40ffd30 2023-12-14T14:12:31.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.045+0000 7fb2bbbda700 1 -- 172.21.15.69:0/1946070936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b410f060 con 0x7fb2b40ffd30 2023-12-14T14:12:31.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.048+0000 7fb2aaffd700 1 -- 172.21.15.69:0/1946070936 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb2a4004750 con 0x7fb2b40ffd30 2023-12-14T14:12:31.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.048+0000 7fb2aaffd700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb2a00a12c0 0x7fb2a00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.048+0000 7fb2b9976700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb2a00a12c0 0x7fb2a00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.048+0000 7fb2aaffd700 1 -- 172.21.15.69:0/1946070936 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fb2a40cca30 con 0x7fb2b40ffd30 2023-12-14T14:12:31.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.049+0000 7fb2b9976700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb2a00a12c0 0x7fb2a00a3770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0011490 tx=0x7fb2b0009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.106+0000 7fb2c7d68b80 1 Processor -- start 2023-12-14T14:12:31.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2c7d68b80 1 -- start start 2023-12-14T14:12:31.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 0x56271b7d37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3d10 0x56271b7e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7e0de0 0x56271b7e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b6bd660 con 0x56271b7e0de0 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b72c8f0 con 0x56271b7d3d10 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b725d80 con 0x56271b7d3400 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2ba177700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7e0de0 0x56271b7e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2ba177700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7e0de0 0x56271b7e31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54136/0 (socket says 172.21.15.69:54136) 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2ba177700 1 -- 172.21.15.69:0/4206885594 learned_addr learned my addr 172.21.15.69:0/4206885594 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2b9976700 1 --2- 172.21.15.69:0/4206885594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 0x56271b7d37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.107+0000 7fb2b9175700 1 --2- 172.21.15.69:0/4206885594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3d10 0x56271b7e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.108+0000 7fb2ba177700 1 -- 172.21.15.69:0/4206885594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 msgr2=0x56271b7d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.108+0000 7fb2ba177700 1 --2- 172.21.15.69:0/4206885594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 0x56271b7d37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.108+0000 7fb2ba177700 1 -- 172.21.15.69:0/4206885594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3d10 msgr2=0x56271b7e08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:31.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.108+0000 7fb2ba177700 1 --2- 172.21.15.69:0/4206885594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3d10 0x56271b7e08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.108+0000 7fb2ba177700 1 -- 172.21.15.69:0/4206885594 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56271b5a7430 con 0x56271b7e0de0 2023-12-14T14:12:31.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.108+0000 7fb2ba177700 1 --2- 172.21.15.69:0/4206885594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7e0de0 0x56271b7e31c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009c60 tx=0x7fb2ac009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71e1c24b71d88a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:31.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.108+0000 7fb29ffff700 1 -- 172.21.15.69:0/4206885594 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac00e040 con 0x56271b7e0de0 2023-12-14T14:12:31.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.108+0000 7fb29ffff700 1 -- 172.21.15.69:0/4206885594 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2ac009490 con 0x56271b7e0de0 2023-12-14T14:12:31.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.108+0000 7fb29ffff700 1 -- 172.21.15.69:0/4206885594 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac005270 con 0x56271b7e0de0 2023-12-14T14:12:31.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/4206885594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7e0de0 msgr2=0x56271b7e31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:31.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/4206885594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7e0de0 0x56271b7e31c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009c60 tx=0x7fb2ac009c90 comp rx=0 tx=0).stop 2023-12-14T14:12:31.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/4206885594 shutdown_connections 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/4206885594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7e0de0 0x56271b7e31c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/4206885594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 0x56271b7d37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/4206885594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3d10 0x56271b7e08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/4206885594 >> 172.21.15.69:0/4206885594 conn(0x56271b7c9d20 msgr2=0x56271b7cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/4206885594 shutdown_connections 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/4206885594 wait complete. 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.109+0000 7fb2c7d68b80 1 -- start start 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.110+0000 7fb2c7d68b80 1 Processor -- start 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.110+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 0x56271b7e0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.110+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7dda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.110+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.110+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b6c2010 con 0x56271b7d3d10 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.110+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b6c1cb0 con 0x56271b7e0de0 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.110+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b5a9720 con 0x56271b7d3400 2023-12-14T14:12:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.110+0000 7fb2c7d68b80 10 client.0 _ll_register_callbacks cb 0x56271b6e5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.110+0000 7fb2b9175700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7dda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9175700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7dda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54142/0 (socket says 172.21.15.69:54142) 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9175700 1 -- 172.21.15.69:0/3784498920 learned_addr learned my addr 172.21.15.69:0/3784498920 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9976700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 0x56271b7e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2ba177700 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9175700 1 -- 172.21.15.69:0/3784498920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 msgr2=0x56271b7e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9175700 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 0x56271b7e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9175700 1 -- 172.21.15.69:0/3784498920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 msgr2=0x56271b7ddfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9175700 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7ddfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9175700 1 -- 172.21.15.69:0/3784498920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b410c7e0 con 0x56271b7d3d10 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9976700 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 0x56271b7e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2ba177700 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7ddfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2b9175700 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7dda10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4096040 tx=0x7fb2a4099bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0056b2c876c784a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb29d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:31.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb29d7fa700 1 -- 172.21.15.69:0/3784498920 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4004a00 con 0x56271b7d3d10 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb29d7fa700 1 -- 172.21.15.69:0/3784498920 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fb2a4096250 con 0x56271b7d3d10 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/3784498920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56271b7c7330 con 0x56271b7d3d10 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.111+0000 7fb29d7fa700 1 -- 172.21.15.69:0/3784498920 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2a4096410 con 0x56271b7d3d10 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb2c7d68b80 10 client.15801 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/3784498920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56271b6ec1f0 con 0x56271b7d3d10 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb29d7fa700 1 -- 172.21.15.69:0/3784498920 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56271b7c7330 con 0x56271b7d3d10 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb29d7fa700 1 -- 172.21.15.69:0/3784498920 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb2a4099030 con 0x56271b7d3d10 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb2c7d68b80 10 client.15801 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb2c7d68b80 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb2c7d68b80 20 client.15801 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56271b7f0660 0x56271b7f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb2c7d68b80 4 client.15801 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/3784498920 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56271b71ed60 con 0x56271b7f0660 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.112+0000 7fb2b9976700 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56271b7f0660 0x56271b7f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.113+0000 7fb2b9976700 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56271b7f0660 0x56271b7f2a70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c251a9c1f592bdb server_cookie=35f641c49cd8934 in_seq=0 out_seq=0 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.113+0000 7fb29d7fa700 10 client.15801 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.113+0000 7fb29d7fa700 1 -- 172.21.15.69:0/3784498920 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56271b71ed60 con 0x56271b7f0660 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.113+0000 7fb29d7fa700 10 client.15801 handle_command_reply: tid=0 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 client.15801 shutdown 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/3784498920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 msgr2=0x56271b7dda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7dda10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4096040 tx=0x7fb2a4099bb0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/3784498920 shutdown_connections 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56271b7f0660 0x56271b7f2a70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7ddfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3400 0x56271b7e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/3784498920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7dda10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb29d7fa700 0 client.15801 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/3784498920 >> 172.21.15.69:0/3784498920 conn(0x56271b7c9d20 msgr2=0x56271b7cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/3784498920 shutdown_connections 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/3784498920 wait complete. 2023-12-14T14:12:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.114+0000 7fb2c7d68b80 20 client.15801 trim_cache size 0 max 16384 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.132+0000 7fb2c7d68b80 1 Processor -- start 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.132+0000 7fb2c7d68b80 1 -- start start 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3400 0x56271b7e0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7e0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7e0de0 0x56271b7dac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b7f0440 con 0x56271b7d3d10 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b7d43b0 con 0x56271b7d3400 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b7dbf70 con 0x56271b7e0de0 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9175700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9175700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7e0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54146/0 (socket says 172.21.15.69:54146) 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9175700 1 -- 172.21.15.69:0/509602293 learned_addr learned my addr 172.21.15.69:0/509602293 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2ba177700 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7e0de0 0x56271b7dac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9976700 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3400 0x56271b7e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9175700 1 -- 172.21.15.69:0/509602293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7e0de0 msgr2=0x56271b7dac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9175700 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7e0de0 0x56271b7dac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9175700 1 -- 172.21.15.69:0/509602293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3400 msgr2=0x56271b7e0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9175700 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3400 0x56271b7e0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9175700 1 -- 172.21.15.69:0/509602293 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56271b7dd580 con 0x56271b7d3d10 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9976700 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3400 0x56271b7e0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2b9175700 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7e0760 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40ca7c0 tx=0x7fb2a40980f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df39ccd91aa86fd server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2a8dac700 1 -- 172.21.15.69:0/509602293 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a409db70 con 0x56271b7d3d10 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2a8dac700 1 -- 172.21.15.69:0/509602293 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2a40ca040 con 0x56271b7d3d10 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.133+0000 7fb2a8dac700 1 -- 172.21.15.69:0/509602293 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005020 con 0x56271b7d3d10 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.134+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/509602293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 msgr2=0x56271b7e0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.134+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7e0760 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40ca7c0 tx=0x7fb2a40980f0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.134+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/509602293 shutdown_connections 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.134+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7e0de0 0x56271b7dac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.134+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7d3400 0x56271b7e0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.134+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/509602293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3d10 0x56271b7e0760 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.134+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/509602293 >> 172.21.15.69:0/509602293 conn(0x56271b7c9d20 msgr2=0x56271b7dd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.134+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/509602293 shutdown_connections 2023-12-14T14:12:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.134+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/509602293 wait complete. 2023-12-14T14:12:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2c7d68b80 1 -- start start 2023-12-14T14:12:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2c7d68b80 1 Processor -- start 2023-12-14T14:12:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3400 0x56271b7e7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3d10 0x56271b7e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2c7d68b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7e60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b7e66f0 con 0x56271b7d3400 2023-12-14T14:12:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b7e6830 con 0x56271b7e0de0 2023-12-14T14:12:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2c7d68b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b7e69f0 con 0x56271b7d3d10 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2c7d68b80 10 client.0 _ll_register_callbacks cb 0x7fb2a4099770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2b9976700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3400 0x56271b7e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2b9976700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3400 0x56271b7e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54154/0 (socket says 172.21.15.69:54154) 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.135+0000 7fb2b9976700 1 -- 172.21.15.69:0/55000678 learned_addr learned my addr 172.21.15.69:0/55000678 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2b9175700 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3d10 0x56271b7e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2ba177700 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7e60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2b9976700 1 -- 172.21.15.69:0/55000678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3d10 msgr2=0x56271b7e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2b9976700 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3d10 0x56271b7e5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2b9976700 1 -- 172.21.15.69:0/55000678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 msgr2=0x56271b7e60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2b9976700 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7e60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2b9976700 1 -- 172.21.15.69:0/55000678 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56271b6ec1f0 con 0x56271b7d3400 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2ba177700 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2b9976700 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3400 0x56271b7e7860 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x56271b7f3350 tx=0x7fb2b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48164b36beeff1cb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb29d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb29d7fa700 1 -- 172.21.15.69:0/55000678 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0024040 con 0x56271b7d3400 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb29d7fa700 1 -- 172.21.15.69:0/55000678 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fb2b0003d40 con 0x56271b7d3400 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/55000678 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2ac009490 con 0x56271b7d3400 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb29d7fa700 1 -- 172.21.15.69:0/55000678 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2b001e3f0 con 0x56271b7d3400 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2c7d68b80 10 client.15807 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.136+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/55000678 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56271b553be0 con 0x56271b7d3400 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb29d7fa700 1 -- 172.21.15.69:0/55000678 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2ac009490 con 0x56271b7d3400 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb29d7fa700 1 -- 172.21.15.69:0/55000678 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb2b000e3b0 con 0x56271b7d3400 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb2c7d68b80 10 client.15807 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb2c7d68b80 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb2c7d68b80 20 client.15807 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56271b845a90 0x56271b847ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb2c7d68b80 4 client.15807 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/55000678 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56271b71ea80 con 0x56271b845a90 2023-12-14T14:12:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb2b9175700 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56271b845a90 0x56271b847ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb29d7fa700 10 client.15807 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.137+0000 7fb2b9175700 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56271b845a90 0x56271b847ea0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d912f4b1f2b5409b server_cookie=360ae42b31e8f1cf in_seq=0 out_seq=0 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.138+0000 7fb29d7fa700 1 -- 172.21.15.69:0/55000678 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56271b71ea80 con 0x56271b845a90 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.138+0000 7fb29d7fa700 10 client.15807 handle_command_reply: tid=0 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.138+0000 7fb2c7d68b80 1 client.15807 shutdown 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/55000678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3400 msgr2=0x56271b7e7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3400 0x56271b7e7860 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x56271b7f3350 tx=0x7fb2b00047c0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/55000678 shutdown_connections 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56271b845a90 0x56271b847ea0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271b7e0de0 0x56271b7e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56271b7d3400 0x56271b7e7860 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb29d7fa700 0 client.15807 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 --2- 172.21.15.69:0/55000678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56271b7d3d10 0x56271b7e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/55000678 >> 172.21.15.69:0/55000678 conn(0x56271b7c9d20 msgr2=0x56271b7d5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/55000678 shutdown_connections 2023-12-14T14:12:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 1 -- 172.21.15.69:0/55000678 wait complete. 2023-12-14T14:12:31.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2c7d68b80 20 client.15807 trim_cache size 0 max 16384 2023-12-14T14:12:31.144 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:12:31.144 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:12:31.144 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "e36c888b-1e4d-4767-be05-45c44cdb4ed1", 2023-12-14T14:12:31.144 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:12:31.144 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:12:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2bbbda700 1 -- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb2a00a12c0 msgr2=0x7fb2a00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb2a00a12c0 0x7fb2a00a3770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0011490 tx=0x7fb2b0009260 comp rx=0 tx=0).stop 2023-12-14T14:12:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2bbbda700 1 -- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b40ffd30 msgr2=0x7fb2b4195950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.139+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b40ffd30 0x7fb2b4195950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c8c0 tx=0x7fb2a400cbd0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.140+0000 7fb2bbbda700 1 -- 172.21.15.69:0/1946070936 shutdown_connections 2023-12-14T14:12:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.140+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb2a00a12c0 0x7fb2a00a3770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.140+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b41043d0 0x7fb2b4199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.140+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40ff390 0x7fb2b4195410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.140+0000 7fb2bbbda700 1 --2- 172.21.15.69:0/1946070936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b40ffd30 0x7fb2b4195950 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:31.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.140+0000 7fb2bbbda700 1 -- 172.21.15.69:0/1946070936 >> 172.21.15.69:0/1946070936 conn(0x7fb2b4075fd0 msgr2=0x7fb2b40fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:31.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.140+0000 7fb2bbbda700 1 -- 172.21.15.69:0/1946070936 shutdown_connections 2023-12-14T14:12:31.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:31.140+0000 7fb2bbbda700 1 -- 172.21.15.69:0/1946070936 wait complete. 2023-12-14T14:12:31.186 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:12:31.503 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:31 smithi069 ceph-mon[42034]: pgmap v59: 97 pgs: 97 active+clean; 2.1 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-12-14T14:12:31.737 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:31.738 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:31.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:31 smithi119 ceph-mon[43834]: pgmap v59: 97 pgs: 97 active+clean; 2.1 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-12-14T14:12:31.818 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:31.818 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:31.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:31.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:31.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 61 -lt 100 ']' 2023-12-14T14:12:31.846 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 61 + 1 2023-12-14T14:12:31.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=62 2023-12-14T14:12:31.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:31 smithi081 ceph-mon[43371]: pgmap v59: 97 pgs: 97 active+clean; 2.1 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-12-14T14:12:31.909 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:31.909 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:31.910 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:31.910 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:31.910 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:32.304 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:32.304 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:32.420 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:32.420 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:32.426 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:32.426 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:32.426 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 62 -lt 100 ']' 2023-12-14T14:12:32.426 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 62 + 1 2023-12-14T14:12:32.452 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=63 2023-12-14T14:12:32.452 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:32.489 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:32.489 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:32.490 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:32.490 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:32.490 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:32.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:32 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:12:32.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:32 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:32.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:32 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:12:32.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:32 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:32.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:32 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:12:32.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:32 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:32.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:32 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:12:32.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:32 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:32.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:32 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:12:32.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:32 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:32.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:32 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:12:32.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:32 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:33.204 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:33.204 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:33.454 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:33.454 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:33.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:33.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:33.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 63 -lt 100 ']' 2023-12-14T14:12:33.470 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 63 + 1 2023-12-14T14:12:33.521 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=64 2023-12-14T14:12:33.522 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:33.587 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:33.587 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:33.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:33.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:33.589 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:33.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:33 smithi119 ceph-mon[43834]: pgmap v60: 97 pgs: 97 active+clean; 2.1 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-12-14T14:12:33.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:33 smithi069 ceph-mon[42034]: pgmap v60: 97 pgs: 97 active+clean; 2.1 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-12-14T14:12:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:33 smithi081 ceph-mon[43371]: pgmap v60: 97 pgs: 97 active+clean; 2.1 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-12-14T14:12:34.154 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:34.154 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:34.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:34.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:34.366 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:34.366 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:34.366 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 64 -lt 100 ']' 2023-12-14T14:12:34.366 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 64 + 1 2023-12-14T14:12:34.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=65 2023-12-14T14:12:34.402 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:34.446 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:34.446 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:34.447 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:34.447 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:34.447 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:34.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.825+0000 7fc1638a3700 1 -- 172.21.15.69:0/2630836411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 msgr2=0x7fc15c0ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:34.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.825+0000 7fc1638a3700 1 --2- 172.21.15.69:0/2630836411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 0x7fc15c0ffeb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc150009990 tx=0x7fc150009ca0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.825+0000 7fc1638a3700 1 -- 172.21.15.69:0/2630836411 shutdown_connections 2023-12-14T14:12:34.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.825+0000 7fc1638a3700 1 --2- 172.21.15.69:0/2630836411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc15c10a890 0x7fc15c10cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.825+0000 7fc1638a3700 1 --2- 172.21.15.69:0/2630836411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c067980 0x7fc15c0ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.825+0000 7fc1638a3700 1 --2- 172.21.15.69:0/2630836411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 0x7fc15c0ffeb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.825+0000 7fc1638a3700 1 -- 172.21.15.69:0/2630836411 >> 172.21.15.69:0/2630836411 conn(0x7fc15c074a60 msgr2=0x7fc15c074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:34.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.826+0000 7fc1638a3700 1 -- 172.21.15.69:0/2630836411 shutdown_connections 2023-12-14T14:12:34.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.826+0000 7fc1638a3700 1 -- 172.21.15.69:0/2630836411 wait complete. 2023-12-14T14:12:34.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.826+0000 7fc1638a3700 1 Processor -- start 2023-12-14T14:12:34.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.826+0000 7fc1638a3700 1 -- start start 2023-12-14T14:12:34.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc1638a3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c067980 0x7fc15c196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc1638a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 0x7fc15c1969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc1638a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc15c10a890 0x7fc15c19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc1638a3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c19b3f0 con 0x7fc15c0ffa40 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc1638a3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c19b560 con 0x7fc15c10a890 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc1638a3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c19b720 con 0x7fc15c067980 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc160e3e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 0x7fc15c1969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc160e3e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 0x7fc15c1969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54178/0 (socket says 172.21.15.69:54178) 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc160e3e700 1 -- 172.21.15.69:0/372619535 learned_addr learned my addr 172.21.15.69:0/372619535 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc161e40700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc15c10a890 0x7fc15c19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc16163f700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c067980 0x7fc15c196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc160e3e700 1 -- 172.21.15.69:0/372619535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c067980 msgr2=0x7fc15c196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:34.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc160e3e700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c067980 0x7fc15c196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc160e3e700 1 -- 172.21.15.69:0/372619535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc15c10a890 msgr2=0x7fc15c19adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:34.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc160e3e700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc15c10a890 0x7fc15c19adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc160e3e700 1 -- 172.21.15.69:0/372619535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1500095f0 con 0x7fc15c0ffa40 2023-12-14T14:12:34.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.827+0000 7fc160e3e700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 0x7fc15c1969a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc150003730 tx=0x7fc15000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:34.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.828+0000 7fc14e7fc700 1 -- 172.21.15.69:0/372619535 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15001d070 con 0x7fc15c0ffa40 2023-12-14T14:12:34.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.828+0000 7fc14e7fc700 1 -- 172.21.15.69:0/372619535 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1500047d0 con 0x7fc15c0ffa40 2023-12-14T14:12:34.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.828+0000 7fc14e7fc700 1 -- 172.21.15.69:0/372619535 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150005270 con 0x7fc15c0ffa40 2023-12-14T14:12:34.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.828+0000 7fc1638a3700 1 -- 172.21.15.69:0/372619535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15c1102f0 con 0x7fc15c0ffa40 2023-12-14T14:12:34.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.828+0000 7fc1638a3700 1 -- 172.21.15.69:0/372619535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c110160 con 0x7fc15c0ffa40 2023-12-14T14:12:34.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.830+0000 7fc14e7fc700 1 -- 172.21.15.69:0/372619535 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc150004940 con 0x7fc15c0ffa40 2023-12-14T14:12:34.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.831+0000 7fc14e7fc700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc1480a1340 0x7fc1480a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.831+0000 7fc14e7fc700 1 -- 172.21.15.69:0/372619535 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fc1500cdb10 con 0x7fc15c0ffa40 2023-12-14T14:12:34.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.831+0000 7fc16163f700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc1480a1340 0x7fc1480a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.832+0000 7fc16163f700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc1480a1340 0x7fc1480a37f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc158005950 tx=0x7fc15800b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:34.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.924+0000 7fc16fa31b80 1 Processor -- start 2023-12-14T14:12:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.924+0000 7fc16fa31b80 1 -- start start 2023-12-14T14:12:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.924+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2046a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.924+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046ac90 0x55da20479a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.924+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20479f60 0x55da2047c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.924+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da203545e0 con 0x55da2046ac90 2023-12-14T14:12:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.924+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da203c3870 con 0x55da2046a380 2023-12-14T14:12:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.924+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da203bcd00 con 0x55da20479f60 2023-12-14T14:12:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc160e3e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046ac90 0x55da20479a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc160e3e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046ac90 0x55da20479a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54182/0 (socket says 172.21.15.69:54182) 2023-12-14T14:12:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc160e3e700 1 -- 172.21.15.69:0/2595140766 learned_addr learned my addr 172.21.15.69:0/2595140766 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc161e40700 1 --2- 172.21.15.69:0/2595140766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20479f60 0x55da2047c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc16163f700 1 --2- 172.21.15.69:0/2595140766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2046a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc160e3e700 1 -- 172.21.15.69:0/2595140766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20479f60 msgr2=0x55da2047c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc160e3e700 1 --2- 172.21.15.69:0/2595140766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20479f60 0x55da2047c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc160e3e700 1 -- 172.21.15.69:0/2595140766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 msgr2=0x55da2046a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc160e3e700 1 --2- 172.21.15.69:0/2595140766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2046a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc160e3e700 1 -- 172.21.15.69:0/2595140766 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da2023e3b0 con 0x55da2046ac90 2023-12-14T14:12:34.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc160e3e700 1 --2- 172.21.15.69:0/2595140766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046ac90 0x55da20479a20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc1500976c0 tx=0x7fc15009ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff782e9c58aee44 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.925+0000 7fc1477fe700 1 -- 172.21.15.69:0/2595140766 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150097360 con 0x55da2046ac90 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc1477fe700 1 -- 172.21.15.69:0/2595140766 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1500974c0 con 0x55da2046ac90 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc1477fe700 1 -- 172.21.15.69:0/2595140766 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1500a2dc0 con 0x55da2046ac90 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2595140766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046ac90 msgr2=0x55da20479a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2595140766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046ac90 0x55da20479a20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc1500976c0 tx=0x7fc15009ad40 comp rx=0 tx=0).stop 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2595140766 shutdown_connections 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2595140766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20479f60 0x55da2047c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2595140766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2046a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2595140766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046ac90 0x55da20479a20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2595140766 >> 172.21.15.69:0/2595140766 conn(0x55da20460ca0 msgr2=0x55da204667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:34.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.926+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2595140766 shutdown_connections 2023-12-14T14:12:34.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.927+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2595140766 wait complete. 2023-12-14T14:12:34.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.927+0000 7fc16fa31b80 1 -- start start 2023-12-14T14:12:34.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.927+0000 7fc16fa31b80 1 Processor -- start 2023-12-14T14:12:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2047a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da2047add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da20358f90 con 0x55da20479f60 2023-12-14T14:12:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da20358c30 con 0x55da2046a380 2023-12-14T14:12:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da202406a0 con 0x55da2046ac90 2023-12-14T14:12:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc16fa31b80 10 client.0 _ll_register_callbacks cb 0x55da2037c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:34.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc161e40700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da2047add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc161e40700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da2047add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54198/0 (socket says 172.21.15.69:54198) 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc161e40700 1 -- 172.21.15.69:0/2841629372 learned_addr learned my addr 172.21.15.69:0/2841629372 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc160e3e700 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.928+0000 7fc16163f700 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2047a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc161e40700 1 -- 172.21.15.69:0/2841629372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 msgr2=0x55da2047a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc161e40700 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc161e40700 1 -- 172.21.15.69:0/2841629372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 msgr2=0x55da2047a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc161e40700 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2047a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc161e40700 1 -- 172.21.15.69:0/2841629372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c110160 con 0x55da20479f60 2023-12-14T14:12:34.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc160e3e700 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc161e40700 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da2047add0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc154003fd0 tx=0x7fc154004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5acb25ce333ed6d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc144ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc144ff9700 1 -- 172.21.15.69:0/2841629372 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154004db0 con 0x55da20479f60 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc144ff9700 1 -- 172.21.15.69:0/2841629372 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fc1540048d0 con 0x55da20479f60 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2841629372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da2045e2b0 con 0x55da20479f60 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc144ff9700 1 -- 172.21.15.69:0/2841629372 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc154007500 con 0x55da20479f60 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc16fa31b80 10 client.15819 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.929+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2841629372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55da20383170 con 0x55da20479f60 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.930+0000 7fc144ff9700 1 -- 172.21.15.69:0/2841629372 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55da2045e2b0 con 0x55da20479f60 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.930+0000 7fc144ff9700 1 -- 172.21.15.69:0/2841629372 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc154016870 con 0x55da20479f60 2023-12-14T14:12:34.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.930+0000 7fc16fa31b80 10 client.15819 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.930+0000 7fc16fa31b80 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.930+0000 7fc16fa31b80 20 client.15819 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.930+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55da20489640 0x55da2048ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.930+0000 7fc16fa31b80 4 client.15819 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.930+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2841629372 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da203b5ce0 con 0x55da20489640 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.930+0000 7fc16163f700 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55da20489640 0x55da2048ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16163f700 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55da20489640 0x55da2048ba50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60f3f505dce84fc8 server_cookie=952e8761eebcace5 in_seq=0 out_seq=0 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc144ff9700 10 client.15819 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc144ff9700 1 -- 172.21.15.69:0/2841629372 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55da203b5ce0 con 0x55da20489640 2023-12-14T14:12:34.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc144ff9700 10 client.15819 handle_command_reply: tid=0 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16fa31b80 1 client.15819 shutdown 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2841629372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 msgr2=0x55da2047add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da2047add0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc154003fd0 tx=0x7fc154004040 comp rx=0 tx=0).stop 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2841629372 shutdown_connections 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55da20489640 0x55da2048ba50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da2047add0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2047a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc144ff9700 0 client.15819 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/2841629372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.931+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2841629372 >> 172.21.15.69:0/2841629372 conn(0x55da20460ca0 msgr2=0x55da20466370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:34.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.932+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2841629372 shutdown_connections 2023-12-14T14:12:34.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.932+0000 7fc16fa31b80 1 -- 172.21.15.69:0/2841629372 wait complete. 2023-12-14T14:12:34.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.932+0000 7fc16fa31b80 20 client.15819 trim_cache size 0 max 16384 2023-12-14T14:12:34.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.950+0000 7fc16fa31b80 1 Processor -- start 2023-12-14T14:12:34.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.950+0000 7fc16fa31b80 1 -- start start 2023-12-14T14:12:34.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.950+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046a380 0x55da2047f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.950+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da204788c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.950+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da20479f60 0x55da20484b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.950+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da20485490 con 0x55da2046a380 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.950+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da20479bf0 con 0x55da20479f60 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.950+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da20477660 con 0x55da2046ac90 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.950+0000 7fc16163f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046a380 0x55da2047f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc16163f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046a380 0x55da2047f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54200/0 (socket says 172.21.15.69:54200) 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc16163f700 1 -- 172.21.15.69:0/1882291930 learned_addr learned my addr 172.21.15.69:0/1882291930 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc160e3e700 1 --2- 172.21.15.69:0/1882291930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da204788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc161e40700 1 --2- 172.21.15.69:0/1882291930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da20479f60 0x55da20484b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc16163f700 1 -- 172.21.15.69:0/1882291930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 msgr2=0x55da204788c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc16163f700 1 --2- 172.21.15.69:0/1882291930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da204788c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc16163f700 1 -- 172.21.15.69:0/1882291930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da20479f60 msgr2=0x55da20484b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:34.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc16163f700 1 --2- 172.21.15.69:0/1882291930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da20479f60 0x55da20484b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc16163f700 1 -- 172.21.15.69:0/1882291930 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da20382ec0 con 0x55da2046a380 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc16163f700 1 --2- 172.21.15.69:0/1882291930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046a380 0x55da2047f360 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x55da2048c330 tx=0x7fc158013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0aaccfaf84673f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc147fff700 1 -- 172.21.15.69:0/1882291930 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15802b070 con 0x55da2046a380 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc147fff700 1 -- 172.21.15.69:0/1882291930 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc158015070 con 0x55da2046a380 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.951+0000 7fc147fff700 1 -- 172.21.15.69:0/1882291930 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158025070 con 0x55da2046a380 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1882291930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046a380 msgr2=0x55da2047f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1882291930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046a380 0x55da2047f360 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x55da2048c330 tx=0x7fc158013000 comp rx=0 tx=0).stop 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1882291930 shutdown_connections 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1882291930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da20479f60 0x55da20484b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1882291930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da2046a380 0x55da2047f360 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1882291930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da204788c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:34.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1882291930 >> 172.21.15.69:0/1882291930 conn(0x55da20460ca0 msgr2=0x55da204743e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:34.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1882291930 shutdown_connections 2023-12-14T14:12:34.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1882291930 wait complete. 2023-12-14T14:12:34.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.952+0000 7fc16fa31b80 1 -- start start 2023-12-14T14:12:34.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc16fa31b80 1 Processor -- start 2023-12-14T14:12:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2047b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc16fa31b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da204d6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da204d6a70 con 0x55da20479f60 2023-12-14T14:12:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da204d6bb0 con 0x55da2046a380 2023-12-14T14:12:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc16fa31b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da204d6d70 con 0x55da2046ac90 2023-12-14T14:12:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc16fa31b80 10 client.0 _ll_register_callbacks cb 0x55da2037c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc161e40700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da204d6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc161e40700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da204d6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54216/0 (socket says 172.21.15.69:54216) 2023-12-14T14:12:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc161e40700 1 -- 172.21.15.69:0/1978052321 learned_addr learned my addr 172.21.15.69:0/1978052321 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:34.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc16163f700 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2047b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:35.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.953+0000 7fc160e3e700 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:35.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc161e40700 1 -- 172.21.15.69:0/1978052321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 msgr2=0x55da2047ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:35.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc161e40700 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc161e40700 1 -- 172.21.15.69:0/1978052321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 msgr2=0x55da2047b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc161e40700 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2047b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc161e40700 1 -- 172.21.15.69:0/1978052321 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc158020440 con 0x55da20479f60 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc160e3e700 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc161e40700 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da204d6530 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc154002230 tx=0x7fc154004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b8823871fb556c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc144ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc144ff9700 1 -- 172.21.15.69:0/1978052321 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154004e80 con 0x55da20479f60 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc144ff9700 1 -- 172.21.15.69:0/1978052321 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fc154009170 con 0x55da20479f60 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1978052321 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc1500974c0 con 0x55da20479f60 2023-12-14T14:12:35.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc144ff9700 1 -- 172.21.15.69:0/1978052321 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc154003ac0 con 0x55da20479f60 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc16fa31b80 10 client.15825 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1978052321 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55da203699a0 con 0x55da20479f60 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.954+0000 7fc144ff9700 1 -- 172.21.15.69:0/1978052321 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1500974c0 con 0x55da20479f60 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc144ff9700 1 -- 172.21.15.69:0/1978052321 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc154007b80 con 0x55da20479f60 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc16fa31b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc16fa31b80 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc16fa31b80 20 client.15825 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55da204de400 0x55da204e0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc16fa31b80 4 client.15825 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:12:35.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1978052321 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55da203b5a00 con 0x55da204de400 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc16163f700 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55da204de400 0x55da204e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc16163f700 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55da204de400 0x55da204e0810 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90aa2003df91ad17 server_cookie=41b06e8d459365bc in_seq=0 out_seq=0 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.955+0000 7fc144ff9700 10 client.15825 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc144ff9700 1 -- 172.21.15.69:0/1978052321 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55da203b5a00 con 0x55da204de400 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc144ff9700 10 client.15825 handle_command_reply: tid=0 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 client.15825 shutdown 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1978052321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 msgr2=0x55da204d6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da204d6530 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc154002230 tx=0x7fc154004b00 comp rx=0 tx=0).stop 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1978052321 shutdown_connections 2023-12-14T14:12:35.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55da204de400 0x55da204e0810 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55da20479f60 0x55da204d6530 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da2046a380 0x55da2047b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc144ff9700 0 client.15825 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:35.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 --2- 172.21.15.69:0/1978052321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da2046ac90 0x55da2047ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1978052321 >> 172.21.15.69:0/1978052321 conn(0x55da20460ca0 msgr2=0x55da2047a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:35.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1978052321 shutdown_connections 2023-12-14T14:12:35.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 1 -- 172.21.15.69:0/1978052321 wait complete. 2023-12-14T14:12:35.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.956+0000 7fc16fa31b80 20 client.15825 trim_cache size 0 max 16384 2023-12-14T14:12:35.009 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:12:35.009 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:12:35.009 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:12:35.009 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:12:35.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 -- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc1480a1340 msgr2=0x7fc1480a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:35.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc1480a1340 0x7fc1480a37f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc158005950 tx=0x7fc15800b410 comp rx=0 tx=0).stop 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 -- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 msgr2=0x7fc15c1969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 0x7fc15c1969a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc150003730 tx=0x7fc15000f690 comp rx=0 tx=0).stop 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 -- 172.21.15.69:0/372619535 shutdown_connections 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc1480a1340 0x7fc1480a37f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc15c10a890 0x7fc15c19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c067980 0x7fc15c196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 --2- 172.21.15.69:0/372619535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc15c0ffa40 0x7fc15c1969a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 -- 172.21.15.69:0/372619535 >> 172.21.15.69:0/372619535 conn(0x7fc15c074a60 msgr2=0x7fc15c102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 -- 172.21.15.69:0/372619535 shutdown_connections 2023-12-14T14:12:35.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:34.957+0000 7fc1638a3700 1 -- 172.21.15.69:0/372619535 wait complete. 2023-12-14T14:12:35.012 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:12:35.012 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:12:35.212 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:35.212 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:35.346 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:35.346 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:35.355 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:35.355 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:35.355 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 65 -lt 100 ']' 2023-12-14T14:12:35.355 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 65 + 1 2023-12-14T14:12:35.393 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=66 2023-12-14T14:12:35.393 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:35.399 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:35.399 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:35.400 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:35.400 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:35.400 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:35.684 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:35 smithi069 ceph-mon[42034]: pgmap v61: 97 pgs: 97 active+clean; 2.2 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 11 op/s 2023-12-14T14:12:35.684 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:35 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:12:35.762 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:35.762 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:35.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:35 smithi119 ceph-mon[43834]: pgmap v61: 97 pgs: 97 active+clean; 2.2 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 11 op/s 2023-12-14T14:12:35.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:35 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:12:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:35 smithi081 ceph-mon[43371]: pgmap v61: 97 pgs: 97 active+clean; 2.2 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 11 op/s 2023-12-14T14:12:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:35 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:12:35.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:35.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:35.946 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:35.946 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:35.946 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 66 -lt 100 ']' 2023-12-14T14:12:35.946 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 66 + 1 2023-12-14T14:12:35.988 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=67 2023-12-14T14:12:35.988 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:36.044 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:36.044 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:36.045 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:36.046 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:36.046 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:36.712 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:36.712 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:36.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:36.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:36.881 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:36.881 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:36.881 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 67 -lt 100 ']' 2023-12-14T14:12:36.881 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 67 + 1 2023-12-14T14:12:36.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=68 2023-12-14T14:12:36.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:36.956 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:36.956 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:36.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:36.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:36.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:37.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:37 smithi069 ceph-mon[42034]: pgmap v62: 97 pgs: 97 active+clean; 2.2 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-12-14T14:12:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:37 smithi081 ceph-mon[43371]: pgmap v62: 97 pgs: 97 active+clean; 2.2 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-12-14T14:12:37.653 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:37.653 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:37.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:37 smithi119 ceph-mon[43834]: pgmap v62: 97 pgs: 97 active+clean; 2.2 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-12-14T14:12:37.903 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:37.904 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:37.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:37.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:37.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 68 -lt 100 ']' 2023-12-14T14:12:37.938 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 68 + 1 2023-12-14T14:12:37.988 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=69 2023-12-14T14:12:37.988 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:37.997 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:37.997 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:37.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:37.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:37.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:38.461 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:38.462 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.741+0000 7f074cc88700 1 -- 172.21.15.69:0/3937184179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 msgr2=0x7f074810c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.741+0000 7f074cc88700 1 --2- 172.21.15.69:0/3937184179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 0x7f074810c100 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f074000b0d0 tx=0x7f074000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:12:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.742+0000 7f074cc88700 1 -- 172.21.15.69:0/3937184179 shutdown_connections 2023-12-14T14:12:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.742+0000 7f074cc88700 1 --2- 172.21.15.69:0/3937184179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 0x7f074810c100 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.742+0000 7f074cc88700 1 --2- 172.21.15.69:0/3937184179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07480ffbe0 0x7f07480fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.742+0000 7f074cc88700 1 --2- 172.21.15.69:0/3937184179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0748100580 0x7f0748103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.742+0000 7f074cc88700 1 -- 172.21.15.69:0/3937184179 >> 172.21.15.69:0/3937184179 conn(0x7f0748074670 msgr2=0x7f0748074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:38.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.742+0000 7f074cc88700 1 -- 172.21.15.69:0/3937184179 shutdown_connections 2023-12-14T14:12:38.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.742+0000 7f074cc88700 1 -- 172.21.15.69:0/3937184179 wait complete. 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.743+0000 7f074cc88700 1 Processor -- start 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.743+0000 7f074cc88700 1 -- start start 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.743+0000 7f074cc88700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07480ffbe0 0x7f07481954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.743+0000 7f074cc88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0748100580 0x7f0748195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.743+0000 7f074cc88700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 0x7f0748199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.743+0000 7f074cc88700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074819a4d0 con 0x7f0748104530 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.743+0000 7f074cc88700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074819a640 con 0x7f0748100580 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.743+0000 7f074cc88700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074819a800 con 0x7f07480ffbe0 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0746d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 0x7f0748199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:38.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0746d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 0x7f0748199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54616/0 (socket says 172.21.15.69:54616) 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0746d9d700 1 -- 172.21.15.69:0/1820349755 learned_addr learned my addr 172.21.15.69:0/1820349755 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f074659c700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07480ffbe0 0x7f07481954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0745d9b700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0748100580 0x7f0748195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0746d9d700 1 -- 172.21.15.69:0/1820349755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07480ffbe0 msgr2=0x7f07481954f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0746d9d700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07480ffbe0 0x7f07481954f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0746d9d700 1 -- 172.21.15.69:0/1820349755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0748100580 msgr2=0x7f0748195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0746d9d700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0748100580 0x7f0748195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0746d9d700 1 -- 172.21.15.69:0/1820349755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740009d00 con 0x7f0748104530 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0745d9b700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0748100580 0x7f0748195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f0746d9d700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 0x7f0748199e90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0740007890 tx=0x7f07400078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f07377fe700 1 -- 172.21.15.69:0/1820349755 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074000e040 con 0x7f0748104530 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074810f330 con 0x7f0748104530 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f07377fe700 1 -- 172.21.15.69:0/1820349755 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f074000bdb0 con 0x7f0748104530 2023-12-14T14:12:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f07377fe700 1 -- 172.21.15.69:0/1820349755 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074001d470 con 0x7f0748104530 2023-12-14T14:12:38.747 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:38.747 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.744+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074810f1a0 con 0x7f0748104530 2023-12-14T14:12:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.747+0000 7f07377fe700 1 -- 172.21.15.69:0/1820349755 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f07400050b0 con 0x7f0748104530 2023-12-14T14:12:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.747+0000 7f07377fe700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f07300a12c0 0x7f07300a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.747+0000 7f074659c700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f07300a12c0 0x7f07300a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.747+0000 7f07377fe700 1 -- 172.21.15.69:0/1820349755 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f07400cdb80 con 0x7f0748104530 2023-12-14T14:12:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.748+0000 7f074659c700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f07300a12c0 0x7f07300a3770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0738009c60 tx=0x7f0738009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:38.752 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:38.752 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:38.752 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 69 -lt 100 ']' 2023-12-14T14:12:38.752 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 69 + 1 2023-12-14T14:12:38.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.764+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074810f4c0 con 0x7f0748104530 2023-12-14T14:12:38.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:38.769+0000 7f07377fe700 1 -- 172.21.15.69:0/1820349755 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0740097060 con 0x7f0748104530 2023-12-14T14:12:38.792 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=70 2023-12-14T14:12:38.792 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:38.820 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:38.820 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:38.821 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:38.821 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:38.822 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:39.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.010+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0748196840 con 0x7f0748104530 2023-12-14T14:12:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.011+0000 7f07377fe700 1 -- 172.21.15.69:0/1820349755 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f0740021090 con 0x7f0748104530 2023-12-14T14:12:39.011 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:12:39.011 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:09:15.801574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f07300a12c0 msgr2=0x7f07300a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f07300a12c0 0x7f07300a3770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0738009c60 tx=0x7f0738009260 comp rx=0 tx=0).stop 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 msgr2=0x7f0748199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 0x7f0748199e90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0740007890 tx=0x7f07400078c0 comp rx=0 tx=0).stop 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 shutdown_connections 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f07300a12c0 0x7f07300a3770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0748104530 0x7f0748199e90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07480ffbe0 0x7f07481954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 --2- 172.21.15.69:0/1820349755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0748100580 0x7f0748195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 >> 172.21.15.69:0/1820349755 conn(0x7f0748074670 msgr2=0x7f07480fc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 shutdown_connections 2023-12-14T14:12:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:39.013+0000 7f074cc88700 1 -- 172.21.15.69:0/1820349755 wait complete. 2023-12-14T14:12:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T14:12:39.060 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:12:39.436 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:39.436 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:39.525 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:39.525 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:39.546 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:39.546 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:39.546 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 70 -lt 100 ']' 2023-12-14T14:12:39.546 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 70 + 1 2023-12-14T14:12:39.584 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=71 2023-12-14T14:12:39.584 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:39.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:39 smithi069 ceph-mon[42034]: pgmap v63: 97 pgs: 97 active+clean; 2.2 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-12-14T14:12:39.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:39 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1820349755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:12:39.598 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:39.598 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:39.599 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:39.599 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:39.600 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:39.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:39 smithi119 ceph-mon[43834]: pgmap v63: 97 pgs: 97 active+clean; 2.2 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-12-14T14:12:39.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:39 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1820349755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:12:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:39 smithi081 ceph-mon[43371]: pgmap v63: 97 pgs: 97 active+clean; 2.2 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-12-14T14:12:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:39 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1820349755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:12:39.977 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:39.978 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:40.062 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:40.062 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:40.068 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:40.068 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:40.068 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 71 -lt 100 ']' 2023-12-14T14:12:40.068 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 71 + 1 2023-12-14T14:12:40.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=72 2023-12-14T14:12:40.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:40.159 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:40.160 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:40.161 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:40.161 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:40.161 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:40.678 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:40.678 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:40.828 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:40.828 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:40.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:40.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:40.836 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 72 -lt 100 ']' 2023-12-14T14:12:40.836 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 72 + 1 2023-12-14T14:12:40.892 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=73 2023-12-14T14:12:40.892 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:40.927 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:40.928 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:40.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:40.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:40.929 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:41.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:41 smithi119 ceph-mon[43834]: pgmap v64: 97 pgs: 97 active+clean; 2.3 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-12-14T14:12:41.811 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:41 smithi069 ceph-mon[42034]: pgmap v64: 97 pgs: 97 active+clean; 2.3 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-12-14T14:12:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:41 smithi081 ceph-mon[43371]: pgmap v64: 97 pgs: 97 active+clean; 2.3 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-12-14T14:12:42.002 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:42.003 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:42.303 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:42.303 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:42.327 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:42.327 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:42.327 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 73 -lt 100 ']' 2023-12-14T14:12:42.327 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 73 + 1 2023-12-14T14:12:42.367 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=74 2023-12-14T14:12:42.367 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:42.442 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:42.442 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:42.443 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:42.444 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:42.444 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:42.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.557+0000 7fa514bb4700 1 -- 172.21.15.69:0/1343320123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 msgr2=0x7fa510100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:42.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.557+0000 7fa514bb4700 1 --2- 172.21.15.69:0/1343320123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 0x7fa510100800 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80099c0 tx=0x7fa4f8009cd0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.557+0000 7fa514bb4700 1 -- 172.21.15.69:0/1343320123 shutdown_connections 2023-12-14T14:12:42.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.557+0000 7fa514bb4700 1 --2- 172.21.15.69:0/1343320123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa510105470 0x7fa51010d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.557+0000 7fa514bb4700 1 --2- 172.21.15.69:0/1343320123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 0x7fa510100800 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.557+0000 7fa514bb4700 1 --2- 172.21.15.69:0/1343320123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa510100dd0 0x7fa510104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.557+0000 7fa514bb4700 1 -- 172.21.15.69:0/1343320123 >> 172.21.15.69:0/1343320123 conn(0x7fa5100fbca0 msgr2=0x7fa5100fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:42.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.557+0000 7fa514bb4700 1 -- 172.21.15.69:0/1343320123 shutdown_connections 2023-12-14T14:12:42.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.557+0000 7fa514bb4700 1 -- 172.21.15.69:0/1343320123 wait complete. 2023-12-14T14:12:42.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.558+0000 7fa514bb4700 1 Processor -- start 2023-12-14T14:12:42.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.558+0000 7fa514bb4700 1 -- start start 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa514bb4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 0x7fa510196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa514bb4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa510100dd0 0x7fa510196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa514bb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa510105470 0x7fa51019ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa514bb4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51019b320 con 0x7fa510100430 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa514bb4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51019b490 con 0x7fa510105470 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa514bb4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51019b650 con 0x7fa510100dd0 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 0x7fa510196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 0x7fa510196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54642/0 (socket says 172.21.15.69:54642) 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50e59c700 1 -- 172.21.15.69:0/83382763 learned_addr learned my addr 172.21.15.69:0/83382763 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:42.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50ed9d700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa510105470 0x7fa51019ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa510100dd0 0x7fa510196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50e59c700 1 -- 172.21.15.69:0/83382763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa510100dd0 msgr2=0x7fa510196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50e59c700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa510100dd0 0x7fa510196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50e59c700 1 -- 172.21.15.69:0/83382763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa510105470 msgr2=0x7fa51019ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50e59c700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa510105470 0x7fa51019ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50e59c700 1 -- 172.21.15.69:0/83382763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80095f0 con 0x7fa510100430 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa50e59c700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 0x7fa510196340 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009990 tx=0x7fa4f8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.559+0000 7fa5077fe700 1 -- 172.21.15.69:0/83382763 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f801d070 con 0x7fa510100430 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.560+0000 7fa5077fe700 1 -- 172.21.15.69:0/83382763 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4f8004010 con 0x7fa510100430 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.560+0000 7fa514bb4700 1 -- 172.21.15.69:0/83382763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa510110230 con 0x7fa510100430 2023-12-14T14:12:42.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.560+0000 7fa5077fe700 1 -- 172.21.15.69:0/83382763 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8022d40 con 0x7fa510100430 2023-12-14T14:12:42.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.560+0000 7fa514bb4700 1 -- 172.21.15.69:0/83382763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5101100a0 con 0x7fa510100430 2023-12-14T14:12:42.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.562+0000 7fa5077fe700 1 -- 172.21.15.69:0/83382763 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa4f8022470 con 0x7fa510100430 2023-12-14T14:12:42.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.562+0000 7fa5077fe700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa4fc0a12c0 0x7fa4fc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.562+0000 7fa5077fe700 1 -- 172.21.15.69:0/83382763 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa4f80ce060 con 0x7fa510100430 2023-12-14T14:12:42.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.562+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa4fc0a12c0 0x7fa4fc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.563+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa4fc0a12c0 0x7fa4fc0a3770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa500005950 tx=0x7fa5000058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:42.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.614+0000 7fa520d42b80 1 Processor -- start 2023-12-14T14:12:42.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.614+0000 7fa520d42b80 1 -- start start 2023-12-14T14:12:42.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.614+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f43c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.614+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f447610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.614+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 0x56130f449f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.614+0000 7fa520d42b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f3265e0 con 0x56130f43c380 2023-12-14T14:12:42.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.614+0000 7fa520d42b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f395870 con 0x56130f447b50 2023-12-14T14:12:42.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.614+0000 7fa520d42b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f38ed00 con 0x56130f43cc90 2023-12-14T14:12:42.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f43c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f43c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54644/0 (socket says 172.21.15.69:54644) 2023-12-14T14:12:42.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50e59c700 1 -- 172.21.15.69:0/2320877543 learned_addr learned my addr 172.21.15.69:0/2320877543 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:42.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50ed9d700 1 --2- 172.21.15.69:0/2320877543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 0x56130f449f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/2320877543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f447610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50e59c700 1 -- 172.21.15.69:0/2320877543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 msgr2=0x56130f447610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:42.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50e59c700 1 --2- 172.21.15.69:0/2320877543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f447610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50e59c700 1 -- 172.21.15.69:0/2320877543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 msgr2=0x56130f449f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:42.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50e59c700 1 --2- 172.21.15.69:0/2320877543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 0x56130f449f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50e59c700 1 -- 172.21.15.69:0/2320877543 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56130f2103b0 con 0x56130f43c380 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa50e59c700 1 --2- 172.21.15.69:0/2320877543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f43c750 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8097700 tx=0x7fa4f8005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cb8d69ac3433fa server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa504ff9700 1 -- 172.21.15.69:0/2320877543 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8004180 con 0x56130f43c380 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa504ff9700 1 -- 172.21.15.69:0/2320877543 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4f809b200 con 0x56130f43c380 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.615+0000 7fa504ff9700 1 -- 172.21.15.69:0/2320877543 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f809a6f0 con 0x56130f43c380 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 -- 172.21.15.69:0/2320877543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 msgr2=0x56130f43c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2320877543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f43c750 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8097700 tx=0x7fa4f8005aa0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 -- 172.21.15.69:0/2320877543 shutdown_connections 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2320877543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 0x56130f449f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2320877543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f43c750 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2320877543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f447610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 -- 172.21.15.69:0/2320877543 >> 172.21.15.69:0/2320877543 conn(0x56130f432ca0 msgr2=0x56130f4387e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 -- 172.21.15.69:0/2320877543 shutdown_connections 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 -- 172.21.15.69:0/2320877543 wait complete. 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.616+0000 7fa520d42b80 1 -- start start 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa520d42b80 1 Processor -- start 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f447f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f448460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 0x56130f4489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa520d42b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f32af90 con 0x56130f43c380 2023-12-14T14:12:42.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa520d42b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f32ac30 con 0x56130f447b50 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa520d42b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f2126a0 con 0x56130f43cc90 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa520d42b80 10 client.0 _ll_register_callbacks cb 0x56130f34e910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f447f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f447f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54652/0 (socket says 172.21.15.69:54652) 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa50e59c700 1 -- 172.21.15.69:0/830896042 learned_addr learned my addr 172.21.15.69:0/830896042 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f448460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa50ed9d700 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 0x56130f4489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.617+0000 7fa50e59c700 1 -- 172.21.15.69:0/830896042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 msgr2=0x56130f448460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa50e59c700 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f448460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa50e59c700 1 -- 172.21.15.69:0/830896042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 msgr2=0x56130f4489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa50e59c700 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 0x56130f4489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa50e59c700 1 -- 172.21.15.69:0/830896042 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5101100a0 con 0x56130f43c380 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa50e59c700 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f447f20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80cbd70 tx=0x7fa4f8022810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427c62d2de879324 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa4f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/830896042 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80a35c0 con 0x56130f43c380 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/830896042 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa4f809f230 con 0x56130f43c380 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa520d42b80 1 -- 172.21.15.69:0/830896042 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56130f4302b0 con 0x56130f43c380 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/830896042 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4f8004180 con 0x56130f43c380 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa520d42b80 10 client.15843 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa520d42b80 1 -- 172.21.15.69:0/830896042 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56130f355170 con 0x56130f43c380 2023-12-14T14:12:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/830896042 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56130f4302b0 con 0x56130f43c380 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/830896042 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa4f80b3b50 con 0x56130f43c380 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa520d42b80 10 client.15843 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa520d42b80 10 client.15843 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa520d42b80 20 client.15843 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa520d42b80 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56130f456c40 0x56130f459020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa520d42b80 4 client.15843 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.618+0000 7fa520d42b80 1 -- 172.21.15.69:0/830896042 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56130f387ce0 con 0x56130f456c40 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.619+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56130f456c40 0x56130f459020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.619+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56130f456c40 0x56130f459020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7fd80727801d134c server_cookie=78f8ef4eda6c5e2b in_seq=0 out_seq=0 2023-12-14T14:12:42.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.619+0000 7fa4f5ffb700 10 client.15843 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/830896042 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56130f387ce0 con 0x56130f456c40 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa4f5ffb700 10 client.15843 handle_command_reply: tid=0 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 client.15843 shutdown 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 -- 172.21.15.69:0/830896042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 msgr2=0x56130f447f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f447f20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80cbd70 tx=0x7fa4f8022810 comp rx=0 tx=0).stop 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 -- 172.21.15.69:0/830896042 shutdown_connections 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f447b50 0x56130f4489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56130f456c40 0x56130f459020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43c380 0x56130f447f20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 --2- 172.21.15.69:0/830896042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f448460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 -- 172.21.15.69:0/830896042 >> 172.21.15.69:0/830896042 conn(0x56130f432ca0 msgr2=0x56130f4383d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa4f5ffb700 0 client.15843 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:12:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 -- 172.21.15.69:0/830896042 shutdown_connections 2023-12-14T14:12:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 1 -- 172.21.15.69:0/830896042 wait complete. 2023-12-14T14:12:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.620+0000 7fa520d42b80 20 client.15843 trim_cache size 0 max 16384 2023-12-14T14:12:42.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.633+0000 7fa520d42b80 1 Processor -- start 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.633+0000 7fa520d42b80 1 -- start start 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 0x56130f4526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43cc90 0x56130f453440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f447b50 0x56130f441e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa520d42b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f43dd30 con 0x56130f43cc90 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa520d42b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f434210 con 0x56130f43c380 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa520d42b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f4343d0 con 0x56130f447b50 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43cc90 0x56130f453440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43cc90 0x56130f453440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54660/0 (socket says 172.21.15.69:54660) 2023-12-14T14:12:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50dd9b700 1 -- 172.21.15.69:0/3705568864 learned_addr learned my addr 172.21.15.69:0/3705568864 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50ed9d700 1 --2- 172.21.15.69:0/3705568864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f447b50 0x56130f441e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50e59c700 1 --2- 172.21.15.69:0/3705568864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 0x56130f4526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50dd9b700 1 -- 172.21.15.69:0/3705568864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f447b50 msgr2=0x56130f441e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/3705568864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f447b50 0x56130f441e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50dd9b700 1 -- 172.21.15.69:0/3705568864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 msgr2=0x56130f4526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/3705568864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 0x56130f4526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50dd9b700 1 -- 172.21.15.69:0/3705568864 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56130f354ec0 con 0x56130f43cc90 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/3705568864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43cc90 0x56130f453440 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa510197950 tx=0x7fa500015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf37cf20d534875 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa5057fa700 1 -- 172.21.15.69:0/3705568864 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500025040 con 0x56130f43cc90 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa5057fa700 1 -- 172.21.15.69:0/3705568864 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa500011b00 con 0x56130f43cc90 2023-12-14T14:12:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.634+0000 7fa5057fa700 1 -- 172.21.15.69:0/3705568864 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50001f430 con 0x56130f43cc90 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 -- 172.21.15.69:0/3705568864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43cc90 msgr2=0x56130f453440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 --2- 172.21.15.69:0/3705568864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43cc90 0x56130f453440 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa510197950 tx=0x7fa500015000 comp rx=0 tx=0).stop 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 -- 172.21.15.69:0/3705568864 shutdown_connections 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 --2- 172.21.15.69:0/3705568864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f447b50 0x56130f441e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 --2- 172.21.15.69:0/3705568864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 0x56130f4526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 --2- 172.21.15.69:0/3705568864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f43cc90 0x56130f453440 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 -- 172.21.15.69:0/3705568864 >> 172.21.15.69:0/3705568864 conn(0x56130f432ca0 msgr2=0x56130f446410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 -- 172.21.15.69:0/3705568864 shutdown_connections 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 -- 172.21.15.69:0/3705568864 wait complete. 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 -- start start 2023-12-14T14:12:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.635+0000 7fa520d42b80 1 Processor -- start 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 0x56130f44a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f44aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa520d42b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f447b50 0x56130f4a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa520d42b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f44b7c0 con 0x56130f447b50 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa520d42b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f4a9fa0 con 0x56130f43c380 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa520d42b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130f4aa0e0 con 0x56130f43cc90 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa520d42b80 10 client.0 _ll_register_callbacks cb 0x56130f34e910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f447b50 0x56130f4a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f447b50 0x56130f4a9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54670/0 (socket says 172.21.15.69:54670) 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50ed9d700 1 -- 172.21.15.69:0/2554548628 learned_addr learned my addr 172.21.15.69:0/2554548628 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f44aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50e59c700 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 0x56130f44a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50ed9d700 1 -- 172.21.15.69:0/2554548628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 msgr2=0x56130f44aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50ed9d700 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f44aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50ed9d700 1 -- 172.21.15.69:0/2554548628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 msgr2=0x56130f44a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50ed9d700 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 0x56130f44a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50ed9d700 1 -- 172.21.15.69:0/2554548628 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50000f950 con 0x56130f447b50 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50dd9b700 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f44aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa4f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.636+0000 7fa50ed9d700 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f447b50 0x56130f4a9a60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa508008e60 tx=0x7fa5080155a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d8df0680d1226a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/2554548628 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508004bb0 con 0x56130f447b50 2023-12-14T14:12:42.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/2554548628 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa508004d10 con 0x56130f447b50 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa520d42b80 1 -- 172.21.15.69:0/2554548628 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4f809b200 con 0x56130f447b50 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/2554548628 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa508015a80 con 0x56130f447b50 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa520d42b80 10 client.15849 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa520d42b80 1 -- 172.21.15.69:0/2554548628 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56130f33b9a0 con 0x56130f447b50 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/2554548628 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4f809b200 con 0x56130f447b50 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/2554548628 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa508018bd0 con 0x56130f447b50 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa520d42b80 10 client.15849 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa520d42b80 10 client.15849 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa520d42b80 20 client.15849 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56130f4ab850 0x56130f4adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa520d42b80 4 client.15849 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa520d42b80 1 -- 172.21.15.69:0/2554548628 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56130f387a00 con 0x56130f4ab850 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.637+0000 7fa50e59c700 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56130f4ab850 0x56130f4adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa50e59c700 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56130f4ab850 0x56130f4adc60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f1c9176fcb2428d server_cookie=d68985ba633283f6 in_seq=0 out_seq=0 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa4f5ffb700 10 client.15849 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa4f5ffb700 1 -- 172.21.15.69:0/2554548628 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56130f387a00 con 0x56130f4ab850 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa4f5ffb700 10 client.15849 handle_command_reply: tid=0 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 client.15849 shutdown 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 -- 172.21.15.69:0/2554548628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f447b50 msgr2=0x56130f4a9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f447b50 0x56130f4a9a60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa508008e60 tx=0x7fa5080155a0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 -- 172.21.15.69:0/2554548628 shutdown_connections 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56130f4ab850 0x56130f4adc60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56130f447b50 0x56130f4a9a60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56130f43c380 0x56130f44a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 --2- 172.21.15.69:0/2554548628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56130f43cc90 0x56130f44aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 -- 172.21.15.69:0/2554548628 >> 172.21.15.69:0/2554548628 conn(0x56130f432ca0 msgr2=0x56130f453440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa4f5ffb700 0 client.15849 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:12:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 -- 172.21.15.69:0/2554548628 shutdown_connections 2023-12-14T14:12:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 1 -- 172.21.15.69:0/2554548628 wait complete. 2023-12-14T14:12:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.638+0000 7fa520d42b80 20 client.15849 trim_cache size 0 max 16384 2023-12-14T14:12:42.648 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:12:42.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 -- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa4fc0a12c0 msgr2=0x7fa4fc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:42.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa4fc0a12c0 0x7fa4fc0a3770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa500005950 tx=0x7fa5000058e0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 -- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 msgr2=0x7fa510196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 0x7fa510196340 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009990 tx=0x7fa4f8009580 comp rx=0 tx=0).stop 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 -- 172.21.15.69:0/83382763 shutdown_connections 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa4fc0a12c0 0x7fa4fc0a3770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa510105470 0x7fa51019ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa510100430 0x7fa510196340 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 --2- 172.21.15.69:0/83382763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa510100dd0 0x7fa510196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 -- 172.21.15.69:0/83382763 >> 172.21.15.69:0/83382763 conn(0x7fa5100fbca0 msgr2=0x7fa5100fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 -- 172.21.15.69:0/83382763 shutdown_connections 2023-12-14T14:12:42.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:42.639+0000 7fa514bb4700 1 -- 172.21.15.69:0/83382763 wait complete. 2023-12-14T14:12:42.693 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:12:43.152 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:43.153 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:43.325 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:43.325 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:43.332 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:43.332 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:43.332 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 74 -lt 100 ']' 2023-12-14T14:12:43.332 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 74 + 1 2023-12-14T14:12:43.359 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=75 2023-12-14T14:12:43.359 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:43.378 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:43.378 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:43.379 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:43.379 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:43.379 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:43.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:43 smithi069 ceph-mon[42034]: pgmap v65: 97 pgs: 97 active+clean; 2.3 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-12-14T14:12:43.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:43 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:12:43.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:43 smithi119 ceph-mon[43834]: pgmap v65: 97 pgs: 97 active+clean; 2.3 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-12-14T14:12:43.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:43 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:12:43.861 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:43.861 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:43 smithi081 ceph-mon[43371]: pgmap v65: 97 pgs: 97 active+clean; 2.3 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-12-14T14:12:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:43 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:12:43.960 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:43.960 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:43.969 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:43.970 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:43.970 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 75 -lt 100 ']' 2023-12-14T14:12:43.970 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 75 + 1 2023-12-14T14:12:44.017 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=76 2023-12-14T14:12:44.017 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:44.052 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:44.052 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:44.053 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:44.053 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:44.053 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:44.777 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:44.777 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:45.069 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:45.069 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:45.111 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:45.111 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:45.111 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 76 -lt 100 ']' 2023-12-14T14:12:45.111 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 76 + 1 2023-12-14T14:12:45.141 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=77 2023-12-14T14:12:45.141 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:45.178 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:45.178 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:45.178 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:45.179 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:45.179 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:45.680 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:45 smithi069 ceph-mon[42034]: pgmap v66: 97 pgs: 97 active+clean; 2.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 11 op/s 2023-12-14T14:12:45.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:45 smithi119 ceph-mon[43834]: pgmap v66: 97 pgs: 97 active+clean; 2.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 11 op/s 2023-12-14T14:12:45.868 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:45.869 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:45 smithi081 ceph-mon[43371]: pgmap v66: 97 pgs: 97 active+clean; 2.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 11 op/s 2023-12-14T14:12:46.211 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:46.211 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:46.228 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:46.228 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:46.228 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 77 -lt 100 ']' 2023-12-14T14:12:46.228 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 77 + 1 2023-12-14T14:12:46.266 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=78 2023-12-14T14:12:46.267 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:46.393 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:46.393 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:46.394 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:46.394 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:46.394 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:46.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.459+0000 7fa81ad1a700 1 -- 172.21.15.69:0/475388465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814104d70 msgr2=0x7fa81410b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:46.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.459+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/475388465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814104d70 0x7fa81410b750 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00b0d0 tx=0x7fa80c00b3e0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.459+0000 7fa81ad1a700 1 -- 172.21.15.69:0/475388465 shutdown_connections 2023-12-14T14:12:46.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.459+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/475388465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814104d70 0x7fa81410b750 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.459+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/475388465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8140ff6e0 0x7fa8140ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.459+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/475388465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa814100080 0x7fa814104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.459+0000 7fa81ad1a700 1 -- 172.21.15.69:0/475388465 >> 172.21.15.69:0/475388465 conn(0x7fa814074a60 msgr2=0x7fa814074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:46.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.459+0000 7fa81ad1a700 1 -- 172.21.15.69:0/475388465 shutdown_connections 2023-12-14T14:12:46.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.459+0000 7fa81ad1a700 1 -- 172.21.15.69:0/475388465 wait complete. 2023-12-14T14:12:46.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa81ad1a700 1 Processor -- start 2023-12-14T14:12:46.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa81ad1a700 1 -- start start 2023-12-14T14:12:46.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa81ad1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8140ff6e0 0x7fa8141942a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa81ad1a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814100080 0x7fa8141947e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa81ad1a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa814104d70 0x7fa814198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa81ad1a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814199280 con 0x7fa814100080 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa81ad1a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8141993f0 con 0x7fa8140ff6e0 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa81ad1a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8141995b0 con 0x7fa814104d70 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa813fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814100080 0x7fa8141947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa813fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814100080 0x7fa8141947e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43422/0 (socket says 172.21.15.69:43422) 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa813fff700 1 -- 172.21.15.69:0/4011476541 learned_addr learned my addr 172.21.15.69:0/4011476541 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa818ab6700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8140ff6e0 0x7fa8141942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa8192b7700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa814104d70 0x7fa814198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa813fff700 1 -- 172.21.15.69:0/4011476541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa814104d70 msgr2=0x7fa814198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa813fff700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa814104d70 0x7fa814198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa813fff700 1 -- 172.21.15.69:0/4011476541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8140ff6e0 msgr2=0x7fa8141942a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa813fff700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8140ff6e0 0x7fa8141942a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa813fff700 1 -- 172.21.15.69:0/4011476541 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c009d00 con 0x7fa814100080 2023-12-14T14:12:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.460+0000 7fa813fff700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814100080 0x7fa8141947e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa80400fe40 tx=0x7fa80400d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.461+0000 7fa811ffb700 1 -- 172.21.15.69:0/4011476541 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804004a30 con 0x7fa814100080 2023-12-14T14:12:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.461+0000 7fa811ffb700 1 -- 172.21.15.69:0/4011476541 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8040054e0 con 0x7fa814100080 2023-12-14T14:12:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.461+0000 7fa81ad1a700 1 -- 172.21.15.69:0/4011476541 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81410e170 con 0x7fa814100080 2023-12-14T14:12:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.461+0000 7fa811ffb700 1 -- 172.21.15.69:0/4011476541 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804017720 con 0x7fa814100080 2023-12-14T14:12:46.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.461+0000 7fa81ad1a700 1 -- 172.21.15.69:0/4011476541 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81410dfe0 con 0x7fa814100080 2023-12-14T14:12:46.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.463+0000 7fa811ffb700 1 -- 172.21.15.69:0/4011476541 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa804005000 con 0x7fa814100080 2023-12-14T14:12:46.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.463+0000 7fa811ffb700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa8000a12c0 0x7fa8000a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.463+0000 7fa811ffb700 1 -- 172.21.15.69:0/4011476541 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa8040ce000 con 0x7fa814100080 2023-12-14T14:12:46.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.464+0000 7fa818ab6700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa8000a12c0 0x7fa8000a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.464+0000 7fa818ab6700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa8000a12c0 0x7fa8000a3770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc005950 tx=0x7fa7fc0058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:46.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.789+0000 7fa826ea8b80 1 Processor -- start 2023-12-14T14:12:46.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.789+0000 7fa826ea8b80 1 -- start start 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.789+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 0x55ee791e4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.789+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ef820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.789+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee791f2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee790cc5e0 con 0x55ee791efd60 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7913b870 con 0x55ee791e4590 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee79134d00 con 0x55ee791e4ea0 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa8192b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee791f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa8192b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee791f2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43438/0 (socket says 172.21.15.69:43438) 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa8192b7700 1 -- 172.21.15.69:0/1489210833 learned_addr learned my addr 172.21.15.69:0/1489210833 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:46.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa818ab6700 1 --2- 172.21.15.69:0/1489210833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 0x55ee791e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa813fff700 1 --2- 172.21.15.69:0/1489210833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa8192b7700 1 -- 172.21.15.69:0/1489210833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 msgr2=0x55ee791ef820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa8192b7700 1 --2- 172.21.15.69:0/1489210833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ef820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa8192b7700 1 -- 172.21.15.69:0/1489210833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 msgr2=0x55ee791e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa8192b7700 1 --2- 172.21.15.69:0/1489210833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 0x55ee791e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa8192b7700 1 -- 172.21.15.69:0/1489210833 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee78fb63b0 con 0x55ee791efd60 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa8192b7700 1 --2- 172.21.15.69:0/1489210833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee791f2140 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009c50 tx=0x7fa80c009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ed4b1ab2099b8b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa80affd700 1 -- 172.21.15.69:0/1489210833 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00e040 con 0x55ee791efd60 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa80affd700 1 -- 172.21.15.69:0/1489210833 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa80c009490 con 0x55ee791efd60 2023-12-14T14:12:46.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.790+0000 7fa80affd700 1 -- 172.21.15.69:0/1489210833 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c01c6a0 con 0x55ee791efd60 2023-12-14T14:12:46.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.791+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1489210833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 msgr2=0x55ee791f2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:46.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.791+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1489210833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee791f2140 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009c50 tx=0x7fa80c009c80 comp rx=0 tx=0).stop 2023-12-14T14:12:46.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.791+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1489210833 shutdown_connections 2023-12-14T14:12:46.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.791+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1489210833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee791f2140 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.791+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1489210833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 0x55ee791e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.791+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1489210833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.791+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1489210833 >> 172.21.15.69:0/1489210833 conn(0x55ee791d8ca0 msgr2=0x55ee791de730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:46.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.791+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1489210833 shutdown_connections 2023-12-14T14:12:46.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.791+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1489210833 wait complete. 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.792+0000 7fa826ea8b80 1 -- start start 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.792+0000 7fa826ea8b80 1 Processor -- start 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.792+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.792+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ec960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.792+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 0x55ee791ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.792+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee790d0f90 con 0x55ee791e4590 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.792+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee790d0c30 con 0x55ee791efd60 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.792+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee78fb86a0 con 0x55ee791e4ea0 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa826ea8b80 10 client.0 _ll_register_callbacks cb 0x55ee790f4910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:46.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa818ab6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa818ab6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791ef5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43448/0 (socket says 172.21.15.69:43448) 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa818ab6700 1 -- 172.21.15.69:0/1089358777 learned_addr learned my addr 172.21.15.69:0/1089358777 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa813fff700 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa818ab6700 1 -- 172.21.15.69:0/1089358777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 msgr2=0x55ee791ec960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa818ab6700 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ec960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa8192b7700 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 0x55ee791ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa818ab6700 1 -- 172.21.15.69:0/1089358777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 msgr2=0x55ee791ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa818ab6700 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 0x55ee791ecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa818ab6700 1 -- 172.21.15.69:0/1089358777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81410bf90 con 0x55ee791e4590 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa8192b7700 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 0x55ee791ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:12:46.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa818ab6700 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791ef5d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc010000 tx=0x7fa7fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96797a61a8ed500 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa7f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa7f3fff700 1 -- 172.21.15.69:0/1089358777 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc028670 con 0x55ee791e4590 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa7f3fff700 1 -- 172.21.15.69:0/1089358777 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa7fc01f430 con 0x55ee791e4590 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1089358777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee791d62b0 con 0x55ee791e4590 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa7f3fff700 1 -- 172.21.15.69:0/1089358777 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7fc011e70 con 0x55ee791e4590 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa826ea8b80 10 client.15861 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.793+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1089358777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ee790fb170 con 0x55ee791e4590 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.794+0000 7fa7f3fff700 1 -- 172.21.15.69:0/1089358777 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee791d62b0 con 0x55ee791e4590 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.794+0000 7fa7f3fff700 1 -- 172.21.15.69:0/1089358777 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa7fc01fb40 con 0x55ee791e4590 2023-12-14T14:12:46.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.794+0000 7fa826ea8b80 10 client.15861 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.794+0000 7fa826ea8b80 10 client.15861 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.794+0000 7fa826ea8b80 20 client.15861 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.794+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ee791ff4f0 0x55ee79201900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.794+0000 7fa826ea8b80 4 client.15861 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.794+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1089358777 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee7912dce0 con 0x55ee791ff4f0 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.794+0000 7fa813fff700 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ee791ff4f0 0x55ee79201900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa7f3fff700 10 client.15861 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa813fff700 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ee791ff4f0 0x55ee79201900 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=23633bd7024ef8bf server_cookie=f50552888cc9826c in_seq=0 out_seq=0 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa7f3fff700 1 -- 172.21.15.69:0/1089358777 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ee7912dce0 con 0x55ee791ff4f0 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa7f3fff700 10 client.15861 handle_command_reply: tid=0 2023-12-14T14:12:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa826ea8b80 1 client.15861 shutdown 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1089358777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 msgr2=0x55ee791ef5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791ef5d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc010000 tx=0x7fa7fc004750 comp rx=0 tx=0).stop 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1089358777 shutdown_connections 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 0x55ee791ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.795+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ee791ff4f0 0x55ee79201900 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.796+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791ef5d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.796+0000 7fa7f3fff700 0 client.15861 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.796+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/1089358777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.796+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1089358777 >> 172.21.15.69:0/1089358777 conn(0x55ee791d8ca0 msgr2=0x55ee791de320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.796+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1089358777 shutdown_connections 2023-12-14T14:12:46.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.796+0000 7fa826ea8b80 1 -- 172.21.15.69:0/1089358777 wait complete. 2023-12-14T14:12:46.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.796+0000 7fa826ea8b80 20 client.15861 trim_cache size 0 max 16384 2023-12-14T14:12:46.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa826ea8b80 1 Processor -- start 2023-12-14T14:12:46.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa826ea8b80 1 -- start start 2023-12-14T14:12:46.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ef100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 0x55ee791e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee791d5e80 con 0x55ee791e4590 2023-12-14T14:12:46.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee791e85d0 con 0x55ee791efd60 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee791e87d0 con 0x55ee791e4ea0 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa818ab6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa818ab6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43450/0 (socket says 172.21.15.69:43450) 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa818ab6700 1 -- 172.21.15.69:0/230757508 learned_addr learned my addr 172.21.15.69:0/230757508 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa813fff700 1 --2- 172.21.15.69:0/230757508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa8192b7700 1 --2- 172.21.15.69:0/230757508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 0x55ee791e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa818ab6700 1 -- 172.21.15.69:0/230757508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 msgr2=0x55ee791ef100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa818ab6700 1 --2- 172.21.15.69:0/230757508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ef100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa818ab6700 1 -- 172.21.15.69:0/230757508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 msgr2=0x55ee791e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:46.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa818ab6700 1 --2- 172.21.15.69:0/230757508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 0x55ee791e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.809+0000 7fa818ab6700 1 -- 172.21.15.69:0/230757508 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee790faec0 con 0x55ee791e4590 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.810+0000 7fa818ab6700 1 --2- 172.21.15.69:0/230757508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791f67e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc014040 tx=0x7fa7fc00f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecad451b9476d15b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.810+0000 7fa80b7fe700 1 -- 172.21.15.69:0/230757508 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc011e70 con 0x55ee791e4590 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.810+0000 7fa80b7fe700 1 -- 172.21.15.69:0/230757508 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7fc0103d0 con 0x55ee791e4590 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.810+0000 7fa80b7fe700 1 -- 172.21.15.69:0/230757508 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc01f850 con 0x55ee791e4590 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.810+0000 7fa826ea8b80 1 -- 172.21.15.69:0/230757508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 msgr2=0x55ee791f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.810+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/230757508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791f67e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc014040 tx=0x7fa7fc00f960 comp rx=0 tx=0).stop 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 -- 172.21.15.69:0/230757508 shutdown_connections 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/230757508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791efd60 0x55ee791e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/230757508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791e4590 0x55ee791f67e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/230757508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee791ef100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 -- 172.21.15.69:0/230757508 >> 172.21.15.69:0/230757508 conn(0x55ee791d8ca0 msgr2=0x55ee791de210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 -- 172.21.15.69:0/230757508 shutdown_connections 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 -- 172.21.15.69:0/230757508 wait complete. 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 -- start start 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 Processor -- start 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 0x55ee7924b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee7924bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee79247340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee79247940 con 0x55ee791efd60 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee79247ab0 con 0x55ee791e4590 2023-12-14T14:12:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee79247c70 con 0x55ee791e4ea0 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.811+0000 7fa826ea8b80 10 client.0 _ll_register_callbacks cb 0x55ee790f4910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa813fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee7924bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa8192b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee79247340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa813fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee7924bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:47890/0 (socket says 172.21.15.69:47890) 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa8192b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee79247340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43454/0 (socket says 172.21.15.69:43454) 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa813fff700 1 -- 172.21.15.69:0/264790009 learned_addr learned my addr 172.21.15.69:0/264790009 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa818ab6700 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 0x55ee7924b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa8192b7700 1 -- 172.21.15.69:0/264790009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 msgr2=0x55ee7924bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa8192b7700 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee7924bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa8192b7700 1 -- 172.21.15.69:0/264790009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 msgr2=0x55ee7924b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa8192b7700 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 0x55ee7924b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa8192b7700 1 -- 172.21.15.69:0/264790009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee790fb170 con 0x55ee791efd60 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa8192b7700 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee79247340 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00b0d0 tx=0x7fa80c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cf96caf22d2962 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa7f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa7f3fff700 1 -- 172.21.15.69:0/264790009 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00e040 con 0x55ee791efd60 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa7f3fff700 1 -- 172.21.15.69:0/264790009 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fa80c025450 con 0x55ee791efd60 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa826ea8b80 1 -- 172.21.15.69:0/264790009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa80c009490 con 0x55ee791efd60 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa7f3fff700 1 -- 172.21.15.69:0/264790009 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa80c00be80 con 0x55ee791efd60 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa826ea8b80 10 client.15867 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.812+0000 7fa826ea8b80 1 -- 172.21.15.69:0/264790009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ee790e19a0 con 0x55ee791efd60 2023-12-14T14:12:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.813+0000 7fa7f3fff700 1 -- 172.21.15.69:0/264790009 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa80c009490 con 0x55ee791efd60 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.813+0000 7fa7f3fff700 1 -- 172.21.15.69:0/264790009 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa80c019030 con 0x55ee791efd60 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.813+0000 7fa826ea8b80 10 client.15867 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.813+0000 7fa826ea8b80 10 client.15867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.813+0000 7fa826ea8b80 20 client.15867 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.813+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ee792542e0 0x55ee792566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.813+0000 7fa826ea8b80 4 client.15867 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.813+0000 7fa826ea8b80 1 -- 172.21.15.69:0/264790009 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ee7912da00 con 0x55ee792542e0 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.813+0000 7fa818ab6700 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ee792542e0 0x55ee792566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa7f3fff700 10 client.15867 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa818ab6700 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ee792542e0 0x55ee792566f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6be5825da20f3e8 server_cookie=819ff8c0548a7801 in_seq=0 out_seq=0 2023-12-14T14:12:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa7f3fff700 1 -- 172.21.15.69:0/264790009 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ee7912da00 con 0x55ee792542e0 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa7f3fff700 10 client.15867 handle_command_reply: tid=0 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 client.15867 shutdown 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 -- 172.21.15.69:0/264790009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 msgr2=0x55ee79247340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee79247340 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00b0d0 tx=0x7fa80c0099e0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 -- 172.21.15.69:0/264790009 shutdown_connections 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ee792542e0 0x55ee792566f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee791efd60 0x55ee79247340 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa7f3fff700 0 client.15867 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee791e4590 0x55ee7924b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 --2- 172.21.15.69:0/264790009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee791e4ea0 0x55ee7924bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 -- 172.21.15.69:0/264790009 >> 172.21.15.69:0/264790009 conn(0x55ee791d8ca0 msgr2=0x55ee791faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:46.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 -- 172.21.15.69:0/264790009 shutdown_connections 2023-12-14T14:12:46.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 1 -- 172.21.15.69:0/264790009 wait complete. 2023-12-14T14:12:46.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.814+0000 7fa826ea8b80 20 client.15867 trim_cache size 0 max 16384 2023-12-14T14:12:46.823 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:12:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 -- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa8000a12c0 msgr2=0x7fa8000a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa8000a12c0 0x7fa8000a3770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc005950 tx=0x7fa7fc0058e0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 -- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814100080 msgr2=0x7fa8141947e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814100080 0x7fa8141947e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa80400fe40 tx=0x7fa80400d6c0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 -- 172.21.15.69:0/4011476541 shutdown_connections 2023-12-14T14:12:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa8000a12c0 0x7fa8000a3770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa814104d70 0x7fa814198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8140ff6e0 0x7fa8141942a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 --2- 172.21.15.69:0/4011476541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa814100080 0x7fa8141947e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:46.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 -- 172.21.15.69:0/4011476541 >> 172.21.15.69:0/4011476541 conn(0x7fa814074a60 msgr2=0x7fa8140fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:46.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 -- 172.21.15.69:0/4011476541 shutdown_connections 2023-12-14T14:12:46.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:46.815+0000 7fa81ad1a700 1 -- 172.21.15.69:0/4011476541 wait complete. 2023-12-14T14:12:46.918 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:12:47.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:47 smithi069 ceph-mon[42034]: pgmap v67: 97 pgs: 97 active+clean; 2.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-12-14T14:12:47.610 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:47.610 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:47.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:47 smithi081 ceph-mon[43371]: pgmap v67: 97 pgs: 97 active+clean; 2.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-12-14T14:12:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:47 smithi119 ceph-mon[43834]: pgmap v67: 97 pgs: 97 active+clean; 2.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-12-14T14:12:47.849 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:47.849 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:47.859 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:47.859 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:47.859 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 78 -lt 100 ']' 2023-12-14T14:12:47.860 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 78 + 1 2023-12-14T14:12:47.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=79 2023-12-14T14:12:47.920 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:48.002 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:48.003 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:48.004 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:48.004 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:48.004 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:48.660 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:48.660 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:48.755 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:48.755 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:48.775 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:48.775 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:48.775 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 79 -lt 100 ']' 2023-12-14T14:12:48.775 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 79 + 1 2023-12-14T14:12:48.816 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=80 2023-12-14T14:12:48.816 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:48.844 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:48.844 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:48.845 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:48.845 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:48.845 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:49.435 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:49.435 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:49.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:49 smithi069 ceph-mon[42034]: pgmap v68: 97 pgs: 97 active+clean; 2.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-12-14T14:12:49.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:49 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:12:49.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:49 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:12:49.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:49 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:12:49.627 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:49.627 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:49.651 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:49.651 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:49.651 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 80 -lt 100 ']' 2023-12-14T14:12:49.651 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 80 + 1 2023-12-14T14:12:49.682 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=81 2023-12-14T14:12:49.682 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:49.733 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:49.734 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:49.734 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:49.734 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:49.735 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:49 smithi119 ceph-mon[43834]: pgmap v68: 97 pgs: 97 active+clean; 2.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-12-14T14:12:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:49 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:12:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:49 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:12:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:49 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:12:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:49 smithi081 ceph-mon[43371]: pgmap v68: 97 pgs: 97 active+clean; 2.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-12-14T14:12:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:49 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:12:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:49 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:12:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:49 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:12:50.493 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:50.494 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:50.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:50 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:12:50.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:50 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:12:50.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:50 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:12:50.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:50 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:12:50.726 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:50.726 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:50.734 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:50.734 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:50.734 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 81 -lt 100 ']' 2023-12-14T14:12:50.734 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 81 + 1 2023-12-14T14:12:50.774 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=82 2023-12-14T14:12:50.774 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:50.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:50 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:12:50.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:50 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:12:50.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:50 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:12:50.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:50 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:12:50.834 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:50.834 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:50.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:50.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:50.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:50.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:50 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:12:50.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:50 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:12:50.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:50 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:12:50.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:50 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:12:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 -- 172.21.15.69:0/908557388 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e240679f0 msgr2=0x7f2e240ff470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 --2- 172.21.15.69:0/908557388 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e240679f0 0x7f2e240ff470 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009990 tx=0x7f2e18009ca0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 -- 172.21.15.69:0/908557388 shutdown_connections 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 --2- 172.21.15.69:0/908557388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2410a880 0x7f2e2410cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 --2- 172.21.15.69:0/908557388 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e240679f0 0x7f2e240ff470 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 --2- 172.21.15.69:0/908557388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e240ff9b0 0x7f2e240ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 -- 172.21.15.69:0/908557388 >> 172.21.15.69:0/908557388 conn(0x7f2e24074a60 msgr2=0x7f2e24074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 -- 172.21.15.69:0/908557388 shutdown_connections 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 -- 172.21.15.69:0/908557388 wait complete. 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.132+0000 7f2e292b2700 1 Processor -- start 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e292b2700 1 -- start start 2023-12-14T14:12:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e292b2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e240ff9b0 0x7f2e24196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e292b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2410a880 0x7f2e24196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e292b2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e2419acb0 0x7f2e2419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e292b2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2419b720 con 0x7f2e2419acb0 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e292b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2419b890 con 0x7f2e2410a880 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e292b2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2419ba50 con 0x7f2e240ff9b0 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e237fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e2419acb0 0x7f2e2419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e237fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e2419acb0 0x7f2e2419b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43484/0 (socket says 172.21.15.69:43484) 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e237fe700 1 -- 172.21.15.69:0/818636167 learned_addr learned my addr 172.21.15.69:0/818636167 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e227fc700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2410a880 0x7f2e24196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e240ff9b0 0x7f2e24196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e237fe700 1 -- 172.21.15.69:0/818636167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e240ff9b0 msgr2=0x7f2e24196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e237fe700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e240ff9b0 0x7f2e24196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e237fe700 1 -- 172.21.15.69:0/818636167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2410a880 msgr2=0x7f2e24196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e237fe700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2410a880 0x7f2e24196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.133+0000 7f2e237fe700 1 -- 172.21.15.69:0/818636167 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180095f0 con 0x7f2e2419acb0 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.134+0000 7f2e237fe700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e2419acb0 0x7f2e2419b120 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00ada0 tx=0x7f2e1c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.134+0000 7f2e0bfff700 1 -- 172.21.15.69:0/818636167 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00f070 con 0x7f2e2419acb0 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.134+0000 7f2e0bfff700 1 -- 172.21.15.69:0/818636167 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e1c007b00 con 0x7f2e2419acb0 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.134+0000 7f2e292b2700 1 -- 172.21.15.69:0/818636167 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24110290 con 0x7f2e2419acb0 2023-12-14T14:12:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.134+0000 7f2e0bfff700 1 -- 172.21.15.69:0/818636167 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0053a0 con 0x7f2e2419acb0 2023-12-14T14:12:51.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.134+0000 7f2e292b2700 1 -- 172.21.15.69:0/818636167 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e24110100 con 0x7f2e2419acb0 2023-12-14T14:12:51.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.136+0000 7f2e0bfff700 1 -- 172.21.15.69:0/818636167 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2e1c00c980 con 0x7f2e2419acb0 2023-12-14T14:12:51.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.136+0000 7f2e0bfff700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e0c0a12c0 0x7f2e0c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.136+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e0c0a12c0 0x7f2e0c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.136+0000 7f2e0bfff700 1 -- 172.21.15.69:0/818636167 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f2e1c0cc250 con 0x7f2e2419acb0 2023-12-14T14:12:51.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.137+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e0c0a12c0 0x7f2e0c0a3770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e18006010 tx=0x7f2e1800b540 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e35440b80 1 Processor -- start 2023-12-14T14:12:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e35440b80 1 -- start start 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 0x55816e7c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 0x55816e7d6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e35440b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e6b35e0 con 0x55816e7c9c90 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e35440b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e722870 con 0x55816e7c9380 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e35440b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e71bd00 con 0x55816e7d4b50 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e227fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e227fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43500/0 (socket says 172.21.15.69:43500) 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e227fc700 1 -- 172.21.15.69:0/2805862874 learned_addr learned my addr 172.21.15.69:0/2805862874 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e237fe700 1 --2- 172.21.15.69:0/2805862874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 0x55816e7d6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e227fc700 1 -- 172.21.15.69:0/2805862874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 msgr2=0x55816e7d6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e227fc700 1 --2- 172.21.15.69:0/2805862874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 0x55816e7d6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/2805862874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 0x55816e7c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e227fc700 1 -- 172.21.15.69:0/2805862874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 msgr2=0x55816e7c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e227fc700 1 --2- 172.21.15.69:0/2805862874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 0x55816e7c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.197+0000 7f2e227fc700 1 -- 172.21.15.69:0/2805862874 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55816e59d3b0 con 0x55816e7c9c90 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e227fc700 1 --2- 172.21.15.69:0/2805862874 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d4610 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400bd30 tx=0x7f2e140106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a28e399dc4bf1c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e097fa700 1 -- 172.21.15.69:0/2805862874 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14010ec0 con 0x55816e7c9c90 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e097fa700 1 -- 172.21.15.69:0/2805862874 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e14015070 con 0x55816e7c9c90 2023-12-14T14:12:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e097fa700 1 -- 172.21.15.69:0/2805862874 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14003ea0 con 0x55816e7c9c90 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e35440b80 1 -- 172.21.15.69:0/2805862874 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 msgr2=0x55816e7d4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2805862874 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d4610 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400bd30 tx=0x7f2e140106b0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e35440b80 1 -- 172.21.15.69:0/2805862874 shutdown_connections 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2805862874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 0x55816e7d6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2805862874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 0x55816e7c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2805862874 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d4610 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e35440b80 1 -- 172.21.15.69:0/2805862874 >> 172.21.15.69:0/2805862874 conn(0x55816e7bfca0 msgr2=0x55816e7c57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e35440b80 1 -- 172.21.15.69:0/2805862874 shutdown_connections 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.198+0000 7f2e35440b80 1 -- 172.21.15.69:0/2805862874 wait complete. 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e35440b80 1 -- start start 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e35440b80 1 Processor -- start 2023-12-14T14:12:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9380 0x55816e7d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9c90 0x55816e7d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 0x55816e7d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e35440b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e6b7f90 con 0x55816e7c9380 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e35440b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e6b7c30 con 0x55816e7c9c90 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e35440b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e59f6a0 con 0x55816e7d4b50 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e35440b80 10 client.0 _ll_register_callbacks cb 0x55816e6db910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e22ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9380 0x55816e7d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e22ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9380 0x55816e7d44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43512/0 (socket says 172.21.15.69:43512) 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e22ffd700 1 -- 172.21.15.69:0/2932125668 learned_addr learned my addr 172.21.15.69:0/2932125668 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e237fe700 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 0x55816e7d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.199+0000 7f2e227fc700 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9c90 0x55816e7d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e22ffd700 1 -- 172.21.15.69:0/2932125668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 msgr2=0x55816e7d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 0x55816e7d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e22ffd700 1 -- 172.21.15.69:0/2932125668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9c90 msgr2=0x55816e7d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9c90 0x55816e7d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e22ffd700 1 -- 172.21.15.69:0/2932125668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1400b960 con 0x55816e7c9380 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e227fc700 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9c90 0x55816e7d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9380 0x55816e7d44f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2e18003710 tx=0x7f2e18009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd455e8f358d79d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e06ff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e06ff5700 1 -- 172.21.15.69:0/2932125668 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1802f640 con 0x55816e7c9380 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e06ff5700 1 -- 172.21.15.69:0/2932125668 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f2e1802f7a0 con 0x55816e7c9380 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e35440b80 1 -- 172.21.15.69:0/2932125668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55816e7bd2b0 con 0x55816e7c9380 2023-12-14T14:12:51.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e06ff5700 1 -- 172.21.15.69:0/2932125668 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e1802f960 con 0x55816e7c9380 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e35440b80 10 client.15879 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e35440b80 1 -- 172.21.15.69:0/2932125668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55816e6e2170 con 0x55816e7c9380 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e06ff5700 1 -- 172.21.15.69:0/2932125668 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55816e7bd2b0 con 0x55816e7c9380 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e06ff5700 1 -- 172.21.15.69:0/2932125668 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2e18024c50 con 0x55816e7c9380 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.200+0000 7f2e35440b80 10 client.15879 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.201+0000 7f2e35440b80 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.201+0000 7f2e35440b80 20 client.15879 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.201+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55816e7e4540 0x55816e7e6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.201+0000 7f2e35440b80 4 client.15879 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.201+0000 7f2e35440b80 1 -- 172.21.15.69:0/2932125668 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55816e714ce0 con 0x55816e7e4540 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.201+0000 7f2e227fc700 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55816e7e4540 0x55816e7e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.201+0000 7f2e227fc700 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55816e7e4540 0x55816e7e6950 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3922e3ed5eb9ee1 server_cookie=9012ba053a9cb3c5 in_seq=0 out_seq=0 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.201+0000 7f2e06ff5700 10 client.15879 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e06ff5700 1 -- 172.21.15.69:0/2932125668 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55816e714ce0 con 0x55816e7e4540 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e06ff5700 10 client.15879 handle_command_reply: tid=0 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 client.15879 shutdown 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 -- 172.21.15.69:0/2932125668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9380 msgr2=0x55816e7d44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9380 0x55816e7d44f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2e18003710 tx=0x7f2e18009ca0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 -- 172.21.15.69:0/2932125668 shutdown_connections 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55816e7e4540 0x55816e7e6950 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7d4b50 0x55816e7d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9380 0x55816e7d44f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e06ff5700 0 client.15879 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2932125668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9c90 0x55816e7d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 -- 172.21.15.69:0/2932125668 >> 172.21.15.69:0/2932125668 conn(0x55816e7bfca0 msgr2=0x55816e7c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 -- 172.21.15.69:0/2932125668 shutdown_connections 2023-12-14T14:12:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 1 -- 172.21.15.69:0/2932125668 wait complete. 2023-12-14T14:12:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.202+0000 7f2e35440b80 20 client.15879 trim_cache size 0 max 16384 2023-12-14T14:12:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e35440b80 1 Processor -- start 2023-12-14T14:12:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e35440b80 1 -- start start 2023-12-14T14:12:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7bfca0 0x55816e7d4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 0x55816e7d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e35440b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e7c70e0 con 0x55816e7c9c90 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e35440b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e7cfd70 con 0x55816e7c9380 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e35440b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e7cd660 con 0x55816e7bfca0 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e237fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e237fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43518/0 (socket says 172.21.15.69:43518) 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e237fe700 1 -- 172.21.15.69:0/2201668222 learned_addr learned my addr 172.21.15.69:0/2201668222 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7bfca0 0x55816e7d4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e227fc700 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 0x55816e7d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e237fe700 1 -- 172.21.15.69:0/2201668222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7bfca0 msgr2=0x55816e7d4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e237fe700 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7bfca0 0x55816e7d4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e237fe700 1 -- 172.21.15.69:0/2201668222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 msgr2=0x55816e7d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e237fe700 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 0x55816e7d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e237fe700 1 -- 172.21.15.69:0/2201668222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55816e6e1ec0 con 0x55816e7c9c90 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.216+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7bfca0 0x55816e7d4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e237fe700 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d1510 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0060b0 tx=0x7f2e1c095730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743c4913f2d41b41 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e09ffb700 1 -- 172.21.15.69:0/2201668222 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0cb040 con 0x55816e7c9c90 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e09ffb700 1 -- 172.21.15.69:0/2201668222 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e1c0192b0 con 0x55816e7c9c90 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e09ffb700 1 -- 172.21.15.69:0/2201668222 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c095b00 con 0x55816e7c9c90 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e35440b80 1 -- 172.21.15.69:0/2201668222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 msgr2=0x55816e7d1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d1510 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0060b0 tx=0x7f2e1c095730 comp rx=0 tx=0).stop 2023-12-14T14:12:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e35440b80 1 -- 172.21.15.69:0/2201668222 shutdown_connections 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d1510 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7bfca0 0x55816e7d4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e35440b80 1 --2- 172.21.15.69:0/2201668222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7c9380 0x55816e7d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e35440b80 1 -- 172.21.15.69:0/2201668222 >> 172.21.15.69:0/2201668222 conn(0x55816e7d7200 msgr2=0x55816e7e08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e35440b80 1 -- 172.21.15.69:0/2201668222 shutdown_connections 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.217+0000 7f2e35440b80 1 -- 172.21.15.69:0/2201668222 wait complete. 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e35440b80 1 -- start start 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e35440b80 1 Processor -- start 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7bfca0 0x55816e7db460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7c9380 0x55816e7d9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e35440b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e35440b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e7da1a0 con 0x55816e7c9c90 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e35440b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e7da310 con 0x55816e7bfca0 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e35440b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816e7da4d0 con 0x55816e7c9380 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e35440b80 10 client.0 _ll_register_callbacks cb 0x55816e6db910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e237fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e22ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7bfca0 0x55816e7db460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e237fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43530/0 (socket says 172.21.15.69:43530) 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e237fe700 1 -- 172.21.15.69:0/443042482 learned_addr learned my addr 172.21.15.69:0/443042482 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.218+0000 7f2e227fc700 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7c9380 0x55816e7d9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e237fe700 1 -- 172.21.15.69:0/443042482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7c9380 msgr2=0x55816e7d9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e237fe700 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7c9380 0x55816e7d9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e237fe700 1 -- 172.21.15.69:0/443042482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7bfca0 msgr2=0x55816e7db460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e237fe700 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7bfca0 0x55816e7db460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e237fe700 1 -- 172.21.15.69:0/443042482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e24110100 con 0x55816e7c9c90 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e227fc700 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7c9380 0x55816e7d9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7bfca0 0x55816e7db460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e237fe700 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d9c60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00a3e0 tx=0x7f2e1c0c9950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b50ac0dcd5e5ab9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e06ff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e06ff5700 1 -- 172.21.15.69:0/443042482 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0cb050 con 0x55816e7c9c90 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e06ff5700 1 -- 172.21.15.69:0/443042482 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f2e1c0a17b0 con 0x55816e7c9c90 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e35440b80 1 -- 172.21.15.69:0/443042482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e14015070 con 0x55816e7c9c90 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e06ff5700 1 -- 172.21.15.69:0/443042482 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e1c09f2c0 con 0x55816e7c9c90 2023-12-14T14:12:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e35440b80 10 client.15885 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e35440b80 1 -- 172.21.15.69:0/443042482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55816e6c89a0 con 0x55816e7c9c90 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e06ff5700 1 -- 172.21.15.69:0/443042482 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e14015070 con 0x55816e7c9c90 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e06ff5700 1 -- 172.21.15.69:0/443042482 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2e1c099650 con 0x55816e7c9c90 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e35440b80 10 client.15885 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e35440b80 10 client.15885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e35440b80 20 client.15885 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e35440b80 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55816e7d4b50 0x55816e83b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e35440b80 4 client.15885 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.219+0000 7f2e35440b80 1 -- 172.21.15.69:0/443042482 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55816e714a00 con 0x55816e7d4b50 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55816e7d4b50 0x55816e83b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e06ff5700 10 client.15885 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e22ffd700 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55816e7d4b50 0x55816e83b430 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efafbf5bb7bceaf1 server_cookie=ceef5060c75243cb in_seq=0 out_seq=0 2023-12-14T14:12:51.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e06ff5700 1 -- 172.21.15.69:0/443042482 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55816e714a00 con 0x55816e7d4b50 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e06ff5700 10 client.15885 handle_command_reply: tid=0 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 client.15885 shutdown 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 -- 172.21.15.69:0/443042482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 msgr2=0x55816e7d9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d9c60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00a3e0 tx=0x7f2e1c0c9950 comp rx=0 tx=0).stop 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 -- 172.21.15.69:0/443042482 shutdown_connections 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55816e7d4b50 0x55816e83b430 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55816e7c9c90 0x55816e7d9c60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55816e7bfca0 0x55816e7db460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e06ff5700 0 client.15885 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 --2- 172.21.15.69:0/443042482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55816e7c9380 0x55816e7d9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 -- 172.21.15.69:0/443042482 >> 172.21.15.69:0/443042482 conn(0x55816e7d7200 msgr2=0x55816e7c49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:51.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 -- 172.21.15.69:0/443042482 shutdown_connections 2023-12-14T14:12:51.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.220+0000 7f2e35440b80 1 -- 172.21.15.69:0/443042482 wait complete. 2023-12-14T14:12:51.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e35440b80 20 client.15885 trim_cache size 0 max 16384 2023-12-14T14:12:51.229 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:12:51.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 -- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e0c0a12c0 msgr2=0x7f2e0c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:51.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e0c0a12c0 0x7f2e0c0a3770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e18006010 tx=0x7f2e1800b540 comp rx=0 tx=0).stop 2023-12-14T14:12:51.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 -- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e2419acb0 msgr2=0x7f2e2419b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:51.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e2419acb0 0x7f2e2419b120 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00ada0 tx=0x7f2e1c00c330 comp rx=0 tx=0).stop 2023-12-14T14:12:51.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 -- 172.21.15.69:0/818636167 shutdown_connections 2023-12-14T14:12:51.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e0c0a12c0 0x7f2e0c0a3770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e2419acb0 0x7f2e2419b120 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e240ff9b0 0x7f2e24196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 --2- 172.21.15.69:0/818636167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2410a880 0x7f2e24196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:51.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 -- 172.21.15.69:0/818636167 >> 172.21.15.69:0/818636167 conn(0x7f2e24074a60 msgr2=0x7f2e24102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:51.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 -- 172.21.15.69:0/818636167 shutdown_connections 2023-12-14T14:12:51.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:51.221+0000 7f2e292b2700 1 -- 172.21.15.69:0/818636167 wait complete. 2023-12-14T14:12:51.376 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:51.376 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:51.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:51 smithi069 ceph-mon[42034]: pgmap v69: 97 pgs: 97 active+clean; 2.5 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-12-14T14:12:51.676 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:51.676 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:51.697 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:51.697 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:51.697 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 82 -lt 100 ']' 2023-12-14T14:12:51.697 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 82 + 1 2023-12-14T14:12:51.724 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=83 2023-12-14T14:12:51.724 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:51.759 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:51.759 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:51.760 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:51.760 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:51.760 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:51.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:51 smithi119 ceph-mon[43834]: pgmap v69: 97 pgs: 97 active+clean; 2.5 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-12-14T14:12:51.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:51 smithi081 ceph-mon[43371]: pgmap v69: 97 pgs: 97 active+clean; 2.5 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-12-14T14:12:52.167 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:52.168 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:52.250 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:12:52.251 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:12:52.724 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:52.724 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:52.784 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:52.784 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:52.784 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 83 -lt 100 ']' 2023-12-14T14:12:52.784 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 83 + 1 2023-12-14T14:12:52.818 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=84 2023-12-14T14:12:52.818 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:52.844 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:52.844 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:52.845 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:52.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:52.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:53.326 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:53.326 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:53.441 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:53.442 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:53.458 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:53.458 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:53.458 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 84 -lt 100 ']' 2023-12-14T14:12:53.458 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 84 + 1 2023-12-14T14:12:53.510 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=85 2023-12-14T14:12:53.510 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:53.558 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:53.558 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:53.560 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:53.560 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:53.560 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:53.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:53 smithi119 ceph-mon[43834]: pgmap v70: 97 pgs: 97 active+clean; 2.5 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-12-14T14:12:53.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:53 smithi069 ceph-mon[42034]: pgmap v70: 97 pgs: 97 active+clean; 2.5 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-12-14T14:12:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:53 smithi081 ceph-mon[43371]: pgmap v70: 97 pgs: 97 active+clean; 2.5 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-12-14T14:12:54.142 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:54.143 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:54.384 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:54.384 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:54.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:54.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:54.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 85 -lt 100 ']' 2023-12-14T14:12:54.401 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 85 + 1 2023-12-14T14:12:54.440 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=86 2023-12-14T14:12:54.440 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:54.501 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:54.501 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:54.502 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:54.502 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:54.502 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:55.134 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:55.134 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:55.309 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:55.309 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:55.324 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:55.324 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:55.324 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 86 -lt 100 ']' 2023-12-14T14:12:55.324 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 86 + 1 2023-12-14T14:12:55.356 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=87 2023-12-14T14:12:55.356 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:55.402 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:55.402 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:55.403 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:55.404 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:55.404 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:55.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:55 smithi119 ceph-mon[43834]: pgmap v71: 97 pgs: 97 active+clean; 2.6 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-12-14T14:12:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.815+0000 7f684ad3b700 1 -- 172.21.15.69:0/1945772174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 msgr2=0x7f6844101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.815+0000 7f684ad3b700 1 --2- 172.21.15.69:0/1945772174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 0x7f6844101710 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f682c009990 tx=0x7f682c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.815+0000 7f684ad3b700 1 -- 172.21.15.69:0/1945772174 shutdown_connections 2023-12-14T14:12:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.815+0000 7f684ad3b700 1 --2- 172.21.15.69:0/1945772174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f684410a860 0x7f684410cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.815+0000 7f684ad3b700 1 --2- 172.21.15.69:0/1945772174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 0x7f6844101710 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.815+0000 7f684ad3b700 1 --2- 172.21.15.69:0/1945772174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6844101c50 0x7f684410a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.815+0000 7f684ad3b700 1 -- 172.21.15.69:0/1945772174 >> 172.21.15.69:0/1945772174 conn(0x7f6844075fc0 msgr2=0x7f68440763c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.815+0000 7f684ad3b700 1 -- 172.21.15.69:0/1945772174 shutdown_connections 2023-12-14T14:12:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.815+0000 7f684ad3b700 1 -- 172.21.15.69:0/1945772174 wait complete. 2023-12-14T14:12:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.816+0000 7f684ad3b700 1 Processor -- start 2023-12-14T14:12:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.816+0000 7f684ad3b700 1 -- start start 2023-12-14T14:12:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.816+0000 7f684ad3b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 0x7f68441963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.816+0000 7f684ad3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6844101c50 0x7f68441968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.816+0000 7f684ad3b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f684410a860 0x7f684419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.816+0000 7f684ad3b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684419b390 con 0x7f6844101340 2023-12-14T14:12:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.816+0000 7f684ad3b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684419b500 con 0x7f6844101c50 2023-12-14T14:12:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.816+0000 7f684ad3b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684419b6c0 con 0x7f684410a860 2023-12-14T14:12:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6848ad7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 0x7f68441963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6848ad7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 0x7f68441963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43550/0 (socket says 172.21.15.69:43550) 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6848ad7700 1 -- 172.21.15.69:0/2500021015 learned_addr learned my addr 172.21.15.69:0/2500021015 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f68492d8700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f684410a860 0x7f684419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6843fff700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6844101c50 0x7f68441968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6848ad7700 1 -- 172.21.15.69:0/2500021015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f684410a860 msgr2=0x7f684419ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6848ad7700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f684410a860 0x7f684419ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6848ad7700 1 -- 172.21.15.69:0/2500021015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6844101c50 msgr2=0x7f68441968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6848ad7700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6844101c50 0x7f68441968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6848ad7700 1 -- 172.21.15.69:0/2500021015 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0095f0 con 0x7f6844101340 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6843fff700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6844101c50 0x7f68441968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6848ad7700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 0x7f68441963b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f682c0098e0 tx=0x7f682c00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6841ffb700 1 -- 172.21.15.69:0/2500021015 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c01d070 con 0x7f6844101340 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6841ffb700 1 -- 172.21.15.69:0/2500021015 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f682c005510 con 0x7f6844101340 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f684ad3b700 1 -- 172.21.15.69:0/2500021015 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68441102d0 con 0x7f6844101340 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.817+0000 7f6841ffb700 1 -- 172.21.15.69:0/2500021015 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c004bd0 con 0x7f6844101340 2023-12-14T14:12:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.818+0000 7f684ad3b700 1 -- 172.21.15.69:0/2500021015 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6844110140 con 0x7f6844101340 2023-12-14T14:12:55.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.820+0000 7f6841ffb700 1 -- 172.21.15.69:0/2500021015 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f682c004d30 con 0x7f6844101340 2023-12-14T14:12:55.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.821+0000 7f6841ffb700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68300a1340 0x7f68300a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.821+0000 7f6843fff700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68300a1340 0x7f68300a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.821+0000 7f6841ffb700 1 -- 172.21.15.69:0/2500021015 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f682c0cda80 con 0x7f6844101340 2023-12-14T14:12:55.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.821+0000 7f6843fff700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68300a1340 0x7f68300a37f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6834005950 tx=0x7f68340058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:55.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:55 smithi069 ceph-mon[42034]: pgmap v71: 97 pgs: 97 active+clean; 2.6 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-12-14T14:12:55.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:55 smithi081 ceph-mon[43371]: pgmap v71: 97 pgs: 97 active+clean; 2.6 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-12-14T14:12:55.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6856ec9b80 1 Processor -- start 2023-12-14T14:12:55.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6856ec9b80 1 -- start start 2023-12-14T14:12:55.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c1f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c1fd10 0x55f001c2a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c2abd0 0x55f001c2cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001b09660 con 0x55f001c2abd0 2023-12-14T14:12:55.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001b788f0 con 0x55f001c1fd10 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001b71d80 con 0x55f001c1f400 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f68492d8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c2abd0 0x55f001c2cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f68492d8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c2abd0 0x55f001c2cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43552/0 (socket says 172.21.15.69:43552) 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f68492d8700 1 -- 172.21.15.69:0/2366060361 learned_addr learned my addr 172.21.15.69:0/2366060361 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6848ad7700 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c1f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.900+0000 7f6843fff700 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c1fd10 0x55f001c2a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f6848ad7700 1 -- 172.21.15.69:0/2366060361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c1fd10 msgr2=0x55f001c2a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f6848ad7700 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c1fd10 0x55f001c2a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f6848ad7700 1 -- 172.21.15.69:0/2366060361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c2abd0 msgr2=0x55f001c2cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f6848ad7700 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c2abd0 0x55f001c2cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f6848ad7700 1 -- 172.21.15.69:0/2366060361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0019f3430 con 0x55f001c1f400 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f68492d8700 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c2abd0 0x55f001c2cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f6848ad7700 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c1f7d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f682c0cb1b0 tx=0x7f682c09a520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=285cf1223a42c687 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f683affd700 1 -- 172.21.15.69:0/2366060361 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c09ebf0 con 0x55f001c1f400 2023-12-14T14:12:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f683affd700 1 -- 172.21.15.69:0/2366060361 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f682c0a2f80 con 0x55f001c1f400 2023-12-14T14:12:55.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.901+0000 7f683affd700 1 -- 172.21.15.69:0/2366060361 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c09a0b0 con 0x55f001c1f400 2023-12-14T14:12:55.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.902+0000 7f6856ec9b80 1 -- 172.21.15.69:0/2366060361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 msgr2=0x55f001c1f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.902+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c1f7d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f682c0cb1b0 tx=0x7f682c09a520 comp rx=0 tx=0).stop 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.902+0000 7f6856ec9b80 1 -- 172.21.15.69:0/2366060361 shutdown_connections 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.902+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c2abd0 0x55f001c2cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.902+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c1f7d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.902+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/2366060361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c1fd10 0x55f001c2a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.902+0000 7f6856ec9b80 1 -- 172.21.15.69:0/2366060361 >> 172.21.15.69:0/2366060361 conn(0x55f001c15d20 msgr2=0x55f001c1b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.902+0000 7f6856ec9b80 1 -- 172.21.15.69:0/2366060361 shutdown_connections 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.902+0000 7f6856ec9b80 1 -- 172.21.15.69:0/2366060361 wait complete. 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.903+0000 7f6856ec9b80 1 -- start start 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.903+0000 7f6856ec9b80 1 Processor -- start 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c2afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c2b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c2ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001b0e010 con 0x55f001c1fd10 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001b0dcb0 con 0x55f001c2abd0 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0019f5720 con 0x55f001c1f400 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6856ec9b80 10 client.0 _ll_register_callbacks cb 0x55f001b31990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6843fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c2b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6843fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c2b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43558/0 (socket says 172.21.15.69:43558) 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6843fff700 1 -- 172.21.15.69:0/1874043914 learned_addr learned my addr 172.21.15.69:0/1874043914 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6848ad7700 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c2afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f68492d8700 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c2ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6843fff700 1 -- 172.21.15.69:0/1874043914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 msgr2=0x55f001c2afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6843fff700 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c2afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6843fff700 1 -- 172.21.15.69:0/1874043914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 msgr2=0x55f001c2ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6843fff700 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c2ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6843fff700 1 -- 172.21.15.69:0/1874043914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6844110140 con 0x55f001c1fd10 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6843fff700 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c2b4e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6834010000 tx=0x7f6834004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae8176b0b15f6f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.904+0000 7f6823fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:55.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6823fff700 1 -- 172.21.15.69:0/1874043914 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834017040 con 0x55f001c1fd10 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6823fff700 1 -- 172.21.15.69:0/1874043914 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f6834003880 con 0x55f001c1fd10 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6856ec9b80 1 -- 172.21.15.69:0/1874043914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f001c13330 con 0x55f001c1fd10 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6823fff700 1 -- 172.21.15.69:0/1874043914 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6834003a40 con 0x55f001c1fd10 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6856ec9b80 10 client.15897 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6856ec9b80 1 -- 172.21.15.69:0/1874043914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55f001b381f0 con 0x55f001c1fd10 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6823fff700 1 -- 172.21.15.69:0/1874043914 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f001c13330 con 0x55f001c1fd10 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6823fff700 1 -- 172.21.15.69:0/1874043914 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6834011d20 con 0x55f001c1fd10 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6856ec9b80 10 client.15897 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6856ec9b80 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6856ec9b80 20 client.15897 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f001c3a2e0 0x55f001c3c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6856ec9b80 4 client.15897 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.905+0000 7f6856ec9b80 1 -- 172.21.15.69:0/1874043914 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f001b6ad60 con 0x55f001c3a2e0 2023-12-14T14:12:55.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.906+0000 7f6848ad7700 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f001c3a2e0 0x55f001c3c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.906+0000 7f6848ad7700 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f001c3a2e0 0x55f001c3c6f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2672726badcb867 server_cookie=d83e9e160d0262a9 in_seq=0 out_seq=0 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.906+0000 7f6823fff700 10 client.15897 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6823fff700 1 -- 172.21.15.69:0/1874043914 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f001b6ad60 con 0x55f001c3a2e0 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6823fff700 10 client.15897 handle_command_reply: tid=0 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 client.15897 shutdown 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 -- 172.21.15.69:0/1874043914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 msgr2=0x55f001c2b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c2b4e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6834010000 tx=0x7f6834004750 comp rx=0 tx=0).stop 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 -- 172.21.15.69:0/1874043914 shutdown_connections 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f001c3a2e0 0x55f001c3c6f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c2ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c2afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6823fff700 0 client.15897 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/1874043914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c2b4e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 -- 172.21.15.69:0/1874043914 >> 172.21.15.69:0/1874043914 conn(0x55f001c15d20 msgr2=0x55f001c1b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 -- 172.21.15.69:0/1874043914 shutdown_connections 2023-12-14T14:12:55.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 1 -- 172.21.15.69:0/1874043914 wait complete. 2023-12-14T14:12:55.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.907+0000 7f6856ec9b80 20 client.15897 trim_cache size 0 max 16384 2023-12-14T14:12:55.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.925+0000 7f6856ec9b80 1 Processor -- start 2023-12-14T14:12:55.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.925+0000 7f6856ec9b80 1 -- start start 2023-12-14T14:12:55.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.925+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c2efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.925+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c26f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.925+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c27440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.925+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001c1d160 con 0x55f001c1fd10 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.925+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001b6ad60 con 0x55f001c2abd0 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.925+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001c24ac0 con 0x55f001c1f400 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6843fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c26f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6843fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c26f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43568/0 (socket says 172.21.15.69:43568) 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6843fff700 1 -- 172.21.15.69:0/287661024 learned_addr learned my addr 172.21.15.69:0/287661024 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6848ad7700 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c2efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f68492d8700 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c27440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6843fff700 1 -- 172.21.15.69:0/287661024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 msgr2=0x55f001c2efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6843fff700 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c2efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6843fff700 1 -- 172.21.15.69:0/287661024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 msgr2=0x55f001c27440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6843fff700 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c27440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6843fff700 1 -- 172.21.15.69:0/287661024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f001c17560 con 0x55f001c1fd10 2023-12-14T14:12:55.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f68492d8700 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c27440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:12:55.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f6843fff700 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c26f00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f683400b660 tx=0x7f683400b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d62daa0947db40 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:55.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f683b7fe700 1 -- 172.21.15.69:0/287661024 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834020bc0 con 0x55f001c1fd10 2023-12-14T14:12:55.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f683b7fe700 1 -- 172.21.15.69:0/287661024 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6834004310 con 0x55f001c1fd10 2023-12-14T14:12:55.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.926+0000 7f683b7fe700 1 -- 172.21.15.69:0/287661024 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68340296a0 con 0x55f001c1fd10 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 -- 172.21.15.69:0/287661024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 msgr2=0x55f001c26f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c26f00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f683400b660 tx=0x7f683400b380 comp rx=0 tx=0).stop 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 -- 172.21.15.69:0/287661024 shutdown_connections 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c27440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c2efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/287661024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c26f00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 -- 172.21.15.69:0/287661024 >> 172.21.15.69:0/287661024 conn(0x55f001c15d20 msgr2=0x55f001c24f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 -- 172.21.15.69:0/287661024 shutdown_connections 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 -- 172.21.15.69:0/287661024 wait complete. 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 -- start start 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.927+0000 7f6856ec9b80 1 Processor -- start 2023-12-14T14:12:55.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c87c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c88140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6856ec9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c82130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001c82740 con 0x55f001c1fd10 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001c828b0 con 0x55f001c2abd0 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6856ec9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f001c82a70 con 0x55f001c1f400 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6856ec9b80 10 client.0 _ll_register_callbacks cb 0x55f001b31990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6843fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c88140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6848ad7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c87c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6843fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c88140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43570/0 (socket says 172.21.15.69:43570) 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f6843fff700 1 -- 172.21.15.69:0/309234811 learned_addr learned my addr 172.21.15.69:0/309234811 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.928+0000 7f68492d8700 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c82130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6843fff700 1 -- 172.21.15.69:0/309234811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 msgr2=0x55f001c87c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6843fff700 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c87c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6843fff700 1 -- 172.21.15.69:0/309234811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 msgr2=0x55f001c82130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6843fff700 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c82130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6843fff700 1 -- 172.21.15.69:0/309234811 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f001b381f0 con 0x55f001c1fd10 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6848ad7700 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c87c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6843fff700 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c88140 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6834000c00 tx=0x7f68340057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40822c49424b70de server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6823fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6823fff700 1 -- 172.21.15.69:0/309234811 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834003a90 con 0x55f001c1fd10 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6823fff700 1 -- 172.21.15.69:0/309234811 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f68340209c0 con 0x55f001c1fd10 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6856ec9b80 1 -- 172.21.15.69:0/309234811 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f682c0a2f80 con 0x55f001c1fd10 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6823fff700 1 -- 172.21.15.69:0/309234811 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6834020b80 con 0x55f001c1fd10 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6856ec9b80 10 client.15903 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6856ec9b80 1 -- 172.21.15.69:0/309234811 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55f00199fbe0 con 0x55f001c1fd10 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6823fff700 1 -- 172.21.15.69:0/309234811 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f682c0a2f80 con 0x55f001c1fd10 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6823fff700 1 -- 172.21.15.69:0/309234811 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f683404f440 con 0x55f001c1fd10 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6856ec9b80 10 client.15903 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6856ec9b80 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6856ec9b80 20 client.15903 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.929+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f001c8f5b0 0x55f001c919c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.930+0000 7f6856ec9b80 4 client.15903 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:12:55.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.930+0000 7f6856ec9b80 1 -- 172.21.15.69:0/309234811 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f001b6aa80 con 0x55f001c8f5b0 2023-12-14T14:12:55.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.930+0000 7f6848ad7700 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f001c8f5b0 0x55f001c919c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:55.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.930+0000 7f6823fff700 10 client.15903 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:55.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.930+0000 7f6848ad7700 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f001c8f5b0 0x55f001c919c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaefa58b8afef95a server_cookie=b33bb3f05c58da0f in_seq=0 out_seq=0 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6823fff700 1 -- 172.21.15.69:0/309234811 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f001b6aa80 con 0x55f001c8f5b0 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6823fff700 10 client.15903 handle_command_reply: tid=0 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 client.15903 shutdown 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 -- 172.21.15.69:0/309234811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 msgr2=0x55f001c88140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c88140 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6834000c00 tx=0x7f68340057b0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 -- 172.21.15.69:0/309234811 shutdown_connections 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55f001c8f5b0 0x55f001c919c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f001c2abd0 0x55f001c82130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f001c1f400 0x55f001c87c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6823fff700 0 client.15903 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 --2- 172.21.15.69:0/309234811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f001c1fd10 0x55f001c88140 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 -- 172.21.15.69:0/309234811 >> 172.21.15.69:0/309234811 conn(0x55f001c15d20 msgr2=0x55f001c28440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:55.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 -- 172.21.15.69:0/309234811 shutdown_connections 2023-12-14T14:12:55.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 1 -- 172.21.15.69:0/309234811 wait complete. 2023-12-14T14:12:55.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.932+0000 7f6856ec9b80 20 client.15903 trim_cache size 0 max 16384 2023-12-14T14:12:55.935 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:12:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:12:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "6fe7143b-c5ff-4dfc-be88-2906d5de269e", 2023-12-14T14:12:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:12:55.935 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 -- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68300a1340 msgr2=0x7f68300a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68300a1340 0x7f68300a37f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6834005950 tx=0x7f68340058e0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 -- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 msgr2=0x7f68441963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 0x7f68441963b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f682c0098e0 tx=0x7f682c00f670 comp rx=0 tx=0).stop 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 -- 172.21.15.69:0/2500021015 shutdown_connections 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68300a1340 0x7f68300a37f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f684410a860 0x7f684419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6844101340 0x7f68441963b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 --2- 172.21.15.69:0/2500021015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6844101c50 0x7f68441968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 -- 172.21.15.69:0/2500021015 >> 172.21.15.69:0/2500021015 conn(0x7f6844075fc0 msgr2=0x7f68441022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 -- 172.21.15.69:0/2500021015 shutdown_connections 2023-12-14T14:12:55.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:55.933+0000 7f684ad3b700 1 -- 172.21.15.69:0/2500021015 wait complete. 2023-12-14T14:12:55.983 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:12:56.116 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:56.116 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:56.223 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:56.223 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:56.240 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:56.240 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:56.241 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 87 -lt 100 ']' 2023-12-14T14:12:56.241 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 87 + 1 2023-12-14T14:12:56.281 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=88 2023-12-14T14:12:56.281 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:56.301 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:56.301 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:56.302 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:56.302 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:56.303 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:56.842 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:56.842 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:57.005 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:57.005 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:57.017 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:57.018 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:57.018 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 88 -lt 100 ']' 2023-12-14T14:12:57.018 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 88 + 1 2023-12-14T14:12:57.066 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=89 2023-12-14T14:12:57.066 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:57.190 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:57.190 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:57.191 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:57.191 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:57.191 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:57.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:57 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:12:57.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:57 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:57.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:57 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:12:57.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:57 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:57.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:57 smithi069 ceph-mon[42034]: pgmap v72: 97 pgs: 97 active+clean; 2.6 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-12-14T14:12:57.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:57 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:12:57.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:57 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:57.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:57 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:12:57.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:57 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:57.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:57 smithi081 ceph-mon[43371]: pgmap v72: 97 pgs: 97 active+clean; 2.6 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-12-14T14:12:57.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:57 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:12:57.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:57 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:57.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:57 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:12:57.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:57 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:12:57.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:57 smithi119 ceph-mon[43834]: pgmap v72: 97 pgs: 97 active+clean; 2.6 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-12-14T14:12:57.875 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:57.875 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:58.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:58.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:58.075 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:58.075 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:58.075 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 89 -lt 100 ']' 2023-12-14T14:12:58.075 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 89 + 1 2023-12-14T14:12:58.131 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=90 2023-12-14T14:12:58.131 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:58.174 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:58.175 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:58.176 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:58.176 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:58.176 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:59.008 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:59.008 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:59.183 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:12:59.183 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:12:59.194 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:59.194 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:12:59.194 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 90 -lt 100 ']' 2023-12-14T14:12:59.194 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 90 + 1 2023-12-14T14:12:59.297 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=91 2023-12-14T14:12:59.298 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:12:59.399 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:59.399 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:12:59.400 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:12:59.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:12:59.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:12:59.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 -- 172.21.15.69:0/3688060339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 msgr2=0x7fc0a40ffe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:59.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/3688060339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 0x7fc0a40ffe80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009990 tx=0x7fc08c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 -- 172.21.15.69:0/3688060339 shutdown_connections 2023-12-14T14:12:59.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/3688060339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0a410a860 0x7fc0a410cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/3688060339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a4076040 0x7fc0a40ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/3688060339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 0x7fc0a40ffe80 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 -- 172.21.15.69:0/3688060339 >> 172.21.15.69:0/3688060339 conn(0x7fc0a40749f0 msgr2=0x7fc0a4074df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:59.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 -- 172.21.15.69:0/3688060339 shutdown_connections 2023-12-14T14:12:59.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 -- 172.21.15.69:0/3688060339 wait complete. 2023-12-14T14:12:59.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.481+0000 7fc0a94d9700 1 Processor -- start 2023-12-14T14:12:59.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a94d9700 1 -- start start 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a94d9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0a4076040 0x7fc0a4100620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a94d9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 0x7fc0a4100b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a94d9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a410a860 0x7fc0a41a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a94d9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4101390 con 0x7fc0a40ffa10 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a94d9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41a4b90 con 0x7fc0a410a860 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a94d9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41a4cd0 con 0x7fc0a4076040 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a27fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 0x7fc0a4100b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a27fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 0x7fc0a4100b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42080/0 (socket says 172.21.15.69:42080) 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a27fc700 1 -- 172.21.15.69:0/1363938405 learned_addr learned my addr 172.21.15.69:0/1363938405 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0a4076040 0x7fc0a4100620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.482+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a410a860 0x7fc0a41a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc0a27fc700 1 -- 172.21.15.69:0/1363938405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0a4076040 msgr2=0x7fc0a4100620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:59.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0a4076040 0x7fc0a4100620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc0a27fc700 1 -- 172.21.15.69:0/1363938405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a410a860 msgr2=0x7fc0a41a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a410a860 0x7fc0a41a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc0a27fc700 1 -- 172.21.15.69:0/1363938405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c0095f0 con 0x7fc0a40ffa10 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 0x7fc0a4100b60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc08c003730 tx=0x7fc08c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc09bfff700 1 -- 172.21.15.69:0/1363938405 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c01d070 con 0x7fc0a40ffa10 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc09bfff700 1 -- 172.21.15.69:0/1363938405 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc08c00fb80 con 0x7fc0a40ffa10 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc09bfff700 1 -- 172.21.15.69:0/1363938405 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0173f0 con 0x7fc0a40ffa10 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc0a94d9700 1 -- 172.21.15.69:0/1363938405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a4110290 con 0x7fc0a40ffa10 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.483+0000 7fc0a94d9700 1 -- 172.21.15.69:0/1363938405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4110100 con 0x7fc0a40ffa10 2023-12-14T14:12:59.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.486+0000 7fc09bfff700 1 -- 172.21.15.69:0/1363938405 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc08c022470 con 0x7fc0a40ffa10 2023-12-14T14:12:59.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.486+0000 7fc09bfff700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc0900a12c0 0x7fc0900a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.486+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc0900a12c0 0x7fc0900a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.486+0000 7fc09bfff700 1 -- 172.21.15.69:0/1363938405 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fc08c0ce080 con 0x7fc0a40ffa10 2023-12-14T14:12:59.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.487+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc0900a12c0 0x7fc0900a3770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc094005950 tx=0x7fc09400b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:59.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.554+0000 7fc0b5667b80 1 Processor -- start 2023-12-14T14:12:59.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.554+0000 7fc0b5667b80 1 -- start start 2023-12-14T14:12:59.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672df750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672ea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593671c95e0 con 0x5593672eab50 2023-12-14T14:12:59.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559367238870 con 0x5593672df380 2023-12-14T14:12:59.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559367231d00 con 0x5593672dfc90 2023-12-14T14:12:59.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672df750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42092/0 (socket says 172.21.15.69:42092) 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0a37fe700 1 -- 172.21.15.69:0/3524563133 learned_addr learned my addr 172.21.15.69:0/3524563133 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.555+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/3524563133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0a2ffd700 1 -- 172.21.15.69:0/3524563133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 msgr2=0x5593672ea610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/3524563133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672ea610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0a2ffd700 1 -- 172.21.15.69:0/3524563133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 msgr2=0x5593672ecf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/3524563133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ecf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0a2ffd700 1 -- 172.21.15.69:0/3524563133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593670b33b0 con 0x5593672df380 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/3524563133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/3524563133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672df750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc094005d90 tx=0x7fc094013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5504f2601bb20c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0997fa700 1 -- 172.21.15.69:0/3524563133 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094011b80 con 0x5593672df380 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0997fa700 1 -- 172.21.15.69:0/3524563133 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc094015070 con 0x5593672df380 2023-12-14T14:12:59.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.556+0000 7fc0997fa700 1 -- 172.21.15.69:0/3524563133 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094005500 con 0x5593672df380 2023-12-14T14:12:59.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.557+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3524563133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 msgr2=0x5593672df750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:59.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.557+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3524563133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672df750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc094005d90 tx=0x7fc094013000 comp rx=0 tx=0).stop 2023-12-14T14:12:59.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.557+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3524563133 shutdown_connections 2023-12-14T14:12:59.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.557+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3524563133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.557+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3524563133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672df750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.557+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3524563133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672ea610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.557+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3524563133 >> 172.21.15.69:0/3524563133 conn(0x5593672d5ca0 msgr2=0x5593672db7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:59.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.557+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3524563133 shutdown_connections 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.557+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3524563133 wait complete. 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.558+0000 7fc0b5667b80 1 -- start start 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.558+0000 7fc0b5667b80 1 Processor -- start 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.558+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.558+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.558+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672e7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.558+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593671cdf90 con 0x5593672eab50 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.558+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593671cdc30 con 0x5593672df380 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.558+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593670b56a0 con 0x5593672dfc90 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.558+0000 7fc0b5667b80 10 client.0 _ll_register_callbacks cb 0x5593671f1910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672e7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672e7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42100/0 (socket says 172.21.15.69:42100) 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a37fe700 1 -- 172.21.15.69:0/3618036348 learned_addr learned my addr 172.21.15.69:0/3618036348 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:59.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a37fe700 1 -- 172.21.15.69:0/3618036348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 msgr2=0x5593672e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a37fe700 1 -- 172.21.15.69:0/3618036348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 msgr2=0x5593672ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ea4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a37fe700 1 -- 172.21.15.69:0/3618036348 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc094010c50 con 0x5593672eab50 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672e7d60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc09c007af0 tx=0x7fc09c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d8d09af16e91b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.559+0000 7fc08a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc08a7fc700 1 -- 172.21.15.69:0/3618036348 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c012b40 con 0x5593672eab50 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc08a7fc700 1 -- 172.21.15.69:0/3618036348 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fc09c012ca0 con 0x5593672eab50 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3618036348 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593672d32b0 con 0x5593672eab50 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc08a7fc700 1 -- 172.21.15.69:0/3618036348 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc09c012ea0 con 0x5593672eab50 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc0b5667b80 10 client.15915 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:59.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3618036348 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5593671f8170 con 0x5593672eab50 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc08a7fc700 1 -- 172.21.15.69:0/3618036348 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5593672d32b0 con 0x5593672eab50 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc08a7fc700 1 -- 172.21.15.69:0/3618036348 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc09c014040 con 0x5593672eab50 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc0b5667b80 10 client.15915 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc0b5667b80 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc0b5667b80 20 client.15915 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5593672fa520 0x5593672fc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc0b5667b80 4 client.15915 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.560+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3618036348 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55936722ace0 con 0x5593672fa520 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.561+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5593672fa520 0x5593672fc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.561+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5593672fa520 0x5593672fc930 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8de97eab01527b8a server_cookie=65b9489937b6f7d0 in_seq=0 out_seq=0 2023-12-14T14:12:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.561+0000 7fc08a7fc700 10 client.15915 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:59.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc08a7fc700 1 -- 172.21.15.69:0/3618036348 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55936722ace0 con 0x5593672fa520 2023-12-14T14:12:59.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc08a7fc700 10 client.15915 handle_command_reply: tid=0 2023-12-14T14:12:59.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 client.15915 shutdown 2023-12-14T14:12:59.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3618036348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 msgr2=0x5593672e7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:59.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672e7d60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc09c007af0 tx=0x7fc09c007e00 comp rx=0 tx=0).stop 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3618036348 shutdown_connections 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5593672fa520 0x5593672fc930 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672e7d60 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc08a7fc700 0 client.15915 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/3618036348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3618036348 >> 172.21.15.69:0/3618036348 conn(0x5593672d5ca0 msgr2=0x5593672db370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3618036348 shutdown_connections 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 1 -- 172.21.15.69:0/3618036348 wait complete. 2023-12-14T14:12:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.562+0000 7fc0b5667b80 20 client.15915 trim_cache size 0 max 16384 2023-12-14T14:12:59.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.580+0000 7fc0b5667b80 1 Processor -- start 2023-12-14T14:12:59.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.580+0000 7fc0b5667b80 1 -- start start 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672df380 0x5593672e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672dfc90 0x5593672e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593672e3610 con 0x5593672eab50 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593672e74a0 con 0x5593672dfc90 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593672d75d0 con 0x5593672df380 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ea4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42102/0 (socket says 172.21.15.69:42102) 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a37fe700 1 -- 172.21.15.69:0/1906596420 learned_addr learned my addr 172.21.15.69:0/1906596420 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672df380 0x5593672e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672dfc90 0x5593672e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a37fe700 1 -- 172.21.15.69:0/1906596420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672df380 msgr2=0x5593672e6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:59.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672df380 0x5593672e6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a37fe700 1 -- 172.21.15.69:0/1906596420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672dfc90 msgr2=0x5593672e9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:59.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672dfc90 0x5593672e9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a37fe700 1 -- 172.21.15.69:0/1906596420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593671f7ec0 con 0x5593672eab50 2023-12-14T14:12:59.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672dfc90 0x5593672e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:59.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ea4f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc09c015510 tx=0x7fc09c012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3ffd9e094aee24 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:59.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.581+0000 7fc099ffb700 1 -- 172.21.15.69:0/1906596420 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c015880 con 0x5593672eab50 2023-12-14T14:12:59.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc099ffb700 1 -- 172.21.15.69:0/1906596420 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc09c00f040 con 0x5593672eab50 2023-12-14T14:12:59.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc099ffb700 1 -- 172.21.15.69:0/1906596420 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c012db0 con 0x5593672eab50 2023-12-14T14:12:59.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1906596420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 msgr2=0x5593672ea4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:59.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ea4f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc09c015510 tx=0x7fc09c012520 comp rx=0 tx=0).stop 2023-12-14T14:12:59.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1906596420 shutdown_connections 2023-12-14T14:12:59.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x5593672ea4f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672df380 0x5593672e6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1906596420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672dfc90 0x5593672e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1906596420 >> 172.21.15.69:0/1906596420 conn(0x5593672d5ca0 msgr2=0x5593672f6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1906596420 shutdown_connections 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.582+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1906596420 wait complete. 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0b5667b80 1 -- start start 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0b5667b80 1 Processor -- start 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ef860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672efda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0b5667b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x55936734d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593672f0540 con 0x5593672eab50 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55936734d920 con 0x5593672df380 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0b5667b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55936734dab0 con 0x5593672dfc90 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0b5667b80 10 client.0 _ll_register_callbacks cb 0x7fc09c009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x55936734d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x55936734d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42118/0 (socket says 172.21.15.69:42118) 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0a37fe700 1 -- 172.21.15.69:0/1447283023 learned_addr learned my addr 172.21.15.69:0/1447283023 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:12:59.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.583+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0a37fe700 1 -- 172.21.15.69:0/1447283023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 msgr2=0x5593672efda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672efda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0a37fe700 1 -- 172.21.15.69:0/1447283023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 msgr2=0x5593672ef860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ef860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0a37fe700 1 -- 172.21.15.69:0/1447283023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593671f8170 con 0x5593672eab50 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0a27fc700 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ef860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0a37fe700 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x55936734d3e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc09c015990 tx=0x7fc09c009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78b08ff73cec5f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc08a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc08a7fc700 1 -- 172.21.15.69:0/1447283023 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c004a50 con 0x5593672eab50 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc08a7fc700 1 -- 172.21.15.69:0/1447283023 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fc09c004bb0 con 0x5593672eab50 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1447283023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc094015070 con 0x5593672eab50 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc08a7fc700 1 -- 172.21.15.69:0/1447283023 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc09c004d70 con 0x5593672eab50 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0b5667b80 10 client.15921 fetch_fsmap learned FSMap version 22 2023-12-14T14:12:59.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1447283023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5593671de9a0 con 0x5593672eab50 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.584+0000 7fc08a7fc700 1 -- 172.21.15.69:0/1447283023 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc09c03f020 con 0x5593672eab50 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc08a7fc700 1 -- 172.21.15.69:0/1447283023 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc09c039070 con 0x5593672eab50 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc0b5667b80 10 client.15921 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc0b5667b80 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc0b5667b80 20 client.15921 populate_metadata read hostname 'smithi069' 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55936734ecb0 0x559367351090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc0b5667b80 4 client.15921 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1447283023 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55936722aa00 con 0x55936734ecb0 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55936734ecb0 0x559367351090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc08a7fc700 10 client.15921 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.585+0000 7fc0a2ffd700 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55936734ecb0 0x559367351090 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9601e25ed36471e0 server_cookie=84f378c985325aaa in_seq=0 out_seq=0 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc08a7fc700 1 -- 172.21.15.69:0/1447283023 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55936722aa00 con 0x55936734ecb0 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc08a7fc700 10 client.15921 handle_command_reply: tid=0 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 client.15921 shutdown 2023-12-14T14:12:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1447283023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 msgr2=0x55936734d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x55936734d3e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc09c015990 tx=0x7fc09c009100 comp rx=0 tx=0).stop 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1447283023 shutdown_connections 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55936734ecb0 0x559367351090 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593672eab50 0x55936734d3e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593672df380 0x5593672ef860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 --2- 172.21.15.69:0/1447283023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5593672dfc90 0x5593672efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc08a7fc700 0 client.15921 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1447283023 >> 172.21.15.69:0/1447283023 conn(0x5593672d5ca0 msgr2=0x5593672e2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1447283023 shutdown_connections 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 1 -- 172.21.15.69:0/1447283023 wait complete. 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.586+0000 7fc0b5667b80 20 client.15921 trim_cache size 0 max 16384 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:12:59.590 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:12:59.591 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:12:59.591 INFO:teuthology.orchestra.run.smithi069.stdout: "6fe7143b-c5ff-4dfc-be88-2906d5de269e": { 2023-12-14T14:12:59.591 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:12:59.591 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6fe7143b-c5ff-4dfc-be88-2906d5de269e", 2023-12-14T14:12:59.591 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:12:59.591 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:12:59.591 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:12:59.591 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 -- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc0900a12c0 msgr2=0x7fc0900a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc0900a12c0 0x7fc0900a3770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc094005950 tx=0x7fc09400b410 comp rx=0 tx=0).stop 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 -- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 msgr2=0x7fc0a4100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 0x7fc0a4100b60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc08c003730 tx=0x7fc08c00f690 comp rx=0 tx=0).stop 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 -- 172.21.15.69:0/1363938405 shutdown_connections 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc0900a12c0 0x7fc0900a3770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a410a860 0x7fc0a41a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0a4076040 0x7fc0a4100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 --2- 172.21.15.69:0/1363938405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0a40ffa10 0x7fc0a4100b60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 -- 172.21.15.69:0/1363938405 >> 172.21.15.69:0/1363938405 conn(0x7fc0a40749f0 msgr2=0x7fc0a4102760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 -- 172.21.15.69:0/1363938405 shutdown_connections 2023-12-14T14:12:59.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:12:59.587+0000 7fc0a94d9700 1 -- 172.21.15.69:0/1363938405 wait complete. 2023-12-14T14:12:59.650 INFO:tasks.cephfs.filesystem:scrub status for tag:6fe7143b-c5ff-4dfc-be88-2906d5de269e - {'path': '/', 'tag': '6fe7143b-c5ff-4dfc-be88-2906d5de269e', 'options': 'recursive,force'} 2023-12-14T14:12:59.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:12:59 smithi119 ceph-mon[43834]: pgmap v73: 97 pgs: 97 active+clean; 2.6 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-12-14T14:12:59.806 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:12:59 smithi069 ceph-mon[42034]: pgmap v73: 97 pgs: 97 active+clean; 2.6 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-12-14T14:12:59.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:12:59 smithi081 ceph-mon[43371]: pgmap v73: 97 pgs: 97 active+clean; 2.6 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-12-14T14:12:59.941 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:12:59.941 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:00.066 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:00.066 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:00.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:00.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:00.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 91 -lt 100 ']' 2023-12-14T14:13:00.073 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 91 + 1 2023-12-14T14:13:00.109 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=92 2023-12-14T14:13:00.109 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:00.124 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:00.125 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:00.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:13:00.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:13:00.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:13:00.466 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:00.466 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:00.575 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:00.575 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:00.582 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:00.582 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:00.582 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 92 -lt 100 ']' 2023-12-14T14:13:00.582 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 92 + 1 2023-12-14T14:13:00.614 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=93 2023-12-14T14:13:00.614 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:00.640 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:00.640 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:00.641 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:13:00.641 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:13:00.641 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:13:00.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:00 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:13:00.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:00 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:13:00.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:00 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:13:01.033 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:01.033 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:01.150 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:01.150 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:01.156 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:01.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:01.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 93 -lt 100 ']' 2023-12-14T14:13:01.157 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 93 + 1 2023-12-14T14:13:01.189 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=94 2023-12-14T14:13:01.189 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:01.224 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:01.224 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:01.225 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:13:01.225 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:13:01.225 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:13:01.650 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:01.650 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:01 smithi119 ceph-mon[43834]: pgmap v74: 97 pgs: 97 active+clean; 2.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-12-14T14:13:01.791 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:01.791 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:01.799 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:01.799 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:01.799 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 94 -lt 100 ']' 2023-12-14T14:13:01.799 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 94 + 1 2023-12-14T14:13:01.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=95 2023-12-14T14:13:01.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:01.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:01 smithi069 ceph-mon[42034]: pgmap v74: 97 pgs: 97 active+clean; 2.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-12-14T14:13:01.866 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:01.866 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:01.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:13:01.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:13:01.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:13:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:01 smithi081 ceph-mon[43371]: pgmap v74: 97 pgs: 97 active+clean; 2.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-12-14T14:13:02.316 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:02.316 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:02.441 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:02.442 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:02.448 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:02.448 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:02.449 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 95 -lt 100 ']' 2023-12-14T14:13:02.449 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 95 + 1 2023-12-14T14:13:02.472 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=96 2023-12-14T14:13:02.472 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:02.522 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:02.522 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:02.523 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:13:02.523 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:13:02.523 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:13:02.908 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:02.908 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:03.041 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:03.041 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:03.057 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:03.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:03.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 96 -lt 100 ']' 2023-12-14T14:13:03.058 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 96 + 1 2023-12-14T14:13:03.089 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=97 2023-12-14T14:13:03.089 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:03.117 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:03.117 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:03.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:13:03.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:13:03.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:13:03.474 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:03.474 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:03.583 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:03.583 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:03.589 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:03.590 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:03.590 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 97 -lt 100 ']' 2023-12-14T14:13:03.590 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 97 + 1 2023-12-14T14:13:03.613 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=98 2023-12-14T14:13:03.613 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:03.640 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:03.641 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:03.642 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:13:03.642 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:13:03.642 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:13:03.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:03 smithi119 ceph-mon[43834]: pgmap v75: 97 pgs: 97 active+clean; 2.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 7 op/s 2023-12-14T14:13:03.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:03 smithi069 ceph-mon[42034]: pgmap v75: 97 pgs: 97 active+clean; 2.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 7 op/s 2023-12-14T14:13:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:03 smithi081 ceph-mon[43371]: pgmap v75: 97 pgs: 97 active+clean; 2.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 7 op/s 2023-12-14T14:13:04.182 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:04.182 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:04.299 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:04.299 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:04.307 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:04.307 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:04.307 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 98 -lt 100 ']' 2023-12-14T14:13:04.307 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 98 + 1 2023-12-14T14:13:04.341 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=99 2023-12-14T14:13:04.342 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:04.382 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:04.382 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:04.383 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:13:04.383 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:13:04.383 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:13:04.758 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:04.758 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:04.891 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:04.891 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:04.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:04.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:04.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 99 -lt 100 ']' 2023-12-14T14:13:04.919 INFO:tasks.workunit.client.0.smithi069.stderr:++ expr 99 + 1 2023-12-14T14:13:04.947 INFO:tasks.workunit.client.0.smithi069.stderr:+ c=100 2023-12-14T14:13:04.947 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:04.982 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:04.982 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:04.983 INFO:tasks.workunit.client.0.smithi069.stderr:+ c1=2 2023-12-14T14:13:04.983 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 3 2023-12-14T14:13:04.983 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo tee /proc/sys/vm/drop_caches 2023-12-14T14:13:05.382 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfacl d1 2023-12-14T14:13:05.382 INFO:tasks.workunit.client.0.smithi069.stderr:++ grep -c nobody:rw 2023-12-14T14:13:05.516 INFO:tasks.workunit.client.0.smithi069.stderr:+ c2=2 2023-12-14T14:13:05.516 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:05.523 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:05.524 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 2 -ne 2 ']' 2023-12-14T14:13:05.524 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 100 -lt 100 ']' 2023-12-14T14:13:05.532 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir d1 2023-12-14T14:13:05.565 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n system.posix_acl_access -v 0x02000000 d1 2023-12-14T14:13:05.575 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n system.posix_acl_default -v 0x02000000 . 2023-12-14T14:13:05.578 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_failure getfattr -n system.posix_acl_access d1 2023-12-14T14:13:05.578 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n system.posix_acl_access d1 2023-12-14T14:13:05.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:05 smithi069 ceph-mon[42034]: pgmap v76: 97 pgs: 97 active+clean; 2.8 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 52 KiB/s wr, 23 op/s 2023-12-14T14:13:05.600 INFO:tasks.workunit.client.0.smithi069.stderr:d1: system.posix_acl_access: No such attribute 2023-12-14T14:13:05.600 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-12-14T14:13:05.600 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_failure getfattr -n system.posix_acl_default . 2023-12-14T14:13:05.601 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n system.posix_acl_default . 2023-12-14T14:13:05.601 INFO:tasks.workunit.client.0.smithi069.stderr:.: system.posix_acl_default: No such attribute 2023-12-14T14:13:05.601 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-12-14T14:13:05.601 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir d1 2023-12-14T14:13:05.604 INFO:tasks.workunit.client.0.smithi069.stderr:+ cd .. 2023-12-14T14:13:05.604 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir testdir 2023-12-14T14:13:05.613 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo OK 2023-12-14T14:13:05.614 INFO:tasks.workunit.client.0.smithi069.stdout:OK 2023-12-14T14:13:05.615 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T14:13:05.615 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T14:13:05.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:05 smithi119 ceph-mon[43834]: pgmap v76: 97 pgs: 97 active+clean; 2.8 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 52 KiB/s wr, 23 op/s 2023-12-14T14:13:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:05 smithi081 ceph-mon[43371]: pgmap v76: 97 pgs: 97 active+clean; 2.8 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 52 KiB/s wr, 23 op/s 2023-12-14T14:13:06.080 INFO:tasks.workunit:Running workunit fs/misc/chmod.sh... 2023-12-14T14:13:06.080 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/chmod.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2023-12-14T14:13:06.175 INFO:tasks.workunit.client.0.smithi069.stderr:+ set -e 2023-12-14T14:13:06.175 INFO:tasks.workunit.client.0.smithi069.stderr:+ file=test_chmod.95701 2023-12-14T14:13:06.175 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo foo 2023-12-14T14:13:06.179 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T14:13:06.179 INFO:tasks.workunit.client.0.smithi069.stderr:+ chmod 400 test_chmod.95701 2023-12-14T14:13:06.181 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T14:13:06.181 INFO:tasks.workunit.client.0.smithi069.stderr:+ check_perms test_chmod.95701 -r-------- 2023-12-14T14:13:06.181 INFO:tasks.workunit.client.0.smithi069.stderr:+ file=test_chmod.95701 2023-12-14T14:13:06.181 INFO:tasks.workunit.client.0.smithi069.stderr:++ ls -la test_chmod.95701 2023-12-14T14:13:06.183 INFO:tasks.workunit.client.0.smithi069.stderr:+ r='-r--------. 1 ubuntu ubuntu 4 Dec 14 14:13 test_chmod.95701' 2023-12-14T14:13:06.183 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T14:13:06.183 INFO:tasks.workunit.client.0.smithi069.stderr:+ perms=-r-------- 2023-12-14T14:13:06.184 INFO:tasks.workunit.client.0.smithi069.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Dec 14 14:13 test_chmod.95701 2023-12-14T14:13:06.184 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1}' 2023-12-14T14:13:06.256 INFO:tasks.workunit.client.0.smithi069.stderr:+ test -r-------- '!=' -r--------. 2023-12-14T14:13:06.257 INFO:tasks.workunit.client.0.smithi069.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Dec 14 14:13 test_chmod.95701 2023-12-14T14:13:06.257 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1}' 2023-12-14T14:13:06.259 INFO:tasks.workunit.client.0.smithi069.stderr:+ test -r--------. '!=' -r--------. 2023-12-14T14:13:06.259 INFO:tasks.workunit.client.0.smithi069.stderr:+ set +e 2023-12-14T14:13:06.259 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo bar 2023-12-14T14:13:06.260 INFO:tasks.workunit.client.0.smithi069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh: line 40: test_chmod.95701: Permission denied 2023-12-14T14:13:06.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 1 = 0 2023-12-14T14:13:06.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ set -e 2023-12-14T14:13:06.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ chmod 600 test_chmod.95701 2023-12-14T14:13:06.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo bar 2023-12-14T14:13:06.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T14:13:06.261 INFO:tasks.workunit.client.0.smithi069.stderr:+ check_perms test_chmod.95701 -rw------- 2023-12-14T14:13:06.261 INFO:tasks.workunit.client.0.smithi069.stderr:+ file=test_chmod.95701 2023-12-14T14:13:06.261 INFO:tasks.workunit.client.0.smithi069.stderr:++ ls -la test_chmod.95701 2023-12-14T14:13:06.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ r='-rw-------. 1 ubuntu ubuntu 8 Dec 14 14:13 test_chmod.95701' 2023-12-14T14:13:06.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T14:13:06.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ perms=-rw------- 2023-12-14T14:13:06.262 INFO:tasks.workunit.client.0.smithi069.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Dec 14 14:13 test_chmod.95701 2023-12-14T14:13:06.262 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1}' 2023-12-14T14:13:06.264 INFO:tasks.workunit.client.0.smithi069.stderr:+ test -rw------- '!=' -rw-------. 2023-12-14T14:13:06.264 INFO:tasks.workunit.client.0.smithi069.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Dec 14 14:13 test_chmod.95701 2023-12-14T14:13:06.264 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1}' 2023-12-14T14:13:06.266 INFO:tasks.workunit.client.0.smithi069.stderr:+ test -rw-------. '!=' -rw-------. 2023-12-14T14:13:06.267 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo foo 2023-12-14T14:13:06.267 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T14:13:06.267 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T14:13:06.267 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T14:13:06.317 INFO:tasks.workunit:Running workunit fs/misc/dac_override.sh... 2023-12-14T14:13:06.317 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/dac_override.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2023-12-14T14:13:06.342 INFO:tasks.workunit.client.0.smithi069.stderr:+ set -e 2023-12-14T14:13:06.342 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir -p testdir 2023-12-14T14:13:06.344 INFO:tasks.workunit.client.0.smithi069.stderr:+ file=test_chmod.95760 2023-12-14T14:13:06.344 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo foo 2023-12-14T14:13:06.346 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo chmod 600 testdir 2023-12-14T14:13:06.368 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_failure cat testdir/test_chmod.95760 2023-12-14T14:13:06.368 INFO:tasks.workunit.client.0.smithi069.stderr:+ cat testdir/test_chmod.95760 2023-12-14T14:13:06.370 INFO:tasks.workunit.client.0.smithi069.stderr:cat: testdir/test_chmod.95760: Permission denied 2023-12-14T14:13:06.370 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-12-14T14:13:06.370 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo cat testdir/test_chmod.95760 2023-12-14T14:13:06.381 INFO:tasks.workunit.client.0.smithi069.stdout:foo 2023-12-14T14:13:06.382 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T14:13:06.382 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T14:13:06.471 INFO:tasks.workunit:Running workunit fs/misc/direct_io.py... 2023-12-14T14:13:06.472 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/direct_io.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/direct_io.py 2023-12-14T14:13:07.365 INFO:tasks.workunit.client.0.smithi069.stdout:ok 2023-12-14T14:13:07.369 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T14:13:07.370 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T14:13:07.412 INFO:tasks.workunit:Running workunit fs/misc/dirfrag.sh... 2023-12-14T14:13:07.412 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/dirfrag.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dirfrag.sh 2023-12-14T14:13:07.495 INFO:tasks.workunit.client.0.smithi069.stdout:creating folder hierarchy 2023-12-14T14:13:07.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:07 smithi069 ceph-mon[42034]: pgmap v77: 97 pgs: 97 active+clean; 2.8 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 KiB/s wr, 19 op/s 2023-12-14T14:13:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:07 smithi081 ceph-mon[43371]: pgmap v77: 97 pgs: 97 active+clean; 2.8 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 KiB/s wr, 19 op/s 2023-12-14T14:13:07.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:07 smithi119 ceph-mon[43834]: pgmap v77: 97 pgs: 97 active+clean; 2.8 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 KiB/s wr, 19 op/s 2023-12-14T14:13:09.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:09 smithi119 ceph-mon[43834]: pgmap v78: 97 pgs: 97 active+clean; 2.8 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 KiB/s wr, 19 op/s 2023-12-14T14:13:09.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:09 smithi069 ceph-mon[42034]: pgmap v78: 97 pgs: 97 active+clean; 2.8 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 KiB/s wr, 19 op/s 2023-12-14T14:13:09.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:09 smithi081 ceph-mon[43371]: pgmap v78: 97 pgs: 97 active+clean; 2.8 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 KiB/s wr, 19 op/s 2023-12-14T14:13:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:11 smithi119 ceph-mon[43834]: pgmap v79: 97 pgs: 97 active+clean; 3.1 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 64 KiB/s wr, 24 op/s 2023-12-14T14:13:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:11 smithi069 ceph-mon[42034]: pgmap v79: 97 pgs: 97 active+clean; 3.1 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 64 KiB/s wr, 24 op/s 2023-12-14T14:13:11.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:11 smithi081 ceph-mon[43371]: pgmap v79: 97 pgs: 97 active+clean; 3.1 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 64 KiB/s wr, 24 op/s 2023-12-14T14:13:13.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:13 smithi119 ceph-mon[43834]: pgmap v80: 97 pgs: 97 active+clean; 3.1 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-12-14T14:13:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:13 smithi069 ceph-mon[42034]: pgmap v80: 97 pgs: 97 active+clean; 3.1 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-12-14T14:13:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:13 smithi081 ceph-mon[43371]: pgmap v80: 97 pgs: 97 active+clean; 3.1 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-12-14T14:13:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:15 smithi119 ceph-mon[43834]: pgmap v81: 97 pgs: 97 active+clean; 17 MiB data, 96 MiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.3 MiB/s wr, 43 op/s 2023-12-14T14:13:15.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:15 smithi069 ceph-mon[42034]: pgmap v81: 97 pgs: 97 active+clean; 17 MiB data, 96 MiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.3 MiB/s wr, 43 op/s 2023-12-14T14:13:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:15 smithi081 ceph-mon[43371]: pgmap v81: 97 pgs: 97 active+clean; 17 MiB data, 96 MiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.3 MiB/s wr, 43 op/s 2023-12-14T14:13:17.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:17 smithi069 ceph-mon[42034]: pgmap v82: 97 pgs: 97 active+clean; 17 MiB data, 96 MiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-12-14T14:13:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:17 smithi081 ceph-mon[43371]: pgmap v82: 97 pgs: 97 active+clean; 17 MiB data, 96 MiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-12-14T14:13:17.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:17 smithi119 ceph-mon[43834]: pgmap v82: 97 pgs: 97 active+clean; 17 MiB data, 96 MiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-12-14T14:13:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:19 smithi119 ceph-mon[43834]: pgmap v83: 97 pgs: 97 active+clean; 17 MiB data, 96 MiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-12-14T14:13:19.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:19 smithi069 ceph-mon[42034]: pgmap v83: 97 pgs: 97 active+clean; 17 MiB data, 96 MiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-12-14T14:13:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:19 smithi081 ceph-mon[43371]: pgmap v83: 97 pgs: 97 active+clean; 17 MiB data, 96 MiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-12-14T14:13:21.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:21 smithi119 ceph-mon[43834]: pgmap v84: 97 pgs: 97 active+clean; 27 MiB data, 118 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 89 op/s 2023-12-14T14:13:21.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:21 smithi069 ceph-mon[42034]: pgmap v84: 97 pgs: 97 active+clean; 27 MiB data, 118 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 89 op/s 2023-12-14T14:13:21.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:21 smithi081 ceph-mon[43371]: pgmap v84: 97 pgs: 97 active+clean; 27 MiB data, 118 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 89 op/s 2023-12-14T14:13:23.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:23 smithi119 ceph-mon[43834]: pgmap v85: 97 pgs: 97 active+clean; 27 MiB data, 118 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 84 op/s 2023-12-14T14:13:23.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:23 smithi069 ceph-mon[42034]: pgmap v85: 97 pgs: 97 active+clean; 27 MiB data, 118 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 84 op/s 2023-12-14T14:13:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:23 smithi081 ceph-mon[43371]: pgmap v85: 97 pgs: 97 active+clean; 27 MiB data, 118 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 84 op/s 2023-12-14T14:13:25.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:25 smithi119 ceph-mon[43834]: pgmap v86: 97 pgs: 97 active+clean; 41 MiB data, 128 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 93 op/s 2023-12-14T14:13:25.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:25 smithi069 ceph-mon[42034]: pgmap v86: 97 pgs: 97 active+clean; 41 MiB data, 128 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 93 op/s 2023-12-14T14:13:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:25 smithi081 ceph-mon[43371]: pgmap v86: 97 pgs: 97 active+clean; 41 MiB data, 128 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 93 op/s 2023-12-14T14:13:26.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:26 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:26.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:26 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:26.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:26 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:27.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:27 smithi119 ceph-mon[43834]: pgmap v87: 97 pgs: 97 active+clean; 41 MiB data, 128 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 70 op/s 2023-12-14T14:13:27.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:27 smithi069 ceph-mon[42034]: pgmap v87: 97 pgs: 97 active+clean; 41 MiB data, 128 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 70 op/s 2023-12-14T14:13:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:27 smithi081 ceph-mon[43371]: pgmap v87: 97 pgs: 97 active+clean; 41 MiB data, 128 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 70 op/s 2023-12-14T14:13:29.652 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:13:29.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:29 smithi119 ceph-mon[43834]: pgmap v88: 97 pgs: 97 active+clean; 41 MiB data, 128 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 70 op/s 2023-12-14T14:13:29.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:29 smithi069 ceph-mon[42034]: pgmap v88: 97 pgs: 97 active+clean; 41 MiB data, 128 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 70 op/s 2023-12-14T14:13:29.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:29 smithi081 ceph-mon[43371]: pgmap v88: 97 pgs: 97 active+clean; 41 MiB data, 128 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 70 op/s 2023-12-14T14:13:30.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.042+0000 7feb2bbd1700 1 -- 172.21.15.69:0/965029983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb24105240 msgr2=0x7feb24105610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.042+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/965029983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb24105240 0x7feb24105610 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7feb14009990 tx=0x7feb14009ca0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.042+0000 7feb2bbd1700 1 -- 172.21.15.69:0/965029983 shutdown_connections 2023-12-14T14:13:30.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.042+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/965029983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb24100310 0x7feb2410bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.042+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/965029983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb24105240 0x7feb24105610 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.042+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/965029983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb240ff960 0x7feb240ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.042+0000 7feb2bbd1700 1 -- 172.21.15.69:0/965029983 >> 172.21.15.69:0/965029983 conn(0x7feb24076280 msgr2=0x7feb24076680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.042+0000 7feb2bbd1700 1 -- 172.21.15.69:0/965029983 shutdown_connections 2023-12-14T14:13:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.043+0000 7feb2bbd1700 1 -- 172.21.15.69:0/965029983 wait complete. 2023-12-14T14:13:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.043+0000 7feb2bbd1700 1 Processor -- start 2023-12-14T14:13:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.043+0000 7feb2bbd1700 1 -- start start 2023-12-14T14:13:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2bbd1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb240ff960 0x7feb24197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2bbd1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb24100310 0x7feb24197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2bbd1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb24105240 0x7feb241a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2bbd1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb241a2800 con 0x7feb24105240 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2bbd1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb241a2940 con 0x7feb240ff960 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2bbd1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb241a2a80 con 0x7feb24100310 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2996d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb240ff960 0x7feb24197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2996d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb240ff960 0x7feb24197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:46114/0 (socket says 172.21.15.69:46114) 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2996d700 1 -- 172.21.15.69:0/3075485509 learned_addr learned my addr 172.21.15.69:0/3075485509 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2916c700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb24100310 0x7feb24197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2a16e700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb24105240 0x7feb241a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2996d700 1 -- 172.21.15.69:0/3075485509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb24100310 msgr2=0x7feb24197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2996d700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb24100310 0x7feb24197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2996d700 1 -- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb24105240 msgr2=0x7feb241a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2996d700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb24105240 0x7feb241a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2996d700 1 -- 172.21.15.69:0/3075485509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140095f0 con 0x7feb240ff960 2023-12-14T14:13:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2916c700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb24100310 0x7feb24197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:30.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.044+0000 7feb2996d700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb240ff960 0x7feb24197240 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb14000c00 tx=0x7feb14005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.045+0000 7feb1affd700 1 -- 172.21.15.69:0/3075485509 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1401d070 con 0x7feb240ff960 2023-12-14T14:13:30.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.045+0000 7feb1affd700 1 -- 172.21.15.69:0/3075485509 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb14022470 con 0x7feb240ff960 2023-12-14T14:13:30.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.045+0000 7feb1affd700 1 -- 172.21.15.69:0/3075485509 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14017650 con 0x7feb240ff960 2023-12-14T14:13:30.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.045+0000 7feb2bbd1700 1 -- 172.21.15.69:0/3075485509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2410f230 con 0x7feb240ff960 2023-12-14T14:13:30.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.045+0000 7feb2bbd1700 1 -- 172.21.15.69:0/3075485509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2410f0a0 con 0x7feb240ff960 2023-12-14T14:13:30.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.048+0000 7feb1affd700 1 -- 172.21.15.69:0/3075485509 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7feb140225e0 con 0x7feb240ff960 2023-12-14T14:13:30.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.048+0000 7feb1affd700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7feb100a13c0 0x7feb100a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.048+0000 7feb1affd700 1 -- 172.21.15.69:0/3075485509 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7feb140ce080 con 0x7feb240ff960 2023-12-14T14:13:30.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.049+0000 7feb2916c700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7feb100a13c0 0x7feb100a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.049+0000 7feb2916c700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7feb100a13c0 0x7feb100a3870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb20011490 tx=0x7feb20009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.077+0000 7feb37d5fb80 1 Processor -- start 2023-12-14T14:13:30.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb37d5fb80 1 -- start start 2023-12-14T14:13:30.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e5b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 0x55d040e66610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 0x55d040e68f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040d455e0 con 0x55d040e5bc90 2023-12-14T14:13:30.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040db4870 con 0x55d040e66b50 2023-12-14T14:13:30.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040dadd00 con 0x55d040e5b380 2023-12-14T14:13:30.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2916c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 0x55d040e66610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2996d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e5b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2996d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e5b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:60176/0 (socket says 172.21.15.69:60176) 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2916c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 0x55d040e66610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35746/0 (socket says 172.21.15.69:35746) 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2996d700 1 -- 172.21.15.69:0/575484955 learned_addr learned my addr 172.21.15.69:0/575484955 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2a16e700 1 --2- 172.21.15.69:0/575484955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 0x55d040e68f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2996d700 1 -- 172.21.15.69:0/575484955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 msgr2=0x55d040e68f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2996d700 1 --2- 172.21.15.69:0/575484955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 0x55d040e68f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2996d700 1 -- 172.21.15.69:0/575484955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 msgr2=0x55d040e66610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2996d700 1 --2- 172.21.15.69:0/575484955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 0x55d040e66610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.078+0000 7feb2996d700 1 -- 172.21.15.69:0/575484955 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d040c2f3b0 con 0x55d040e5b380 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.079+0000 7feb2996d700 1 --2- 172.21.15.69:0/575484955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e5b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb14097c30 tx=0x7feb14009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8dbcacac851ff06 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.079+0000 7feb0ffff700 1 -- 172.21.15.69:0/575484955 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1409f020 con 0x55d040e5b380 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.079+0000 7feb0ffff700 1 -- 172.21.15.69:0/575484955 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb140a1070 con 0x55d040e5b380 2023-12-14T14:13:30.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.079+0000 7feb0ffff700 1 -- 172.21.15.69:0/575484955 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1409b680 con 0x55d040e5b380 2023-12-14T14:13:30.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 -- 172.21.15.69:0/575484955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 msgr2=0x55d040e5b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/575484955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e5b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb14097c30 tx=0x7feb14009310 comp rx=0 tx=0).stop 2023-12-14T14:13:30.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 -- 172.21.15.69:0/575484955 shutdown_connections 2023-12-14T14:13:30.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/575484955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 0x55d040e68f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/575484955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e5b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/575484955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 0x55d040e66610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 -- 172.21.15.69:0/575484955 >> 172.21.15.69:0/575484955 conn(0x55d040e51ca0 msgr2=0x55d040e577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 -- 172.21.15.69:0/575484955 shutdown_connections 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 -- 172.21.15.69:0/575484955 wait complete. 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 -- start start 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.080+0000 7feb37d5fb80 1 Processor -- start 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5b380 0x55d040e66390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 0x55d040e63720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e66b50 0x55d040e63c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040d49f90 con 0x55d040e5bc90 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040d49c30 con 0x55d040e5b380 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040c316a0 con 0x55d040e66b50 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb37d5fb80 10 client.0 _ll_register_callbacks cb 0x55d040d6d910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb2996d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5b380 0x55d040e66390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb2916c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 0x55d040e63720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb2996d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5b380 0x55d040e66390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:46140/0 (socket says 172.21.15.69:46140) 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb2996d700 1 -- 172.21.15.69:0/3380897825 learned_addr learned my addr 172.21.15.69:0/3380897825 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.081+0000 7feb2a16e700 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e66b50 0x55d040e63c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb2996d700 1 -- 172.21.15.69:0/3380897825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e66b50 msgr2=0x55d040e63c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb2996d700 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e66b50 0x55d040e63c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb2996d700 1 -- 172.21.15.69:0/3380897825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 msgr2=0x55d040e63720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb2996d700 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 0x55d040e63720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb2996d700 1 -- 172.21.15.69:0/3380897825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2410f0a0 con 0x55d040e5b380 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb2996d700 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5b380 0x55d040e66390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb1409b150 tx=0x7feb1400b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca481f26e0cd5641 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb0d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb0d7fa700 1 -- 172.21.15.69:0/3380897825 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1409b1c0 con 0x55d040e5b380 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb0d7fa700 1 -- 172.21.15.69:0/3380897825 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7feb140b9030 con 0x55d040e5b380 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3380897825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d040e4f2b0 con 0x55d040e5b380 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb0d7fa700 1 -- 172.21.15.69:0/3380897825 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb1409f1f0 con 0x55d040e5b380 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb37d5fb80 10 client.25481 fetch_fsmap learned FSMap version 23 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3380897825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55d040d74170 con 0x55d040e5b380 2023-12-14T14:13:30.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.082+0000 7feb0d7fa700 1 -- 172.21.15.69:0/3380897825 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d040e4f2b0 con 0x55d040e5b380 2023-12-14T14:13:30.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.083+0000 7feb0d7fa700 1 -- 172.21.15.69:0/3380897825 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7466+0+0 (secure 0 0 0) 0x7feb140a30f0 con 0x55d040e5b380 2023-12-14T14:13:30.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.083+0000 7feb37d5fb80 10 client.25481 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T14:13:30.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.083+0000 7feb37d5fb80 10 client.25481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:13:30.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.084+0000 7feb37d5fb80 20 client.25481 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:30.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.084+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d040e7a0d0 0x55d040e7c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.084+0000 7feb37d5fb80 4 client.25481 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:13:30.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.084+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3380897825 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d040da6ce0 con 0x55d040e7a0d0 2023-12-14T14:13:30.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.084+0000 7feb2916c700 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d040e7a0d0 0x55d040e7c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.084+0000 7feb2916c700 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d040e7a0d0 0x55d040e7c4b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2f043674bf48938 server_cookie=e68b83f788df8aa9 in_seq=0 out_seq=0 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.084+0000 7feb0d7fa700 10 client.25481 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.085+0000 7feb0d7fa700 1 -- 172.21.15.69:0/3380897825 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d040da6ce0 con 0x55d040e7a0d0 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.085+0000 7feb0d7fa700 10 client.25481 handle_command_reply: tid=0 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.085+0000 7feb37d5fb80 1 client.25481 shutdown 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3380897825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5b380 msgr2=0x55d040e66390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5b380 0x55d040e66390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb1409b150 tx=0x7feb1400b690 comp rx=0 tx=0).stop 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3380897825 shutdown_connections 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d040e7a0d0 0x55d040e7c4b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e66b50 0x55d040e63c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5b380 0x55d040e66390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3380897825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5bc90 0x55d040e63720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3380897825 >> 172.21.15.69:0/3380897825 conn(0x55d040e51ca0 msgr2=0x55d040e573d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb0d7fa700 0 client.25481 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:30.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3380897825 shutdown_connections 2023-12-14T14:13:30.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3380897825 wait complete. 2023-12-14T14:13:30.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.086+0000 7feb37d5fb80 20 client.25481 trim_cache size 0 max 16384 2023-12-14T14:13:30.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.107+0000 7feb37d5fb80 1 Processor -- start 2023-12-14T14:13:30.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.107+0000 7feb37d5fb80 1 -- start start 2023-12-14T14:13:30.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.107+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e65ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.107+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5bc90 0x55d040e572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.107+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e66b50 0x55d040e57820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.107+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040e51820 con 0x55d040e66b50 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.107+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040e5c580 con 0x55d040e5bc90 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.107+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040e61ca0 con 0x55d040e5b380 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2996d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e65ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2a16e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e66b50 0x55d040e57820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2996d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e65ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:60190/0 (socket says 172.21.15.69:60190) 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2996d700 1 -- 172.21.15.69:0/3938442354 learned_addr learned my addr 172.21.15.69:0/3938442354 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2916c700 1 --2- 172.21.15.69:0/3938442354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5bc90 0x55d040e572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2996d700 1 -- 172.21.15.69:0/3938442354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5bc90 msgr2=0x55d040e572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2996d700 1 --2- 172.21.15.69:0/3938442354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5bc90 0x55d040e572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2996d700 1 -- 172.21.15.69:0/3938442354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e66b50 msgr2=0x55d040e57820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2996d700 1 --2- 172.21.15.69:0/3938442354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e66b50 0x55d040e57820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2996d700 1 -- 172.21.15.69:0/3938442354 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d040e69040 con 0x55d040e5b380 2023-12-14T14:13:30.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2916c700 1 --2- 172.21.15.69:0/3938442354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5bc90 0x55d040e572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:13:30.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb2996d700 1 --2- 172.21.15.69:0/3938442354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e65ec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb14009580 tx=0x7feb14009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa366e4d0e30050b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb18dac700 1 -- 172.21.15.69:0/3938442354 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1409b1c0 con 0x55d040e5b380 2023-12-14T14:13:30.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb18dac700 1 -- 172.21.15.69:0/3938442354 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb140a3580 con 0x55d040e5b380 2023-12-14T14:13:30.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.108+0000 7feb18dac700 1 -- 172.21.15.69:0/3938442354 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1409bfa0 con 0x55d040e5b380 2023-12-14T14:13:30.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.109+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3938442354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 msgr2=0x55d040e65ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.109+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3938442354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e65ec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb14009580 tx=0x7feb14009310 comp rx=0 tx=0).stop 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.109+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3938442354 shutdown_connections 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.109+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3938442354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e66b50 0x55d040e57820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.109+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3938442354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5b380 0x55d040e65ec0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.109+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/3938442354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e5bc90 0x55d040e572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.109+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3938442354 >> 172.21.15.69:0/3938442354 conn(0x55d040e51ca0 msgr2=0x55d040e5ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.109+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3938442354 shutdown_connections 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.109+0000 7feb37d5fb80 1 -- 172.21.15.69:0/3938442354 wait complete. 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb37d5fb80 1 -- start start 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb37d5fb80 1 Processor -- start 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5b380 0x55d040e6f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5bc90 0x55d040e6fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb37d5fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 0x55d040e70310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040eccfd0 con 0x55d040e5b380 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040ecd110 con 0x55d040e66b50 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb37d5fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040ecd2d0 con 0x55d040e5bc90 2023-12-14T14:13:30.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb37d5fb80 10 client.0 _ll_register_callbacks cb 0x7feb20004030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb2996d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5b380 0x55d040e6f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb2996d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5b380 0x55d040e6f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35786/0 (socket says 172.21.15.69:35786) 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb2996d700 1 -- 172.21.15.69:0/1088033937 learned_addr learned my addr 172.21.15.69:0/1088033937 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.110+0000 7feb2a16e700 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 0x55d040e70310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb2916c700 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5bc90 0x55d040e6fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb2996d700 1 -- 172.21.15.69:0/1088033937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5bc90 msgr2=0x55d040e6fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb2996d700 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5bc90 0x55d040e6fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb2996d700 1 -- 172.21.15.69:0/1088033937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 msgr2=0x55d040e70310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb2996d700 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 0x55d040e70310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb2996d700 1 -- 172.21.15.69:0/1088033937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d040d74170 con 0x55d040e5b380 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb2916c700 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5bc90 0x55d040e6fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb2996d700 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5b380 0x55d040e6f890 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7feb140976c0 tx=0x7feb14022c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba22ee29ae12b9f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb0d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:13:30.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb0d7fa700 1 -- 172.21.15.69:0/1088033937 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14097500 con 0x55d040e5b380 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb0d7fa700 1 -- 172.21.15.69:0/1088033937 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7feb140b7070 con 0x55d040e5b380 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.111+0000 7feb37d5fb80 1 -- 172.21.15.69:0/1088033937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb140a1070 con 0x55d040e5b380 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb0d7fa700 1 -- 172.21.15.69:0/1088033937 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb1409f1f0 con 0x55d040e5b380 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb37d5fb80 10 client.15957 fetch_fsmap learned FSMap version 23 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb37d5fb80 1 -- 172.21.15.69:0/1088033937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55d040bdbb60 con 0x55d040e5b380 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb0d7fa700 1 -- 172.21.15.69:0/1088033937 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb140a1070 con 0x55d040e5b380 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb0d7fa700 1 -- 172.21.15.69:0/1088033937 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 23) v1 ==== 7466+0+0 (secure 0 0 0) 0x7feb140c5400 con 0x55d040e5b380 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb37d5fb80 10 client.15957 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb37d5fb80 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb37d5fb80 20 client.15957 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d040ece510 0x55d040ed08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb37d5fb80 4 client.15957 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb37d5fb80 1 -- 172.21.15.69:0/1088033937 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d040da6a00 con 0x55d040ece510 2023-12-14T14:13:30.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.112+0000 7feb2916c700 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d040ece510 0x55d040ed08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.113+0000 7feb0d7fa700 10 client.15957 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.113+0000 7feb2916c700 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d040ece510 0x55d040ed08f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f075a3d4b4dae1b6 server_cookie=d0ff53369166581f in_seq=0 out_seq=0 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb0d7fa700 1 -- 172.21.15.69:0/1088033937 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d040da6a00 con 0x55d040ece510 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb0d7fa700 10 client.15957 handle_command_reply: tid=0 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb37d5fb80 1 client.15957 shutdown 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb37d5fb80 1 -- 172.21.15.69:0/1088033937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5b380 msgr2=0x55d040e6f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5b380 0x55d040e6f890 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7feb140976c0 tx=0x7feb14022c80 comp rx=0 tx=0).stop 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb37d5fb80 1 -- 172.21.15.69:0/1088033937 shutdown_connections 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d040ece510 0x55d040ed08f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d040e66b50 0x55d040e70310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d040e5b380 0x55d040e6f890 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb0d7fa700 0 client.15957 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb37d5fb80 1 --2- 172.21.15.69:0/1088033937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d040e5bc90 0x55d040e6fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.115+0000 7feb37d5fb80 1 -- 172.21.15.69:0/1088033937 >> 172.21.15.69:0/1088033937 conn(0x55d040e51ca0 msgr2=0x55d040e57280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb37d5fb80 1 -- 172.21.15.69:0/1088033937 shutdown_connections 2023-12-14T14:13:30.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb37d5fb80 1 -- 172.21.15.69:0/1088033937 wait complete. 2023-12-14T14:13:30.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb37d5fb80 20 client.15957 trim_cache size 0 max 16384 2023-12-14T14:13:30.117 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:13:30.117 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:13:30.117 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:13:30.117 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 -- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7feb100a13c0 msgr2=0x7feb100a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7feb100a13c0 0x7feb100a3870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb20011490 tx=0x7feb20009260 comp rx=0 tx=0).stop 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 -- 172.21.15.69:0/3075485509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb240ff960 msgr2=0x7feb24197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb240ff960 0x7feb24197240 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb14000c00 tx=0x7feb14005740 comp rx=0 tx=0).stop 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 -- 172.21.15.69:0/3075485509 shutdown_connections 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7feb100a13c0 0x7feb100a3870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb24105240 0x7feb241a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb240ff960 0x7feb24197240 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 --2- 172.21.15.69:0/3075485509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb24100310 0x7feb24197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 -- 172.21.15.69:0/3075485509 >> 172.21.15.69:0/3075485509 conn(0x7feb24076280 msgr2=0x7feb240fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.116+0000 7feb2bbd1700 1 -- 172.21.15.69:0/3075485509 shutdown_connections 2023-12-14T14:13:30.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.117+0000 7feb2bbd1700 1 -- 172.21.15.69:0/3075485509 wait complete. 2023-12-14T14:13:30.132 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:13:30.132 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:13:30.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.270+0000 7f9d0d685700 1 -- 172.21.15.69:0/3463680017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d080ff900 msgr2=0x7f9d0810c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.270+0000 7f9d0d685700 1 --2- 172.21.15.69:0/3463680017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d080ff900 0x7f9d0810c660 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009990 tx=0x7f9cf8009ca0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.270+0000 7f9d0d685700 1 -- 172.21.15.69:0/3463680017 shutdown_connections 2023-12-14T14:13:30.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.270+0000 7f9d0d685700 1 --2- 172.21.15.69:0/3463680017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d0810cba0 0x7f9d0810ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.270+0000 7f9d0d685700 1 --2- 172.21.15.69:0/3463680017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d080feff0 0x7f9d080ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.270+0000 7f9d0d685700 1 --2- 172.21.15.69:0/3463680017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d080ff900 0x7f9d0810c660 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.270+0000 7f9d0d685700 1 -- 172.21.15.69:0/3463680017 >> 172.21.15.69:0/3463680017 conn(0x7f9d08076370 msgr2=0x7f9d08076770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.270+0000 7f9d0d685700 1 -- 172.21.15.69:0/3463680017 shutdown_connections 2023-12-14T14:13:30.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.270+0000 7f9d0d685700 1 -- 172.21.15.69:0/3463680017 wait complete. 2023-12-14T14:13:30.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.271+0000 7f9d0d685700 1 Processor -- start 2023-12-14T14:13:30.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.271+0000 7f9d0d685700 1 -- start start 2023-12-14T14:13:30.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.271+0000 7f9d0d685700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d080feff0 0x7f9d081985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.271+0000 7f9d0d685700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d080ff900 0x7f9d08198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.271+0000 7f9d0d685700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0810cba0 0x7f9d0819cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.271+0000 7f9d0d685700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0819d5b0 con 0x7f9d0810cba0 2023-12-14T14:13:30.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.271+0000 7f9d0d685700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0819d720 con 0x7f9d080ff900 2023-12-14T14:13:30.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.271+0000 7f9d0d685700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0819d8e0 con 0x7f9d080feff0 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0810cba0 0x7f9d0819cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d06ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d080feff0 0x7f9d081985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d06ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d080feff0 0x7f9d081985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:60208/0 (socket says 172.21.15.69:60208) 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0810cba0 0x7f9d0819cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35798/0 (socket says 172.21.15.69:35798) 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d06ffd700 1 -- 172.21.15.69:0/2059366384 learned_addr learned my addr 172.21.15.69:0/2059366384 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d067fc700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d080ff900 0x7f9d08198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d067fc700 1 -- 172.21.15.69:0/2059366384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d080feff0 msgr2=0x7f9d081985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d067fc700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d080feff0 0x7f9d081985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d067fc700 1 -- 172.21.15.69:0/2059366384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0810cba0 msgr2=0x7f9d0819cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d067fc700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0810cba0 0x7f9d0819cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d067fc700 1 -- 172.21.15.69:0/2059366384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf80095f0 con 0x7f9d080ff900 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d067fc700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d080ff900 0x7f9d08198b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8000c00 tx=0x7f9cf8009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9ceffff700 1 -- 172.21.15.69:0/2059366384 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf801d070 con 0x7f9d080ff900 2023-12-14T14:13:30.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d081124a0 con 0x7f9d080ff900 2023-12-14T14:13:30.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9ceffff700 1 -- 172.21.15.69:0/2059366384 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cf8022470 con 0x7f9d080ff900 2023-12-14T14:13:30.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9ceffff700 1 -- 172.21.15.69:0/2059366384 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8017650 con 0x7f9d080ff900 2023-12-14T14:13:30.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.272+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d08112310 con 0x7f9d080ff900 2023-12-14T14:13:30.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.273+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d08112630 con 0x7f9d080ff900 2023-12-14T14:13:30.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.275+0000 7f9ceffff700 1 -- 172.21.15.69:0/2059366384 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9cf80225e0 con 0x7f9d080ff900 2023-12-14T14:13:30.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.275+0000 7f9ceffff700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f9cf00a12c0 0x7f9cf00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.275+0000 7f9d06ffd700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f9cf00a12c0 0x7f9cf00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.275+0000 7f9ceffff700 1 -- 172.21.15.69:0/2059366384 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f9cf80ce270 con 0x7f9d080ff900 2023-12-14T14:13:30.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.276+0000 7f9d06ffd700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f9cf00a12c0 0x7f9cf00a3770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d20 tx=0x7f9cfc009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.282+0000 7f9ceffff700 1 -- 172.21.15.69:0/2059366384 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9cf8097750 con 0x7f9d080ff900 2023-12-14T14:13:30.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.564+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d080679f0 con 0x7f9d080ff900 2023-12-14T14:13:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.565+0000 7f9ceffff700 1 -- 172.21.15.69:0/2059366384 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10804 (secure 0 0 0) 0x7f9cf809ad70 con 0x7f9d080ff900 2023-12-14T14:13:30.565 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:13:30.565 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:13:30.439735+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:13:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f9cf00a12c0 msgr2=0x7f9cf00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f9cf00a12c0 0x7f9cf00a3770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d20 tx=0x7f9cfc009260 comp rx=0 tx=0).stop 2023-12-14T14:13:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d080ff900 msgr2=0x7f9d08198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d080ff900 0x7f9d08198b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8000c00 tx=0x7f9cf8009580 comp rx=0 tx=0).stop 2023-12-14T14:13:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 shutdown_connections 2023-12-14T14:13:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f9cf00a12c0 0x7f9cf00a3770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0810cba0 0x7f9d0819cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d080feff0 0x7f9d081985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 --2- 172.21.15.69:0/2059366384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d080ff900 0x7f9d08198b10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.567+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 >> 172.21.15.69:0/2059366384 conn(0x7f9d08076370 msgr2=0x7f9d080fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.568+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 shutdown_connections 2023-12-14T14:13:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.568+0000 7f9d0d685700 1 -- 172.21.15.69:0/2059366384 wait complete. 2023-12-14T14:13:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 24 2023-12-14T14:13:30.580 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:13:30.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.719+0000 7f99831ab700 1 -- 172.21.15.69:0/1722849847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c101c00 msgr2=0x7f997c10a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.719+0000 7f99831ab700 1 --2- 172.21.15.69:0/1722849847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c101c00 0x7f997c10a2d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9968009990 tx=0x7f9968009ca0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.719+0000 7f99831ab700 1 -- 172.21.15.69:0/1722849847 shutdown_connections 2023-12-14T14:13:30.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.719+0000 7f99831ab700 1 --2- 172.21.15.69:0/1722849847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c10a810 0x7f997c10cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.719+0000 7f99831ab700 1 --2- 172.21.15.69:0/1722849847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1012f0 0x7f997c1016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.719+0000 7f99831ab700 1 --2- 172.21.15.69:0/1722849847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c101c00 0x7f997c10a2d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.719+0000 7f99831ab700 1 -- 172.21.15.69:0/1722849847 >> 172.21.15.69:0/1722849847 conn(0x7f997c076000 msgr2=0x7f997c076400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.719+0000 7f99831ab700 1 -- 172.21.15.69:0/1722849847 shutdown_connections 2023-12-14T14:13:30.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.719+0000 7f99831ab700 1 -- 172.21.15.69:0/1722849847 wait complete. 2023-12-14T14:13:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f99831ab700 1 Processor -- start 2023-12-14T14:13:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f99831ab700 1 -- start start 2023-12-14T14:13:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f99831ab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c1012f0 0x7f997c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f99831ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101c00 0x7f997c1968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f99831ab700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c10a810 0x7f997c19ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f99831ab700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c19b380 con 0x7f997c1012f0 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f99831ab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c19b4f0 con 0x7f997c101c00 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f99831ab700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c19b6b0 con 0x7f997c10a810 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f9980f47700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c1012f0 0x7f997c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f9980f47700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c1012f0 0x7f997c1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35818/0 (socket says 172.21.15.69:35818) 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f9980f47700 1 -- 172.21.15.69:0/2999248564 learned_addr learned my addr 172.21.15.69:0/2999248564 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f997bfff700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101c00 0x7f997c1968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.720+0000 7f9981748700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c10a810 0x7f997c19ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f9980f47700 1 -- 172.21.15.69:0/2999248564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c10a810 msgr2=0x7f997c19ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f9980f47700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c10a810 0x7f997c19ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f9980f47700 1 -- 172.21.15.69:0/2999248564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101c00 msgr2=0x7f997c1968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f9980f47700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101c00 0x7f997c1968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f9980f47700 1 -- 172.21.15.69:0/2999248564 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680095f0 con 0x7f997c1012f0 2023-12-14T14:13:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f9980f47700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c1012f0 0x7f997c1963a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f997000e9a0 tx=0x7f997000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f9979ffb700 1 -- 172.21.15.69:0/2999248564 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970009790 con 0x7f997c1012f0 2023-12-14T14:13:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f99831ab700 1 -- 172.21.15.69:0/2999248564 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997c1102e0 con 0x7f997c1012f0 2023-12-14T14:13:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f9979ffb700 1 -- 172.21.15.69:0/2999248564 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9970010430 con 0x7f997c1012f0 2023-12-14T14:13:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f9979ffb700 1 -- 172.21.15.69:0/2999248564 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970018680 con 0x7f997c1012f0 2023-12-14T14:13:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.721+0000 7f99831ab700 1 -- 172.21.15.69:0/2999248564 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997c110150 con 0x7f997c1012f0 2023-12-14T14:13:30.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.723+0000 7f9979ffb700 1 -- 172.21.15.69:0/2999248564 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f99700105a0 con 0x7f997c1012f0 2023-12-14T14:13:30.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.724+0000 7f9979ffb700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f996c0a12c0 0x7f996c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.724+0000 7f9979ffb700 1 -- 172.21.15.69:0/2999248564 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f9970014070 con 0x7f997c1012f0 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.724+0000 7f997bfff700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f996c0a12c0 0x7f996c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f997bfff700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f996c0a12c0 0x7f996c0a3770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f997c1979b0 tx=0x7f9968005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f998f339b80 1 Processor -- start 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f998f339b80 1 -- start start 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f998f339b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fbeb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f998f339b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 0x56228fbfaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f998f339b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbfaf60 0x56228fbfd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f998f339b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fad55e0 con 0x56228fbeb380 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f998f339b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fb44870 con 0x56228fbfaf60 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f998f339b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fb3dd00 con 0x56228fbebc90 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f9980f47700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fbeb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f997bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 0x56228fbfaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f9980f47700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fbeb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35824/0 (socket says 172.21.15.69:35824) 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f9981748700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbfaf60 0x56228fbfd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.725+0000 7f9980f47700 1 -- 172.21.15.69:0/4131351830 learned_addr learned my addr 172.21.15.69:0/4131351830 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f9980f47700 1 -- 172.21.15.69:0/4131351830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 msgr2=0x56228fbfaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f9980f47700 1 --2- 172.21.15.69:0/4131351830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 0x56228fbfaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f9980f47700 1 -- 172.21.15.69:0/4131351830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbfaf60 msgr2=0x56228fbfd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f9980f47700 1 --2- 172.21.15.69:0/4131351830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbfaf60 0x56228fbfd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f9980f47700 1 -- 172.21.15.69:0/4131351830 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56228f9bf3b0 con 0x56228fbeb380 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f997bfff700 1 --2- 172.21.15.69:0/4131351830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 0x56228fbfaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f9980f47700 1 --2- 172.21.15.69:0/4131351830 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fbeb750 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f99700a1ec0 tx=0x7f9970099fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9927db79ab87f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f9966ffd700 1 -- 172.21.15.69:0/4131351830 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970010880 con 0x56228fbeb380 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f9966ffd700 1 -- 172.21.15.69:0/4131351830 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99700109e0 con 0x56228fbeb380 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.726+0000 7f9966ffd700 1 -- 172.21.15.69:0/4131351830 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700a1f60 con 0x56228fbeb380 2023-12-14T14:13:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 -- 172.21.15.69:0/4131351830 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 msgr2=0x56228fbeb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 --2- 172.21.15.69:0/4131351830 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fbeb750 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f99700a1ec0 tx=0x7f9970099fa0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 -- 172.21.15.69:0/4131351830 shutdown_connections 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 --2- 172.21.15.69:0/4131351830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbfaf60 0x56228fbfd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 --2- 172.21.15.69:0/4131351830 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fbeb750 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 --2- 172.21.15.69:0/4131351830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 0x56228fbfaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 -- 172.21.15.69:0/4131351830 >> 172.21.15.69:0/4131351830 conn(0x56228fbe1ca0 msgr2=0x56228fbe77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 -- 172.21.15.69:0/4131351830 shutdown_connections 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 -- 172.21.15.69:0/4131351830 wait complete. 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 -- start start 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.727+0000 7f998f339b80 1 Processor -- start 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f998f339b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbeb380 0x56228fbfaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f998f339b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 0x56228fbf7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f998f339b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbf8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f998f339b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fad9f90 con 0x56228fbfaf60 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f998f339b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fad9c30 con 0x56228fbeb380 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f998f339b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228f9c16a0 con 0x56228fbebc90 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f998f339b80 10 client.0 _ll_register_callbacks cb 0x56228fafd910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9981748700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbf8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9981748700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbf8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35828/0 (socket says 172.21.15.69:35828) 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9980f47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbeb380 0x56228fbfaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9981748700 1 -- 172.21.15.69:0/1209779689 learned_addr learned my addr 172.21.15.69:0/1209779689 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f997bfff700 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 0x56228fbf7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9981748700 1 -- 172.21.15.69:0/1209779689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 msgr2=0x56228fbf7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9981748700 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 0x56228fbf7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9981748700 1 -- 172.21.15.69:0/1209779689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbeb380 msgr2=0x56228fbfaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9981748700 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbeb380 0x56228fbfaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9981748700 1 -- 172.21.15.69:0/1209779689 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997c110150 con 0x56228fbfaf60 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f9981748700 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbf8470 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f99740042c0 tx=0x7f99740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95b53d3704ed4ab server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f995bfff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.728+0000 7f995bfff700 1 -- 172.21.15.69:0/1209779689 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974016630 con 0x56228fbfaf60 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f995bfff700 1 -- 172.21.15.69:0/1209779689 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f9974016790 con 0x56228fbfaf60 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f998f339b80 1 -- 172.21.15.69:0/1209779689 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56228fbdf2b0 con 0x56228fbfaf60 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f995bfff700 1 -- 172.21.15.69:0/1209779689 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9974016950 con 0x56228fbfaf60 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f998f339b80 10 client.15975 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f998f339b80 1 -- 172.21.15.69:0/1209779689 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56228fb04170 con 0x56228fbfaf60 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f995bfff700 1 -- 172.21.15.69:0/1209779689 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56228fbdf2b0 con 0x56228fbfaf60 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f995bfff700 1 -- 172.21.15.69:0/1209779689 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9974007b80 con 0x56228fbfaf60 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f998f339b80 10 client.15975 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f998f339b80 10 client.15975 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:13:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f998f339b80 20 client.15975 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:30.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f998f339b80 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56228fc0aa30 0x56228fc0ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f998f339b80 4 client.15975 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:13:30.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.729+0000 7f998f339b80 1 -- 172.21.15.69:0/1209779689 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56228fb36ce0 con 0x56228fc0aa30 2023-12-14T14:13:30.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.732+0000 7f9980f47700 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56228fc0aa30 0x56228fc0ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.732+0000 7f995bfff700 10 client.15975 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:13:30.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.732+0000 7f9980f47700 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56228fc0aa30 0x56228fc0ce40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d24fbfa89a24086c server_cookie=e6e87f5bb863deb in_seq=0 out_seq=0 2023-12-14T14:13:30.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f995bfff700 1 -- 172.21.15.69:0/1209779689 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56228fb36ce0 con 0x56228fc0aa30 2023-12-14T14:13:30.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f995bfff700 10 client.15975 handle_command_reply: tid=0 2023-12-14T14:13:30.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f998f339b80 1 client.15975 shutdown 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f998f339b80 1 -- 172.21.15.69:0/1209779689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 msgr2=0x56228fbf8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f998f339b80 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbf8470 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f99740042c0 tx=0x7f99740042f0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f998f339b80 1 -- 172.21.15.69:0/1209779689 shutdown_connections 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f998f339b80 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56228fc0aa30 0x56228fc0ce40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f998f339b80 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbf8470 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f995bfff700 0 client.15975 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f998f339b80 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbeb380 0x56228fbfaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f998f339b80 1 --2- 172.21.15.69:0/1209779689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbebc90 0x56228fbf7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.733+0000 7f998f339b80 1 -- 172.21.15.69:0/1209779689 >> 172.21.15.69:0/1209779689 conn(0x56228fbe1ca0 msgr2=0x56228fbe73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.734+0000 7f998f339b80 1 -- 172.21.15.69:0/1209779689 shutdown_connections 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.734+0000 7f998f339b80 1 -- 172.21.15.69:0/1209779689 wait complete. 2023-12-14T14:13:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.734+0000 7f998f339b80 20 client.15975 trim_cache size 0 max 16384 2023-12-14T14:13:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f998f339b80 1 Processor -- start 2023-12-14T14:13:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f998f339b80 1 -- start start 2023-12-14T14:13:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f998f339b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbeb380 0x56228fbf72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f998f339b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 0x56228fbfa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f998f339b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbfaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f998f339b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fbecd30 con 0x56228fbfaf60 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f998f339b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fbee270 con 0x56228fbebc90 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f998f339b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fbf7cf0 con 0x56228fbeb380 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f9981748700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbfaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f9981748700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbfaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35842/0 (socket says 172.21.15.69:35842) 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f9980f47700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbeb380 0x56228fbf72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f9981748700 1 -- 172.21.15.69:0/816459447 learned_addr learned my addr 172.21.15.69:0/816459447 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f997bfff700 1 --2- 172.21.15.69:0/816459447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 0x56228fbfa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f9981748700 1 -- 172.21.15.69:0/816459447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbeb380 msgr2=0x56228fbf72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f9981748700 1 --2- 172.21.15.69:0/816459447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbeb380 0x56228fbf72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f9981748700 1 -- 172.21.15.69:0/816459447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 msgr2=0x56228fbfa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f9981748700 1 --2- 172.21.15.69:0/816459447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 0x56228fbfa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.747+0000 7f9981748700 1 -- 172.21.15.69:0/816459447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56228fb03ec0 con 0x56228fbfaf60 2023-12-14T14:13:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.748+0000 7f9981748700 1 --2- 172.21.15.69:0/816459447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbfaa10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9974009720 tx=0x7f9974009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ebf6bf177a5b74 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.748+0000 7f99677fe700 1 -- 172.21.15.69:0/816459447 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997401e5f0 con 0x56228fbfaf60 2023-12-14T14:13:30.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.748+0000 7f99677fe700 1 -- 172.21.15.69:0/816459447 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9974023070 con 0x56228fbfaf60 2023-12-14T14:13:30.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.748+0000 7f99677fe700 1 -- 172.21.15.69:0/816459447 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974007b20 con 0x56228fbfaf60 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 -- 172.21.15.69:0/816459447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 msgr2=0x56228fbfaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 --2- 172.21.15.69:0/816459447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbfaa10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9974009720 tx=0x7f9974009750 comp rx=0 tx=0).stop 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 -- 172.21.15.69:0/816459447 shutdown_connections 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 --2- 172.21.15.69:0/816459447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbfaf60 0x56228fbfaa10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 --2- 172.21.15.69:0/816459447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbeb380 0x56228fbf72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 --2- 172.21.15.69:0/816459447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 0x56228fbfa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 -- 172.21.15.69:0/816459447 >> 172.21.15.69:0/816459447 conn(0x56228fbe1ca0 msgr2=0x56228fbf3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 -- 172.21.15.69:0/816459447 shutdown_connections 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 -- 172.21.15.69:0/816459447 wait complete. 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 -- start start 2023-12-14T14:13:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 Processor -- start 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fc01c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 0x56228fbfffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbfaf60 0x56228fc006e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fc00df0 con 0x56228fbeb380 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fc5e8c0 con 0x56228fbebc90 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.749+0000 7f998f339b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fc5ea00 con 0x56228fbfaf60 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f998f339b80 10 client.0 _ll_register_callbacks cb 0x56228fafd910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9980f47700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fc01c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f997bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 0x56228fbfffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9980f47700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fc01c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35846/0 (socket says 172.21.15.69:35846) 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9980f47700 1 -- 172.21.15.69:0/4147089739 learned_addr learned my addr 172.21.15.69:0/4147089739 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9981748700 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbfaf60 0x56228fc006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9980f47700 1 -- 172.21.15.69:0/4147089739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbfaf60 msgr2=0x56228fc006e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9980f47700 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbfaf60 0x56228fc006e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9980f47700 1 -- 172.21.15.69:0/4147089739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 msgr2=0x56228fbfffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9980f47700 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 0x56228fbfffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9980f47700 1 -- 172.21.15.69:0/4147089739 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56228fb04170 con 0x56228fbeb380 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f9980f47700 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fc01c70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9970099f30 tx=0x7f9970010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e17d09602a084f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f995bfff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f995bfff700 1 -- 172.21.15.69:0/4147089739 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997009a400 con 0x56228fbeb380 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f995bfff700 1 -- 172.21.15.69:0/4147089739 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f99700b8220 con 0x56228fbeb380 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f998f339b80 1 -- 172.21.15.69:0/4147089739 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99700109e0 con 0x56228fbeb380 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f995bfff700 1 -- 172.21.15.69:0/4147089739 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99700b83e0 con 0x56228fbeb380 2023-12-14T14:13:30.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f998f339b80 10 client.15981 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.750+0000 7f998f339b80 1 -- 172.21.15.69:0/4147089739 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56228faea9a0 con 0x56228fbeb380 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f995bfff700 1 -- 172.21.15.69:0/4147089739 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99700109e0 con 0x56228fbeb380 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f995bfff700 1 -- 172.21.15.69:0/4147089739 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9970094bb0 con 0x56228fbeb380 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f998f339b80 10 client.15981 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f998f339b80 10 client.15981 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f998f339b80 20 client.15981 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f998f339b80 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56228fc0aa30 0x56228fc61de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f998f339b80 4 client.15981 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f998f339b80 1 -- 172.21.15.69:0/4147089739 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56228fb36a00 con 0x56228fc0aa30 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f997bfff700 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56228fc0aa30 0x56228fc61de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f995bfff700 10 client.15981 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:13:30.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.751+0000 7f997bfff700 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56228fc0aa30 0x56228fc61de0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c8a390e7b27489e server_cookie=facc22fa74ec1f4d in_seq=0 out_seq=0 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f995bfff700 1 -- 172.21.15.69:0/4147089739 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56228fb36a00 con 0x56228fc0aa30 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f995bfff700 10 client.15981 handle_command_reply: tid=0 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 client.15981 shutdown 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 -- 172.21.15.69:0/4147089739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 msgr2=0x56228fc01c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fc01c70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9970099f30 tx=0x7f9970010c80 comp rx=0 tx=0).stop 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 -- 172.21.15.69:0/4147089739 shutdown_connections 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56228fbfaf60 0x56228fc006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56228fc0aa30 0x56228fc61de0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56228fbeb380 0x56228fc01c70 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 --2- 172.21.15.69:0/4147089739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56228fbebc90 0x56228fbfffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f995bfff700 0 client.15981 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:13:30.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 -- 172.21.15.69:0/4147089739 >> 172.21.15.69:0/4147089739 conn(0x56228fbe1ca0 msgr2=0x56228fbed260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 -- 172.21.15.69:0/4147089739 shutdown_connections 2023-12-14T14:13:30.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 1 -- 172.21.15.69:0/4147089739 wait complete. 2023-12-14T14:13:30.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.772+0000 7f998f339b80 20 client.15981 trim_cache size 0 max 16384 2023-12-14T14:13:30.773 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:13:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 -- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f996c0a12c0 msgr2=0x7f996c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f996c0a12c0 0x7f996c0a3770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f997c1979b0 tx=0x7f9968005fb0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 -- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c1012f0 msgr2=0x7f997c1963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c1012f0 0x7f997c1963a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f997000e9a0 tx=0x7f997000ecb0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 -- 172.21.15.69:0/2999248564 shutdown_connections 2023-12-14T14:13:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f996c0a12c0 0x7f996c0a3770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c10a810 0x7f997c19ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f997c1012f0 0x7f997c1963a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 --2- 172.21.15.69:0/2999248564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101c00 0x7f997c1968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 -- 172.21.15.69:0/2999248564 >> 172.21.15.69:0/2999248564 conn(0x7f997c076000 msgr2=0x7f997c0fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 -- 172.21.15.69:0/2999248564 shutdown_connections 2023-12-14T14:13:30.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.773+0000 7f99831ab700 1 -- 172.21.15.69:0/2999248564 wait complete. 2023-12-14T14:13:30.786 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:13:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.940+0000 7f4d8448f700 1 -- 172.21.15.69:0/1861159604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d7c109b30 msgr2=0x7f4d7c10bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.940+0000 7f4d8448f700 1 --2- 172.21.15.69:0/1861159604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d7c109b30 0x7f4d7c10bf10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400b0a0 tx=0x7f4d7400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.940+0000 7f4d8448f700 1 -- 172.21.15.69:0/1861159604 shutdown_connections 2023-12-14T14:13:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.940+0000 7f4d8448f700 1 --2- 172.21.15.69:0/1861159604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d7c109b30 0x7f4d7c10bf10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.940+0000 7f4d8448f700 1 --2- 172.21.15.69:0/1861159604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7c100580 0x7f4d7c100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.940+0000 7f4d8448f700 1 --2- 172.21.15.69:0/1861159604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7c100e90 0x7f4d7c1095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.940+0000 7f4d8448f700 1 -- 172.21.15.69:0/1861159604 >> 172.21.15.69:0/1861159604 conn(0x7f4d7c074a60 msgr2=0x7f4d7c074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.940+0000 7f4d8448f700 1 -- 172.21.15.69:0/1861159604 shutdown_connections 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.940+0000 7f4d8448f700 1 -- 172.21.15.69:0/1861159604 wait complete. 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8448f700 1 Processor -- start 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8448f700 1 -- start start 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8448f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d7c100580 0x7f4d7c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8448f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7c100e90 0x7f4d7c196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8448f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7c109b30 0x7f4d7c19add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8448f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c19b410 con 0x7f4d7c100580 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8448f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c19b580 con 0x7f4d7c109b30 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8448f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c19b740 con 0x7f4d7c100e90 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8222b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d7c100580 0x7f4d7c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8222b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d7c100580 0x7f4d7c196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35874/0 (socket says 172.21.15.69:35874) 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d8222b700 1 -- 172.21.15.69:0/3027100315 learned_addr learned my addr 172.21.15.69:0/3027100315 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.941+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7c109b30 0x7f4d7c19add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7c100e90 0x7f4d7c196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d82a2c700 1 -- 172.21.15.69:0/3027100315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7c100e90 msgr2=0x7f4d7c196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7c100e90 0x7f4d7c196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d82a2c700 1 -- 172.21.15.69:0/3027100315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d7c100580 msgr2=0x7f4d7c196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d7c100580 0x7f4d7c196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d82a2c700 1 -- 172.21.15.69:0/3027100315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74009d00 con 0x7f4d7c109b30 2023-12-14T14:13:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7c109b30 0x7f4d7c19add0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400b070 tx=0x7f4d740078e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d737fe700 1 -- 172.21.15.69:0/3027100315 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400e040 con 0x7f4d7c109b30 2023-12-14T14:13:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d8448f700 1 -- 172.21.15.69:0/3027100315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c10f160 con 0x7f4d7c109b30 2023-12-14T14:13:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d737fe700 1 -- 172.21.15.69:0/3027100315 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d7401d470 con 0x7f4d7c109b30 2023-12-14T14:13:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d737fe700 1 -- 172.21.15.69:0/3027100315 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740052a0 con 0x7f4d7c109b30 2023-12-14T14:13:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.942+0000 7f4d8448f700 1 -- 172.21.15.69:0/3027100315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c10efd0 con 0x7f4d7c109b30 2023-12-14T14:13:30.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.945+0000 7f4d737fe700 1 -- 172.21.15.69:0/3027100315 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4d74004a50 con 0x7f4d7c109b30 2023-12-14T14:13:30.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.946+0000 7f4d737fe700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d680a12c0 0x7f4d680a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.946+0000 7f4d8222b700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d680a12c0 0x7f4d680a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.946+0000 7f4d737fe700 1 -- 172.21.15.69:0/3027100315 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4d740ce110 con 0x7f4d7c109b30 2023-12-14T14:13:30.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.946+0000 7f4d9061db80 1 Processor -- start 2023-12-14T14:13:30.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.946+0000 7f4d9061db80 1 -- start start 2023-12-14T14:13:30.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.946+0000 7f4d8222b700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d680a12c0 0x7f4d680a3770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4d78005950 tx=0x7f4d78009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10c0df0 0x5583b10bf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 0x5583b10bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10d31f0 0x5583b10d55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d9061db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b0fa95e0 con 0x5583b10d31f0 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d9061db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b1018870 con 0x5583b10bf8c0 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d9061db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b1011d00 con 0x5583b10c0df0 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d82a2c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10d31f0 0x5583b10d55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d8222b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10c0df0 0x5583b10bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d82a2c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10d31f0 0x5583b10d55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35880/0 (socket says 172.21.15.69:35880) 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d82a2c700 1 -- 172.21.15.69:0/458153865 learned_addr learned my addr 172.21.15.69:0/458153865 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/458153865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 0x5583b10bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d8222b700 1 -- 172.21.15.69:0/458153865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 msgr2=0x5583b10bfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d8222b700 1 --2- 172.21.15.69:0/458153865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 0x5583b10bfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d8222b700 1 -- 172.21.15.69:0/458153865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10d31f0 msgr2=0x5583b10d55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d8222b700 1 --2- 172.21.15.69:0/458153865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10d31f0 0x5583b10d55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d8222b700 1 -- 172.21.15.69:0/458153865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583b0e933b0 con 0x5583b10c0df0 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/458153865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10d31f0 0x5583b10d55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.947+0000 7f4d8222b700 1 --2- 172.21.15.69:0/458153865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10c0df0 0x5583b10bf380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800e4b0 tx=0x7f4d78014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b77c8ee147217b16 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.948+0000 7f4d70dac700 1 -- 172.21.15.69:0/458153865 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800edd0 con 0x5583b10c0df0 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.948+0000 7f4d70dac700 1 -- 172.21.15.69:0/458153865 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d78021070 con 0x5583b10c0df0 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.948+0000 7f4d70dac700 1 -- 172.21.15.69:0/458153865 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78026480 con 0x5583b10c0df0 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.948+0000 7f4d9061db80 1 -- 172.21.15.69:0/458153865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10c0df0 msgr2=0x5583b10bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.948+0000 7f4d9061db80 1 --2- 172.21.15.69:0/458153865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10c0df0 0x5583b10bf380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800e4b0 tx=0x7f4d78014000 comp rx=0 tx=0).stop 2023-12-14T14:13:30.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 -- 172.21.15.69:0/458153865 shutdown_connections 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 --2- 172.21.15.69:0/458153865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10d31f0 0x5583b10d55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 --2- 172.21.15.69:0/458153865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10c0df0 0x5583b10bf380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 --2- 172.21.15.69:0/458153865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 0x5583b10bfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 -- 172.21.15.69:0/458153865 >> 172.21.15.69:0/458153865 conn(0x5583b10b5ca0 msgr2=0x5583b10bb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 -- 172.21.15.69:0/458153865 shutdown_connections 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 -- 172.21.15.69:0/458153865 wait complete. 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 -- start start 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 Processor -- start 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 0x5583b10cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 0x5583b10d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b0fadf90 con 0x5583b10c0df0 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b0fadc30 con 0x5583b10bf8c0 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b0e956a0 con 0x5583b10d31f0 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d9061db80 10 client.0 _ll_register_callbacks cb 0x5583b0fd1910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d81a2a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.949+0000 7f4d81a2a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35882/0 (socket says 172.21.15.69:35882) 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d81a2a700 1 -- 172.21.15.69:0/2099759825 learned_addr learned my addr 172.21.15.69:0/2099759825 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d8222b700 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 0x5583b10cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 0x5583b10d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d81a2a700 1 -- 172.21.15.69:0/2099759825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 msgr2=0x5583b10d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 0x5583b10d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d81a2a700 1 -- 172.21.15.69:0/2099759825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 msgr2=0x5583b10cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 0x5583b10cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d81a2a700 1 -- 172.21.15.69:0/2099759825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d78017070 con 0x5583b10c0df0 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10ccab0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0127f0 tx=0x7f4d6c012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b89dc7001c3185 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d65ffb700 1 -- 172.21.15.69:0/2099759825 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c017070 con 0x5583b10c0df0 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d65ffb700 1 -- 172.21.15.69:0/2099759825 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4d6c00f500 con 0x5583b10c0df0 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d9061db80 1 -- 172.21.15.69:0/2099759825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583b10b32b0 con 0x5583b10c0df0 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d65ffb700 1 -- 172.21.15.69:0/2099759825 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d6c00f6c0 con 0x5583b10c0df0 2023-12-14T14:13:30.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d9061db80 10 client.15993 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d9061db80 1 -- 172.21.15.69:0/2099759825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5583b0fd8170 con 0x5583b10c0df0 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.950+0000 7f4d65ffb700 1 -- 172.21.15.69:0/2099759825 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5583b10b32b0 con 0x5583b10c0df0 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d65ffb700 1 -- 172.21.15.69:0/2099759825 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4d6c010850 con 0x5583b10c0df0 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d9061db80 10 client.15993 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d9061db80 10 client.15993 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d9061db80 20 client.15993 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d9061db80 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5583b10eb3b0 0x5583b10ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d9061db80 4 client.15993 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d9061db80 1 -- 172.21.15.69:0/2099759825 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5583b100ace0 con 0x5583b10eb3b0 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d8222b700 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5583b10eb3b0 0x5583b10ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d65ffb700 10 client.15993 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:13:30.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.951+0000 7f4d8222b700 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5583b10eb3b0 0x5583b10ed7c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c68d24fd9ebdc5ee server_cookie=216fb40a536bce7c in_seq=0 out_seq=0 2023-12-14T14:13:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d65ffb700 1 -- 172.21.15.69:0/2099759825 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5583b100ace0 con 0x5583b10eb3b0 2023-12-14T14:13:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d65ffb700 10 client.15993 handle_command_reply: tid=0 2023-12-14T14:13:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 client.15993 shutdown 2023-12-14T14:13:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 -- 172.21.15.69:0/2099759825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 msgr2=0x5583b10ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10ccab0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0127f0 tx=0x7f4d6c012b00 comp rx=0 tx=0).stop 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 -- 172.21.15.69:0/2099759825 shutdown_connections 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 0x5583b10d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10bf8c0 0x5583b10cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5583b10eb3b0 0x5583b10ed7c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 --2- 172.21.15.69:0/2099759825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10ccab0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d65ffb700 0 client.15993 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 -- 172.21.15.69:0/2099759825 >> 172.21.15.69:0/2099759825 conn(0x5583b10b5ca0 msgr2=0x5583b10bb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 -- 172.21.15.69:0/2099759825 shutdown_connections 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 1 -- 172.21.15.69:0/2099759825 wait complete. 2023-12-14T14:13:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.954+0000 7f4d9061db80 20 client.15993 trim_cache size 0 max 16384 2023-12-14T14:13:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.967+0000 7f4d9061db80 1 Processor -- start 2023-12-14T14:13:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d9061db80 1 -- start start 2023-12-14T14:13:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10bf8c0 0x5583b10d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10f2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10d31f0 0x5583b10c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d9061db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b10bcb50 con 0x5583b10c0df0 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d9061db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b10b5820 con 0x5583b10d31f0 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d9061db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b10b3160 con 0x5583b10bf8c0 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d81a2a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d81a2a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10f2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35884/0 (socket says 172.21.15.69:35884) 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d81a2a700 1 -- 172.21.15.69:0/3727105137 learned_addr learned my addr 172.21.15.69:0/3727105137 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d8222b700 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10bf8c0 0x5583b10d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.968+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10d31f0 0x5583b10c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d81a2a700 1 -- 172.21.15.69:0/3727105137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10bf8c0 msgr2=0x5583b10d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10bf8c0 0x5583b10d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d81a2a700 1 -- 172.21.15.69:0/3727105137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10d31f0 msgr2=0x5583b10c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10d31f0 0x5583b10c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d81a2a700 1 -- 172.21.15.69:0/3727105137 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583b0fd7ec0 con 0x5583b10c0df0 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10d31f0 0x5583b10c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10f2120 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009780 tx=0x7f4d6c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e2d2e8b37facbe server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d715ad700 1 -- 172.21.15.69:0/3727105137 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c017070 con 0x5583b10c0df0 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d715ad700 1 -- 172.21.15.69:0/3727105137 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d6c018040 con 0x5583b10c0df0 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.969+0000 7f4d715ad700 1 -- 172.21.15.69:0/3727105137 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c003680 con 0x5583b10c0df0 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 -- 172.21.15.69:0/3727105137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 msgr2=0x5583b10f2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10f2120 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009780 tx=0x7f4d6c01c480 comp rx=0 tx=0).stop 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 -- 172.21.15.69:0/3727105137 shutdown_connections 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10d31f0 0x5583b10c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10bf8c0 0x5583b10d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 --2- 172.21.15.69:0/3727105137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10c0df0 0x5583b10f2120 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 -- 172.21.15.69:0/3727105137 >> 172.21.15.69:0/3727105137 conn(0x5583b10b5ca0 msgr2=0x5583b10b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 -- 172.21.15.69:0/3727105137 shutdown_connections 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 -- 172.21.15.69:0/3727105137 wait complete. 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 -- start start 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.970+0000 7f4d9061db80 1 Processor -- start 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10bf8c0 0x5583b10d2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10c0df0 0x5583b10d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d9061db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 0x5583b10d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d9061db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b10d0fa0 con 0x5583b10bf8c0 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d9061db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b10d1110 con 0x5583b10c0df0 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d9061db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b113f280 con 0x5583b10d31f0 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d9061db80 10 client.0 _ll_register_callbacks cb 0x7f4d6c009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d8222b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10bf8c0 0x5583b10d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d81a2a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10c0df0 0x5583b10d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d8222b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10bf8c0 0x5583b10d2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35900/0 (socket says 172.21.15.69:35900) 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d8222b700 1 -- 172.21.15.69:0/1258403757 learned_addr learned my addr 172.21.15.69:0/1258403757 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 0x5583b10d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d8222b700 1 -- 172.21.15.69:0/1258403757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 msgr2=0x5583b10d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d8222b700 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 0x5583b10d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d8222b700 1 -- 172.21.15.69:0/1258403757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10c0df0 msgr2=0x5583b10d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d8222b700 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10c0df0 0x5583b10d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d8222b700 1 -- 172.21.15.69:0/1258403757 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583b0fd8170 con 0x5583b10bf8c0 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d82a2c700 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 0x5583b10d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d8222b700 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10bf8c0 0x5583b10d2060 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800eaa0 tx=0x7f4d78011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffbb3430b80d241 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.971+0000 7f4d65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d65ffb700 1 -- 172.21.15.69:0/1258403757 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7802a040 con 0x5583b10bf8c0 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d65ffb700 1 -- 172.21.15.69:0/1258403757 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4d78003880 con 0x5583b10bf8c0 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d9061db80 1 -- 172.21.15.69:0/1258403757 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d78021070 con 0x5583b10bf8c0 2023-12-14T14:13:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d65ffb700 1 -- 172.21.15.69:0/1258403757 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d7800ed50 con 0x5583b10bf8c0 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d9061db80 10 client.15999 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d9061db80 1 -- 172.21.15.69:0/1258403757 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5583b0fbe9a0 con 0x5583b10bf8c0 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d65ffb700 1 -- 172.21.15.69:0/1258403757 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d78021070 con 0x5583b10bf8c0 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d65ffb700 1 -- 172.21.15.69:0/1258403757 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4d78003c20 con 0x5583b10bf8c0 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d9061db80 10 client.15999 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d9061db80 10 client.15999 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d9061db80 20 client.15999 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d9061db80 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5583b1140840 0x5583b1142c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d9061db80 4 client.15999 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d9061db80 1 -- 172.21.15.69:0/1258403757 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5583b100aa00 con 0x5583b1140840 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.972+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5583b1140840 0x5583b1142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.973+0000 7f4d65ffb700 10 client.15999 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:13:30.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.973+0000 7f4d81a2a700 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5583b1140840 0x5583b1142c50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8494a32b62787ef7 server_cookie=48589eec42f20506 in_seq=0 out_seq=0 2023-12-14T14:13:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.974+0000 7f4d65ffb700 1 -- 172.21.15.69:0/1258403757 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5583b100aa00 con 0x5583b1140840 2023-12-14T14:13:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.974+0000 7f4d65ffb700 10 client.15999 handle_command_reply: tid=0 2023-12-14T14:13:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.974+0000 7f4d9061db80 1 client.15999 shutdown 2023-12-14T14:13:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.974+0000 7f4d9061db80 1 -- 172.21.15.69:0/1258403757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10bf8c0 msgr2=0x5583b10d2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.974+0000 7f4d9061db80 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10bf8c0 0x5583b10d2060 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800eaa0 tx=0x7f4d78011bc0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d9061db80 1 -- 172.21.15.69:0/1258403757 shutdown_connections 2023-12-14T14:13:30.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d9061db80 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583b10d31f0 0x5583b10d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d9061db80 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5583b1140840 0x5583b1142c50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d9061db80 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5583b10bf8c0 0x5583b10d2060 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d9061db80 1 --2- 172.21.15.69:0/1258403757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583b10c0df0 0x5583b10d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d65ffb700 0 client.15999 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:13:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d9061db80 1 -- 172.21.15.69:0/1258403757 >> 172.21.15.69:0/1258403757 conn(0x5583b10b5ca0 msgr2=0x5583b10f2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d9061db80 1 -- 172.21.15.69:0/1258403757 shutdown_connections 2023-12-14T14:13:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d9061db80 1 -- 172.21.15.69:0/1258403757 wait complete. 2023-12-14T14:13:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d9061db80 20 client.15999 trim_cache size 0 max 16384 2023-12-14T14:13:30.981 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:13:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 -- 172.21.15.69:0/3027100315 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d680a12c0 msgr2=0x7f4d680a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d680a12c0 0x7f4d680a3770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4d78005950 tx=0x7f4d78009260 comp rx=0 tx=0).stop 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 -- 172.21.15.69:0/3027100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7c109b30 msgr2=0x7f4d7c19add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7c109b30 0x7f4d7c19add0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400b070 tx=0x7f4d740078e0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 -- 172.21.15.69:0/3027100315 shutdown_connections 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4d680a12c0 0x7f4d680a3770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7c109b30 0x7f4d7c19add0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d7c100580 0x7f4d7c196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 --2- 172.21.15.69:0/3027100315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d7c100e90 0x7f4d7c196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.975+0000 7f4d8448f700 1 -- 172.21.15.69:0/3027100315 >> 172.21.15.69:0/3027100315 conn(0x7f4d7c074a60 msgr2=0x7f4d7c0fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.976+0000 7f4d8448f700 1 -- 172.21.15.69:0/3027100315 shutdown_connections 2023-12-14T14:13:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:30.976+0000 7f4d8448f700 1 -- 172.21.15.69:0/3027100315 wait complete. 2023-12-14T14:13:30.990 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:13:31.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.120+0000 7f751aafc700 1 -- 172.21.15.69:0/918802195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75140680c0 msgr2=0x7f7514068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:31.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.120+0000 7f751aafc700 1 --2- 172.21.15.69:0/918802195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75140680c0 0x7f7514068490 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f75080099c0 tx=0x7f7508009cd0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.120+0000 7f751aafc700 1 -- 172.21.15.69:0/918802195 shutdown_connections 2023-12-14T14:13:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.120+0000 7f751aafc700 1 --2- 172.21.15.69:0/918802195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75141054d0 0x7f751410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.120+0000 7f751aafc700 1 --2- 172.21.15.69:0/918802195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75140680c0 0x7f7514068490 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.120+0000 7f751aafc700 1 --2- 172.21.15.69:0/918802195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7514068a60 0x7f7514104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.120+0000 7f751aafc700 1 -- 172.21.15.69:0/918802195 >> 172.21.15.69:0/918802195 conn(0x7f7514075fd0 msgr2=0x7f75140763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.120+0000 7f751aafc700 1 -- 172.21.15.69:0/918802195 shutdown_connections 2023-12-14T14:13:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.120+0000 7f751aafc700 1 -- 172.21.15.69:0/918802195 wait complete. 2023-12-14T14:13:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f751aafc700 1 Processor -- start 2023-12-14T14:13:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f751aafc700 1 -- start start 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f751aafc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75140680c0 0x7f75141963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f751aafc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7514068a60 0x7f75141968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f751aafc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75141054d0 0x7f751419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f751aafc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751419b380 con 0x7f7514068a60 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f751aafc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751419b4f0 con 0x7f75140680c0 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f751aafc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751419b6b0 con 0x7f75141054d0 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f7513fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7514068a60 0x7f75141968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.121+0000 7f7513fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7514068a60 0x7f75141968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35916/0 (socket says 172.21.15.69:35916) 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7518898700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75140680c0 0x7f75141963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7513fff700 1 -- 172.21.15.69:0/2346883362 learned_addr learned my addr 172.21.15.69:0/2346883362 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7519099700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75141054d0 0x7f751419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7518898700 1 -- 172.21.15.69:0/2346883362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75141054d0 msgr2=0x7f751419ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7518898700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75141054d0 0x7f751419ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7518898700 1 -- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7514068a60 msgr2=0x7f75141968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7518898700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7514068a60 0x7f75141968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7518898700 1 -- 172.21.15.69:0/2346883362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080095f0 con 0x7f75140680c0 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7519099700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75141054d0 0x7f751419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7513fff700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7514068a60 0x7f75141968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7518898700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75140680c0 0x7f75141963a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f75080098e0 tx=0x7f750800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7511ffb700 1 -- 172.21.15.69:0/2346883362 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750801d070 con 0x7f75140680c0 2023-12-14T14:13:31.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f751aafc700 1 -- 172.21.15.69:0/2346883362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7514110290 con 0x7f75140680c0 2023-12-14T14:13:31.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f751aafc700 1 -- 172.21.15.69:0/2346883362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7514110100 con 0x7f75140680c0 2023-12-14T14:13:31.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7511ffb700 1 -- 172.21.15.69:0/2346883362 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7508022470 con 0x7f75140680c0 2023-12-14T14:13:31.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.122+0000 7f7511ffb700 1 -- 172.21.15.69:0/2346883362 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508022ea0 con 0x7f75140680c0 2023-12-14T14:13:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.126+0000 7f7511ffb700 1 -- 172.21.15.69:0/2346883362 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7508022830 con 0x7f75140680c0 2023-12-14T14:13:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.126+0000 7f7511ffb700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f75040a12c0 0x7f75040a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.126+0000 7f7526c8ab80 1 Processor -- start 2023-12-14T14:13:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.126+0000 7f7511ffb700 1 -- 172.21.15.69:0/2346883362 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f75080cd870 con 0x7f75140680c0 2023-12-14T14:13:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.126+0000 7f7513fff700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f75040a12c0 0x7f75040a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.126+0000 7f7526c8ab80 1 -- start start 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7380 0x563515ae7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7c90 0x563515af2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515af4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635159d15e0 con 0x563515ae7380 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563515a40870 con 0x563515af2b50 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563515a39d00 con 0x563515ae7c90 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7513fff700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f75040a12c0 0x7f75040a3770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75141979b0 tx=0x7f7500009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7518898700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7380 0x563515ae7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7518898700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7380 0x563515ae7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35920/0 (socket says 172.21.15.69:35920) 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7518898700 1 -- 172.21.15.69:0/1323172599 learned_addr learned my addr 172.21.15.69:0/1323172599 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7513fff700 1 --2- 172.21.15.69:0/1323172599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7c90 0x563515af2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7519099700 1 --2- 172.21.15.69:0/1323172599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515af4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7518898700 1 -- 172.21.15.69:0/1323172599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7c90 msgr2=0x563515af2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7518898700 1 --2- 172.21.15.69:0/1323172599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7c90 0x563515af2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7518898700 1 -- 172.21.15.69:0/1323172599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 msgr2=0x563515af4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7518898700 1 --2- 172.21.15.69:0/1323172599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515af4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7518898700 1 -- 172.21.15.69:0/1323172599 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635158bb3b0 con 0x563515ae7380 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f7518898700 1 --2- 172.21.15.69:0/1323172599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7380 0x563515ae7750 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f75080a28a0 tx=0x7f750809a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62c458c70665be1 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f74feffd700 1 -- 172.21.15.69:0/1323172599 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750809ea40 con 0x563515ae7380 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f74feffd700 1 -- 172.21.15.69:0/1323172599 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75080a2dd0 con 0x563515ae7380 2023-12-14T14:13:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.127+0000 7f74feffd700 1 -- 172.21.15.69:0/1323172599 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750809a120 con 0x563515ae7380 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.128+0000 7f7526c8ab80 1 -- 172.21.15.69:0/1323172599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7380 msgr2=0x563515ae7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.128+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/1323172599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7380 0x563515ae7750 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f75080a28a0 tx=0x7f750809a640 comp rx=0 tx=0).stop 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.128+0000 7f7526c8ab80 1 -- 172.21.15.69:0/1323172599 shutdown_connections 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.128+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/1323172599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515af4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.128+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/1323172599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7380 0x563515ae7750 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.128+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/1323172599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7c90 0x563515af2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.128+0000 7f7526c8ab80 1 -- 172.21.15.69:0/1323172599 >> 172.21.15.69:0/1323172599 conn(0x563515addca0 msgr2=0x563515ae37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.128+0000 7f7526c8ab80 1 -- 172.21.15.69:0/1323172599 shutdown_connections 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.128+0000 7f7526c8ab80 1 -- 172.21.15.69:0/1323172599 wait complete. 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.129+0000 7f7526c8ab80 1 -- start start 2023-12-14T14:13:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.129+0000 7f7526c8ab80 1 Processor -- start 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.129+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515ae7380 0x563515af7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.129+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515af8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.129+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515af2b50 0x563515af1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.129+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635159d5f90 con 0x563515ae7c90 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635159d5c30 con 0x563515ae7380 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635158bd6a0 con 0x563515af2b50 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7526c8ab80 10 client.0 _ll_register_callbacks cb 0x5635159f9910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7513fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515af8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7513fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515af8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35928/0 (socket says 172.21.15.69:35928) 2023-12-14T14:13:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7518898700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515ae7380 0x563515af7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7513fff700 1 -- 172.21.15.69:0/877375905 learned_addr learned my addr 172.21.15.69:0/877375905 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7519099700 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515af2b50 0x563515af1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7513fff700 1 -- 172.21.15.69:0/877375905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515af2b50 msgr2=0x563515af1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7513fff700 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515af2b50 0x563515af1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7513fff700 1 -- 172.21.15.69:0/877375905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515ae7380 msgr2=0x563515af7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7513fff700 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515ae7380 0x563515af7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7513fff700 1 -- 172.21.15.69:0/877375905 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7514110100 con 0x563515ae7c90 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7519099700 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515af2b50 0x563515af1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7513fff700 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515af8110 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f750000ed10 tx=0x7f75000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d1be7b4b1cab86 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f74f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:13:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f74f3fff700 1 -- 172.21.15.69:0/877375905 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500022070 con 0x563515ae7c90 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f74f3fff700 1 -- 172.21.15.69:0/877375905 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f750000ee00 con 0x563515ae7c90 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7526c8ab80 1 -- 172.21.15.69:0/877375905 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563515adb2b0 con 0x563515ae7c90 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f74f3fff700 1 -- 172.21.15.69:0/877375905 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f750001dc90 con 0x563515ae7c90 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7526c8ab80 10 client.16011 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.130+0000 7f7526c8ab80 1 -- 172.21.15.69:0/877375905 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563515a00170 con 0x563515ae7c90 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f74f3fff700 1 -- 172.21.15.69:0/877375905 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7500034020 con 0x563515ae7c90 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f74f3fff700 1 -- 172.21.15.69:0/877375905 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7500026410 con 0x563515ae7c90 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f7526c8ab80 10 client.16011 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f7526c8ab80 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f7526c8ab80 20 client.16011 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563515b02110 0x563515b04520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f7526c8ab80 4 client.16011 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f7526c8ab80 1 -- 172.21.15.69:0/877375905 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563515a32ce0 con 0x563515b02110 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f7518898700 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563515b02110 0x563515b04520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f74f3fff700 10 client.16011 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.131+0000 7f7518898700 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563515b02110 0x563515b04520 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca18ca8b1b0f920 server_cookie=21cd6d1ee438cc49 in_seq=0 out_seq=0 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f74f3fff700 1 -- 172.21.15.69:0/877375905 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563515a32ce0 con 0x563515b02110 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f74f3fff700 10 client.16011 handle_command_reply: tid=0 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 client.16011 shutdown 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 -- 172.21.15.69:0/877375905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 msgr2=0x563515af8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515af8110 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f750000ed10 tx=0x7f75000047c0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 -- 172.21.15.69:0/877375905 shutdown_connections 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563515b02110 0x563515b04520 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515af2b50 0x563515af1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515ae7380 0x563515af7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f74f3fff700 0 client.16011 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/877375905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515af8110 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 -- 172.21.15.69:0/877375905 >> 172.21.15.69:0/877375905 conn(0x563515addca0 msgr2=0x563515ae33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 -- 172.21.15.69:0/877375905 shutdown_connections 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 1 -- 172.21.15.69:0/877375905 wait complete. 2023-12-14T14:13:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.132+0000 7f7526c8ab80 20 client.16011 trim_cache size 0 max 16384 2023-12-14T14:13:31.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7526c8ab80 1 Processor -- start 2023-12-14T14:13:31.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7526c8ab80 1 -- start start 2023-12-14T14:13:31.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515aeed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515aef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515af76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563515af34a0 con 0x563515ae7c90 2023-12-14T14:13:31.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563515af0050 con 0x563515af2b50 2023-12-14T14:13:31.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563515aed960 con 0x563515ae7380 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7513fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515aef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7518898700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515aeed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7518898700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515aeed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:60352/0 (socket says 172.21.15.69:60352) 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7513fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515aef2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35936/0 (socket says 172.21.15.69:35936) 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7518898700 1 -- 172.21.15.69:0/2757254531 learned_addr learned my addr 172.21.15.69:0/2757254531 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.148+0000 7f7519099700 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515af76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f7518898700 1 -- 172.21.15.69:0/2757254531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 msgr2=0x563515af76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f7518898700 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515af76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f7518898700 1 -- 172.21.15.69:0/2757254531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 msgr2=0x563515aef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:31.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f7518898700 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515aef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f7518898700 1 -- 172.21.15.69:0/2757254531 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635159ffec0 con 0x563515ae7380 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f7519099700 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515af76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f7513fff700 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515aef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f7518898700 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515aeed80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f750809a9a0 tx=0x7f750801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=496a5f78a79b943c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f74ff7fe700 1 -- 172.21.15.69:0/2757254531 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750809a370 con 0x563515ae7380 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f74ff7fe700 1 -- 172.21.15.69:0/2757254531 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7508098bd0 con 0x563515ae7380 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.149+0000 7f74ff7fe700 1 -- 172.21.15.69:0/2757254531 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750809aed0 con 0x563515ae7380 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2757254531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 msgr2=0x563515aeed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515aeed80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f750809a9a0 tx=0x7f750801a040 comp rx=0 tx=0).stop 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2757254531 shutdown_connections 2023-12-14T14:13:31.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515af76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515aeed80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2757254531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515aef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2757254531 >> 172.21.15.69:0/2757254531 conn(0x563515addca0 msgr2=0x563515b08e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2757254531 shutdown_connections 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2757254531 wait complete. 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 -- start start 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.150+0000 7f7526c8ab80 1 Processor -- start 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515b49f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515b4a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7526c8ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515b54fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563515b4ace0 con 0x563515ae7c90 2023-12-14T14:13:31.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563515b554e0 con 0x563515af2b50 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7526c8ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563515b55620 con 0x563515ae7380 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7526c8ab80 10 client.0 _ll_register_callbacks cb 0x7f750000e8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7513fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515b4a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7518898700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515b49f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7513fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515b4a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35948/0 (socket says 172.21.15.69:35948) 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7513fff700 1 -- 172.21.15.69:0/2630941617 learned_addr learned my addr 172.21.15.69:0/2630941617 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7519099700 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515b54fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7513fff700 1 -- 172.21.15.69:0/2630941617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 msgr2=0x563515b49f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7513fff700 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515b49f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7513fff700 1 -- 172.21.15.69:0/2630941617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 msgr2=0x563515b54fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7513fff700 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515b54fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7513fff700 1 -- 172.21.15.69:0/2630941617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563515a00170 con 0x563515ae7c90 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7518898700 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515b49f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f7513fff700 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515b4a460 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x563515af3470 tx=0x7f7500030720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68bf5bb03371534 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f74f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.151+0000 7f74f3fff700 1 -- 172.21.15.69:0/2630941617 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500022030 con 0x563515ae7c90 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f74f3fff700 1 -- 172.21.15.69:0/2630941617 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f7500023070 con 0x563515ae7c90 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2630941617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75080a2dd0 con 0x563515ae7c90 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f74f3fff700 1 -- 172.21.15.69:0/2630941617 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f750000e3b0 con 0x563515ae7c90 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f7526c8ab80 10 client.16017 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2630941617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5635158bb3b0 con 0x563515ae7c90 2023-12-14T14:13:31.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f74f3fff700 1 -- 172.21.15.69:0/2630941617 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75080a2dd0 con 0x563515ae7c90 2023-12-14T14:13:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f74f3fff700 1 -- 172.21.15.69:0/2630941617 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f750001d410 con 0x563515ae7c90 2023-12-14T14:13:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f7526c8ab80 10 client.16017 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f7526c8ab80 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:13:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f7526c8ab80 20 client.16017 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563515b56d20 0x563515b59130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f7526c8ab80 4 client.16017 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:13:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.152+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2630941617 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563515a32a00 con 0x563515b56d20 2023-12-14T14:13:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.153+0000 7f7518898700 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563515b56d20 0x563515b59130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:31.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.154+0000 7f7518898700 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563515b56d20 0x563515b59130 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d651603517c45aa5 server_cookie=5781bcdfaf28991c in_seq=0 out_seq=0 2023-12-14T14:13:31.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.154+0000 7f74f3fff700 10 client.16017 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:31.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f74f3fff700 1 -- 172.21.15.69:0/2630941617 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563515a32a00 con 0x563515b56d20 2023-12-14T14:13:31.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f74f3fff700 10 client.16017 handle_command_reply: tid=0 2023-12-14T14:13:31.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 client.16017 shutdown 2023-12-14T14:13:31.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2630941617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 msgr2=0x563515b4a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:31.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515b4a460 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x563515af3470 tx=0x7f7500030720 comp rx=0 tx=0).stop 2023-12-14T14:13:31.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2630941617 shutdown_connections 2023-12-14T14:13:31.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563515b56d20 0x563515b59130 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563515af2b50 0x563515b54fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f74f3fff700 0 client.16017 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:31.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563515ae7380 0x563515b49f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 --2- 172.21.15.69:0/2630941617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563515ae7c90 0x563515b4a460 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2630941617 >> 172.21.15.69:0/2630941617 conn(0x563515addca0 msgr2=0x563515af02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:31.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2630941617 shutdown_connections 2023-12-14T14:13:31.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.165+0000 7f7526c8ab80 1 -- 172.21.15.69:0/2630941617 wait complete. 2023-12-14T14:13:31.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f7526c8ab80 20 client.16017 trim_cache size 0 max 16384 2023-12-14T14:13:31.167 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 -- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f75040a12c0 msgr2=0x7f75040a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f75040a12c0 0x7f75040a3770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75141979b0 tx=0x7f7500009260 comp rx=0 tx=0).stop 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 -- 172.21.15.69:0/2346883362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75140680c0 msgr2=0x7f75141963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75140680c0 0x7f75141963a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f75080098e0 tx=0x7f750800f690 comp rx=0 tx=0).stop 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 -- 172.21.15.69:0/2346883362 shutdown_connections 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f75040a12c0 0x7f75040a3770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75141054d0 0x7f751419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75140680c0 0x7f75141963a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 --2- 172.21.15.69:0/2346883362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7514068a60 0x7f75141968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:31.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 -- 172.21.15.69:0/2346883362 >> 172.21.15.69:0/2346883362 conn(0x7f7514075fd0 msgr2=0x7f75140fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:31.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 -- 172.21.15.69:0/2346883362 shutdown_connections 2023-12-14T14:13:31.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:31.166+0000 7f751aafc700 1 -- 172.21.15.69:0/2346883362 wait complete. 2023-12-14T14:13:31.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:31 smithi119 ceph-mon[43834]: pgmap v89: 97 pgs: 97 active+clean; 59 MiB data, 159 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.3 MiB/s wr, 166 op/s 2023-12-14T14:13:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:31 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:31 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2059366384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:13:31.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:31 smithi069 ceph-mon[42034]: pgmap v89: 97 pgs: 97 active+clean; 59 MiB data, 159 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.3 MiB/s wr, 166 op/s 2023-12-14T14:13:31.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:31 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:31 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2059366384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:13:31.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:31 smithi081 ceph-mon[43371]: pgmap v89: 97 pgs: 97 active+clean; 59 MiB data, 159 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.3 MiB/s wr, 166 op/s 2023-12-14T14:13:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:31 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:31 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2059366384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:13:32.180 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:13:32.180 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:13:32.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.328+0000 7f8712fda700 1 -- 172.21.15.69:0/1586802218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c0ffd30 msgr2=0x7f870c103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.328+0000 7f8712fda700 1 --2- 172.21.15.69:0/1586802218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c0ffd30 0x7f870c103cf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f86f80099c0 tx=0x7f86f8009cd0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.329+0000 7f8712fda700 1 -- 172.21.15.69:0/1586802218 shutdown_connections 2023-12-14T14:13:32.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.329+0000 7f8712fda700 1 --2- 172.21.15.69:0/1586802218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870c1043d0 0x7f870c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.329+0000 7f8712fda700 1 --2- 172.21.15.69:0/1586802218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f870c0ff390 0x7f870c0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.329+0000 7f8712fda700 1 --2- 172.21.15.69:0/1586802218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c0ffd30 0x7f870c103cf0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.329+0000 7f8712fda700 1 -- 172.21.15.69:0/1586802218 >> 172.21.15.69:0/1586802218 conn(0x7f870c075fd0 msgr2=0x7f870c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.329+0000 7f8712fda700 1 -- 172.21.15.69:0/1586802218 shutdown_connections 2023-12-14T14:13:32.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.329+0000 7f8712fda700 1 -- 172.21.15.69:0/1586802218 wait complete. 2023-12-14T14:13:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.329+0000 7f8712fda700 1 Processor -- start 2023-12-14T14:13:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.329+0000 7f8712fda700 1 -- start start 2023-12-14T14:13:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8712fda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870c0ff390 0x7f870c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8712fda700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f870c0ffd30 0x7f870c196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8712fda700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c1043d0 0x7f870c19ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8712fda700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c19b3c0 con 0x7f870c1043d0 2023-12-14T14:13:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8712fda700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c19b530 con 0x7f870c0ff390 2023-12-14T14:13:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8712fda700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c19b6f0 con 0x7f870c0ffd30 2023-12-14T14:13:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8711577700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c1043d0 0x7f870c19ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f870bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f870c0ffd30 0x7f870c196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8711577700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c1043d0 0x7f870c19ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35974/0 (socket says 172.21.15.69:35974) 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8711577700 1 -- 172.21.15.69:0/1986137603 learned_addr learned my addr 172.21.15.69:0/1986137603 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f870bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f870c0ffd30 0x7f870c196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:60376/0 (socket says 172.21.15.69:60376) 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8710d76700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870c0ff390 0x7f870c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8711577700 1 -- 172.21.15.69:0/1986137603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f870c0ffd30 msgr2=0x7f870c196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8711577700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f870c0ffd30 0x7f870c196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8711577700 1 -- 172.21.15.69:0/1986137603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870c0ff390 msgr2=0x7f870c1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8711577700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870c0ff390 0x7f870c1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8711577700 1 -- 172.21.15.69:0/1986137603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f80095f0 con 0x7f870c1043d0 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8711577700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c1043d0 0x7f870c19ad80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f870400ef30 tx=0x7f870400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.330+0000 7f8709ffb700 1 -- 172.21.15.69:0/1986137603 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704018070 con 0x7f870c1043d0 2023-12-14T14:13:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.331+0000 7f8709ffb700 1 -- 172.21.15.69:0/1986137603 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f870400f040 con 0x7f870c1043d0 2023-12-14T14:13:32.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.331+0000 7f8712fda700 1 -- 172.21.15.69:0/1986137603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c10f1a0 con 0x7f870c1043d0 2023-12-14T14:13:32.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.331+0000 7f8709ffb700 1 -- 172.21.15.69:0/1986137603 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400cd00 con 0x7f870c1043d0 2023-12-14T14:13:32.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.331+0000 7f8712fda700 1 -- 172.21.15.69:0/1986137603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c10f010 con 0x7f870c1043d0 2023-12-14T14:13:32.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.333+0000 7f8709ffb700 1 -- 172.21.15.69:0/1986137603 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8704003a00 con 0x7f870c1043d0 2023-12-14T14:13:32.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.334+0000 7f8709ffb700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f86fc0a56d0 0x7f86fc0a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.334+0000 7f8709ffb700 1 -- 172.21.15.69:0/1986137603 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f87040cc400 con 0x7f870c1043d0 2023-12-14T14:13:32.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.334+0000 7f8710d76700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f86fc0a56d0 0x7f86fc0a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.334+0000 7f8710d76700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f86fc0a56d0 0x7f86fc0a7b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8700009c60 tx=0x7f8700009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f871f168b80 1 Processor -- start 2023-12-14T14:13:32.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f871f168b80 1 -- start start 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f871f168b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x5590919147d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f871f168b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x55909191f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f871f168b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55909191fbd0 0x559091921fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f871f168b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590917fe660 con 0x559091914400 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f871f168b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909186d8f0 con 0x559091914d10 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f871f168b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559091866d80 con 0x55909191fbd0 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f8710d76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x5590919147d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f870bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x55909191f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f8710d76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x5590919147d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35990/0 (socket says 172.21.15.69:35990) 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.335+0000 7f8710d76700 1 -- 172.21.15.69:0/2718474367 learned_addr learned my addr 172.21.15.69:0/2718474367 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f8711577700 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55909191fbd0 0x559091921fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f870bfff700 1 -- 172.21.15.69:0/2718474367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55909191fbd0 msgr2=0x559091921fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f870bfff700 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55909191fbd0 0x559091921fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f870bfff700 1 -- 172.21.15.69:0/2718474367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 msgr2=0x5590919147d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f870bfff700 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x5590919147d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f870bfff700 1 -- 172.21.15.69:0/2718474367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590916e8430 con 0x559091914d10 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f8710d76700 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x5590919147d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f8711577700 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55909191fbd0 0x559091921fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f870bfff700 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x55909191f690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f86f80058e0 tx=0x7f86f8005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf9d368b7694a82 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f86f6ffd700 1 -- 172.21.15.69:0/2718474367 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8026070 con 0x559091914d10 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f86f6ffd700 1 -- 172.21.15.69:0/2718474367 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86f801e040 con 0x559091914d10 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.336+0000 7f86f6ffd700 1 -- 172.21.15.69:0/2718474367 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800fb00 con 0x559091914d10 2023-12-14T14:13:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 -- 172.21.15.69:0/2718474367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 msgr2=0x55909191f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x55909191f690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f86f80058e0 tx=0x7f86f8005c50 comp rx=0 tx=0).stop 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 -- 172.21.15.69:0/2718474367 shutdown_connections 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55909191fbd0 0x559091921fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x5590919147d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 --2- 172.21.15.69:0/2718474367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x55909191f690 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 -- 172.21.15.69:0/2718474367 >> 172.21.15.69:0/2718474367 conn(0x55909190ad20 msgr2=0x559091910860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 -- 172.21.15.69:0/2718474367 shutdown_connections 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 -- 172.21.15.69:0/2718474367 wait complete. 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.337+0000 7f871f168b80 1 -- start start 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f871f168b80 1 Processor -- start 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f871f168b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914400 0x55909191f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f871f168b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f871f168b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 0x55909191d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f871f168b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559091803010 con 0x55909191fbd0 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f871f168b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559091802cb0 con 0x559091914400 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f871f168b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590916ea720 con 0x559091914d10 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f871f168b80 10 client.0 _ll_register_callbacks cb 0x559091826990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f8710d76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914400 0x55909191f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f8710d76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914400 0x55909191f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:46364/0 (socket says 172.21.15.69:46364) 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f8710d76700 1 -- 172.21.15.69:0/1617086924 learned_addr learned my addr 172.21.15.69:0/1617086924 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f8711577700 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 0x55909191d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f870bfff700 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f8710d76700 1 -- 172.21.15.69:0/1617086924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 msgr2=0x55909191c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f8710d76700 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f8710d76700 1 -- 172.21.15.69:0/1617086924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 msgr2=0x55909191d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f8710d76700 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 0x55909191d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f8710d76700 1 -- 172.21.15.69:0/1617086924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c10c7e0 con 0x559091914400 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.338+0000 7f870bfff700 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.339+0000 7f8710d76700 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914400 0x55909191f680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8700003900 tx=0x7f87000047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33ed32e3e39c1a78 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.339+0000 7f86ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.339+0000 7f86ebfff700 1 -- 172.21.15.69:0/1617086924 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700022070 con 0x559091914400 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.339+0000 7f86ebfff700 1 -- 172.21.15.69:0/1617086924 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f870001d820 con 0x559091914400 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.339+0000 7f871f168b80 1 -- 172.21.15.69:0/1617086924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559091908330 con 0x559091914400 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.339+0000 7f86ebfff700 1 -- 172.21.15.69:0/1617086924 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f870001d9e0 con 0x559091914400 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.339+0000 7f871f168b80 10 client.25559 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.339+0000 7f871f168b80 1 -- 172.21.15.69:0/1617086924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55909182d1f0 con 0x559091914400 2023-12-14T14:13:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.339+0000 7f86ebfff700 1 -- 172.21.15.69:0/1617086924 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559091908330 con 0x559091914400 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f86ebfff700 1 -- 172.21.15.69:0/1617086924 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8700027aa0 con 0x559091914400 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f871f168b80 10 client.25559 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f871f168b80 10 client.25559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f871f168b80 20 client.25559 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f871f168b80 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55909192f5b0 0x5590919319c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f871f168b80 4 client.25559 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f871f168b80 1 -- 172.21.15.69:0/1617086924 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55909185fd60 con 0x55909192f5b0 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f870bfff700 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55909192f5b0 0x5590919319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f86ebfff700 10 client.25559 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.340+0000 7f870bfff700 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55909192f5b0 0x5590919319c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b46c965eb858dab9 server_cookie=5f8dd2dfb1e8fd5d in_seq=0 out_seq=0 2023-12-14T14:13:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f86ebfff700 1 -- 172.21.15.69:0/1617086924 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55909185fd60 con 0x55909192f5b0 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f86ebfff700 10 client.25559 handle_command_reply: tid=0 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 client.25559 shutdown 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 -- 172.21.15.69:0/1617086924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914400 msgr2=0x55909191f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914400 0x55909191f680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8700003900 tx=0x7f87000047c0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 -- 172.21.15.69:0/1617086924 shutdown_connections 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55909192f5b0 0x5590919319c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 0x55909191d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914400 0x55909191f680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f86ebfff700 0 client.25559 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 --2- 172.21.15.69:0/1617086924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 -- 172.21.15.69:0/1617086924 >> 172.21.15.69:0/1617086924 conn(0x55909190ad20 msgr2=0x559091910450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 -- 172.21.15.69:0/1617086924 shutdown_connections 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 1 -- 172.21.15.69:0/1617086924 wait complete. 2023-12-14T14:13:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.341+0000 7f871f168b80 20 client.25559 trim_cache size 0 max 16384 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f871f168b80 1 Processor -- start 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f871f168b80 1 -- start start 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f871f168b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x55909191c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f871f168b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f871f168b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55909191fbd0 0x55909191f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f871f168b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590919188f0 con 0x559091914400 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f871f168b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909191d6e0 con 0x55909191fbd0 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f871f168b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559091908170 con 0x559091914d10 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f8710d76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x55909191c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f8710d76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x55909191c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36018/0 (socket says 172.21.15.69:36018) 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f8710d76700 1 -- 172.21.15.69:0/3683330808 learned_addr learned my addr 172.21.15.69:0/3683330808 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f870bfff700 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.360+0000 7f8711577700 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55909191fbd0 0x55909191f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f8710d76700 1 -- 172.21.15.69:0/3683330808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 msgr2=0x55909191f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f8710d76700 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f8710d76700 1 -- 172.21.15.69:0/3683330808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55909191fbd0 msgr2=0x55909191f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f8710d76700 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55909191fbd0 0x55909191f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f8710d76700 1 -- 172.21.15.69:0/3683330808 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55909182cf40 con 0x559091914400 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f8711577700 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55909191fbd0 0x55909191f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f870bfff700 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f8710d76700 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x55909191c970 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8700009b20 tx=0x7f8700005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97636fe4a502ee07 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f86f77fe700 1 -- 172.21.15.69:0/3683330808 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700022030 con 0x559091914400 2023-12-14T14:13:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f86f77fe700 1 -- 172.21.15.69:0/3683330808 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87000092d0 con 0x559091914400 2023-12-14T14:13:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.361+0000 7f86f77fe700 1 -- 172.21.15.69:0/3683330808 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870001dc00 con 0x559091914400 2023-12-14T14:13:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 -- 172.21.15.69:0/3683330808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 msgr2=0x55909191c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x55909191c970 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8700009b20 tx=0x7f8700005880 comp rx=0 tx=0).stop 2023-12-14T14:13:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 -- 172.21.15.69:0/3683330808 shutdown_connections 2023-12-14T14:13:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55909191fbd0 0x55909191f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559091914400 0x55909191c970 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 --2- 172.21.15.69:0/3683330808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914d10 0x55909191f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 -- 172.21.15.69:0/3683330808 >> 172.21.15.69:0/3683330808 conn(0x55909190ad20 msgr2=0x55909191c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 -- 172.21.15.69:0/3683330808 shutdown_connections 2023-12-14T14:13:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 -- 172.21.15.69:0/3683330808 wait complete. 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.362+0000 7f871f168b80 1 -- start start 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f871f168b80 1 Processor -- start 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f871f168b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914400 0x559091924fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f871f168b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x5590919254e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f871f168b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 0x559091983480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f871f168b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559091925c30 con 0x55909191fbd0 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f871f168b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559091925da0 con 0x559091914d10 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f871f168b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590919839c0 con 0x559091914400 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f871f168b80 10 client.0 _ll_register_callbacks cb 0x7f8700004420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f8710d76700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914400 0x559091924fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f8710d76700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914400 0x559091924fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:60412/0 (socket says 172.21.15.69:60412) 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f8710d76700 1 -- 172.21.15.69:0/3571085154 learned_addr learned my addr 172.21.15.69:0/3571085154 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.363+0000 7f8711577700 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 0x559091983480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f870bfff700 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x5590919254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f8710d76700 1 -- 172.21.15.69:0/3571085154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 msgr2=0x5590919254e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f8710d76700 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x5590919254e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f8710d76700 1 -- 172.21.15.69:0/3571085154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 msgr2=0x559091983480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f8710d76700 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 0x559091983480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f8710d76700 1 -- 172.21.15.69:0/3571085154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590916e8430 con 0x559091914400 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f870bfff700 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x5590919254e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f8710d76700 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914400 0x559091924fa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87000097c0 tx=0x7f870001df60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50586814f6d22e15 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f86ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f86ebfff700 1 -- 172.21.15.69:0/3571085154 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700022070 con 0x559091914400 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f86ebfff700 1 -- 172.21.15.69:0/3571085154 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f8700023070 con 0x559091914400 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f871f168b80 1 -- 172.21.15.69:0/3571085154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86f801e040 con 0x559091914400 2023-12-14T14:13:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f86ebfff700 1 -- 172.21.15.69:0/3571085154 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f870001c590 con 0x559091914400 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f871f168b80 10 client.25528 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.364+0000 7f871f168b80 1 -- 172.21.15.69:0/3571085154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f870c10f010 con 0x559091914400 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f86ebfff700 1 -- 172.21.15.69:0/3571085154 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86f801e040 con 0x559091914400 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f86ebfff700 1 -- 172.21.15.69:0/3571085154 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f870003f070 con 0x559091914400 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f871f168b80 10 client.25528 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f871f168b80 10 client.25528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f871f168b80 20 client.25528 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f871f168b80 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559091984da0 0x5590919871b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f871f168b80 4 client.25528 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f871f168b80 1 -- 172.21.15.69:0/3571085154 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55909185fa80 con 0x559091984da0 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f870bfff700 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559091984da0 0x5590919871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f86ebfff700 10 client.25528 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.365+0000 7f870bfff700 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559091984da0 0x5590919871b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18117e9f68da92f2 server_cookie=10a9158756e4e269 in_seq=0 out_seq=0 2023-12-14T14:13:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f86ebfff700 1 -- 172.21.15.69:0/3571085154 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55909185fa80 con 0x559091984da0 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f86ebfff700 10 client.25528 handle_command_reply: tid=0 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f871f168b80 1 client.25528 shutdown 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f871f168b80 1 -- 172.21.15.69:0/3571085154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914400 msgr2=0x559091924fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f871f168b80 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914400 0x559091924fa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87000097c0 tx=0x7f870001df60 comp rx=0 tx=0).stop 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f871f168b80 1 -- 172.21.15.69:0/3571085154 shutdown_connections 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f871f168b80 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559091984da0 0x5590919871b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f871f168b80 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55909191fbd0 0x559091983480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f871f168b80 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559091914400 0x559091924fa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f86ebfff700 0 client.25528 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f871f168b80 1 --2- 172.21.15.69:0/3571085154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559091914d10 0x5590919254e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.366+0000 7f871f168b80 1 -- 172.21.15.69:0/3571085154 >> 172.21.15.69:0/3571085154 conn(0x55909190ad20 msgr2=0x559091916c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f871f168b80 1 -- 172.21.15.69:0/3571085154 shutdown_connections 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f871f168b80 1 -- 172.21.15.69:0/3571085154 wait complete. 2023-12-14T14:13:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f871f168b80 20 client.25528 trim_cache size 0 max 16384 2023-12-14T14:13:32.372 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:13:32.372 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:13:32.372 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "6ac35f34-16ae-4d21-a087-3da5b8baaf4c", 2023-12-14T14:13:32.372 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:13:32.372 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:13:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 -- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f86fc0a56d0 msgr2=0x7f86fc0a7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f86fc0a56d0 0x7f86fc0a7b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8700009c60 tx=0x7f8700009260 comp rx=0 tx=0).stop 2023-12-14T14:13:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 -- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c1043d0 msgr2=0x7f870c19ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c1043d0 0x7f870c19ad80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f870400ef30 tx=0x7f870400c3a0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 -- 172.21.15.69:0/1986137603 shutdown_connections 2023-12-14T14:13:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f86fc0a56d0 0x7f86fc0a7b80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f870c1043d0 0x7f870c19ad80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870c0ff390 0x7f870c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 --2- 172.21.15.69:0/1986137603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f870c0ffd30 0x7f870c196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 -- 172.21.15.69:0/1986137603 >> 172.21.15.69:0/1986137603 conn(0x7f870c075fd0 msgr2=0x7f870c067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 -- 172.21.15.69:0/1986137603 shutdown_connections 2023-12-14T14:13:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.367+0000 7f8712fda700 1 -- 172.21.15.69:0/1986137603 wait complete. 2023-12-14T14:13:32.382 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:13:32.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.533+0000 7f1362ac0700 1 -- 172.21.15.69:0/4060754177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f135c0ff3d0 msgr2=0x7f135c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.533+0000 7f1362ac0700 1 --2- 172.21.15.69:0/4060754177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f135c0ff3d0 0x7f135c0ff7a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f134c0099c0 tx=0x7f134c009cd0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.533+0000 7f1362ac0700 1 -- 172.21.15.69:0/4060754177 shutdown_connections 2023-12-14T14:13:32.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.533+0000 7f1362ac0700 1 --2- 172.21.15.69:0/4060754177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c104410 0x7f135c10bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.533+0000 7f1362ac0700 1 --2- 172.21.15.69:0/4060754177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f135c0ff3d0 0x7f135c0ff7a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.533+0000 7f1362ac0700 1 --2- 172.21.15.69:0/4060754177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f135c0ffd70 0x7f135c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.533+0000 7f1362ac0700 1 -- 172.21.15.69:0/4060754177 >> 172.21.15.69:0/4060754177 conn(0x7f135c076230 msgr2=0x7f135c076630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.533+0000 7f1362ac0700 1 -- 172.21.15.69:0/4060754177 shutdown_connections 2023-12-14T14:13:32.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.534+0000 7f1362ac0700 1 -- 172.21.15.69:0/4060754177 wait complete. 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.534+0000 7f1362ac0700 1 Processor -- start 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.534+0000 7f1362ac0700 1 -- start start 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f1362ac0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f135c0ff3d0 0x7f135c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f1362ac0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0ffd70 0x7f135c1968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f1362ac0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f135c104410 0x7f135c19ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f1362ac0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c19b380 con 0x7f135c0ff3d0 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f1362ac0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c19b4f0 con 0x7f135c0ffd70 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f1362ac0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c19b6b0 con 0x7f135c104410 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136085c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f135c0ff3d0 0x7f135c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136085c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f135c0ff3d0 0x7f135c1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36048/0 (socket says 172.21.15.69:36048) 2023-12-14T14:13:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136085c700 1 -- 172.21.15.69:0/2576224721 learned_addr learned my addr 172.21.15.69:0/2576224721 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f135bfff700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0ffd70 0x7f135c1968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136105d700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f135c104410 0x7f135c19ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136085c700 1 -- 172.21.15.69:0/2576224721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f135c104410 msgr2=0x7f135c19ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136085c700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f135c104410 0x7f135c19ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136085c700 1 -- 172.21.15.69:0/2576224721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0ffd70 msgr2=0x7f135c1968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136085c700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0ffd70 0x7f135c1968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136085c700 1 -- 172.21.15.69:0/2576224721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c0095f0 con 0x7f135c0ff3d0 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136105d700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f135c104410 0x7f135c19ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.535+0000 7f136085c700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f135c0ff3d0 0x7f135c1963a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f134c009990 tx=0x7f134c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.536+0000 7f1359ffb700 1 -- 172.21.15.69:0/2576224721 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c01d070 con 0x7f135c0ff3d0 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.536+0000 7f1362ac0700 1 -- 172.21.15.69:0/2576224721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c110350 con 0x7f135c0ff3d0 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.536+0000 7f1362ac0700 1 -- 172.21.15.69:0/2576224721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c1101c0 con 0x7f135c0ff3d0 2023-12-14T14:13:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.536+0000 7f1359ffb700 1 -- 172.21.15.69:0/2576224721 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f134c004cb0 con 0x7f135c0ff3d0 2023-12-14T14:13:32.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.536+0000 7f1359ffb700 1 -- 172.21.15.69:0/2576224721 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c003ad0 con 0x7f135c0ff3d0 2023-12-14T14:13:32.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.540+0000 7f136ec4eb80 1 Processor -- start 2023-12-14T14:13:32.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.540+0000 7f136ec4eb80 1 -- start start 2023-12-14T14:13:32.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb3c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 0x5568eeb47610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 0x5568eeb4e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eea265e0 con 0x5568eeb4bf60 2023-12-14T14:13:32.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eea95870 con 0x5568eeb3cc90 2023-12-14T14:13:32.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eea8ed00 con 0x5568eeb3c380 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f1359ffb700 1 -- 172.21.15.69:0/2576224721 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f134c004e20 con 0x7f135c0ff3d0 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136105d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb3c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136105d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb3c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:60434/0 (socket says 172.21.15.69:60434) 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136105d700 1 -- 172.21.15.69:0/2415652877 learned_addr learned my addr 172.21.15.69:0/2415652877 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f135bfff700 1 --2- 172.21.15.69:0/2415652877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 0x5568eeb4e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136085c700 1 --2- 172.21.15.69:0/2415652877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 0x5568eeb47610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136105d700 1 -- 172.21.15.69:0/2415652877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 msgr2=0x5568eeb47610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136105d700 1 --2- 172.21.15.69:0/2415652877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 0x5568eeb47610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136105d700 1 -- 172.21.15.69:0/2415652877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 msgr2=0x5568eeb4e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136105d700 1 --2- 172.21.15.69:0/2415652877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 0x5568eeb4e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f136105d700 1 -- 172.21.15.69:0/2415652877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568ee9103b0 con 0x5568eeb3c380 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.541+0000 7f1359ffb700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13440a1340 0x7f13440a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.542+0000 7f136105d700 1 --2- 172.21.15.69:0/2415652877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb3c750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f135400a870 tx=0x7f1354009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c546379474c06945 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.542+0000 7f136085c700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13440a1340 0x7f13440a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.542+0000 7f1342ffd700 1 -- 172.21.15.69:0/2415652877 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354010040 con 0x5568eeb3c380 2023-12-14T14:13:32.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.542+0000 7f1359ffb700 1 -- 172.21.15.69:0/2576224721 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f134c0cd9c0 con 0x7f135c0ff3d0 2023-12-14T14:13:32.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.542+0000 7f1342ffd700 1 -- 172.21.15.69:0/2415652877 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1354014d90 con 0x5568eeb3c380 2023-12-14T14:13:32.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.542+0000 7f1342ffd700 1 -- 172.21.15.69:0/2415652877 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354013cd0 con 0x5568eeb3c380 2023-12-14T14:13:32.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2415652877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 msgr2=0x5568eeb3c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2415652877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb3c750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f135400a870 tx=0x7f1354009650 comp rx=0 tx=0).stop 2023-12-14T14:13:32.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136085c700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13440a1340 0x7f13440a37f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f134c0cb200 tx=0x7f134c0d3530 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2415652877 shutdown_connections 2023-12-14T14:13:32.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2415652877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 0x5568eeb4e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2415652877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb3c750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2415652877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 0x5568eeb47610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2415652877 >> 172.21.15.69:0/2415652877 conn(0x5568eeb32ca0 msgr2=0x5568eeb387e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2415652877 shutdown_connections 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2415652877 wait complete. 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 -- start start 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.543+0000 7f136ec4eb80 1 Processor -- start 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb47320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 0x5568eeb40590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 0x5568eeb40ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eea2af90 con 0x5568eeb4bf60 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eea2ac30 con 0x5568eeb3cc90 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ee9126a0 con 0x5568eeb3c380 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136ec4eb80 10 client.0 _ll_register_callbacks cb 0x5568eea4e910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136105d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb47320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136105d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb47320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:60446/0 (socket says 172.21.15.69:60446) 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f135bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 0x5568eeb40590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136105d700 1 -- 172.21.15.69:0/2073629545 learned_addr learned my addr 172.21.15.69:0/2073629545 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136105d700 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 0x5568eeb40ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f135bfff700 1 -- 172.21.15.69:0/2073629545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 msgr2=0x5568eeb47320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f135bfff700 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb47320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f135bfff700 1 -- 172.21.15.69:0/2073629545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 msgr2=0x5568eeb40ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f135bfff700 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 0x5568eeb40ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f135bfff700 1 -- 172.21.15.69:0/2073629545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135400a4a0 con 0x5568eeb3cc90 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.544+0000 7f136105d700 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb47320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.545+0000 7f135bfff700 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 0x5568eeb40590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f135c067d50 tx=0x7f1350011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7cf2e6c86a8b0c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.545+0000 7f133bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.545+0000 7f133bfff700 1 -- 172.21.15.69:0/2073629545 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350016070 con 0x5568eeb3cc90 2023-12-14T14:13:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.545+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2073629545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568eeb302b0 con 0x5568eeb3cc90 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.545+0000 7f133bfff700 1 -- 172.21.15.69:0/2073629545 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f1350004030 con 0x5568eeb3cc90 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.545+0000 7f133bfff700 1 -- 172.21.15.69:0/2073629545 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1350004230 con 0x5568eeb3cc90 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.545+0000 7f136ec4eb80 10 client.25571 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.545+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2073629545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5568eea55170 con 0x5568eeb3cc90 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.545+0000 7f133bfff700 1 -- 172.21.15.69:0/2073629545 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5568eeb302b0 con 0x5568eeb3cc90 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f133bfff700 1 -- 172.21.15.69:0/2073629545 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1350003780 con 0x5568eeb3cc90 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f136ec4eb80 10 client.25571 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f136ec4eb80 10 client.25571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f136ec4eb80 20 client.25571 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5568eeb5fd60 0x5568eeb62170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f136ec4eb80 4 client.25571 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2073629545 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568eea87ce0 con 0x5568eeb5fd60 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f136105d700 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5568eeb5fd60 0x5568eeb62170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f136105d700 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5568eeb5fd60 0x5568eeb62170 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=234c352c333d8a39 server_cookie=b50c40ef9ac81aa1 in_seq=0 out_seq=0 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.546+0000 7f133bfff700 10 client.25571 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f133bfff700 1 -- 172.21.15.69:0/2073629545 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5568eea87ce0 con 0x5568eeb5fd60 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f133bfff700 10 client.25571 handle_command_reply: tid=0 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 client.25571 shutdown 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2073629545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 msgr2=0x5568eeb40590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 0x5568eeb40590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f135c067d50 tx=0x7f1350011720 comp rx=0 tx=0).stop 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2073629545 shutdown_connections 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5568eeb5fd60 0x5568eeb62170 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb4bf60 0x5568eeb40ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f133bfff700 0 client.25571 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3c380 0x5568eeb47320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/2073629545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3cc90 0x5568eeb40590 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2073629545 >> 172.21.15.69:0/2073629545 conn(0x5568eeb32ca0 msgr2=0x5568eeb38370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2073629545 shutdown_connections 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.547+0000 7f136ec4eb80 1 -- 172.21.15.69:0/2073629545 wait complete. 2023-12-14T14:13:32.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.548+0000 7f136ec4eb80 20 client.25571 trim_cache size 0 max 16384 2023-12-14T14:13:32.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136ec4eb80 1 Processor -- start 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136ec4eb80 1 -- start start 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3c380 0x5568eeb4b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3cc90 0x5568eeb44c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb4bf60 0x5568eeb46e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eeb41480 con 0x5568eeb3cc90 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eeb627d0 con 0x5568eeb3c380 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eeb47b00 con 0x5568eeb4bf60 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136105d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3c380 0x5568eeb4b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136105d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3c380 0x5568eeb4b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:46426/0 (socket says 172.21.15.69:46426) 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136105d700 1 -- 172.21.15.69:0/4100190569 learned_addr learned my addr 172.21.15.69:0/4100190569 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f136105d700 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb4bf60 0x5568eeb46e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.570+0000 7f135bfff700 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3cc90 0x5568eeb44c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f135bfff700 1 -- 172.21.15.69:0/4100190569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb4bf60 msgr2=0x5568eeb46e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f135bfff700 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb4bf60 0x5568eeb46e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f135bfff700 1 -- 172.21.15.69:0/4100190569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3c380 msgr2=0x5568eeb4b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f135bfff700 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3c380 0x5568eeb4b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f135bfff700 1 -- 172.21.15.69:0/4100190569 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568eea54ec0 con 0x5568eeb3cc90 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f136105d700 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3c380 0x5568eeb4b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f135bfff700 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3cc90 0x5568eeb44c90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1350003b90 tx=0x7f1350011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8a150df2b30fa8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f13437fe700 1 -- 172.21.15.69:0/4100190569 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350016040 con 0x5568eeb3cc90 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f13437fe700 1 -- 172.21.15.69:0/4100190569 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1350005530 con 0x5568eeb3cc90 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.571+0000 7f13437fe700 1 -- 172.21.15.69:0/4100190569 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350010960 con 0x5568eeb3cc90 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.572+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4100190569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3cc90 msgr2=0x5568eeb44c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.572+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3cc90 0x5568eeb44c90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1350003b90 tx=0x7f1350011af0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.572+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4100190569 shutdown_connections 2023-12-14T14:13:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.572+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb4bf60 0x5568eeb46e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.572+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb3c380 0x5568eeb4b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.572+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4100190569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3cc90 0x5568eeb44c90 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.572+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4100190569 >> 172.21.15.69:0/4100190569 conn(0x5568eeb32ca0 msgr2=0x5568eeb36f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.572+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4100190569 shutdown_connections 2023-12-14T14:13:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.572+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4100190569 wait complete. 2023-12-14T14:13:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f136ec4eb80 1 -- start start 2023-12-14T14:13:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f136ec4eb80 1 Processor -- start 2023-12-14T14:13:32.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3c380 0x5568eeb5c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3cc90 0x5568eeb5c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f136ec4eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb4bf60 0x5568eeb491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eeb49700 con 0x5568eeb3c380 2023-12-14T14:13:32.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eeb49870 con 0x5568eeb4bf60 2023-12-14T14:13:32.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f136ec4eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eeb49a30 con 0x5568eeb3cc90 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f136ec4eb80 10 client.0 _ll_register_callbacks cb 0x7f1350007a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.573+0000 7f135bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3cc90 0x5568eeb5c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f135bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3cc90 0x5568eeb5c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:60456/0 (socket says 172.21.15.69:60456) 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f135bfff700 1 -- 172.21.15.69:0/4043749834 learned_addr learned my addr 172.21.15.69:0/4043749834 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f136105d700 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb4bf60 0x5568eeb491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f136105d700 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3c380 0x5568eeb5c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f135bfff700 1 -- 172.21.15.69:0/4043749834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb4bf60 msgr2=0x5568eeb491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f135bfff700 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb4bf60 0x5568eeb491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f135bfff700 1 -- 172.21.15.69:0/4043749834 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3c380 msgr2=0x5568eeb5c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f135bfff700 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3c380 0x5568eeb5c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f135bfff700 1 -- 172.21.15.69:0/4043749834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568eea55170 con 0x5568eeb3cc90 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f135bfff700 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3cc90 0x5568eeb5c800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1350003fd0 tx=0x7f1350005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9be25161df459c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f133bfff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:13:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.574+0000 7f133bfff700 1 -- 172.21.15.69:0/4043749834 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350010b10 con 0x5568eeb3cc90 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f133bfff700 1 -- 172.21.15.69:0/4043749834 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f13500056a0 con 0x5568eeb3cc90 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4043749834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1354014d90 con 0x5568eeb3cc90 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f133bfff700 1 -- 172.21.15.69:0/4043749834 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1350003680 con 0x5568eeb3cc90 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136ec4eb80 10 client.25546 fetch_fsmap learned FSMap version 24 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4043749834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5568eea3b9a0 con 0x5568eeb3cc90 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f133bfff700 1 -- 172.21.15.69:0/4043749834 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1354014d90 con 0x5568eeb3cc90 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f133bfff700 1 -- 172.21.15.69:0/4043749834 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f135001bd00 con 0x5568eeb3cc90 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136ec4eb80 10 client.25546 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136ec4eb80 10 client.25546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136ec4eb80 20 client.25546 populate_metadata read hostname 'smithi069' 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5568eeb4ad00 0x5568eebb6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136ec4eb80 4 client.25546 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4043749834 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5568eea87a00 con 0x5568eeb4ad00 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.575+0000 7f136105d700 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5568eeb4ad00 0x5568eebb6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:13:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.576+0000 7f133bfff700 10 client.25546 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.576+0000 7f136105d700 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5568eeb4ad00 0x5568eebb6bf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f139b23940e4bab2 server_cookie=79e4251bfaf1d35e in_seq=0 out_seq=0 2023-12-14T14:13:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f133bfff700 1 -- 172.21.15.69:0/4043749834 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x5568eea87a00 con 0x5568eeb4ad00 2023-12-14T14:13:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f133bfff700 10 client.25546 handle_command_reply: tid=0 2023-12-14T14:13:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 client.25546 shutdown 2023-12-14T14:13:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4043749834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3cc90 msgr2=0x5568eeb5c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3cc90 0x5568eeb5c800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1350003fd0 tx=0x7f1350005ce0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4043749834 shutdown_connections 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5568eeb4ad00 0x5568eebb6bf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568eeb4bf60 0x5568eeb491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568eeb3c380 0x5568eeb5c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f133bfff700 0 client.25546 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 --2- 172.21.15.69:0/4043749834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5568eeb3cc90 0x5568eeb5c800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4043749834 >> 172.21.15.69:0/4043749834 conn(0x5568eeb32ca0 msgr2=0x5568eeb4b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4043749834 shutdown_connections 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 1 -- 172.21.15.69:0/4043749834 wait complete. 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.577+0000 7f136ec4eb80 20 client.25546 trim_cache size 0 max 16384 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:13:32.579 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (8307 inodes in the stack)", 2023-12-14T14:13:32.580 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:13:32.580 INFO:teuthology.orchestra.run.smithi069.stdout: "6ac35f34-16ae-4d21-a087-3da5b8baaf4c": { 2023-12-14T14:13:32.580 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:13:32.580 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6ac35f34-16ae-4d21-a087-3da5b8baaf4c", 2023-12-14T14:13:32.580 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:13:32.580 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:13:32.580 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:13:32.580 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 -- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13440a1340 msgr2=0x7f13440a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13440a1340 0x7f13440a37f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f134c0cb200 tx=0x7f134c0d3530 comp rx=0 tx=0).stop 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 -- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f135c0ff3d0 msgr2=0x7f135c1963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f135c0ff3d0 0x7f135c1963a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f134c009990 tx=0x7f134c009580 comp rx=0 tx=0).stop 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 -- 172.21.15.69:0/2576224721 shutdown_connections 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13440a1340 0x7f13440a37f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f135c104410 0x7f135c19ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f135c0ff3d0 0x7f135c1963a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 --2- 172.21.15.69:0/2576224721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0ffd70 0x7f135c1968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 -- 172.21.15.69:0/2576224721 >> 172.21.15.69:0/2576224721 conn(0x7f135c076230 msgr2=0x7f135c0fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 -- 172.21.15.69:0/2576224721 shutdown_connections 2023-12-14T14:13:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:13:32.578+0000 7f1362ac0700 1 -- 172.21.15.69:0/2576224721 wait complete. 2023-12-14T14:13:32.593 INFO:tasks.cephfs.filesystem:scrub status for tag:6ac35f34-16ae-4d21-a087-3da5b8baaf4c - {'path': '/', 'tag': '6ac35f34-16ae-4d21-a087-3da5b8baaf4c', 'options': 'recursive,force'} 2023-12-14T14:13:33.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:33 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:13:33.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:33 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:13:33.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:33 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:13:33.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:33 smithi119 ceph-mon[43834]: pgmap v90: 97 pgs: 97 active+clean; 59 MiB data, 159 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 105 op/s 2023-12-14T14:13:33.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:33 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:13:33.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:33 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:13:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:33 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:13:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:33 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:13:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:33 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:13:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:33 smithi069 ceph-mon[42034]: pgmap v90: 97 pgs: 97 active+clean; 59 MiB data, 159 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 105 op/s 2023-12-14T14:13:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:33 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:13:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:33 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:13:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:33 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:13:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:33 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:13:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:33 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:13:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:33 smithi081 ceph-mon[43371]: pgmap v90: 97 pgs: 97 active+clean; 59 MiB data, 159 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 105 op/s 2023-12-14T14:13:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:33 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:13:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:33 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:13:35.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:35 smithi119 ceph-mon[43834]: pgmap v91: 97 pgs: 97 active+clean; 78 MiB data, 197 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.9 MiB/s wr, 137 op/s 2023-12-14T14:13:35.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:35 smithi069 ceph-mon[42034]: pgmap v91: 97 pgs: 97 active+clean; 78 MiB data, 197 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.9 MiB/s wr, 137 op/s 2023-12-14T14:13:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:35 smithi081 ceph-mon[43371]: pgmap v91: 97 pgs: 97 active+clean; 78 MiB data, 197 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.9 MiB/s wr, 137 op/s 2023-12-14T14:13:37.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:37 smithi069 ceph-mon[42034]: pgmap v92: 97 pgs: 97 active+clean; 78 MiB data, 197 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 127 op/s 2023-12-14T14:13:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:37 smithi081 ceph-mon[43371]: pgmap v92: 97 pgs: 97 active+clean; 78 MiB data, 197 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 127 op/s 2023-12-14T14:13:37.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:37 smithi119 ceph-mon[43834]: pgmap v92: 97 pgs: 97 active+clean; 78 MiB data, 197 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 127 op/s 2023-12-14T14:13:39.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:39 smithi119 ceph-mon[43834]: pgmap v93: 97 pgs: 97 active+clean; 78 MiB data, 197 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 127 op/s 2023-12-14T14:13:39.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:39 smithi069 ceph-mon[42034]: pgmap v93: 97 pgs: 97 active+clean; 78 MiB data, 197 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 127 op/s 2023-12-14T14:13:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:39 smithi081 ceph-mon[43371]: pgmap v93: 97 pgs: 97 active+clean; 78 MiB data, 197 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 127 op/s 2023-12-14T14:13:41.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:41 smithi119 ceph-mon[43834]: pgmap v94: 97 pgs: 97 active+clean; 97 MiB data, 226 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.4 MiB/s wr, 165 op/s 2023-12-14T14:13:41.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:41 smithi069 ceph-mon[42034]: pgmap v94: 97 pgs: 97 active+clean; 97 MiB data, 226 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.4 MiB/s wr, 165 op/s 2023-12-14T14:13:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:41 smithi081 ceph-mon[43371]: pgmap v94: 97 pgs: 97 active+clean; 97 MiB data, 226 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.4 MiB/s wr, 165 op/s 2023-12-14T14:13:43.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:43 smithi119 ceph-mon[43834]: pgmap v95: 97 pgs: 97 active+clean; 97 MiB data, 226 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 69 op/s 2023-12-14T14:13:43.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:43 smithi069 ceph-mon[42034]: pgmap v95: 97 pgs: 97 active+clean; 97 MiB data, 226 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 69 op/s 2023-12-14T14:13:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:43 smithi081 ceph-mon[43371]: pgmap v95: 97 pgs: 97 active+clean; 97 MiB data, 226 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 69 op/s 2023-12-14T14:13:45.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:45 smithi119 ceph-mon[43834]: pgmap v96: 97 pgs: 97 active+clean; 108 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 345 op/s 2023-12-14T14:13:45.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:45 smithi069 ceph-mon[42034]: pgmap v96: 97 pgs: 97 active+clean; 108 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 345 op/s 2023-12-14T14:13:45.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:45 smithi081 ceph-mon[43371]: pgmap v96: 97 pgs: 97 active+clean; 108 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 345 op/s 2023-12-14T14:13:47.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:47 smithi069 ceph-mon[42034]: pgmap v97: 97 pgs: 97 active+clean; 108 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2023-12-14T14:13:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:47 smithi081 ceph-mon[43371]: pgmap v97: 97 pgs: 97 active+clean; 108 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2023-12-14T14:13:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:47 smithi119 ceph-mon[43834]: pgmap v97: 97 pgs: 97 active+clean; 108 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2023-12-14T14:13:49.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:49 smithi119 ceph-mon[43834]: pgmap v98: 97 pgs: 97 active+clean; 108 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2023-12-14T14:13:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:49 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:13:49.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:49 smithi069 ceph-mon[42034]: pgmap v98: 97 pgs: 97 active+clean; 108 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2023-12-14T14:13:49.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:49 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:13:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:49 smithi081 ceph-mon[43371]: pgmap v98: 97 pgs: 97 active+clean; 108 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2023-12-14T14:13:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:49 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:13:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:51 smithi119 ceph-mon[43834]: pgmap v99: 97 pgs: 97 active+clean; 125 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.6 MiB/s wr, 395 op/s 2023-12-14T14:13:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:51 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:13:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:13:51.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:51 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:13:51.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:13:51.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:51 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:13:51.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:51 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:13:51.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:51 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:13:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:51 smithi069 ceph-mon[42034]: pgmap v99: 97 pgs: 97 active+clean; 125 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.6 MiB/s wr, 395 op/s 2023-12-14T14:13:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:51 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:13:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:13:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:51 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:13:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:13:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:51 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:13:51.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:51 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:13:51.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:51 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:13:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:51 smithi081 ceph-mon[43371]: pgmap v99: 97 pgs: 97 active+clean; 125 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.6 MiB/s wr, 395 op/s 2023-12-14T14:13:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:51 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:13:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:13:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:51 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:13:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:13:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:51 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:13:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:51 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:13:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:51 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:13:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:53 smithi119 ceph-mon[43834]: pgmap v100: 97 pgs: 97 active+clean; 125 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 358 op/s 2023-12-14T14:13:53.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:53 smithi069 ceph-mon[42034]: pgmap v100: 97 pgs: 97 active+clean; 125 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 358 op/s 2023-12-14T14:13:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:53 smithi081 ceph-mon[43371]: pgmap v100: 97 pgs: 97 active+clean; 125 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 358 op/s 2023-12-14T14:13:54.480 INFO:tasks.workunit.client.0.smithi069.stdout:created hierarchy, now cleaning up 2023-12-14T14:13:55.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:55 smithi119 ceph-mon[43834]: pgmap v101: 97 pgs: 97 active+clean; 137 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.0 MiB/s wr, 395 op/s 2023-12-14T14:13:55.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:55 smithi069 ceph-mon[42034]: pgmap v101: 97 pgs: 97 active+clean; 137 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.0 MiB/s wr, 395 op/s 2023-12-14T14:13:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:55 smithi081 ceph-mon[43371]: pgmap v101: 97 pgs: 97 active+clean; 137 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.0 MiB/s wr, 395 op/s 2023-12-14T14:13:56.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:56 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:56.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:56 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:56.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:56 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:13:57.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:57 smithi119 ceph-mon[43834]: pgmap v102: 97 pgs: 97 active+clean; 137 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 119 op/s 2023-12-14T14:13:57.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:57 smithi069 ceph-mon[42034]: pgmap v102: 97 pgs: 97 active+clean; 137 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 119 op/s 2023-12-14T14:13:57.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:57 smithi081 ceph-mon[43371]: pgmap v102: 97 pgs: 97 active+clean; 137 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 119 op/s 2023-12-14T14:13:59.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:13:59 smithi119 ceph-mon[43834]: pgmap v103: 97 pgs: 97 active+clean; 137 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 119 op/s 2023-12-14T14:13:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:13:59 smithi069 ceph-mon[42034]: pgmap v103: 97 pgs: 97 active+clean; 137 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 119 op/s 2023-12-14T14:13:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:13:59 smithi081 ceph-mon[43371]: pgmap v103: 97 pgs: 97 active+clean; 137 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 119 op/s 2023-12-14T14:14:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:01 smithi119 ceph-mon[43834]: pgmap v104: 97 pgs: 97 active+clean; 141 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 128 op/s 2023-12-14T14:14:01.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:01 smithi069 ceph-mon[42034]: pgmap v104: 97 pgs: 97 active+clean; 141 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 128 op/s 2023-12-14T14:14:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:01 smithi081 ceph-mon[43371]: pgmap v104: 97 pgs: 97 active+clean; 141 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 128 op/s 2023-12-14T14:14:02.594 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:14:02.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.729+0000 7fe26316f700 1 -- 172.21.15.69:0/1696098943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c0ff3d0 msgr2=0x7fe25c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:02.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.729+0000 7fe26316f700 1 --2- 172.21.15.69:0/1696098943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c0ff3d0 0x7fe25c0ff7a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe2500099c0 tx=0x7fe250009cd0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.729+0000 7fe26316f700 1 -- 172.21.15.69:0/1696098943 shutdown_connections 2023-12-14T14:14:02.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.729+0000 7fe26316f700 1 --2- 172.21.15.69:0/1696098943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25c104400 0x7fe25c10bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.729+0000 7fe26316f700 1 --2- 172.21.15.69:0/1696098943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c0ff3d0 0x7fe25c0ff7a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.729+0000 7fe26316f700 1 --2- 172.21.15.69:0/1696098943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe25c0ffd70 0x7fe25c103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.729+0000 7fe26316f700 1 -- 172.21.15.69:0/1696098943 >> 172.21.15.69:0/1696098943 conn(0x7fe25c075fa0 msgr2=0x7fe25c0763a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:02.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.729+0000 7fe26316f700 1 -- 172.21.15.69:0/1696098943 shutdown_connections 2023-12-14T14:14:02.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.729+0000 7fe26316f700 1 -- 172.21.15.69:0/1696098943 wait complete. 2023-12-14T14:14:02.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26316f700 1 Processor -- start 2023-12-14T14:14:02.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26316f700 1 -- start start 2023-12-14T14:14:02.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26316f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25c0ff3d0 0x7fe25c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26316f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe25c0ffd70 0x7fe25c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26316f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104400 0x7fe25c19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26316f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c19d540 con 0x7fe25c104400 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26316f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c19d6b0 con 0x7fe25c0ff3d0 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26316f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c19d870 con 0x7fe25c0ffd70 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26170c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104400 0x7fe25c19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26170c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104400 0x7fe25c19cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57908/0 (socket says 172.21.15.69:57908) 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe260f0b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25c0ff3d0 0x7fe25c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26170c700 1 -- 172.21.15.69:0/3525112799 learned_addr learned my addr 172.21.15.69:0/3525112799 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:02.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe25bfff700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe25c0ffd70 0x7fe25c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26170c700 1 -- 172.21.15.69:0/3525112799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe25c0ffd70 msgr2=0x7fe25c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26170c700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe25c0ffd70 0x7fe25c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26170c700 1 -- 172.21.15.69:0/3525112799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25c0ff3d0 msgr2=0x7fe25c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26170c700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25c0ff3d0 0x7fe25c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.730+0000 7fe26170c700 1 -- 172.21.15.69:0/3525112799 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500095f0 con 0x7fe25c104400 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.731+0000 7fe26170c700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104400 0x7fe25c19cf00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe25400ef30 tx=0x7fe25400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.731+0000 7fe259ffb700 1 -- 172.21.15.69:0/3525112799 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254018070 con 0x7fe25c104400 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.731+0000 7fe259ffb700 1 -- 172.21.15.69:0/3525112799 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe25400f040 con 0x7fe25c104400 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.731+0000 7fe259ffb700 1 -- 172.21.15.69:0/3525112799 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400cd00 con 0x7fe25c104400 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.731+0000 7fe26316f700 1 -- 172.21.15.69:0/3525112799 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c10f1c0 con 0x7fe25c104400 2023-12-14T14:14:02.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.731+0000 7fe26316f700 1 -- 172.21.15.69:0/3525112799 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c10f030 con 0x7fe25c104400 2023-12-14T14:14:02.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.733+0000 7fe259ffb700 1 -- 172.21.15.69:0/3525112799 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe254003a00 con 0x7fe25c104400 2023-12-14T14:14:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.734+0000 7fe259ffb700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe24c0a1340 0x7fe24c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.734+0000 7fe260f0b700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe24c0a1340 0x7fe24c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.734+0000 7fe259ffb700 1 -- 172.21.15.69:0/3525112799 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fe2540cc6f0 con 0x7fe25c104400 2023-12-14T14:14:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe260f0b700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe24c0a1340 0x7fe24c0a37f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe250009990 tx=0x7fe250005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe26f2fdb80 1 Processor -- start 2023-12-14T14:14:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe26f2fdb80 1 -- start start 2023-12-14T14:14:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 0x55850a8f4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a8ff610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 0x55850a901f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a7de5e0 con 0x55850a8f4c90 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a84d870 con 0x55850a8ffb50 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a846d00 con 0x55850a8f4380 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a8ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe260f0b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 0x55850a8f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a8ff610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57918/0 (socket says 172.21.15.69:57918) 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe260f0b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 0x55850a8f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:51366/0 (socket says 172.21.15.69:51366) 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe25bfff700 1 -- 172.21.15.69:0/3484765165 learned_addr learned my addr 172.21.15.69:0/3484765165 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe26170c700 1 --2- 172.21.15.69:0/3484765165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 0x55850a901f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe25bfff700 1 -- 172.21.15.69:0/3484765165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 msgr2=0x55850a8f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe25bfff700 1 --2- 172.21.15.69:0/3484765165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 0x55850a8f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe25bfff700 1 -- 172.21.15.69:0/3484765165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 msgr2=0x55850a901f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe25bfff700 1 --2- 172.21.15.69:0/3484765165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 0x55850a901f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.735+0000 7fe25bfff700 1 -- 172.21.15.69:0/3484765165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55850a6c83b0 con 0x55850a8f4c90 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.736+0000 7fe25bfff700 1 --2- 172.21.15.69:0/3484765165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a8ff610 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe24800bcb0 tx=0x7fe2480103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfec880024036dd server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.736+0000 7fe246ffd700 1 -- 172.21.15.69:0/3484765165 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248010d10 con 0x55850a8f4c90 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.736+0000 7fe246ffd700 1 -- 172.21.15.69:0/3484765165 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe248015070 con 0x55850a8f4c90 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.736+0000 7fe246ffd700 1 -- 172.21.15.69:0/3484765165 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248005020 con 0x55850a8f4c90 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.736+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3484765165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 msgr2=0x55850a8ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.736+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3484765165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a8ff610 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe24800bcb0 tx=0x7fe2480103d0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3484765165 shutdown_connections 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3484765165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 0x55850a901f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3484765165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 0x55850a8f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3484765165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a8ff610 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3484765165 >> 172.21.15.69:0/3484765165 conn(0x55850a8eaca0 msgr2=0x55850a8f07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3484765165 shutdown_connections 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3484765165 wait complete. 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 -- start start 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 Processor -- start 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8fc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 0x55850a8fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a7e2f90 con 0x55850a8f4380 2023-12-14T14:14:02.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a7e2c30 con 0x55850a8ffb50 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a6ca6a0 con 0x55850a8f4c90 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.737+0000 7fe26f2fdb80 10 client.0 _ll_register_callbacks cb 0x55850a806910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe260f0b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8fc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe260f0b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57924/0 (socket says 172.21.15.69:57924) 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8fc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:51372/0 (socket says 172.21.15.69:51372) 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe260f0b700 1 -- 172.21.15.69:0/2018147781 learned_addr learned my addr 172.21.15.69:0/2018147781 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe26170c700 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 0x55850a8fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe260f0b700 1 -- 172.21.15.69:0/2018147781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 msgr2=0x55850a8fc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe260f0b700 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8fc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe260f0b700 1 -- 172.21.15.69:0/2018147781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 msgr2=0x55850a8fcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe260f0b700 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 0x55850a8fcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe260f0b700 1 -- 172.21.15.69:0/2018147781 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24800b8e0 con 0x55850a8f4380 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe26170c700 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 0x55850a8fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe260f0b700 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe2500099c0 tx=0x7fe250009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51626aa4e3385ca server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe23bfff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe23bfff700 1 -- 172.21.15.69:0/2018147781 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25002c040 con 0x55850a8f4380 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe23bfff700 1 -- 172.21.15.69:0/2018147781 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fe250004460 con 0x55850a8f4380 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/2018147781 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55850a8e82b0 con 0x55850a8f4380 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe23bfff700 1 -- 172.21.15.69:0/2018147781 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe250004620 con 0x55850a8f4380 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe26f2fdb80 10 client.16065 fetch_fsmap learned FSMap version 26 2023-12-14T14:14:02.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/2018147781 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55850a80d170 con 0x55850a8f4380 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.738+0000 7fe23bfff700 1 -- 172.21.15.69:0/2018147781 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe25003e020 con 0x55850a8f4380 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.739+0000 7fe23bfff700 1 -- 172.21.15.69:0/2018147781 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe25000f460 con 0x55850a8f4380 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.739+0000 7fe26f2fdb80 10 client.16065 fetch_fsmap finished waiting for FSMap version 26 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.739+0000 7fe26f2fdb80 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.739+0000 7fe26f2fdb80 20 client.16065 populate_metadata read hostname 'smithi069' 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.739+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55850a90f4b0 0x55850a9118c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.739+0000 7fe26f2fdb80 4 client.16065 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.739+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/2018147781 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55850a83fce0 con 0x55850a90f4b0 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.739+0000 7fe25bfff700 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55850a90f4b0 0x55850a9118c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.740+0000 7fe23bfff700 10 client.16065 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:14:02.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.740+0000 7fe25bfff700 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55850a90f4b0 0x55850a9118c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba2b7ed1927aa936 server_cookie=f03b7970e059b638 in_seq=0 out_seq=0 2023-12-14T14:14:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe23bfff700 1 -- 172.21.15.69:0/2018147781 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55850a83fce0 con 0x55850a90f4b0 2023-12-14T14:14:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe23bfff700 10 client.16065 handle_command_reply: tid=0 2023-12-14T14:14:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 client.16065 shutdown 2023-12-14T14:14:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/2018147781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 msgr2=0x55850a8ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe2500099c0 tx=0x7fe250009cd0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/2018147781 shutdown_connections 2023-12-14T14:14:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55850a90f4b0 0x55850a9118c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8ffb50 0x55850a8fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe23bfff700 0 client.16065 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:14:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/2018147781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8fc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/2018147781 >> 172.21.15.69:0/2018147781 conn(0x55850a8eaca0 msgr2=0x55850a8f0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/2018147781 shutdown_connections 2023-12-14T14:14:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.742+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/2018147781 wait complete. 2023-12-14T14:14:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.743+0000 7fe26f2fdb80 20 client.16065 trim_cache size 0 max 16384 2023-12-14T14:14:02.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.760+0000 7fe26f2fdb80 1 Processor -- start 2023-12-14T14:14:02.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.760+0000 7fe26f2fdb80 1 -- start start 2023-12-14T14:14:02.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 0x55850a8fefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a8f55b0 con 0x55850a8f4380 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a90bee0 con 0x55850a8eaca0 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a90b540 con 0x55850a8f4c90 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57938/0 (socket says 172.21.15.69:57938) 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe25bfff700 1 -- 172.21.15.69:0/4095970768 learned_addr learned my addr 172.21.15.69:0/4095970768 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe260f0b700 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 0x55850a8fefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe26170c700 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe25bfff700 1 -- 172.21.15.69:0/4095970768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 msgr2=0x55850a8f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe25bfff700 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe25bfff700 1 -- 172.21.15.69:0/4095970768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 msgr2=0x55850a8fefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe25bfff700 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 0x55850a8fefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe25bfff700 1 -- 172.21.15.69:0/4095970768 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55850a80cec0 con 0x55850a8f4380 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe26170c700 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe25bfff700 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55850a8f1b90 tx=0x7fe248005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c161c892f099f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe2477fe700 1 -- 172.21.15.69:0/4095970768 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248020030 con 0x55850a8f4380 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe2477fe700 1 -- 172.21.15.69:0/4095970768 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe24802c020 con 0x55850a8f4380 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.761+0000 7fe2477fe700 1 -- 172.21.15.69:0/4095970768 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2480038e0 con 0x55850a8f4380 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/4095970768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 msgr2=0x55850a8ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55850a8f1b90 tx=0x7fe248005950 comp rx=0 tx=0).stop 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/4095970768 shutdown_connections 2023-12-14T14:14:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4c90 0x55850a8f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 0x55850a8fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/4095970768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4380 0x55850a8ff4f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/4095970768 >> 172.21.15.69:0/4095970768 conn(0x55850a902200 msgr2=0x55850a90ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/4095970768 shutdown_connections 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/4095970768 wait complete. 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 -- start start 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.762+0000 7fe26f2fdb80 1 Processor -- start 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 0x55850a906680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 0x55850a904ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26f2fdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a905000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a9056c0 con 0x55850a8f4c90 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a905830 con 0x55850a8eaca0 2023-12-14T14:14:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26f2fdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850a963380 con 0x55850a8f4380 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26f2fdb80 10 client.0 _ll_register_callbacks cb 0x55850a806910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe260f0b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 0x55850a906680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26170c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a905000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 0x55850a904ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26170c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a905000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57944/0 (socket says 172.21.15.69:57944) 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe260f0b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 0x55850a906680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:55432/0 (socket says 172.21.15.69:55432) 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26170c700 1 -- 172.21.15.69:0/3412913584 learned_addr learned my addr 172.21.15.69:0/3412913584 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26170c700 1 -- 172.21.15.69:0/3412913584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 msgr2=0x55850a904ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26170c700 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 0x55850a904ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26170c700 1 -- 172.21.15.69:0/3412913584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 msgr2=0x55850a906680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26170c700 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 0x55850a906680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26170c700 1 -- 172.21.15.69:0/3412913584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55850a6c83b0 con 0x55850a8f4c90 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe26170c700 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a905000 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe254099590 tx=0x7fe2540092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b85ac03bbd87d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.763+0000 7fe23bfff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe23bfff700 1 -- 172.21.15.69:0/3412913584 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540b92b0 con 0x55850a8f4c90 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe23bfff700 1 -- 172.21.15.69:0/3412913584 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fe254004ad0 con 0x55850a8f4c90 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3412913584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe248015070 con 0x55850a8f4c90 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe23bfff700 1 -- 172.21.15.69:0/3412913584 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe25400ce60 con 0x55850a8f4c90 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe26f2fdb80 10 client.16071 fetch_fsmap learned FSMap version 26 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3412913584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55850a7f39a0 con 0x55850a8f4c90 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe23bfff700 1 -- 172.21.15.69:0/3412913584 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe25407c020 con 0x55850a8f4c90 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe23bfff700 1 -- 172.21.15.69:0/3412913584 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe254098d80 con 0x55850a8f4c90 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe26f2fdb80 10 client.16071 fetch_fsmap finished waiting for FSMap version 26 2023-12-14T14:14:02.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe26f2fdb80 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:14:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe26f2fdb80 20 client.16071 populate_metadata read hostname 'smithi069' 2023-12-14T14:14:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55850a8ffb50 0x55850a966960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe26f2fdb80 4 client.16071 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:14:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3412913584 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55850a83fa00 con 0x55850a8ffb50 2023-12-14T14:14:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.764+0000 7fe260f0b700 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55850a8ffb50 0x55850a966960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.765+0000 7fe23bfff700 10 client.16071 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:14:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.765+0000 7fe260f0b700 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55850a8ffb50 0x55850a966960 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99781942d1e4495 server_cookie=d14067f4f1d3d2f3 in_seq=0 out_seq=0 2023-12-14T14:14:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe23bfff700 1 -- 172.21.15.69:0/3412913584 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55850a83fa00 con 0x55850a8ffb50 2023-12-14T14:14:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe23bfff700 10 client.16071 handle_command_reply: tid=0 2023-12-14T14:14:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 client.16071 shutdown 2023-12-14T14:14:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3412913584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 msgr2=0x55850a905000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a905000 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe254099590 tx=0x7fe2540092e0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3412913584 shutdown_connections 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55850a8ffb50 0x55850a966960 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55850a8f4c90 0x55850a905000 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850a8eaca0 0x55850a906680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 --2- 172.21.15.69:0/3412913584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55850a8f4380 0x55850a904ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe23bfff700 0 client.16071 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3412913584 >> 172.21.15.69:0/3412913584 conn(0x55850a902200 msgr2=0x55850a8f7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3412913584 shutdown_connections 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.767+0000 7fe26f2fdb80 1 -- 172.21.15.69:0/3412913584 wait complete. 2023-12-14T14:14:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26f2fdb80 20 client.16071 trim_cache size 0 max 16384 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (1 inodes in the stack)", 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "6ac35f34-16ae-4d21-a087-3da5b8baaf4c": { 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6ac35f34-16ae-4d21-a087-3da5b8baaf4c", 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:14:02.774 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:14:02.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 -- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe24c0a1340 msgr2=0x7fe24c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:02.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe24c0a1340 0x7fe24c0a37f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe250009990 tx=0x7fe250005fb0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 -- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104400 msgr2=0x7fe25c19cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:02.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104400 0x7fe25c19cf00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe25400ef30 tx=0x7fe25400c3a0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 -- 172.21.15.69:0/3525112799 shutdown_connections 2023-12-14T14:14:02.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe24c0a1340 0x7fe24c0a37f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104400 0x7fe25c19cf00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25c0ff3d0 0x7fe25c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 --2- 172.21.15.69:0/3525112799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe25c0ffd70 0x7fe25c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:02.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 -- 172.21.15.69:0/3525112799 >> 172.21.15.69:0/3525112799 conn(0x7fe25c075fa0 msgr2=0x7fe25c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:02.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 -- 172.21.15.69:0/3525112799 shutdown_connections 2023-12-14T14:14:02.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:02.768+0000 7fe26316f700 1 -- 172.21.15.69:0/3525112799 wait complete. 2023-12-14T14:14:02.781 INFO:tasks.cephfs.filesystem:scrub status for tag:6ac35f34-16ae-4d21-a087-3da5b8baaf4c - {'path': '/', 'tag': '6ac35f34-16ae-4d21-a087-3da5b8baaf4c', 'options': 'recursive,force'} 2023-12-14T14:14:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:03 smithi119 ceph-mon[43834]: pgmap v105: 97 pgs: 97 active+clean; 141 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 47 op/s 2023-12-14T14:14:03.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:03 smithi069 ceph-mon[42034]: pgmap v105: 97 pgs: 97 active+clean; 141 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 47 op/s 2023-12-14T14:14:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:03 smithi081 ceph-mon[43371]: pgmap v105: 97 pgs: 97 active+clean; 141 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 47 op/s 2023-12-14T14:14:04.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:04 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:14:04.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:04 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:14:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:04 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:14:05.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:05 smithi119 ceph-mon[43834]: pgmap v106: 97 pgs: 97 active+clean; 187 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 78 op/s 2023-12-14T14:14:05.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:05 smithi069 ceph-mon[42034]: pgmap v106: 97 pgs: 97 active+clean; 187 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 78 op/s 2023-12-14T14:14:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:05 smithi081 ceph-mon[43371]: pgmap v106: 97 pgs: 97 active+clean; 187 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 78 op/s 2023-12-14T14:14:07.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:07 smithi069 ceph-mon[42034]: pgmap v107: 97 pgs: 97 active+clean; 187 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 40 op/s 2023-12-14T14:14:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:07 smithi081 ceph-mon[43371]: pgmap v107: 97 pgs: 97 active+clean; 187 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 40 op/s 2023-12-14T14:14:07.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:07 smithi119 ceph-mon[43834]: pgmap v107: 97 pgs: 97 active+clean; 187 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 40 op/s 2023-12-14T14:14:09.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:09 smithi119 ceph-mon[43834]: pgmap v108: 97 pgs: 97 active+clean; 187 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 40 op/s 2023-12-14T14:14:09.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:09 smithi069 ceph-mon[42034]: pgmap v108: 97 pgs: 97 active+clean; 187 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 40 op/s 2023-12-14T14:14:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:09 smithi081 ceph-mon[43371]: pgmap v108: 97 pgs: 97 active+clean; 187 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 40 op/s 2023-12-14T14:14:11.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:11 smithi119 ceph-mon[43834]: pgmap v109: 97 pgs: 97 active+clean; 249 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 9.5 MiB/s wr, 59 op/s 2023-12-14T14:14:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:11 smithi069 ceph-mon[42034]: pgmap v109: 97 pgs: 97 active+clean; 249 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 9.5 MiB/s wr, 59 op/s 2023-12-14T14:14:11.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:11 smithi081 ceph-mon[43371]: pgmap v109: 97 pgs: 97 active+clean; 249 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 9.5 MiB/s wr, 59 op/s 2023-12-14T14:14:13.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:13 smithi119 ceph-mon[43834]: pgmap v110: 97 pgs: 97 active+clean; 249 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 9.1 MiB/s wr, 50 op/s 2023-12-14T14:14:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:13 smithi069 ceph-mon[42034]: pgmap v110: 97 pgs: 97 active+clean; 249 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 9.1 MiB/s wr, 50 op/s 2023-12-14T14:14:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:13 smithi081 ceph-mon[43371]: pgmap v110: 97 pgs: 97 active+clean; 249 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 9.1 MiB/s wr, 50 op/s 2023-12-14T14:14:14.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:14 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:14:14.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:14 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:14:14.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:14 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:14:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:15 smithi119 ceph-mon[43834]: pgmap v111: 97 pgs: 97 active+clean; 280 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 12 MiB/s wr, 69 op/s 2023-12-14T14:14:15.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:15 smithi069 ceph-mon[42034]: pgmap v111: 97 pgs: 97 active+clean; 280 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 12 MiB/s wr, 69 op/s 2023-12-14T14:14:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:15 smithi081 ceph-mon[43371]: pgmap v111: 97 pgs: 97 active+clean; 280 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 12 MiB/s wr, 69 op/s 2023-12-14T14:14:17.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:17 smithi069 ceph-mon[42034]: pgmap v112: 97 pgs: 97 active+clean; 280 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 37 op/s 2023-12-14T14:14:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:17 smithi081 ceph-mon[43371]: pgmap v112: 97 pgs: 97 active+clean; 280 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 37 op/s 2023-12-14T14:14:17.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:17 smithi119 ceph-mon[43834]: pgmap v112: 97 pgs: 97 active+clean; 280 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 37 op/s 2023-12-14T14:14:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:19 smithi119 ceph-mon[43834]: pgmap v113: 97 pgs: 97 active+clean; 280 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 37 op/s 2023-12-14T14:14:19.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:19 smithi069 ceph-mon[42034]: pgmap v113: 97 pgs: 97 active+clean; 280 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 37 op/s 2023-12-14T14:14:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:19 smithi081 ceph-mon[43371]: pgmap v113: 97 pgs: 97 active+clean; 280 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 37 op/s 2023-12-14T14:14:21.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:21 smithi119 ceph-mon[43834]: pgmap v114: 97 pgs: 97 active+clean; 310 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 10 MiB/s wr, 51 op/s 2023-12-14T14:14:21.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:21 smithi069 ceph-mon[42034]: pgmap v114: 97 pgs: 97 active+clean; 310 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 10 MiB/s wr, 51 op/s 2023-12-14T14:14:21.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:21 smithi081 ceph-mon[43371]: pgmap v114: 97 pgs: 97 active+clean; 310 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 10 MiB/s wr, 51 op/s 2023-12-14T14:14:23.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:23 smithi119 ceph-mon[43834]: pgmap v115: 97 pgs: 97 active+clean; 310 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.0 MiB/s wr, 32 op/s 2023-12-14T14:14:23.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:23 smithi069 ceph-mon[42034]: pgmap v115: 97 pgs: 97 active+clean; 310 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.0 MiB/s wr, 32 op/s 2023-12-14T14:14:23.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:23 smithi081 ceph-mon[43371]: pgmap v115: 97 pgs: 97 active+clean; 310 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.0 MiB/s wr, 32 op/s 2023-12-14T14:14:25.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:25 smithi119 ceph-mon[43834]: pgmap v116: 97 pgs: 97 active+clean; 332 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 6.9 MiB/s wr, 42 op/s 2023-12-14T14:14:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:25 smithi069 ceph-mon[42034]: pgmap v116: 97 pgs: 97 active+clean; 332 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 6.9 MiB/s wr, 42 op/s 2023-12-14T14:14:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:25 smithi081 ceph-mon[43371]: pgmap v116: 97 pgs: 97 active+clean; 332 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 6.9 MiB/s wr, 42 op/s 2023-12-14T14:14:27.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:27 smithi069 ceph-mon[42034]: pgmap v117: 97 pgs: 97 active+clean; 332 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 23 op/s 2023-12-14T14:14:27.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:27 smithi081 ceph-mon[43371]: pgmap v117: 97 pgs: 97 active+clean; 332 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 23 op/s 2023-12-14T14:14:27.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:27 smithi119 ceph-mon[43834]: pgmap v117: 97 pgs: 97 active+clean; 332 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 23 op/s 2023-12-14T14:14:29.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:29 smithi119 ceph-mon[43834]: pgmap v118: 97 pgs: 97 active+clean; 332 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 23 op/s 2023-12-14T14:14:29.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:29 smithi069 ceph-mon[42034]: pgmap v118: 97 pgs: 97 active+clean; 332 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 23 op/s 2023-12-14T14:14:29.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:29 smithi081 ceph-mon[43371]: pgmap v118: 97 pgs: 97 active+clean; 332 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 23 op/s 2023-12-14T14:14:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:31 smithi119 ceph-mon[43834]: pgmap v119: 97 pgs: 97 active+clean; 353 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 35 op/s 2023-12-14T14:14:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:31 smithi069 ceph-mon[42034]: pgmap v119: 97 pgs: 97 active+clean; 353 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 35 op/s 2023-12-14T14:14:31.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:31 smithi081 ceph-mon[43371]: pgmap v119: 97 pgs: 97 active+clean; 353 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 35 op/s 2023-12-14T14:14:32.782 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:14:32.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.924+0000 7fe7e8645700 1 -- 172.21.15.69:0/2560488036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e01043d0 msgr2=0x7fe7e010bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.924+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2560488036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e01043d0 0x7fe7e010bfa0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800b0d0 tx=0x7fe7d800b3e0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.924+0000 7fe7e8645700 1 -- 172.21.15.69:0/2560488036 shutdown_connections 2023-12-14T14:14:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.924+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2560488036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e01043d0 0x7fe7e010bfa0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.924+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2560488036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7e00ff390 0x7fe7e00ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.924+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2560488036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e00ffd30 0x7fe7e0103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.924+0000 7fe7e8645700 1 -- 172.21.15.69:0/2560488036 >> 172.21.15.69:0/2560488036 conn(0x7fe7e0075fd0 msgr2=0x7fe7e00763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.924+0000 7fe7e8645700 1 -- 172.21.15.69:0/2560488036 shutdown_connections 2023-12-14T14:14:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.924+0000 7fe7e8645700 1 -- 172.21.15.69:0/2560488036 wait complete. 2023-12-14T14:14:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e8645700 1 Processor -- start 2023-12-14T14:14:32.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e8645700 1 -- start start 2023-12-14T14:14:32.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e8645700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e00ff390 0x7fe7e0195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e8645700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7e00ffd30 0x7fe7e01958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e8645700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e01043d0 0x7fe7e0199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e8645700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e019a350 con 0x7fe7e00ff390 2023-12-14T14:14:32.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e8645700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e019a4c0 con 0x7fe7e01043d0 2023-12-14T14:14:32.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e8645700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e019a680 con 0x7fe7e00ffd30 2023-12-14T14:14:32.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e63e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e00ff390 0x7fe7e0195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e63e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e00ff390 0x7fe7e0195370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38218/0 (socket says 172.21.15.69:38218) 2023-12-14T14:14:32.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e63e1700 1 -- 172.21.15.69:0/2472809967 learned_addr learned my addr 172.21.15.69:0/2472809967 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:32.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e6be2700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e01043d0 0x7fe7e0199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7e00ffd30 0x7fe7e01958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e63e1700 1 -- 172.21.15.69:0/2472809967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7e00ffd30 msgr2=0x7fe7e01958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:32.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7e00ffd30 0x7fe7e01958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e63e1700 1 -- 172.21.15.69:0/2472809967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e01043d0 msgr2=0x7fe7e0199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:32.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e01043d0 0x7fe7e0199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e63e1700 1 -- 172.21.15.69:0/2472809967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8009d00 con 0x7fe7e00ff390 2023-12-14T14:14:32.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e00ff390 0x7fe7e0195370 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00e9a0 tx=0x7fe7dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:32.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.925+0000 7fe7d77fe700 1 -- 172.21.15.69:0/2472809967 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc009790 con 0x7fe7e00ff390 2023-12-14T14:14:32.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.926+0000 7fe7d77fe700 1 -- 172.21.15.69:0/2472809967 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7dc010430 con 0x7fe7e00ff390 2023-12-14T14:14:32.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.926+0000 7fe7e8645700 1 -- 172.21.15.69:0/2472809967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e010f1a0 con 0x7fe7e00ff390 2023-12-14T14:14:32.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.926+0000 7fe7d77fe700 1 -- 172.21.15.69:0/2472809967 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc018680 con 0x7fe7e00ff390 2023-12-14T14:14:32.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.926+0000 7fe7e8645700 1 -- 172.21.15.69:0/2472809967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e010f010 con 0x7fe7e00ff390 2023-12-14T14:14:32.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.928+0000 7fe7d77fe700 1 -- 172.21.15.69:0/2472809967 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe7dc0105a0 con 0x7fe7e00ff390 2023-12-14T14:14:32.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.928+0000 7fe7d77fe700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7cc0a1340 0x7fe7cc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.928+0000 7fe7d77fe700 1 -- 172.21.15.69:0/2472809967 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fe7dc014070 con 0x7fe7e00ff390 2023-12-14T14:14:32.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.928+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7cc0a1340 0x7fe7cc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.929+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7cc0a1340 0x7fe7cc0a37f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0196980 tx=0x7fe7d0009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:32.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.929+0000 7fe7f47d3b80 1 Processor -- start 2023-12-14T14:14:32.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.929+0000 7fe7f47d3b80 1 -- start start 2023-12-14T14:14:32.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9380 0x5558c4fc9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9c90 0x5558c4fd4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fd4b50 0x5558c4fd6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4eb35e0 con 0x5558c4fc9380 2023-12-14T14:14:32.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4f22870 con 0x5558c4fc9c90 2023-12-14T14:14:32.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4f1bd00 con 0x5558c4fd4b50 2023-12-14T14:14:32.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e63e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9380 0x5558c4fc9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e5be0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9c90 0x5558c4fd4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e63e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9380 0x5558c4fc9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38226/0 (socket says 172.21.15.69:38226) 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e63e1700 1 -- 172.21.15.69:0/520938236 learned_addr learned my addr 172.21.15.69:0/520938236 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e6be2700 1 --2- 172.21.15.69:0/520938236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fd4b50 0x5558c4fd6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e5be0700 1 -- 172.21.15.69:0/520938236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fd4b50 msgr2=0x5558c4fd6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/520938236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fd4b50 0x5558c4fd6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e5be0700 1 -- 172.21.15.69:0/520938236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9380 msgr2=0x5558c4fc9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/520938236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9380 0x5558c4fc9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e5be0700 1 -- 172.21.15.69:0/520938236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558c4d9d3b0 con 0x5558c4fc9c90 2023-12-14T14:14:32.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/520938236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9380 0x5558c4fc9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/520938236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9c90 0x5558c4fd4610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009fd0 tx=0x7fe7d0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3d87f4f05bda3a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7d4ff9700 1 -- 172.21.15.69:0/520938236 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00119b0 con 0x5558c4fc9c90 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7d4ff9700 1 -- 172.21.15.69:0/520938236 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7d00044e0 con 0x5558c4fc9c90 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.930+0000 7fe7d4ff9700 1 -- 172.21.15.69:0/520938236 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00039b0 con 0x5558c4fc9c90 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.931+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/520938236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9c90 msgr2=0x5558c4fd4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.931+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/520938236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9c90 0x5558c4fd4610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009fd0 tx=0x7fe7d0014000 comp rx=0 tx=0).stop 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.931+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/520938236 shutdown_connections 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.931+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/520938236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fd4b50 0x5558c4fd6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.931+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/520938236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9380 0x5558c4fc9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.931+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/520938236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9c90 0x5558c4fd4610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.931+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/520938236 >> 172.21.15.69:0/520938236 conn(0x5558c4fbfca0 msgr2=0x5558c4fc57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:32.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.931+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/520938236 shutdown_connections 2023-12-14T14:14:32.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.931+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/520938236 wait complete. 2023-12-14T14:14:32.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7f47d3b80 1 -- start start 2023-12-14T14:14:32.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7f47d3b80 1 Processor -- start 2023-12-14T14:14:32.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 0x5558c4fd44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fd4b50 0x5558c4fd1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4eb7f90 con 0x5558c4fc9c90 2023-12-14T14:14:32.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4eb7c30 con 0x5558c4fd4b50 2023-12-14T14:14:32.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4d9f6a0 con 0x5558c4fc9380 2023-12-14T14:14:32.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7f47d3b80 10 client.0 _ll_register_callbacks cb 0x5558c4edb910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:14:32.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7e5be0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7e5be0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38238/0 (socket says 172.21.15.69:38238) 2023-12-14T14:14:32.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7e5be0700 1 -- 172.21.15.69:0/2363174835 learned_addr learned my addr 172.21.15.69:0/2363174835 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:32.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7e6be2700 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fd4b50 0x5558c4fd1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.932+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 0x5558c4fd44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7e5be0700 1 -- 172.21.15.69:0/2363174835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 msgr2=0x5558c4fd44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 0x5558c4fd44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7e5be0700 1 -- 172.21.15.69:0/2363174835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fd4b50 msgr2=0x5558c4fd1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fd4b50 0x5558c4fd1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7e5be0700 1 -- 172.21.15.69:0/2363174835 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d0017070 con 0x5558c4fc9c90 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7e6be2700 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fd4b50 0x5558c4fd1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd17f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000ef10 tx=0x7fe7d001e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3cd0bf3e681c83 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/2363174835 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d002b070 con 0x5558c4fc9c90 2023-12-14T14:14:32.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/2363174835 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fe7d001eaf0 con 0x5558c4fc9c90 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2363174835 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558c4fbd2b0 con 0x5558c4fc9c90 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/2363174835 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d00119b0 con 0x5558c4fc9c90 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7f47d3b80 10 client.16083 fetch_fsmap learned FSMap version 28 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2363174835 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5558c4ee2170 con 0x5558c4fc9c90 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/2363174835 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5558c4fbd2b0 con 0x5558c4fc9c90 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/2363174835 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe7d0024030 con 0x5558c4fc9c90 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7f47d3b80 10 client.16083 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7f47d3b80 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.933+0000 7fe7f47d3b80 20 client.16083 populate_metadata read hostname 'smithi069' 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.934+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558c4fe44b0 0x5558c4fe68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.934+0000 7fe7f47d3b80 4 client.16083 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.934+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2363174835 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558c4f14ce0 con 0x5558c4fe44b0 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.934+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558c4fe44b0 0x5558c4fe68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.934+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558c4fe44b0 0x5558c4fe68c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=827f082f39eabbfc server_cookie=8b5e00d3639ad223 in_seq=0 out_seq=0 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.934+0000 7fe7c9ffb700 10 client.16083 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/2363174835 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5558c4f14ce0 con 0x5558c4fe44b0 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7c9ffb700 10 client.16083 handle_command_reply: tid=0 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 client.16083 shutdown 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2363174835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 msgr2=0x5558c4fd17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd17f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000ef10 tx=0x7fe7d001e650 comp rx=0 tx=0).stop 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2363174835 shutdown_connections 2023-12-14T14:14:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558c4fe44b0 0x5558c4fe68c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fd4b50 0x5558c4fd1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7c9ffb700 0 client.16083 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:14:32.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 0x5558c4fd44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2363174835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd17f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2363174835 >> 172.21.15.69:0/2363174835 conn(0x5558c4fbfca0 msgr2=0x5558c4fc53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:32.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2363174835 shutdown_connections 2023-12-14T14:14:32.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2363174835 wait complete. 2023-12-14T14:14:32.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.935+0000 7fe7f47d3b80 20 client.16083 trim_cache size 0 max 16384 2023-12-14T14:14:32.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7f47d3b80 1 Processor -- start 2023-12-14T14:14:32.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7f47d3b80 1 -- start start 2023-12-14T14:14:32.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fbfca0 0x5558c4fe0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9380 0x5558c4fd3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9c90 0x5558c4fd44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4fcd720 con 0x5558c4fbfca0 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4fcd410 con 0x5558c4fc9380 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4fd1d70 con 0x5558c4fc9c90 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7e63e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fbfca0 0x5558c4fe0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7e5be0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9380 0x5558c4fd3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7e63e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fbfca0 0x5558c4fe0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38250/0 (socket says 172.21.15.69:38250) 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7e63e1700 1 -- 172.21.15.69:0/2345393252 learned_addr learned my addr 172.21.15.69:0/2345393252 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.952+0000 7fe7e6be2700 1 --2- 172.21.15.69:0/2345393252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9c90 0x5558c4fd44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7e63e1700 1 -- 172.21.15.69:0/2345393252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9c90 msgr2=0x5558c4fd44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/2345393252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9c90 0x5558c4fd44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7e63e1700 1 -- 172.21.15.69:0/2345393252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9380 msgr2=0x5558c4fd3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/2345393252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9380 0x5558c4fd3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7e63e1700 1 -- 172.21.15.69:0/2345393252 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558c4ee1ec0 con 0x5558c4fbfca0 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7e5be0700 1 --2- 172.21.15.69:0/2345393252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9380 0x5558c4fd3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/2345393252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fbfca0 0x5558c4fe0800 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc099c40 tx=0x7fe7dc01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d617438b4a4d54eb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7d57fa700 1 -- 172.21.15.69:0/2345393252 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0a2390 con 0x5558c4fbfca0 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7d57fa700 1 -- 172.21.15.69:0/2345393252 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7dc0982e0 con 0x5558c4fbfca0 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7d57fa700 1 -- 172.21.15.69:0/2345393252 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc09a400 con 0x5558c4fbfca0 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2345393252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fbfca0 msgr2=0x5558c4fe0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2345393252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fbfca0 0x5558c4fe0800 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc099c40 tx=0x7fe7dc01a040 comp rx=0 tx=0).stop 2023-12-14T14:14:32.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2345393252 shutdown_connections 2023-12-14T14:14:32.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2345393252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9c90 0x5558c4fd44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2345393252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fbfca0 0x5558c4fe0800 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/2345393252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fc9380 0x5558c4fd3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.953+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2345393252 >> 172.21.15.69:0/2345393252 conn(0x5558c4fd7200 msgr2=0x5558c4fc3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:32.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2345393252 shutdown_connections 2023-12-14T14:14:32.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/2345393252 wait complete. 2023-12-14T14:14:32.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 -- start start 2023-12-14T14:14:32.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 Processor -- start 2023-12-14T14:14:32.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fbfca0 0x5558c4fdb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 0x5558c4fd9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4fdbcb0 con 0x5558c4fc9c90 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4fda0f0 con 0x5558c4fbfca0 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558c4fda260 con 0x5558c4fc9380 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7f47d3b80 10 client.0 _ll_register_callbacks cb 0x5558c4edb910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7e6be2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7e63e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fbfca0 0x5558c4fdb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7e6be2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38266/0 (socket says 172.21.15.69:38266) 2023-12-14T14:14:32.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7e6be2700 1 -- 172.21.15.69:0/3403119040 learned_addr learned my addr 172.21.15.69:0/3403119040 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7e5be0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 0x5558c4fd9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7e6be2700 1 -- 172.21.15.69:0/3403119040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 msgr2=0x5558c4fd9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7e6be2700 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 0x5558c4fd9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7e6be2700 1 -- 172.21.15.69:0/3403119040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fbfca0 msgr2=0x5558c4fdb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.954+0000 7fe7e6be2700 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fbfca0 0x5558c4fdb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7e6be2700 1 -- 172.21.15.69:0/3403119040 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558c4ee2170 con 0x5558c4fc9c90 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fbfca0 0x5558c4fdb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7e6be2700 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd9bb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8015000 tx=0x7fe7d800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9a8bbb7a2f0e58 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/3403119040 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800e040 con 0x5558c4fc9c90 2023-12-14T14:14:32.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/3403119040 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7d00044e0 con 0x5558c4fc9c90 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/3403119040 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fe7d8003a00 con 0x5558c4fc9c90 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/3403119040 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d8003bc0 con 0x5558c4fc9c90 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7f47d3b80 10 client.16089 fetch_fsmap learned FSMap version 28 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/3403119040 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7fe7e010f1a0 con 0x5558c4fc9c90 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/3403119040 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7d00044e0 con 0x5558c4fc9c90 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/3403119040 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe7d800b100 con 0x5558c4fc9c90 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7f47d3b80 10 client.16089 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7f47d3b80 10 client.16089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7f47d3b80 20 client.16089 populate_metadata read hostname 'smithi069' 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558c4fd4b50 0x5558c503fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:14:32.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7f47d3b80 4 client.16089 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.955+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/3403119040 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5558c4f14a00 con 0x5558c4fd4b50 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558c4fd4b50 0x5558c503fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7c9ffb700 10 client.16089 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7e63e1700 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558c4fd4b50 0x5558c503fb90 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3f963ac041a891b server_cookie=47bd30688c76c7e4 in_seq=0 out_seq=0 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7c9ffb700 1 -- 172.21.15.69:0/3403119040 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5558c4f14a00 con 0x5558c4fd4b50 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7c9ffb700 10 client.16089 handle_command_reply: tid=0 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 client.16089 shutdown 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/3403119040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 msgr2=0x5558c4fd9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd9bb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8015000 tx=0x7fe7d800bea0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/3403119040 shutdown_connections 2023-12-14T14:14:32.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558c4fd4b50 0x5558c503fb90 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558c4fc9c90 0x5558c4fd9bb0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558c4fbfca0 0x5558c4fdb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7c9ffb700 0 client.16089 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:14:32.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 --2- 172.21.15.69:0/3403119040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558c4fc9380 0x5558c4fd9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/3403119040 >> 172.21.15.69:0/3403119040 conn(0x5558c4fd7200 msgr2=0x5558c4fe0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:32.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/3403119040 shutdown_connections 2023-12-14T14:14:32.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.956+0000 7fe7f47d3b80 1 -- 172.21.15.69:0/3403119040 wait complete. 2023-12-14T14:14:32.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7f47d3b80 20 client.16089 trim_cache size 0 max 16384 2023-12-14T14:14:32.967 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:14:32.968 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (1 inodes in the stack)", 2023-12-14T14:14:32.968 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:14:32.968 INFO:teuthology.orchestra.run.smithi069.stdout: "6ac35f34-16ae-4d21-a087-3da5b8baaf4c": { 2023-12-14T14:14:32.968 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:14:32.968 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6ac35f34-16ae-4d21-a087-3da5b8baaf4c", 2023-12-14T14:14:32.968 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:14:32.968 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:14:32.968 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:14:32.968 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:14:32.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 -- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7cc0a1340 msgr2=0x7fe7cc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:32.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7cc0a1340 0x7fe7cc0a37f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0196980 tx=0x7fe7d0009260 comp rx=0 tx=0).stop 2023-12-14T14:14:32.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 -- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e00ff390 msgr2=0x7fe7e0195370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:14:32.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e00ff390 0x7fe7e0195370 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00e9a0 tx=0x7fe7dc00ecb0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 -- 172.21.15.69:0/2472809967 shutdown_connections 2023-12-14T14:14:32.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe7cc0a1340 0x7fe7cc0a37f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e01043d0 0x7fe7e0199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7e00ff390 0x7fe7e0195370 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 --2- 172.21.15.69:0/2472809967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7e00ffd30 0x7fe7e01958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:14:32.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 -- 172.21.15.69:0/2472809967 >> 172.21.15.69:0/2472809967 conn(0x7fe7e0075fd0 msgr2=0x7fe7e00fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:14:32.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 -- 172.21.15.69:0/2472809967 shutdown_connections 2023-12-14T14:14:32.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:14:32.957+0000 7fe7e8645700 1 -- 172.21.15.69:0/2472809967 wait complete. 2023-12-14T14:14:32.971 INFO:tasks.cephfs.filesystem:scrub status for tag:6ac35f34-16ae-4d21-a087-3da5b8baaf4c - {'path': '/', 'tag': '6ac35f34-16ae-4d21-a087-3da5b8baaf4c', 'options': 'recursive,force'} 2023-12-14T14:14:33.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:33 smithi119 ceph-mon[43834]: pgmap v120: 97 pgs: 97 active+clean; 353 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 21 op/s 2023-12-14T14:14:33.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:33 smithi069 ceph-mon[42034]: pgmap v120: 97 pgs: 97 active+clean; 353 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 21 op/s 2023-12-14T14:14:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:33 smithi081 ceph-mon[43371]: pgmap v120: 97 pgs: 97 active+clean; 353 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 21 op/s 2023-12-14T14:14:35.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:35 smithi119 ceph-mon[43834]: pgmap v121: 97 pgs: 97 active+clean; 377 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 28 op/s 2023-12-14T14:14:35.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:35 smithi069 ceph-mon[42034]: pgmap v121: 97 pgs: 97 active+clean; 377 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 28 op/s 2023-12-14T14:14:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:35 smithi081 ceph-mon[43371]: pgmap v121: 97 pgs: 97 active+clean; 377 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 28 op/s 2023-12-14T14:14:37.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:37 smithi069 ceph-mon[42034]: pgmap v122: 97 pgs: 97 active+clean; 377 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 19 op/s 2023-12-14T14:14:37.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:37 smithi081 ceph-mon[43371]: pgmap v122: 97 pgs: 97 active+clean; 377 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 19 op/s 2023-12-14T14:14:37.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:37 smithi119 ceph-mon[43834]: pgmap v122: 97 pgs: 97 active+clean; 377 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 19 op/s 2023-12-14T14:14:39.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:39 smithi119 ceph-mon[43834]: pgmap v123: 97 pgs: 97 active+clean; 377 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 19 op/s 2023-12-14T14:14:39.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:39 smithi069 ceph-mon[42034]: pgmap v123: 97 pgs: 97 active+clean; 377 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 19 op/s 2023-12-14T14:14:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:39 smithi081 ceph-mon[43371]: pgmap v123: 97 pgs: 97 active+clean; 377 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 19 op/s 2023-12-14T14:14:41.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:41 smithi119 ceph-mon[43834]: pgmap v124: 97 pgs: 97 active+clean; 382 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 36 op/s 2023-12-14T14:14:41.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:41 smithi069 ceph-mon[42034]: pgmap v124: 97 pgs: 97 active+clean; 382 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 36 op/s 2023-12-14T14:14:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:41 smithi081 ceph-mon[43371]: pgmap v124: 97 pgs: 97 active+clean; 382 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 36 op/s 2023-12-14T14:14:43.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:43 smithi119 ceph-mon[43834]: pgmap v125: 97 pgs: 97 active+clean; 382 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 24 op/s 2023-12-14T14:14:43.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:43 smithi069 ceph-mon[42034]: pgmap v125: 97 pgs: 97 active+clean; 382 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 24 op/s 2023-12-14T14:14:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:43 smithi081 ceph-mon[43371]: pgmap v125: 97 pgs: 97 active+clean; 382 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 24 op/s 2023-12-14T14:14:45.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:45 smithi119 ceph-mon[43834]: pgmap v126: 97 pgs: 97 active+clean; 394 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 69 op/s 2023-12-14T14:14:45.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:45 smithi069 ceph-mon[42034]: pgmap v126: 97 pgs: 97 active+clean; 394 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 69 op/s 2023-12-14T14:14:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:45 smithi081 ceph-mon[43371]: pgmap v126: 97 pgs: 97 active+clean; 394 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 69 op/s 2023-12-14T14:14:47.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:47 smithi069 ceph-mon[42034]: pgmap v127: 97 pgs: 97 active+clean; 394 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 61 op/s 2023-12-14T14:14:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:47 smithi081 ceph-mon[43371]: pgmap v127: 97 pgs: 97 active+clean; 394 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 61 op/s 2023-12-14T14:14:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:47 smithi119 ceph-mon[43834]: pgmap v127: 97 pgs: 97 active+clean; 394 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 61 op/s 2023-12-14T14:14:49.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:49 smithi119 ceph-mon[43834]: pgmap v128: 97 pgs: 97 active+clean; 394 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 61 op/s 2023-12-14T14:14:49.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:49 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:14:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:49 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:49.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:49 smithi069 ceph-mon[42034]: pgmap v128: 97 pgs: 97 active+clean; 394 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 61 op/s 2023-12-14T14:14:49.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:49 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:14:49.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:49 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:49.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:49 smithi081 ceph-mon[43371]: pgmap v128: 97 pgs: 97 active+clean; 394 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 61 op/s 2023-12-14T14:14:49.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:49 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:14:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:49 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:51 smithi119 ceph-mon[43834]: pgmap v129: 97 pgs: 97 active+clean; 417 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 124 op/s 2023-12-14T14:14:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:14:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:51 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:51 smithi069 ceph-mon[42034]: pgmap v129: 97 pgs: 97 active+clean; 417 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 124 op/s 2023-12-14T14:14:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:14:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:51 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:51 smithi081 ceph-mon[43371]: pgmap v129: 97 pgs: 97 active+clean; 417 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 124 op/s 2023-12-14T14:14:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:14:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:51 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:52.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:52 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:14:52.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:52 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:14:52.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:52 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:52.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:52 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:14:52.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:52 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:14:52.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:52 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:52.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:52 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:14:52.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:52 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:14:52.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:52 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:14:53.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:53 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:14:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:53 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:14:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:53 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:14:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:53 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:14:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:53 smithi119 ceph-mon[43834]: pgmap v130: 97 pgs: 97 active+clean; 417 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 107 op/s 2023-12-14T14:14:53.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:53 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:14:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:53 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:14:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:53 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:14:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:53 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:14:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:53 smithi069 ceph-mon[42034]: pgmap v130: 97 pgs: 97 active+clean; 417 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 107 op/s 2023-12-14T14:14:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:53 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:14:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:53 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:14:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:53 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:14:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:53 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:14:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:53 smithi081 ceph-mon[43371]: pgmap v130: 97 pgs: 97 active+clean; 417 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 107 op/s 2023-12-14T14:14:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:54 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:14:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:54 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:54.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:54 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:14:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:54 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:54 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:14:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:54 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:55.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:55 smithi119 ceph-mon[43834]: pgmap v131: 97 pgs: 97 active+clean; 434 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 128 op/s 2023-12-14T14:14:55.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:55 smithi069 ceph-mon[42034]: pgmap v131: 97 pgs: 97 active+clean; 434 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 128 op/s 2023-12-14T14:14:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:55 smithi081 ceph-mon[43371]: pgmap v131: 97 pgs: 97 active+clean; 434 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 128 op/s 2023-12-14T14:14:56.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:56 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:14:56.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:56 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:14:56.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:56 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:56.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:56 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:14:56.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:56 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:14:56.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:56 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:56.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:56 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:14:56.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:56 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:14:56.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:56 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:57.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:57 smithi119 ceph-mon[43834]: pgmap v132: 97 pgs: 97 active+clean; 434 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 84 op/s 2023-12-14T14:14:57.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:57 smithi069 ceph-mon[42034]: pgmap v132: 97 pgs: 97 active+clean; 434 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 84 op/s 2023-12-14T14:14:57.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:57 smithi081 ceph-mon[43371]: pgmap v132: 97 pgs: 97 active+clean; 434 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 84 op/s 2023-12-14T14:14:58.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:58 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:58.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:58 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:58.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:58 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:14:59.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:14:59 smithi119 ceph-mon[43834]: pgmap v133: 97 pgs: 97 active+clean; 434 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 84 op/s 2023-12-14T14:14:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:14:59 smithi069 ceph-mon[42034]: pgmap v133: 97 pgs: 97 active+clean; 434 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 84 op/s 2023-12-14T14:14:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:14:59 smithi081 ceph-mon[43371]: pgmap v133: 97 pgs: 97 active+clean; 434 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 84 op/s 2023-12-14T14:15:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:01 smithi119 ceph-mon[43834]: pgmap v134: 97 pgs: 97 active+clean; 450 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 109 op/s 2023-12-14T14:15:01.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:01 smithi069 ceph-mon[42034]: pgmap v134: 97 pgs: 97 active+clean; 450 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 109 op/s 2023-12-14T14:15:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:01 smithi081 ceph-mon[43371]: pgmap v134: 97 pgs: 97 active+clean; 450 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 109 op/s 2023-12-14T14:15:02.972 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:15:03.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.109+0000 7f108fde5700 1 -- 172.21.15.69:0/1252265081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10881043d0 msgr2=0x7f108810bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:03.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.109+0000 7f108fde5700 1 --2- 172.21.15.69:0/1252265081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10881043d0 0x7f108810bfa0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f108000b0d0 tx=0x7f108000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.109+0000 7f108fde5700 1 -- 172.21.15.69:0/1252265081 shutdown_connections 2023-12-14T14:15:03.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 --2- 172.21.15.69:0/1252265081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10881043d0 0x7f108810bfa0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 --2- 172.21.15.69:0/1252265081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10880ff390 0x7f10880ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 --2- 172.21.15.69:0/1252265081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10880ffd30 0x7f1088103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 -- 172.21.15.69:0/1252265081 >> 172.21.15.69:0/1252265081 conn(0x7f1088075fd0 msgr2=0x7f10880763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:03.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 -- 172.21.15.69:0/1252265081 shutdown_connections 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 -- 172.21.15.69:0/1252265081 wait complete. 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 Processor -- start 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 -- start start 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10880ff390 0x7f1088195160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.110+0000 7f108fde5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10880ffd30 0x7f10881956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108fde5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10881043d0 0x7f1088195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108fde5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10881a49a0 con 0x7f10880ff390 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108fde5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10881a4b10 con 0x7f10880ffd30 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108fde5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10881a4cd0 con 0x7f10881043d0 2023-12-14T14:15:03.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108db81700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10880ff390 0x7f1088195160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108db81700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10880ff390 0x7f1088195160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38488/0 (socket says 172.21.15.69:38488) 2023-12-14T14:15:03.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108db81700 1 -- 172.21.15.69:0/86668471 learned_addr learned my addr 172.21.15.69:0/86668471 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:03.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108e382700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10881043d0 0x7f1088195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108d380700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10880ffd30 0x7f10881956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108db81700 1 -- 172.21.15.69:0/86668471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10881043d0 msgr2=0x7f1088195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:03.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108db81700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10881043d0 0x7f1088195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108db81700 1 -- 172.21.15.69:0/86668471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10880ffd30 msgr2=0x7f10881956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:03.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108db81700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10880ffd30 0x7f10881956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108db81700 1 -- 172.21.15.69:0/86668471 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1080009d00 con 0x7f10880ff390 2023-12-14T14:15:03.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108db81700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10880ff390 0x7f1088195160 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f108400e9a0 tx=0x7f108400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:03.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f107effd700 1 -- 172.21.15.69:0/86668471 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084009790 con 0x7f10880ff390 2023-12-14T14:15:03.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f107effd700 1 -- 172.21.15.69:0/86668471 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1084010430 con 0x7f10880ff390 2023-12-14T14:15:03.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108fde5700 1 -- 172.21.15.69:0/86668471 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108810f1f0 con 0x7f10880ff390 2023-12-14T14:15:03.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f107effd700 1 -- 172.21.15.69:0/86668471 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084018680 con 0x7f10880ff390 2023-12-14T14:15:03.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.111+0000 7f108fde5700 1 -- 172.21.15.69:0/86668471 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108810f060 con 0x7f10880ff390 2023-12-14T14:15:03.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.113+0000 7f107effd700 1 -- 172.21.15.69:0/86668471 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f10840105a0 con 0x7f10880ff390 2023-12-14T14:15:03.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.114+0000 7f107effd700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f10740a1340 0x7f10740a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.114+0000 7f107effd700 1 -- 172.21.15.69:0/86668471 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f1084014070 con 0x7f10880ff390 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.114+0000 7f108d380700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f10740a1340 0x7f10740a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.114+0000 7f108d380700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f10740a1340 0x7f10740a37f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1088068730 tx=0x7f1078009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f109bf73b80 1 Processor -- start 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f109bf73b80 1 -- start start 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1b380 0x55655bc1b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1bc90 0x55655bc26610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc28f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f109bf73b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bb055e0 con 0x55655bc1bc90 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f109bf73b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bb74870 con 0x55655bc26b50 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f109bf73b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bb6dd00 con 0x55655bc1b380 2023-12-14T14:15:03.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f108d380700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1bc90 0x55655bc26610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.115+0000 7f108db81700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1b380 0x55655bc1b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108e382700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc28f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108d380700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1bc90 0x55655bc26610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38502/0 (socket says 172.21.15.69:38502) 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108db81700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1b380 0x55655bc1b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:44632/0 (socket says 172.21.15.69:44632) 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108d380700 1 -- 172.21.15.69:0/484056066 learned_addr learned my addr 172.21.15.69:0/484056066 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108e382700 1 -- 172.21.15.69:0/484056066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1b380 msgr2=0x55655bc1b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108e382700 1 --2- 172.21.15.69:0/484056066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1b380 0x55655bc1b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108e382700 1 -- 172.21.15.69:0/484056066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1bc90 msgr2=0x55655bc26610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108e382700 1 --2- 172.21.15.69:0/484056066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1bc90 0x55655bc26610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108e382700 1 -- 172.21.15.69:0/484056066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55655b9ef3b0 con 0x55655bc26b50 2023-12-14T14:15:03.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108db81700 1 --2- 172.21.15.69:0/484056066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1b380 0x55655bc1b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108d380700 1 --2- 172.21.15.69:0/484056066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1bc90 0x55655bc26610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f108e382700 1 --2- 172.21.15.69:0/484056066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc28f30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1080009fd0 tx=0x7f1080005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e8940bcafcee59d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f1073fff700 1 -- 172.21.15.69:0/484056066 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000e040 con 0x55655bc26b50 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f1073fff700 1 -- 172.21.15.69:0/484056066 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10800074e0 con 0x55655bc26b50 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.116+0000 7f1073fff700 1 -- 172.21.15.69:0/484056066 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080003da0 con 0x55655bc26b50 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 -- 172.21.15.69:0/484056066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 msgr2=0x55655bc28f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 --2- 172.21.15.69:0/484056066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc28f30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1080009fd0 tx=0x7f1080005b00 comp rx=0 tx=0).stop 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 -- 172.21.15.69:0/484056066 shutdown_connections 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 --2- 172.21.15.69:0/484056066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc28f30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 --2- 172.21.15.69:0/484056066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1b380 0x55655bc1b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 --2- 172.21.15.69:0/484056066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1bc90 0x55655bc26610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 -- 172.21.15.69:0/484056066 >> 172.21.15.69:0/484056066 conn(0x55655bc11ca0 msgr2=0x55655bc177e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 -- 172.21.15.69:0/484056066 shutdown_connections 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 -- 172.21.15.69:0/484056066 wait complete. 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.117+0000 7f109bf73b80 1 -- start start 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f109bf73b80 1 Processor -- start 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc264c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc23770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc23cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f109bf73b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bb09f90 con 0x55655bc1b380 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f109bf73b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bb09c30 con 0x55655bc26b50 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f109bf73b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655b9f16a0 con 0x55655bc1bc90 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f109bf73b80 10 client.0 _ll_register_callbacks cb 0x55655bb2d910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:15:03.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108e382700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc23cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108e382700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc23cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:39062/0 (socket says 172.21.15.69:39062) 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108d380700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc23770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108e382700 1 -- 172.21.15.69:0/283286935 learned_addr learned my addr 172.21.15.69:0/283286935 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108e382700 1 -- 172.21.15.69:0/283286935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 msgr2=0x55655bc23770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108e382700 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc23770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108e382700 1 -- 172.21.15.69:0/283286935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 msgr2=0x55655bc264c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108db81700 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108e382700 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc264c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108e382700 1 -- 172.21.15.69:0/283286935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108810c7e0 con 0x55655bc26b50 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.118+0000 7f108db81700 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc264c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f108e382700 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc23cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f108000b010 tx=0x7f108000baa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0b2cb9dd20eade server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:03.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f10717fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f10717fa700 1 -- 172.21.15.69:0/283286935 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000e040 con 0x55655bc26b50 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f10717fa700 1 -- 172.21.15.69:0/283286935 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f108000bdf0 con 0x55655bc26b50 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f109bf73b80 1 -- 172.21.15.69:0/283286935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55655bc0f2b0 con 0x55655bc26b50 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f10717fa700 1 -- 172.21.15.69:0/283286935 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1080003e10 con 0x55655bc26b50 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f109bf73b80 10 client.25625 fetch_fsmap learned FSMap version 28 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f109bf73b80 1 -- 172.21.15.69:0/283286935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55655bb34170 con 0x55655bc26b50 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f10717fa700 1 -- 172.21.15.69:0/283286935 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55655bc0f2b0 con 0x55655bc26b50 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f10717fa700 1 -- 172.21.15.69:0/283286935 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f108000b100 con 0x55655bc26b50 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f109bf73b80 10 client.25625 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f109bf73b80 10 client.25625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f109bf73b80 20 client.25625 populate_metadata read hostname 'smithi069' 2023-12-14T14:15:03.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f109bf73b80 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55655bc36020 0x55655bc38430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f109bf73b80 4 client.25625 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.119+0000 7f109bf73b80 1 -- 172.21.15.69:0/283286935 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55655bb66ce0 con 0x55655bc36020 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.120+0000 7f108db81700 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55655bc36020 0x55655bc38430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.120+0000 7f10717fa700 10 client.25625 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.120+0000 7f108db81700 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55655bc36020 0x55655bc38430 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=963ccf7e8bc41bb7 server_cookie=6e3bedee88158bc2 in_seq=0 out_seq=0 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f10717fa700 1 -- 172.21.15.69:0/283286935 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55655bb66ce0 con 0x55655bc36020 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f10717fa700 10 client.25625 handle_command_reply: tid=0 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 client.25625 shutdown 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 -- 172.21.15.69:0/283286935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 msgr2=0x55655bc23cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc23cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f108000b010 tx=0x7f108000baa0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 -- 172.21.15.69:0/283286935 shutdown_connections 2023-12-14T14:15:03.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55655bc36020 0x55655bc38430 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc23cf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f10717fa700 0 client.25625 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:15:03.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc264c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 --2- 172.21.15.69:0/283286935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc23770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 -- 172.21.15.69:0/283286935 >> 172.21.15.69:0/283286935 conn(0x55655bc11ca0 msgr2=0x55655bc17370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:03.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 -- 172.21.15.69:0/283286935 shutdown_connections 2023-12-14T14:15:03.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 1 -- 172.21.15.69:0/283286935 wait complete. 2023-12-14T14:15:03.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.121+0000 7f109bf73b80 20 client.25625 trim_cache size 0 max 16384 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.139+0000 7f109bf73b80 1 Processor -- start 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.139+0000 7f109bf73b80 1 -- start start 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc25f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc264c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f109bf73b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bc1e590 con 0x55655bc1b380 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f109bf73b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bc242d0 con 0x55655bc26b50 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f109bf73b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bc1c580 con 0x55655bc1bc90 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108db81700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108db81700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38522/0 (socket says 172.21.15.69:38522) 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108db81700 1 -- 172.21.15.69:0/2755453004 learned_addr learned my addr 172.21.15.69:0/2755453004 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108e382700 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108d380700 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc25f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108db81700 1 -- 172.21.15.69:0/2755453004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 msgr2=0x55655bc25f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108db81700 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc25f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108db81700 1 -- 172.21.15.69:0/2755453004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 msgr2=0x55655bc264c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108db81700 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc264c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108db81700 1 -- 172.21.15.69:0/2755453004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55655bb33ec0 con 0x55655bc1b380 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108e382700 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc264c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f108db81700 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d620 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1084096440 tx=0x7f1084095be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e282a95c568788a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f107cff9700 1 -- 172.21.15.69:0/2755453004 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10840b6070 con 0x55655bc1b380 2023-12-14T14:15:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f107cff9700 1 -- 172.21.15.69:0/2755453004 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f108409df70 con 0x55655bc1b380 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.140+0000 7f107cff9700 1 -- 172.21.15.69:0/2755453004 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108409a1a0 con 0x55655bc1b380 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.141+0000 7f109bf73b80 1 -- 172.21.15.69:0/2755453004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 msgr2=0x55655bc2d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.141+0000 7f109bf73b80 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d620 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1084096440 tx=0x7f1084095be0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.141+0000 7f109bf73b80 1 -- 172.21.15.69:0/2755453004 shutdown_connections 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.141+0000 7f109bf73b80 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc264c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.141+0000 7f109bf73b80 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d620 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.141+0000 7f109bf73b80 1 --2- 172.21.15.69:0/2755453004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc25f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.141+0000 7f109bf73b80 1 -- 172.21.15.69:0/2755453004 >> 172.21.15.69:0/2755453004 conn(0x55655bc11ca0 msgr2=0x55655bc327a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.141+0000 7f109bf73b80 1 -- 172.21.15.69:0/2755453004 shutdown_connections 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.141+0000 7f109bf73b80 1 -- 172.21.15.69:0/2755453004 wait complete. 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f109bf73b80 1 -- start start 2023-12-14T14:15:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f109bf73b80 1 Processor -- start 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc2b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f109bf73b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc2bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f109bf73b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bc2c3c0 con 0x55655bc1b380 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f109bf73b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bc2c500 con 0x55655bc26b50 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f109bf73b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bc2c6c0 con 0x55655bc1bc90 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f109bf73b80 10 client.0 _ll_register_callbacks cb 0x55655bb2d910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f108db81700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f108db81700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38532/0 (socket says 172.21.15.69:38532) 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f108db81700 1 -- 172.21.15.69:0/1210191744 learned_addr learned my addr 172.21.15.69:0/1210191744 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f108d380700 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc2b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.142+0000 7f108e382700 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc2bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f108db81700 1 -- 172.21.15.69:0/1210191744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 msgr2=0x55655bc2b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f108db81700 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc2b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f108db81700 1 -- 172.21.15.69:0/1210191744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 msgr2=0x55655bc2bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f108db81700 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc2bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f108db81700 1 -- 172.21.15.69:0/1210191744 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55655bb34170 con 0x55655bc1b380 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f108db81700 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d580 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f10840cabc0 tx=0x7f1084096280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d48ae166824640 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f10717fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f10717fa700 1 -- 172.21.15.69:0/1210191744 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10840b6070 con 0x55655bc1b380 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f10717fa700 1 -- 172.21.15.69:0/1210191744 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f1084098080 con 0x55655bc1b380 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f109bf73b80 1 -- 172.21.15.69:0/1210191744 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10800074e0 con 0x55655bc1b380 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f10717fa700 1 -- 172.21.15.69:0/1210191744 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10840b82d0 con 0x55655bc1b380 2023-12-14T14:15:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f109bf73b80 10 client.16104 fetch_fsmap learned FSMap version 28 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f109bf73b80 1 -- 172.21.15.69:0/1210191744 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f108810f1f0 con 0x55655bc1b380 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f10717fa700 1 -- 172.21.15.69:0/1210191744 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10800074e0 con 0x55655bc1b380 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.143+0000 7f10717fa700 1 -- 172.21.15.69:0/1210191744 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f108409a1a0 con 0x55655bc1b380 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f109bf73b80 10 client.16104 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f109bf73b80 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f109bf73b80 20 client.16104 populate_metadata read hostname 'smithi069' 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f109bf73b80 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55655bc8b100 0x55655bc8d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f109bf73b80 4 client.16104 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f109bf73b80 1 -- 172.21.15.69:0/1210191744 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55655bb66a00 con 0x55655bc8b100 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f108d380700 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55655bc8b100 0x55655bc8d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f10717fa700 10 client.16104 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:15:03.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f108d380700 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55655bc8b100 0x55655bc8d510 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7afab15dd80bf9 server_cookie=bf3cbe425cedd813 in_seq=0 out_seq=0 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f10717fa700 1 -- 172.21.15.69:0/1210191744 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55655bb66a00 con 0x55655bc8b100 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f10717fa700 10 client.16104 handle_command_reply: tid=0 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f109bf73b80 1 client.16104 shutdown 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f109bf73b80 1 -- 172.21.15.69:0/1210191744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 msgr2=0x55655bc2d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.144+0000 7f109bf73b80 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d580 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f10840cabc0 tx=0x7f1084096280 comp rx=0 tx=0).stop 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f109bf73b80 1 -- 172.21.15.69:0/1210191744 shutdown_connections 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f109bf73b80 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55655bc8b100 0x55655bc8d510 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f109bf73b80 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55655bc26b50 0x55655bc2bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f109bf73b80 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55655bc1b380 0x55655bc2d580 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f109bf73b80 1 --2- 172.21.15.69:0/1210191744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55655bc1bc90 0x55655bc2b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f10717fa700 0 client.16104 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:15:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f109bf73b80 1 -- 172.21.15.69:0/1210191744 >> 172.21.15.69:0/1210191744 conn(0x55655bc11ca0 msgr2=0x55655bc23010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f109bf73b80 1 -- 172.21.15.69:0/1210191744 shutdown_connections 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f109bf73b80 1 -- 172.21.15.69:0/1210191744 wait complete. 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f109bf73b80 20 client.16104 trim_cache size 0 max 16384 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "6ac35f34-16ae-4d21-a087-3da5b8baaf4c": { 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6ac35f34-16ae-4d21-a087-3da5b8baaf4c", 2023-12-14T14:15:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:15:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:15:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:15:03.153 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 -- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f10740a1340 msgr2=0x7f10740a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f10740a1340 0x7f10740a37f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1088068730 tx=0x7f1078009260 comp rx=0 tx=0).stop 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 -- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10880ff390 msgr2=0x7f1088195160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10880ff390 0x7f1088195160 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f108400e9a0 tx=0x7f108400ecb0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 -- 172.21.15.69:0/86668471 shutdown_connections 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f10740a1340 0x7f10740a37f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10881043d0 0x7f1088195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10880ff390 0x7f1088195160 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 --2- 172.21.15.69:0/86668471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10880ffd30 0x7f10881956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 -- 172.21.15.69:0/86668471 >> 172.21.15.69:0/86668471 conn(0x7f1088075fd0 msgr2=0x7f10880fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 -- 172.21.15.69:0/86668471 shutdown_connections 2023-12-14T14:15:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:03.145+0000 7f108fde5700 1 -- 172.21.15.69:0/86668471 wait complete. 2023-12-14T14:15:03.157 INFO:tasks.cephfs.filesystem:scrub status for tag:6ac35f34-16ae-4d21-a087-3da5b8baaf4c - {'path': '/', 'tag': '6ac35f34-16ae-4d21-a087-3da5b8baaf4c', 'options': 'recursive,force'} 2023-12-14T14:15:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:03 smithi119 ceph-mon[43834]: pgmap v135: 97 pgs: 97 active+clean; 450 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 46 op/s 2023-12-14T14:15:03.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:03 smithi069 ceph-mon[42034]: pgmap v135: 97 pgs: 97 active+clean; 450 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 46 op/s 2023-12-14T14:15:03.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:03 smithi081 ceph-mon[43371]: pgmap v135: 97 pgs: 97 active+clean; 450 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 46 op/s 2023-12-14T14:15:05.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:05 smithi119 ceph-mon[43834]: pgmap v136: 97 pgs: 97 active+clean; 460 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 63 op/s 2023-12-14T14:15:05.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:05 smithi069 ceph-mon[42034]: pgmap v136: 97 pgs: 97 active+clean; 460 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 63 op/s 2023-12-14T14:15:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:05 smithi081 ceph-mon[43371]: pgmap v136: 97 pgs: 97 active+clean; 460 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 63 op/s 2023-12-14T14:15:07.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:07 smithi069 ceph-mon[42034]: pgmap v137: 97 pgs: 97 active+clean; 460 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 41 op/s 2023-12-14T14:15:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:07 smithi081 ceph-mon[43371]: pgmap v137: 97 pgs: 97 active+clean; 460 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 41 op/s 2023-12-14T14:15:07.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:07 smithi119 ceph-mon[43834]: pgmap v137: 97 pgs: 97 active+clean; 460 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 41 op/s 2023-12-14T14:15:09.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:09 smithi119 ceph-mon[43834]: pgmap v138: 97 pgs: 97 active+clean; 460 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 41 op/s 2023-12-14T14:15:09.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:09 smithi069 ceph-mon[42034]: pgmap v138: 97 pgs: 97 active+clean; 460 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 41 op/s 2023-12-14T14:15:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:09 smithi081 ceph-mon[43371]: pgmap v138: 97 pgs: 97 active+clean; 460 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 41 op/s 2023-12-14T14:15:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:11 smithi119 ceph-mon[43834]: pgmap v139: 97 pgs: 97 active+clean; 480 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 83 op/s 2023-12-14T14:15:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:11 smithi069 ceph-mon[42034]: pgmap v139: 97 pgs: 97 active+clean; 480 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 83 op/s 2023-12-14T14:15:11.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:11 smithi081 ceph-mon[43371]: pgmap v139: 97 pgs: 97 active+clean; 480 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 83 op/s 2023-12-14T14:15:13.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:13 smithi119 ceph-mon[43834]: pgmap v140: 97 pgs: 97 active+clean; 480 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 59 op/s 2023-12-14T14:15:13.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:13 smithi069 ceph-mon[42034]: pgmap v140: 97 pgs: 97 active+clean; 480 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 59 op/s 2023-12-14T14:15:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:13 smithi081 ceph-mon[43371]: pgmap v140: 97 pgs: 97 active+clean; 480 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 59 op/s 2023-12-14T14:15:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:15 smithi119 ceph-mon[43834]: pgmap v141: 97 pgs: 97 active+clean; 505 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.6 MiB/s wr, 99 op/s 2023-12-14T14:15:15.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:15 smithi069 ceph-mon[42034]: pgmap v141: 97 pgs: 97 active+clean; 505 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.6 MiB/s wr, 99 op/s 2023-12-14T14:15:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:15 smithi081 ceph-mon[43371]: pgmap v141: 97 pgs: 97 active+clean; 505 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.6 MiB/s wr, 99 op/s 2023-12-14T14:15:17.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:17 smithi069 ceph-mon[42034]: pgmap v142: 97 pgs: 97 active+clean; 505 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 82 op/s 2023-12-14T14:15:17.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:17 smithi081 ceph-mon[43371]: pgmap v142: 97 pgs: 97 active+clean; 505 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 82 op/s 2023-12-14T14:15:17.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:17 smithi119 ceph-mon[43834]: pgmap v142: 97 pgs: 97 active+clean; 505 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 82 op/s 2023-12-14T14:15:19.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:19 smithi119 ceph-mon[43834]: pgmap v143: 97 pgs: 97 active+clean; 505 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 82 op/s 2023-12-14T14:15:19.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:19 smithi069 ceph-mon[42034]: pgmap v143: 97 pgs: 97 active+clean; 505 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 82 op/s 2023-12-14T14:15:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:19 smithi081 ceph-mon[43371]: pgmap v143: 97 pgs: 97 active+clean; 505 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 82 op/s 2023-12-14T14:15:21.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:21 smithi119 ceph-mon[43834]: pgmap v144: 97 pgs: 97 active+clean; 526 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 103 op/s 2023-12-14T14:15:21.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:21 smithi069 ceph-mon[42034]: pgmap v144: 97 pgs: 97 active+clean; 526 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 103 op/s 2023-12-14T14:15:21.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:21 smithi081 ceph-mon[43371]: pgmap v144: 97 pgs: 97 active+clean; 526 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 103 op/s 2023-12-14T14:15:23.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:23 smithi119 ceph-mon[43834]: pgmap v145: 97 pgs: 97 active+clean; 526 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 61 op/s 2023-12-14T14:15:23.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:23 smithi069 ceph-mon[42034]: pgmap v145: 97 pgs: 97 active+clean; 526 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 61 op/s 2023-12-14T14:15:23.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:23 smithi081 ceph-mon[43371]: pgmap v145: 97 pgs: 97 active+clean; 526 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 61 op/s 2023-12-14T14:15:25.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:25 smithi119 ceph-mon[43834]: pgmap v146: 97 pgs: 97 active+clean; 548 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.7 MiB/s wr, 972 op/s 2023-12-14T14:15:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:25 smithi069 ceph-mon[42034]: pgmap v146: 97 pgs: 97 active+clean; 548 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.7 MiB/s wr, 972 op/s 2023-12-14T14:15:25.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:25 smithi081 ceph-mon[43371]: pgmap v146: 97 pgs: 97 active+clean; 548 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.7 MiB/s wr, 972 op/s 2023-12-14T14:15:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:27 smithi081 ceph-mon[43371]: pgmap v147: 97 pgs: 97 active+clean; 548 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 932 op/s 2023-12-14T14:15:27.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:27 smithi119 ceph-mon[43834]: pgmap v147: 97 pgs: 97 active+clean; 548 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 932 op/s 2023-12-14T14:15:27.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:27 smithi069 ceph-mon[42034]: pgmap v147: 97 pgs: 97 active+clean; 548 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 932 op/s 2023-12-14T14:15:29.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:29 smithi119 ceph-mon[43834]: pgmap v148: 97 pgs: 97 active+clean; 548 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 932 op/s 2023-12-14T14:15:29.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:29 smithi069 ceph-mon[42034]: pgmap v148: 97 pgs: 97 active+clean; 548 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 932 op/s 2023-12-14T14:15:29.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:29 smithi081 ceph-mon[43371]: pgmap v148: 97 pgs: 97 active+clean; 548 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 932 op/s 2023-12-14T14:15:31.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:31 smithi119 ceph-mon[43834]: pgmap v149: 97 pgs: 97 active+clean; 566 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 1.26k op/s 2023-12-14T14:15:31.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:31 smithi069 ceph-mon[42034]: pgmap v149: 97 pgs: 97 active+clean; 566 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 1.26k op/s 2023-12-14T14:15:31.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:31 smithi081 ceph-mon[43371]: pgmap v149: 97 pgs: 97 active+clean; 566 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 1.26k op/s 2023-12-14T14:15:33.158 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:15:33.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 -- 172.21.15.69:0/1803724949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76200680c0 msgr2=0x7f7620068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 --2- 172.21.15.69:0/1803724949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76200680c0 0x7f7620068490 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f76100099c0 tx=0x7f7610009cd0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 -- 172.21.15.69:0/1803724949 shutdown_connections 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 --2- 172.21.15.69:0/1803724949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76201054d0 0x7f762010d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 --2- 172.21.15.69:0/1803724949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76200680c0 0x7f7620068490 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 --2- 172.21.15.69:0/1803724949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7620068a60 0x7f7620104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 -- 172.21.15.69:0/1803724949 >> 172.21.15.69:0/1803724949 conn(0x7f7620075fd0 msgr2=0x7f76200763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 -- 172.21.15.69:0/1803724949 shutdown_connections 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 -- 172.21.15.69:0/1803724949 wait complete. 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.289+0000 7f762544b700 1 Processor -- start 2023-12-14T14:15:33.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f762544b700 1 -- start start 2023-12-14T14:15:33.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f762544b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76200680c0 0x7f7620196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f762544b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7620068a60 0x7f76201968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f762544b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76201054d0 0x7f762019ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f762544b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762019b340 con 0x7f76201054d0 2023-12-14T14:15:33.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f762544b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762019b4b0 con 0x7f7620068a60 2023-12-14T14:15:33.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f762544b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762019b670 con 0x7f76200680c0 2023-12-14T14:15:33.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76201054d0 0x7f762019ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76200680c0 0x7f7620196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7620068a60 0x7f76201968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76200680c0 0x7f7620196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:54760/0 (socket says 172.21.15.69:54760) 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76201054d0 0x7f762019ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52362/0 (socket says 172.21.15.69:52362) 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761effd700 1 -- 172.21.15.69:0/3617031745 learned_addr learned my addr 172.21.15.69:0/3617031745 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761f7fe700 1 -- 172.21.15.69:0/3617031745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76200680c0 msgr2=0x7f7620196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761f7fe700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76200680c0 0x7f7620196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761f7fe700 1 -- 172.21.15.69:0/3617031745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7620068a60 msgr2=0x7f76201968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761f7fe700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7620068a60 0x7f76201968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761f7fe700 1 -- 172.21.15.69:0/3617031745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76100095f0 con 0x7f76201054d0 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761e7fc700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7620068a60 0x7f76201968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.290+0000 7f761f7fe700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76201054d0 0x7f762019ad00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f761800efc0 tx=0x7f761800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.291+0000 7f7607fff700 1 -- 172.21.15.69:0/3617031745 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618018070 con 0x7f76201054d0 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.291+0000 7f7607fff700 1 -- 172.21.15.69:0/3617031745 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f761800f040 con 0x7f76201054d0 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.291+0000 7f762544b700 1 -- 172.21.15.69:0/3617031745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7620110290 con 0x7f76201054d0 2023-12-14T14:15:33.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.291+0000 7f7607fff700 1 -- 172.21.15.69:0/3617031745 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761800cd40 con 0x7f76201054d0 2023-12-14T14:15:33.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.291+0000 7f762544b700 1 -- 172.21.15.69:0/3617031745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7620110100 con 0x7f76201054d0 2023-12-14T14:15:33.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.294+0000 7f7607fff700 1 -- 172.21.15.69:0/3617031745 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7618003a00 con 0x7f76201054d0 2023-12-14T14:15:33.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f7607fff700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f76080a12c0 0x7f76080a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f76315d9b80 1 Processor -- start 2023-12-14T14:15:33.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f76315d9b80 1 -- start start 2023-12-14T14:15:33.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f761effd700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f76080a12c0 0x7f76080a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f7607fff700 1 -- 172.21.15.69:0/3617031745 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f76180cc810 con 0x7f76201054d0 2023-12-14T14:15:33.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 0x5558f2ccf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2cda610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2cdab50 0x5558f2cdcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f76315d9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2bb95e0 con 0x5558f2cdab50 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f76315d9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2c28870 con 0x5558f2ccf380 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f76315d9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2c21d00 con 0x5558f2ccfc90 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f761f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2cdab50 0x5558f2cdcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f761effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 0x5558f2ccf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f761f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2cdab50 0x5558f2cdcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52374/0 (socket says 172.21.15.69:52374) 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f761f7fe700 1 -- 172.21.15.69:0/2745787278 learned_addr learned my addr 172.21.15.69:0/2745787278 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.295+0000 7f761e7fc700 1 --2- 172.21.15.69:0/2745787278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2cda610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f761f7fe700 1 -- 172.21.15.69:0/2745787278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 msgr2=0x5558f2cda610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f761f7fe700 1 --2- 172.21.15.69:0/2745787278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2cda610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f761f7fe700 1 -- 172.21.15.69:0/2745787278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 msgr2=0x5558f2ccf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f761f7fe700 1 --2- 172.21.15.69:0/2745787278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 0x5558f2ccf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f761f7fe700 1 -- 172.21.15.69:0/2745787278 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558f2aa33b0 con 0x5558f2cdab50 2023-12-14T14:15:33.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f761effd700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f76080a12c0 0x7f76080a3770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f76100036c0 tx=0x7f7610004c80 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f761f7fe700 1 --2- 172.21.15.69:0/2745787278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2cdab50 0x5558f2cdcf30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7618095eb0 tx=0x7f7618099780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b9fd6b8073f8b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f76057fa700 1 -- 172.21.15.69:0/2745787278 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761809ac10 con 0x5558f2cdab50 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f76057fa700 1 -- 172.21.15.69:0/2745787278 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7618004ad0 con 0x5558f2cdab50 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.296+0000 7f76057fa700 1 -- 172.21.15.69:0/2745787278 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76180a1ae0 con 0x5558f2cdab50 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 -- 172.21.15.69:0/2745787278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2cdab50 msgr2=0x5558f2cdcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 --2- 172.21.15.69:0/2745787278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2cdab50 0x5558f2cdcf30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7618095eb0 tx=0x7f7618099780 comp rx=0 tx=0).stop 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 -- 172.21.15.69:0/2745787278 shutdown_connections 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 --2- 172.21.15.69:0/2745787278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2cdab50 0x5558f2cdcf30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 --2- 172.21.15.69:0/2745787278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 0x5558f2ccf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 --2- 172.21.15.69:0/2745787278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2cda610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 -- 172.21.15.69:0/2745787278 >> 172.21.15.69:0/2745787278 conn(0x5558f2cc5ca0 msgr2=0x5558f2ccb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 -- 172.21.15.69:0/2745787278 shutdown_connections 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 -- 172.21.15.69:0/2745787278 wait complete. 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 -- start start 2023-12-14T14:15:33.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 Processor -- start 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 0x5558f2cda510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccfc90 0x5558f2cd77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2cdab50 0x5558f2cd7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2bbdf90 con 0x5558f2ccfc90 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2bbdc30 con 0x5558f2ccf380 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2aa56a0 con 0x5558f2cdab50 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f76315d9b80 10 client.0 _ll_register_callbacks cb 0x5558f2be1910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.297+0000 7f761e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccfc90 0x5558f2cd77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccfc90 0x5558f2cd77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52390/0 (socket says 172.21.15.69:52390) 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761e7fc700 1 -- 172.21.15.69:0/775247236 learned_addr learned my addr 172.21.15.69:0/775247236 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761effd700 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 0x5558f2cda510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761f7fe700 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2cdab50 0x5558f2cd7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761e7fc700 1 -- 172.21.15.69:0/775247236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2cdab50 msgr2=0x5558f2cd7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761e7fc700 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2cdab50 0x5558f2cd7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761e7fc700 1 -- 172.21.15.69:0/775247236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 msgr2=0x5558f2cda510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761e7fc700 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 0x5558f2cda510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761e7fc700 1 -- 172.21.15.69:0/775247236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7620110100 con 0x5558f2ccfc90 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f761e7fc700 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccfc90 0x5558f2cd77c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7614012d20 tx=0x7f761400f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e10cc4be97ebf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f7602ff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f7602ff5700 1 -- 172.21.15.69:0/775247236 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7614017070 con 0x5558f2ccfc90 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f7602ff5700 1 -- 172.21.15.69:0/775247236 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f761400fc30 con 0x5558f2ccfc90 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f76315d9b80 1 -- 172.21.15.69:0/775247236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558f2cc32b0 con 0x5558f2ccfc90 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f7602ff5700 1 -- 172.21.15.69:0/775247236 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76140122e0 con 0x5558f2ccfc90 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f76315d9b80 10 client.16116 fetch_fsmap learned FSMap version 28 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.298+0000 7f76315d9b80 1 -- 172.21.15.69:0/775247236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5558f2be8170 con 0x5558f2ccfc90 2023-12-14T14:15:33.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f7602ff5700 1 -- 172.21.15.69:0/775247236 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5558f2cc32b0 con 0x5558f2ccfc90 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f7602ff5700 1 -- 172.21.15.69:0/775247236 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f76140254d0 con 0x5558f2ccfc90 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f76315d9b80 10 client.16116 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f76315d9b80 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f76315d9b80 20 client.16116 populate_metadata read hostname 'smithi069' 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f76315d9b80 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558f2cea420 0x5558f2cec830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f76315d9b80 4 client.16116 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f76315d9b80 1 -- 172.21.15.69:0/775247236 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558f2c1ace0 con 0x5558f2cea420 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f761effd700 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558f2cea420 0x5558f2cec830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f761effd700 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558f2cea420 0x5558f2cec830 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=387aabe2996b5434 server_cookie=af3a2188e5f98d88 in_seq=0 out_seq=0 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.299+0000 7f7602ff5700 10 client.16116 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f7602ff5700 1 -- 172.21.15.69:0/775247236 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5558f2c1ace0 con 0x5558f2cea420 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f7602ff5700 10 client.16116 handle_command_reply: tid=0 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 client.16116 shutdown 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 -- 172.21.15.69:0/775247236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccfc90 msgr2=0x5558f2cd77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:33.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccfc90 0x5558f2cd77c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7614012d20 tx=0x7f761400f6a0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 -- 172.21.15.69:0/775247236 shutdown_connections 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558f2cea420 0x5558f2cec830 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2cdab50 0x5558f2cd7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f7602ff5700 0 client.16116 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2ccf380 0x5558f2cda510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 --2- 172.21.15.69:0/775247236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccfc90 0x5558f2cd77c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 -- 172.21.15.69:0/775247236 >> 172.21.15.69:0/775247236 conn(0x5558f2cc5ca0 msgr2=0x5558f2ccb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 -- 172.21.15.69:0/775247236 shutdown_connections 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 1 -- 172.21.15.69:0/775247236 wait complete. 2023-12-14T14:15:33.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.302+0000 7f76315d9b80 20 client.16116 trim_cache size 0 max 16384 2023-12-14T14:15:33.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.320+0000 7f76315d9b80 1 Processor -- start 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.320+0000 7f76315d9b80 1 -- start start 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.320+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2cd9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.320+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2cda510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.320+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cd2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.320+0000 7f76315d9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2cd83d0 con 0x5558f2ccf380 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.320+0000 7f76315d9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2cca640 con 0x5558f2cdab50 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.320+0000 7f76315d9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2cd88d0 con 0x5558f2ccfc90 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2cd9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2cd9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52396/0 (socket says 172.21.15.69:52396) 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cd2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2cda510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761effd700 1 -- 172.21.15.69:0/1681444566 learned_addr learned my addr 172.21.15.69:0/1681444566 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761effd700 1 -- 172.21.15.69:0/1681444566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 msgr2=0x5558f2cda510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761effd700 1 --2- 172.21.15.69:0/1681444566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2cda510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761effd700 1 -- 172.21.15.69:0/1681444566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 msgr2=0x5558f2cd2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:33.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761effd700 1 --2- 172.21.15.69:0/1681444566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cd2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761effd700 1 -- 172.21.15.69:0/1681444566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558f2be7ec0 con 0x5558f2ccf380 2023-12-14T14:15:33.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761f7fe700 1 --2- 172.21.15.69:0/1681444566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cd2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:15:33.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f761effd700 1 --2- 172.21.15.69:0/1681444566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2cd9fd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7610009fd0 tx=0x7f761002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be8e09c9c425733 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:33.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f7605ffb700 1 -- 172.21.15.69:0/1681444566 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7610003a90 con 0x5558f2ccf380 2023-12-14T14:15:33.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f7605ffb700 1 -- 172.21.15.69:0/1681444566 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f761001e040 con 0x5558f2ccf380 2023-12-14T14:15:33.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.321+0000 7f7605ffb700 1 -- 172.21.15.69:0/1681444566 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761000bb10 con 0x5558f2ccf380 2023-12-14T14:15:33.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 -- 172.21.15.69:0/1681444566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 msgr2=0x5558f2cd9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:33.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 --2- 172.21.15.69:0/1681444566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2cd9fd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7610009fd0 tx=0x7f761002a000 comp rx=0 tx=0).stop 2023-12-14T14:15:33.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 -- 172.21.15.69:0/1681444566 shutdown_connections 2023-12-14T14:15:33.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 --2- 172.21.15.69:0/1681444566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cd2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 --2- 172.21.15.69:0/1681444566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2cd9fd0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 --2- 172.21.15.69:0/1681444566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2cda510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 -- 172.21.15.69:0/1681444566 >> 172.21.15.69:0/1681444566 conn(0x5558f2cc5ca0 msgr2=0x5558f2cc9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 -- 172.21.15.69:0/1681444566 shutdown_connections 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 -- 172.21.15.69:0/1681444566 wait complete. 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 -- start start 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.322+0000 7f76315d9b80 1 Processor -- start 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2ce1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2ce17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f76315d9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cdf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f76315d9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2cdfec0 con 0x5558f2ccf380 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f76315d9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2ce0030 con 0x5558f2cdab50 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f76315d9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558f2ce01f0 con 0x5558f2ccfc90 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f76315d9b80 10 client.0 _ll_register_callbacks cb 0x7f76140127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2ce17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2ce17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:54800/0 (socket says 172.21.15.69:54800) 2023-12-14T14:15:33.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761e7fc700 1 -- 172.21.15.69:0/3819733138 learned_addr learned my addr 172.21.15.69:0/3819733138 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761effd700 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2ce1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761f7fe700 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cdf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761e7fc700 1 -- 172.21.15.69:0/3819733138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 msgr2=0x5558f2cdf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761e7fc700 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cdf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761e7fc700 1 -- 172.21.15.69:0/3819733138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 msgr2=0x5558f2ce1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761e7fc700 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2ce1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761e7fc700 1 -- 172.21.15.69:0/3819733138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558f2aa33b0 con 0x5558f2ccfc90 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761f7fe700 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cdf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f761e7fc700 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2ce17b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7614012a40 tx=0x7f7614009fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b3b5997de02642d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.323+0000 7f7602ff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f7602ff5700 1 -- 172.21.15.69:0/3819733138 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7614017040 con 0x5558f2ccfc90 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f76315d9b80 1 -- 172.21.15.69:0/3819733138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7618004ad0 con 0x5558f2ccfc90 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f7602ff5700 1 -- 172.21.15.69:0/3819733138 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f761402a070 con 0x5558f2ccfc90 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f7602ff5700 1 -- 172.21.15.69:0/3819733138 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f761400fe40 con 0x5558f2ccfc90 2023-12-14T14:15:33.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f76315d9b80 10 client.25618 fetch_fsmap learned FSMap version 28 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f76315d9b80 1 -- 172.21.15.69:0/3819733138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f762010d8e0 con 0x5558f2ccfc90 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f7602ff5700 1 -- 172.21.15.69:0/3819733138 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7618004ad0 con 0x5558f2ccfc90 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f7602ff5700 1 -- 172.21.15.69:0/3819733138 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f76140037f0 con 0x5558f2ccfc90 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f76315d9b80 10 client.25618 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f76315d9b80 10 client.25618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f76315d9b80 20 client.25618 populate_metadata read hostname 'smithi069' 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f76315d9b80 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558f2cea420 0x5558f2d415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f76315d9b80 4 client.25618 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f76315d9b80 1 -- 172.21.15.69:0/3819733138 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5558f2c1aa00 con 0x5558f2cea420 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.324+0000 7f761effd700 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558f2cea420 0x5558f2d415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.325+0000 7f7602ff5700 10 client.25618 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:15:33.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.325+0000 7f761effd700 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558f2cea420 0x5558f2d415e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78c76a00f4e73a5 server_cookie=770337678c49bcbd in_seq=0 out_seq=0 2023-12-14T14:15:33.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f7602ff5700 1 -- 172.21.15.69:0/3819733138 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5558f2c1aa00 con 0x5558f2cea420 2023-12-14T14:15:33.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f7602ff5700 10 client.25618 handle_command_reply: tid=0 2023-12-14T14:15:33.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 client.25618 shutdown 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 -- 172.21.15.69:0/3819733138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 msgr2=0x5558f2ce17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2ce17b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7614012a40 tx=0x7f7614009fb0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 -- 172.21.15.69:0/3819733138 shutdown_connections 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5558f2cea420 0x5558f2d415e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558f2cdab50 0x5558f2cdf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f7602ff5700 0 client.25618 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558f2ccf380 0x5558f2ce1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 --2- 172.21.15.69:0/3819733138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5558f2ccfc90 0x5558f2ce17b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 -- 172.21.15.69:0/3819733138 >> 172.21.15.69:0/3819733138 conn(0x5558f2cc5ca0 msgr2=0x5558f2cd2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 -- 172.21.15.69:0/3819733138 shutdown_connections 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.327+0000 7f76315d9b80 1 -- 172.21.15.69:0/3819733138 wait complete. 2023-12-14T14:15:33.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f76315d9b80 20 client.25618 trim_cache size 0 max 16384 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: "6ac35f34-16ae-4d21-a087-3da5b8baaf4c": { 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6ac35f34-16ae-4d21-a087-3da5b8baaf4c", 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:15:33.332 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:15:33.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 -- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f76080a12c0 msgr2=0x7f76080a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:33.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f76080a12c0 0x7f76080a3770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f76100036c0 tx=0x7f7610004c80 comp rx=0 tx=0).stop 2023-12-14T14:15:33.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 -- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76201054d0 msgr2=0x7f762019ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:15:33.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76201054d0 0x7f762019ad00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f761800efc0 tx=0x7f761800c3a0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 -- 172.21.15.69:0/3617031745 shutdown_connections 2023-12-14T14:15:33.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f76080a12c0 0x7f76080a3770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76201054d0 0x7f762019ad00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76200680c0 0x7f7620196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 --2- 172.21.15.69:0/3617031745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7620068a60 0x7f76201968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:15:33.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 -- 172.21.15.69:0/3617031745 >> 172.21.15.69:0/3617031745 conn(0x7f7620075fd0 msgr2=0x7f76200fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:15:33.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 -- 172.21.15.69:0/3617031745 shutdown_connections 2023-12-14T14:15:33.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:15:33.328+0000 7f762544b700 1 -- 172.21.15.69:0/3617031745 wait complete. 2023-12-14T14:15:33.341 INFO:tasks.cephfs.filesystem:scrub status for tag:6ac35f34-16ae-4d21-a087-3da5b8baaf4c - {'path': '/', 'tag': '6ac35f34-16ae-4d21-a087-3da5b8baaf4c', 'options': 'recursive,force'} 2023-12-14T14:15:33.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:33 smithi119 ceph-mon[43834]: pgmap v150: 97 pgs: 97 active+clean; 566 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 1.24k op/s 2023-12-14T14:15:33.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:33 smithi069 ceph-mon[42034]: pgmap v150: 97 pgs: 97 active+clean; 566 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 1.24k op/s 2023-12-14T14:15:33.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:33 smithi081 ceph-mon[43371]: pgmap v150: 97 pgs: 97 active+clean; 566 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 1.24k op/s 2023-12-14T14:15:35.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:35 smithi119 ceph-mon[43834]: pgmap v151: 97 pgs: 97 active+clean; 581 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 1.80k op/s 2023-12-14T14:15:35.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:35 smithi069 ceph-mon[42034]: pgmap v151: 97 pgs: 97 active+clean; 581 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 1.80k op/s 2023-12-14T14:15:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:35 smithi081 ceph-mon[43371]: pgmap v151: 97 pgs: 97 active+clean; 581 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 1.80k op/s 2023-12-14T14:15:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:37 smithi081 ceph-mon[43371]: pgmap v152: 97 pgs: 97 active+clean; 581 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 891 op/s 2023-12-14T14:15:37.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:37 smithi119 ceph-mon[43834]: pgmap v152: 97 pgs: 97 active+clean; 581 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 891 op/s 2023-12-14T14:15:37.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:37 smithi069 ceph-mon[42034]: pgmap v152: 97 pgs: 97 active+clean; 581 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 891 op/s 2023-12-14T14:15:39.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:39 smithi119 ceph-mon[43834]: pgmap v153: 97 pgs: 97 active+clean; 581 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 891 op/s 2023-12-14T14:15:39.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:39 smithi069 ceph-mon[42034]: pgmap v153: 97 pgs: 97 active+clean; 581 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 891 op/s 2023-12-14T14:15:39.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:39 smithi081 ceph-mon[43371]: pgmap v153: 97 pgs: 97 active+clean; 581 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 891 op/s 2023-12-14T14:15:41.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:41 smithi119 ceph-mon[43834]: pgmap v154: 97 pgs: 97 active+clean; 584 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 1.29k op/s 2023-12-14T14:15:41.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:41 smithi069 ceph-mon[42034]: pgmap v154: 97 pgs: 97 active+clean; 584 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 1.29k op/s 2023-12-14T14:15:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:41 smithi081 ceph-mon[43371]: pgmap v154: 97 pgs: 97 active+clean; 584 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 1.29k op/s 2023-12-14T14:15:43.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:43 smithi119 ceph-mon[43834]: pgmap v155: 97 pgs: 97 active+clean; 584 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 963 op/s 2023-12-14T14:15:43.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:43 smithi069 ceph-mon[42034]: pgmap v155: 97 pgs: 97 active+clean; 584 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 963 op/s 2023-12-14T14:15:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:43 smithi081 ceph-mon[43371]: pgmap v155: 97 pgs: 97 active+clean; 584 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 963 op/s 2023-12-14T14:15:45.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:45 smithi119 ceph-mon[43834]: pgmap v156: 97 pgs: 97 active+clean; 607 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 1.38k op/s 2023-12-14T14:15:45.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:45 smithi069 ceph-mon[42034]: pgmap v156: 97 pgs: 97 active+clean; 607 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 1.38k op/s 2023-12-14T14:15:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:45 smithi081 ceph-mon[43371]: pgmap v156: 97 pgs: 97 active+clean; 607 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 1.38k op/s 2023-12-14T14:15:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:47 smithi081 ceph-mon[43371]: pgmap v157: 97 pgs: 97 active+clean; 607 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 816 op/s 2023-12-14T14:15:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:47 smithi119 ceph-mon[43834]: pgmap v157: 97 pgs: 97 active+clean; 607 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 816 op/s 2023-12-14T14:15:47.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:47 smithi069 ceph-mon[42034]: pgmap v157: 97 pgs: 97 active+clean; 607 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 816 op/s 2023-12-14T14:15:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:49 smithi119 ceph-mon[43834]: pgmap v158: 97 pgs: 97 active+clean; 607 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 816 op/s 2023-12-14T14:15:49.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:49 smithi069 ceph-mon[42034]: pgmap v158: 97 pgs: 97 active+clean; 607 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 816 op/s 2023-12-14T14:15:49.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:49 smithi081 ceph-mon[43371]: pgmap v158: 97 pgs: 97 active+clean; 607 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 816 op/s 2023-12-14T14:15:51.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:51 smithi119 ceph-mon[43834]: pgmap v159: 97 pgs: 97 active+clean; 615 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.9 MiB/s wr, 1.00k op/s 2023-12-14T14:15:51.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:51 smithi069 ceph-mon[42034]: pgmap v159: 97 pgs: 97 active+clean; 615 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.9 MiB/s wr, 1.00k op/s 2023-12-14T14:15:51.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:51 smithi081 ceph-mon[43371]: pgmap v159: 97 pgs: 97 active+clean; 615 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.9 MiB/s wr, 1.00k op/s 2023-12-14T14:15:52.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:52 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:15:52.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:52 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:15:52.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:52 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:15:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:53 smithi119 ceph-mon[43834]: pgmap v160: 97 pgs: 97 active+clean; 615 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.6 MiB/s wr, 602 op/s 2023-12-14T14:15:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:53 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:15:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:53 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:15:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:53 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:15:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:53 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:15:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:53 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:15:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:53 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:15:53.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:53 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:15:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:53 smithi069 ceph-mon[42034]: pgmap v160: 97 pgs: 97 active+clean; 615 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.6 MiB/s wr, 602 op/s 2023-12-14T14:15:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:53 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:15:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:53 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:15:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:53 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:15:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:53 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:15:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:53 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:15:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:53 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:15:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:53 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:15:53.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:53 smithi081 ceph-mon[43371]: pgmap v160: 97 pgs: 97 active+clean; 615 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.6 MiB/s wr, 602 op/s 2023-12-14T14:15:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:53 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:15:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:53 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:15:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:53 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:15:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:53 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:15:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:53 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:15:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:53 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:15:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:53 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:15:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:55 smithi119 ceph-mon[43834]: pgmap v161: 97 pgs: 97 active+clean; 620 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 829 op/s 2023-12-14T14:15:55.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:55 smithi069 ceph-mon[42034]: pgmap v161: 97 pgs: 97 active+clean; 620 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 829 op/s 2023-12-14T14:15:55.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:55 smithi081 ceph-mon[43371]: pgmap v161: 97 pgs: 97 active+clean; 620 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 829 op/s 2023-12-14T14:15:57.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:57 smithi081 ceph-mon[43371]: pgmap v162: 97 pgs: 97 active+clean; 620 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 411 op/s 2023-12-14T14:15:57.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:57 smithi119 ceph-mon[43834]: pgmap v162: 97 pgs: 97 active+clean; 620 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 411 op/s 2023-12-14T14:15:57.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:57 smithi069 ceph-mon[42034]: pgmap v162: 97 pgs: 97 active+clean; 620 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 411 op/s 2023-12-14T14:15:59.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:15:59 smithi119 ceph-mon[43834]: pgmap v163: 97 pgs: 97 active+clean; 620 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 411 op/s 2023-12-14T14:15:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:15:59 smithi069 ceph-mon[42034]: pgmap v163: 97 pgs: 97 active+clean; 620 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 411 op/s 2023-12-14T14:15:59.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:15:59 smithi081 ceph-mon[43371]: pgmap v163: 97 pgs: 97 active+clean; 620 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 411 op/s 2023-12-14T14:16:01.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:01 smithi119 ceph-mon[43834]: pgmap v164: 97 pgs: 97 active+clean; 641 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 676 op/s 2023-12-14T14:16:01.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:01 smithi069 ceph-mon[42034]: pgmap v164: 97 pgs: 97 active+clean; 641 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 676 op/s 2023-12-14T14:16:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:01 smithi081 ceph-mon[43371]: pgmap v164: 97 pgs: 97 active+clean; 641 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 676 op/s 2023-12-14T14:16:03.343 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.518+0000 7f2ea1e51700 1 -- 172.21.15.69:0/3648756319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e9c10a890 msgr2=0x7f2e9c10cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.518+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/3648756319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e9c10a890 0x7f2e9c10cc70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400b0a0 tx=0x7f2e9400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.518+0000 7f2ea1e51700 1 -- 172.21.15.69:0/3648756319 shutdown_connections 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.518+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/3648756319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e9c10a890 0x7f2e9c10cc70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.518+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/3648756319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c067980 0x7f2e9c0ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.518+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/3648756319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e9c0ffa40 0x7f2e9c0ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.518+0000 7f2ea1e51700 1 -- 172.21.15.69:0/3648756319 >> 172.21.15.69:0/3648756319 conn(0x7f2e9c074a60 msgr2=0x7f2e9c074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.518+0000 7f2ea1e51700 1 -- 172.21.15.69:0/3648756319 shutdown_connections 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.518+0000 7f2ea1e51700 1 -- 172.21.15.69:0/3648756319 wait complete. 2023-12-14T14:16:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2ea1e51700 1 Processor -- start 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2ea1e51700 1 -- start start 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2ea1e51700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e9c067980 0x7f2e9c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2ea1e51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c0ffa40 0x7f2e9c196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2ea1e51700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e9c10a890 0x7f2e9c19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2ea1e51700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c19b430 con 0x7f2e9c067980 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2ea1e51700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c19b5a0 con 0x7f2e9c0ffa40 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2ea1e51700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c19b760 con 0x7f2e9c10a890 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e9c067980 0x7f2e9c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c0ffa40 0x7f2e9c196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e9c067980 0x7f2e9c196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57190/0 (socket says 172.21.15.69:57190) 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9b7fe700 1 -- 172.21.15.69:0/4261285873 learned_addr learned my addr 172.21.15.69:0/4261285873 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9bfff700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e9c10a890 0x7f2e9c19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9affd700 1 -- 172.21.15.69:0/4261285873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e9c10a890 msgr2=0x7f2e9c19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9affd700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e9c10a890 0x7f2e9c19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9affd700 1 -- 172.21.15.69:0/4261285873 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e9c067980 msgr2=0x7f2e9c196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9affd700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e9c067980 0x7f2e9c196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.519+0000 7f2e9affd700 1 -- 172.21.15.69:0/4261285873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e94009d00 con 0x7f2e9c0ffa40 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.520+0000 7f2e9affd700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c0ffa40 0x7f2e9c196990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000e9c0 tx=0x7f2e9000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.520+0000 7f2e98ff9700 1 -- 172.21.15.69:0/4261285873 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90004220 con 0x7f2e9c0ffa40 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.520+0000 7f2ea1e51700 1 -- 172.21.15.69:0/4261285873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c110250 con 0x7f2e9c0ffa40 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.520+0000 7f2e98ff9700 1 -- 172.21.15.69:0/4261285873 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e90004380 con 0x7f2e9c0ffa40 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.520+0000 7f2e98ff9700 1 -- 172.21.15.69:0/4261285873 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90003be0 con 0x7f2e9c0ffa40 2023-12-14T14:16:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.520+0000 7f2ea1e51700 1 -- 172.21.15.69:0/4261285873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c1100c0 con 0x7f2e9c0ffa40 2023-12-14T14:16:03.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.523+0000 7f2e98ff9700 1 -- 172.21.15.69:0/4261285873 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2e90003d40 con 0x7f2e9c0ffa40 2023-12-14T14:16:03.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.523+0000 7f2e98ff9700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e840a12c0 0x7f2e840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2e98ff9700 1 -- 172.21.15.69:0/4261285873 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f2e90014070 con 0x7f2e9c0ffa40 2023-12-14T14:16:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2eadfdfb80 1 Processor -- start 2023-12-14T14:16:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2eadfdfb80 1 -- start start 2023-12-14T14:16:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e840a12c0 0x7f2e840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 0x557a86d69750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d69c90 0x557a86d74610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d74b50 0x557a86d76f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86c535e0 con 0x557a86d69380 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86cc2870 con 0x557a86d69c90 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86cbbd00 con 0x557a86d74b50 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2e9affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d69c90 0x557a86d74610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2e9affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d69c90 0x557a86d74610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:55088/0 (socket says 172.21.15.69:55088) 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2e9affd700 1 -- 172.21.15.69:0/1736624351 learned_addr learned my addr 172.21.15.69:0/1736624351 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2e9bfff700 1 --2- 172.21.15.69:0/1736624351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d74b50 0x557a86d76f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.524+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e840a12c0 0x7f2e840a3770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009d70 tx=0x7f2e8c011720 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.525+0000 7f2e9affd700 1 -- 172.21.15.69:0/1736624351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d74b50 msgr2=0x557a86d76f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.525+0000 7f2e9affd700 1 --2- 172.21.15.69:0/1736624351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d74b50 0x557a86d76f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.525+0000 7f2e9affd700 1 -- 172.21.15.69:0/1736624351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 msgr2=0x557a86d69750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.525+0000 7f2e9affd700 1 --2- 172.21.15.69:0/1736624351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 0x557a86d69750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.525+0000 7f2e9affd700 1 -- 172.21.15.69:0/1736624351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a86b3d3b0 con 0x557a86d69c90 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.525+0000 7f2e9affd700 1 --2- 172.21.15.69:0/1736624351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d69c90 0x557a86d74610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e90096aa0 tx=0x7f2e90099a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6bbd3e4efbd3e6b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.525+0000 7f2e81ffb700 1 -- 172.21.15.69:0/1736624351 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9009e060 con 0x557a86d69c90 2023-12-14T14:16:03.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.525+0000 7f2e81ffb700 1 -- 172.21.15.69:0/1736624351 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e900a2480 con 0x557a86d69c90 2023-12-14T14:16:03.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.525+0000 7f2e81ffb700 1 -- 172.21.15.69:0/1736624351 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90099520 con 0x557a86d69c90 2023-12-14T14:16:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/1736624351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d69c90 msgr2=0x557a86d74610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/1736624351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d69c90 0x557a86d74610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e90096aa0 tx=0x7f2e90099a80 comp rx=0 tx=0).stop 2023-12-14T14:16:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/1736624351 shutdown_connections 2023-12-14T14:16:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/1736624351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d74b50 0x557a86d76f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/1736624351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 0x557a86d69750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/1736624351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d69c90 0x557a86d74610 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/1736624351 >> 172.21.15.69:0/1736624351 conn(0x557a86d5fca0 msgr2=0x557a86d657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/1736624351 shutdown_connections 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/1736624351 wait complete. 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 -- start start 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.526+0000 7f2eadfdfb80 1 Processor -- start 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d74590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d71ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86c57f90 con 0x557a86d69c90 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86c57c30 con 0x557a86d74b50 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86b3f6a0 con 0x557a86d69380 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2eadfdfb80 10 client.0 _ll_register_callbacks cb 0x557a86c7b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:16:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57206/0 (socket says 172.21.15.69:57206) 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9affd700 1 -- 172.21.15.69:0/958263655 learned_addr learned my addr 172.21.15.69:0/958263655 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d74590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9bfff700 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d71ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9affd700 1 -- 172.21.15.69:0/958263655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 msgr2=0x557a86d74590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9affd700 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d74590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9affd700 1 -- 172.21.15.69:0/958263655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 msgr2=0x557a86d71ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9affd700 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d71ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9affd700 1 -- 172.21.15.69:0/958263655 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c1100c0 con 0x557a86d69c90 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e9affd700 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d718b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2e900cd040 tx=0x7f2e9000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b88d10758b96a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e7affd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e7affd700 1 -- 172.21.15.69:0/958263655 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90099730 con 0x557a86d69c90 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.527+0000 7f2e7affd700 1 -- 172.21.15.69:0/958263655 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f2e9009a290 con 0x557a86d69c90 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.528+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/958263655 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a86d5d2b0 con 0x557a86d69c90 2023-12-14T14:16:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.528+0000 7f2e7affd700 1 -- 172.21.15.69:0/958263655 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e9009a450 con 0x557a86d69c90 2023-12-14T14:16:03.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.528+0000 7f2eadfdfb80 10 client.16131 fetch_fsmap learned FSMap version 28 2023-12-14T14:16:03.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.528+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/958263655 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557a86c82170 con 0x557a86d69c90 2023-12-14T14:16:03.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.528+0000 7f2e7affd700 1 -- 172.21.15.69:0/958263655 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e900ca020 con 0x557a86d69c90 2023-12-14T14:16:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2e7affd700 1 -- 172.21.15.69:0/958263655 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2e900ca190 con 0x557a86d69c90 2023-12-14T14:16:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2eadfdfb80 10 client.16131 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:16:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2eadfdfb80 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:16:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2eadfdfb80 20 client.16131 populate_metadata read hostname 'smithi069' 2023-12-14T14:16:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557a86d9d9a0 0x557a86d9fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2eadfdfb80 4 client.16131 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:16:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/958263655 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a86cb4ce0 con 0x557a86d9d9a0 2023-12-14T14:16:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557a86d9d9a0 0x557a86d9fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2e7affd700 10 client.16131 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.529+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557a86d9d9a0 0x557a86d9fd80 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51c96aaf35d1be13 server_cookie=1a861b924ae2dd4 in_seq=0 out_seq=0 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2e7affd700 1 -- 172.21.15.69:0/958263655 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557a86cb4ce0 con 0x557a86d9d9a0 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2e7affd700 10 client.16131 handle_command_reply: tid=0 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 client.16131 shutdown 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/958263655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 msgr2=0x557a86d718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d718b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2e900cd040 tx=0x7f2e9000cf10 comp rx=0 tx=0).stop 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/958263655 shutdown_connections 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557a86d9d9a0 0x557a86d9fd80 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d71ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d74590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2e7affd700 0 client.16131 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/958263655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d718b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/958263655 >> 172.21.15.69:0/958263655 conn(0x557a86d5fca0 msgr2=0x557a86d65370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:03.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/958263655 shutdown_connections 2023-12-14T14:16:03.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/958263655 wait complete. 2023-12-14T14:16:03.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.530+0000 7f2eadfdfb80 20 client.16131 trim_cache size 0 max 16384 2023-12-14T14:16:03.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.548+0000 7f2eadfdfb80 1 Processor -- start 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.548+0000 7f2eadfdfb80 1 -- start start 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.548+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 0x557a86d741c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.548+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69c90 0x557a86d6cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.548+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d6d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.548+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86d72830 con 0x557a86d69380 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.548+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86d6a5e0 con 0x557a86d74b50 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.548+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86d99de0 con 0x557a86d69c90 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 0x557a86d741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 0x557a86d741c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57216/0 (socket says 172.21.15.69:57216) 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9b7fe700 1 -- 172.21.15.69:0/2160451353 learned_addr learned my addr 172.21.15.69:0/2160451353 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9bfff700 1 --2- 172.21.15.69:0/2160451353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d6d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9affd700 1 --2- 172.21.15.69:0/2160451353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69c90 0x557a86d6cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9b7fe700 1 -- 172.21.15.69:0/2160451353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69c90 msgr2=0x557a86d6cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/2160451353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69c90 0x557a86d6cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9b7fe700 1 -- 172.21.15.69:0/2160451353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 msgr2=0x557a86d6d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/2160451353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d6d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9b7fe700 1 -- 172.21.15.69:0/2160451353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a86c81ec0 con 0x557a86d69380 2023-12-14T14:16:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/2160451353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 0x557a86d741c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0094f0 tx=0x7f2e8c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984484d613ca4f97 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e827fc700 1 -- 172.21.15.69:0/2160451353 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c024040 con 0x557a86d69380 2023-12-14T14:16:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e827fc700 1 -- 172.21.15.69:0/2160451353 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e8c027cb0 con 0x557a86d69380 2023-12-14T14:16:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.549+0000 7f2e827fc700 1 -- 172.21.15.69:0/2160451353 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c01fe80 con 0x557a86d69380 2023-12-14T14:16:03.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/2160451353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 msgr2=0x557a86d741c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:03.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/2160451353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 0x557a86d741c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0094f0 tx=0x7f2e8c01a000 comp rx=0 tx=0).stop 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/2160451353 shutdown_connections 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/2160451353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d6d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/2160451353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69380 0x557a86d741c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/2160451353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69c90 0x557a86d6cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/2160451353 >> 172.21.15.69:0/2160451353 conn(0x557a86d5fca0 msgr2=0x557a86d996d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/2160451353 shutdown_connections 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/2160451353 wait complete. 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.550+0000 7f2eadfdfb80 1 -- start start 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2eadfdfb80 1 Processor -- start 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d94df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d93170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2eadfdfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d936b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86d93bf0 con 0x557a86d69c90 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86d93d30 con 0x557a86d74b50 2023-12-14T14:16:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2eadfdfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a86d93ef0 con 0x557a86d69380 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2eadfdfb80 10 client.0 _ll_register_callbacks cb 0x557a86c7b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d93170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d94df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d94df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:48838/0 (socket says 172.21.15.69:48838) 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9b7fe700 1 -- 172.21.15.69:0/200419635 learned_addr learned my addr 172.21.15.69:0/200419635 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9bfff700 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d936b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9b7fe700 1 -- 172.21.15.69:0/200419635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 msgr2=0x557a86d936b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d936b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9b7fe700 1 -- 172.21.15.69:0/200419635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 msgr2=0x557a86d93170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d93170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.551+0000 7f2e9b7fe700 1 -- 172.21.15.69:0/200419635 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c01f040 con 0x557a86d69380 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2e9b7fe700 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d94df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c027440 tx=0x7f2e8c0275c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=571925720b6f88e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2e7affd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2e7affd700 1 -- 172.21.15.69:0/200419635 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c01f8f0 con 0x557a86d69380 2023-12-14T14:16:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2e7affd700 1 -- 172.21.15.69:0/200419635 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f2e8c034070 con 0x557a86d69380 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/200419635 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e900a2480 con 0x557a86d69380 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2e7affd700 1 -- 172.21.15.69:0/200419635 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e8c01fa50 con 0x557a86d69380 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2eadfdfb80 10 client.25636 fetch_fsmap learned FSMap version 28 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/200419635 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557a86c689a0 con 0x557a86d69380 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2e7affd700 1 -- 172.21.15.69:0/200419635 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e900a2480 con 0x557a86d69380 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2e7affd700 1 -- 172.21.15.69:0/200419635 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2e8c027050 con 0x557a86d69380 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2eadfdfb80 10 client.25636 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2eadfdfb80 10 client.25636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2eadfdfb80 20 client.25636 populate_metadata read hostname 'smithi069' 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557a86df2cd0 0x557a86df50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2eadfdfb80 4 client.25636 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.552+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/200419635 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557a86cb4a00 con 0x557a86df2cd0 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2e9affd700 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557a86df2cd0 0x557a86df50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2e7affd700 10 client.25636 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:16:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2e9affd700 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557a86df2cd0 0x557a86df50e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bab9dc431594177 server_cookie=30c0d371c3f12a43 in_seq=0 out_seq=0 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2e7affd700 1 -- 172.21.15.69:0/200419635 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557a86cb4a00 con 0x557a86df2cd0 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2e7affd700 10 client.25636 handle_command_reply: tid=0 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2eadfdfb80 1 client.25636 shutdown 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/200419635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 msgr2=0x557a86d94df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d94df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c027440 tx=0x7f2e8c0275c0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/200419635 shutdown_connections 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557a86df2cd0 0x557a86df50e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a86d74b50 0x557a86d936b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a86d69380 0x557a86d94df0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2eadfdfb80 1 --2- 172.21.15.69:0/200419635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a86d69c90 0x557a86d93170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2e7affd700 0 client.25636 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.553+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/200419635 >> 172.21.15.69:0/200419635 conn(0x557a86d5fca0 msgr2=0x557a86d741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/200419635 shutdown_connections 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2eadfdfb80 1 -- 172.21.15.69:0/200419635 wait complete. 2023-12-14T14:16:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2eadfdfb80 20 client.25636 trim_cache size 0 max 16384 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "6ac35f34-16ae-4d21-a087-3da5b8baaf4c": { 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6ac35f34-16ae-4d21-a087-3da5b8baaf4c", 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:16:03.559 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:16:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 -- 172.21.15.69:0/4261285873 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e840a12c0 msgr2=0x7f2e840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e840a12c0 0x7f2e840a3770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009d70 tx=0x7f2e8c011720 comp rx=0 tx=0).stop 2023-12-14T14:16:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 -- 172.21.15.69:0/4261285873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c0ffa40 msgr2=0x7f2e9c196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c0ffa40 0x7f2e9c196990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000e9c0 tx=0x7f2e9000ecd0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 -- 172.21.15.69:0/4261285873 shutdown_connections 2023-12-14T14:16:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2e840a12c0 0x7f2e840a3770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e9c10a890 0x7f2e9c19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e9c067980 0x7f2e9c196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 --2- 172.21.15.69:0/4261285873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c0ffa40 0x7f2e9c196990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 -- 172.21.15.69:0/4261285873 >> 172.21.15.69:0/4261285873 conn(0x7f2e9c074a60 msgr2=0x7f2e9c102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 -- 172.21.15.69:0/4261285873 shutdown_connections 2023-12-14T14:16:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:03.554+0000 7f2ea1e51700 1 -- 172.21.15.69:0/4261285873 wait complete. 2023-12-14T14:16:03.568 INFO:tasks.cephfs.filesystem:scrub status for tag:6ac35f34-16ae-4d21-a087-3da5b8baaf4c - {'path': '/', 'tag': '6ac35f34-16ae-4d21-a087-3da5b8baaf4c', 'options': 'recursive,force'} 2023-12-14T14:16:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:03 smithi119 ceph-mon[43834]: pgmap v165: 97 pgs: 97 active+clean; 641 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 491 op/s 2023-12-14T14:16:03.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:03 smithi069 ceph-mon[42034]: pgmap v165: 97 pgs: 97 active+clean; 641 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 491 op/s 2023-12-14T14:16:03.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:03 smithi081 ceph-mon[43371]: pgmap v165: 97 pgs: 97 active+clean; 641 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 491 op/s 2023-12-14T14:16:05.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:05 smithi119 ceph-mon[43834]: pgmap v166: 97 pgs: 97 active+clean; 632 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 671 op/s 2023-12-14T14:16:05.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:05 smithi069 ceph-mon[42034]: pgmap v166: 97 pgs: 97 active+clean; 632 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 671 op/s 2023-12-14T14:16:05.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:05 smithi081 ceph-mon[43371]: pgmap v166: 97 pgs: 97 active+clean; 632 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 671 op/s 2023-12-14T14:16:07.647 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:07 smithi081 ceph-mon[43371]: pgmap v167: 97 pgs: 97 active+clean; 632 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 444 op/s 2023-12-14T14:16:07.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:07 smithi119 ceph-mon[43834]: pgmap v167: 97 pgs: 97 active+clean; 632 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 444 op/s 2023-12-14T14:16:07.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:07 smithi069 ceph-mon[42034]: pgmap v167: 97 pgs: 97 active+clean; 632 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 444 op/s 2023-12-14T14:16:09.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:09 smithi119 ceph-mon[43834]: pgmap v168: 97 pgs: 97 active+clean; 632 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 444 op/s 2023-12-14T14:16:09.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:09 smithi069 ceph-mon[42034]: pgmap v168: 97 pgs: 97 active+clean; 632 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 444 op/s 2023-12-14T14:16:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:09 smithi081 ceph-mon[43371]: pgmap v168: 97 pgs: 97 active+clean; 632 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 444 op/s 2023-12-14T14:16:11.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:11 smithi119 ceph-mon[43834]: pgmap v169: 97 pgs: 97 active+clean; 647 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 614 op/s 2023-12-14T14:16:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:11 smithi069 ceph-mon[42034]: pgmap v169: 97 pgs: 97 active+clean; 647 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 614 op/s 2023-12-14T14:16:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:11 smithi081 ceph-mon[43371]: pgmap v169: 97 pgs: 97 active+clean; 647 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 614 op/s 2023-12-14T14:16:13.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:13 smithi119 ceph-mon[43834]: pgmap v170: 97 pgs: 97 active+clean; 647 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 349 op/s 2023-12-14T14:16:13.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:13 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:16:13.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:13 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:16:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:13 smithi069 ceph-mon[42034]: pgmap v170: 97 pgs: 97 active+clean; 647 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 349 op/s 2023-12-14T14:16:13.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:13 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:16:13.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:13 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:16:13.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:13 smithi081 ceph-mon[43371]: pgmap v170: 97 pgs: 97 active+clean; 647 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 349 op/s 2023-12-14T14:16:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:13 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:16:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:13 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:16:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:15 smithi119 ceph-mon[43834]: pgmap v171: 97 pgs: 97 active+clean; 668 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 555 op/s 2023-12-14T14:16:15.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:15 smithi069 ceph-mon[42034]: pgmap v171: 97 pgs: 97 active+clean; 668 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 555 op/s 2023-12-14T14:16:15.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:15 smithi081 ceph-mon[43371]: pgmap v171: 97 pgs: 97 active+clean; 668 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 555 op/s 2023-12-14T14:16:17.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:17 smithi081 ceph-mon[43371]: pgmap v172: 97 pgs: 97 active+clean; 668 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 375 op/s 2023-12-14T14:16:17.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:17 smithi119 ceph-mon[43834]: pgmap v172: 97 pgs: 97 active+clean; 668 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 375 op/s 2023-12-14T14:16:17.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:17 smithi069 ceph-mon[42034]: pgmap v172: 97 pgs: 97 active+clean; 668 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 375 op/s 2023-12-14T14:16:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:19 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:16:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:19 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:16:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:19 smithi119 ceph-mon[43834]: pgmap v173: 97 pgs: 97 active+clean; 668 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 375 op/s 2023-12-14T14:16:19.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:19 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:16:19.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:19 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:16:19.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:19 smithi069 ceph-mon[42034]: pgmap v173: 97 pgs: 97 active+clean; 668 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 375 op/s 2023-12-14T14:16:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:19 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:16:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:19 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:16:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:19 smithi081 ceph-mon[43371]: pgmap v173: 97 pgs: 97 active+clean; 668 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 375 op/s 2023-12-14T14:16:21.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:21 smithi119 ceph-mon[43834]: pgmap v174: 97 pgs: 97 active+clean; 676 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.7 MiB/s wr, 561 op/s 2023-12-14T14:16:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:21 smithi069 ceph-mon[42034]: pgmap v174: 97 pgs: 97 active+clean; 676 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.7 MiB/s wr, 561 op/s 2023-12-14T14:16:21.857 INFO:tasks.workunit.client.0.smithi069.stdout:cleaned up hierarchy 2023-12-14T14:16:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:21 smithi081 ceph-mon[43371]: pgmap v174: 97 pgs: 97 active+clean; 676 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.7 MiB/s wr, 561 op/s 2023-12-14T14:16:23.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:23 smithi119 ceph-mon[43834]: pgmap v175: 97 pgs: 97 active+clean; 676 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.8 MiB/s wr, 391 op/s 2023-12-14T14:16:23.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:23 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:16:23.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:23 smithi069 ceph-mon[42034]: pgmap v175: 97 pgs: 97 active+clean; 676 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.8 MiB/s wr, 391 op/s 2023-12-14T14:16:23.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:23 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:16:23.897 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:23 smithi081 ceph-mon[43371]: pgmap v175: 97 pgs: 97 active+clean; 676 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.8 MiB/s wr, 391 op/s 2023-12-14T14:16:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:23 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:16:25.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:25 smithi119 ceph-mon[43834]: pgmap v176: 97 pgs: 97 active+clean; 690 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.0 MiB/s wr, 545 op/s 2023-12-14T14:16:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:25 smithi069 ceph-mon[42034]: pgmap v176: 97 pgs: 97 active+clean; 690 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.0 MiB/s wr, 545 op/s 2023-12-14T14:16:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:25 smithi081 ceph-mon[43371]: pgmap v176: 97 pgs: 97 active+clean; 690 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.0 MiB/s wr, 545 op/s 2023-12-14T14:16:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:27 smithi081 ceph-mon[43371]: pgmap v177: 97 pgs: 97 active+clean; 690 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 339 op/s 2023-12-14T14:16:27.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:27 smithi119 ceph-mon[43834]: pgmap v177: 97 pgs: 97 active+clean; 690 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 339 op/s 2023-12-14T14:16:27.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:27 smithi069 ceph-mon[42034]: pgmap v177: 97 pgs: 97 active+clean; 690 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 339 op/s 2023-12-14T14:16:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:29 smithi119 ceph-mon[43834]: pgmap v178: 97 pgs: 97 active+clean; 690 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 339 op/s 2023-12-14T14:16:29.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:29 smithi069 ceph-mon[42034]: pgmap v178: 97 pgs: 97 active+clean; 690 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 339 op/s 2023-12-14T14:16:29.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:29 smithi081 ceph-mon[43371]: pgmap v178: 97 pgs: 97 active+clean; 690 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 339 op/s 2023-12-14T14:16:30.006 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T14:16:30.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T14:16:30.046 INFO:tasks.workunit:Running workunit fs/misc/filelock_deadlock.py... 2023-12-14T14:16:30.046 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/filelock_deadlock.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_deadlock.py 2023-12-14T14:16:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:31 smithi119 ceph-mon[43834]: pgmap v179: 97 pgs: 97 active+clean; 686 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.6 MiB/s wr, 428 op/s 2023-12-14T14:16:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:31 smithi069 ceph-mon[42034]: pgmap v179: 97 pgs: 97 active+clean; 686 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.6 MiB/s wr, 428 op/s 2023-12-14T14:16:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:31 smithi081 ceph-mon[43371]: pgmap v179: 97 pgs: 97 active+clean; 686 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.6 MiB/s wr, 428 op/s 2023-12-14T14:16:33.568 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.706+0000 7fcfa4335700 1 -- 172.21.15.69:0/1990132052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 msgr2=0x7fcf9c10cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.706+0000 7fcfa4335700 1 --2- 172.21.15.69:0/1990132052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 0x7fcf9c10cff0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400b0d0 tx=0x7fcf9400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.706+0000 7fcfa4335700 1 -- 172.21.15.69:0/1990132052 shutdown_connections 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.706+0000 7fcfa4335700 1 --2- 172.21.15.69:0/1990132052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 0x7fcf9c10cff0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.706+0000 7fcfa4335700 1 --2- 172.21.15.69:0/1990132052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9c106330 0x7fcf9c106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.706+0000 7fcfa4335700 1 --2- 172.21.15.69:0/1990132052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf9c1009e0 0x7fcf9c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.706+0000 7fcfa4335700 1 -- 172.21.15.69:0/1990132052 >> 172.21.15.69:0/1990132052 conn(0x7fcf9c0775c0 msgr2=0x7fcf9c0779c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.706+0000 7fcfa4335700 1 -- 172.21.15.69:0/1990132052 shutdown_connections 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.706+0000 7fcfa4335700 1 -- 172.21.15.69:0/1990132052 wait complete. 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa4335700 1 Processor -- start 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa4335700 1 -- start start 2023-12-14T14:16:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa4335700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf9c1009e0 0x7fcf9c072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa4335700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 0x7fcf9c073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa4335700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9c106330 0x7fcf9c1a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa4335700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c073b60 con 0x7fcf9c101390 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa4335700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c1a4b90 con 0x7fcf9c106330 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa4335700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c1a4cd0 con 0x7fcf9c1009e0 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa18d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 0x7fcf9c073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa18d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 0x7fcf9c073330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39888/0 (socket says 172.21.15.69:39888) 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa18d0700 1 -- 172.21.15.69:0/3878504502 learned_addr learned my addr 172.21.15.69:0/3878504502 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.707+0000 7fcfa28d2700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9c106330 0x7fcf9c1a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf9c1009e0 0x7fcf9c072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa18d0700 1 -- 172.21.15.69:0/3878504502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf9c1009e0 msgr2=0x7fcf9c072df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf9c1009e0 0x7fcf9c072df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa18d0700 1 -- 172.21.15.69:0/3878504502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9c106330 msgr2=0x7fcf9c1a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:33.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9c106330 0x7fcf9c1a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa18d0700 1 -- 172.21.15.69:0/3878504502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf94009d00 con 0x7fcf9c101390 2023-12-14T14:16:33.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf9c1009e0 0x7fcf9c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:16:33.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 0x7fcf9c073330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800d950 tx=0x7fcf9800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:33.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcf937fe700 1 -- 172.21.15.69:0/3878504502 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98009b40 con 0x7fcf9c101390 2023-12-14T14:16:33.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcf937fe700 1 -- 172.21.15.69:0/3878504502 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf98009ca0 con 0x7fcf9c101390 2023-12-14T14:16:33.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa4335700 1 -- 172.21.15.69:0/3878504502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c110360 con 0x7fcf9c101390 2023-12-14T14:16:33.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcf937fe700 1 -- 172.21.15.69:0/3878504502 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800f620 con 0x7fcf9c101390 2023-12-14T14:16:33.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.708+0000 7fcfa4335700 1 -- 172.21.15.69:0/3878504502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c1101d0 con 0x7fcf9c101390 2023-12-14T14:16:33.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.710+0000 7fcf937fe700 1 -- 172.21.15.69:0/3878504502 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcf98010460 con 0x7fcf9c101390 2023-12-14T14:16:33.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.710+0000 7fcf937fe700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fcf880a1340 0x7fcf880a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.711+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fcf880a1340 0x7fcf880a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.711+0000 7fcf937fe700 1 -- 172.21.15.69:0/3878504502 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fcf980cd020 con 0x7fcf9c101390 2023-12-14T14:16:33.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.711+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fcf880a1340 0x7fcf880a37f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009be0 tx=0x7fcf8c009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:33.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.711+0000 7fcfb04c3b80 1 Processor -- start 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfb04c3b80 1 -- start start 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 0x55e17229c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722a7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e1722a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1721865e0 con 0x55e17229cc90 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1721f5870 con 0x55e1722a7b50 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1721eed00 con 0x55e17229c380 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfa18d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfa18d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722a7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39898/0 (socket says 172.21.15.69:39898) 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfa18d0700 1 -- 172.21.15.69:0/2955120954 learned_addr learned my addr 172.21.15.69:0/2955120954 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/2955120954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 0x55e17229c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfa28d2700 1 --2- 172.21.15.69:0/2955120954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e1722a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfa18d0700 1 -- 172.21.15.69:0/2955120954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 msgr2=0x55e17229c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:33.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/2955120954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 0x55e17229c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfa18d0700 1 -- 172.21.15.69:0/2955120954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 msgr2=0x55e1722a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:33.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.712+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/2955120954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e1722a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.713+0000 7fcfa18d0700 1 -- 172.21.15.69:0/2955120954 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1720703b0 con 0x55e17229cc90 2023-12-14T14:16:33.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.713+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/2955120954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722a7610 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcf980a1ff0 tx=0x7fcf98099d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2552749bfb83bca server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:33.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.713+0000 7fcf90dac700 1 -- 172.21.15.69:0/2955120954 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980caea0 con 0x55e17229cc90 2023-12-14T14:16:33.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.713+0000 7fcf90dac700 1 -- 172.21.15.69:0/2955120954 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf9809e100 con 0x55e17229cc90 2023-12-14T14:16:33.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.713+0000 7fcf90dac700 1 -- 172.21.15.69:0/2955120954 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9809a330 con 0x55e17229cc90 2023-12-14T14:16:33.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2955120954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 msgr2=0x55e1722a7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:33.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2955120954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722a7610 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcf980a1ff0 tx=0x7fcf98099d10 comp rx=0 tx=0).stop 2023-12-14T14:16:33.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2955120954 shutdown_connections 2023-12-14T14:16:33.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2955120954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e1722a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2955120954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 0x55e17229c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2955120954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722a7610 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2955120954 >> 172.21.15.69:0/2955120954 conn(0x55e172292ca0 msgr2=0x55e1722987e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:33.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2955120954 shutdown_connections 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2955120954 wait complete. 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 -- start start 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.714+0000 7fcfb04c3b80 1 Processor -- start 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17229cc90 0x55e1722a4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1722a7b50 0x55e1722a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17218af90 con 0x55e17229c380 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17218ac30 con 0x55e17229cc90 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1720726a0 con 0x55e1722a7b50 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 10 client.0 _ll_register_callbacks cb 0x55e1721ae910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa20d1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa20d1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722a75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39912/0 (socket says 172.21.15.69:39912) 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa20d1700 1 -- 172.21.15.69:0/2803857728 learned_addr learned my addr 172.21.15.69:0/2803857728 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17229cc90 0x55e1722a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa28d2700 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1722a7b50 0x55e1722a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa20d1700 1 -- 172.21.15.69:0/2803857728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1722a7b50 msgr2=0x55e1722a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:33.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1722a7b50 0x55e1722a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa20d1700 1 -- 172.21.15.69:0/2803857728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17229cc90 msgr2=0x55e1722a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17229cc90 0x55e1722a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa20d1700 1 -- 172.21.15.69:0/2803857728 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c1101d0 con 0x55e17229c380 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722a75d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009430 tx=0x7fcf8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f554ee236081d5c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcf85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcf85ffb700 1 -- 172.21.15.69:0/2803857728 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c029470 con 0x55e17229c380 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcf85ffb700 1 -- 172.21.15.69:0/2803857728 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fcf8c0295d0 con 0x55e17229c380 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2803857728 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1722902b0 con 0x55e17229c380 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcf85ffb700 1 -- 172.21.15.69:0/2803857728 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf8c029790 con 0x55e17229c380 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 10 client.16149 fetch_fsmap learned FSMap version 28 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.715+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2803857728 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55e1721b5170 con 0x55e17229c380 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcf85ffb700 1 -- 172.21.15.69:0/2803857728 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e1722902b0 con 0x55e17229c380 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcf85ffb700 1 -- 172.21.15.69:0/2803857728 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fcf8c032510 con 0x55e17229c380 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcfb04c3b80 10 client.16149 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcfb04c3b80 10 client.16149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:16:33.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcfb04c3b80 20 client.16149 populate_metadata read hostname 'smithi069' 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e1722b74f0 0x55e1722b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcfb04c3b80 4 client.16149 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2803857728 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1721e7ce0 con 0x55e1722b74f0 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e1722b74f0 0x55e1722b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcf85ffb700 10 client.16149 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.716+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e1722b74f0 0x55e1722b9900 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbd020f08b0808fb server_cookie=4d901493262e81a6 in_seq=0 out_seq=0 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcf85ffb700 1 -- 172.21.15.69:0/2803857728 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e1721e7ce0 con 0x55e1722b74f0 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcf85ffb700 10 client.16149 handle_command_reply: tid=0 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 client.16149 shutdown 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2803857728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 msgr2=0x55e1722a75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722a75d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009430 tx=0x7fcf8c004750 comp rx=0 tx=0).stop 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2803857728 shutdown_connections 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e1722b74f0 0x55e1722b9900 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1722a7b50 0x55e1722a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722a75d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2803857728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17229cc90 0x55e1722a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2803857728 >> 172.21.15.69:0/2803857728 conn(0x55e172292ca0 msgr2=0x55e1722983d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcf85ffb700 0 client.16149 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:16:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2803857728 shutdown_connections 2023-12-14T14:16:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2803857728 wait complete. 2023-12-14T14:16:33.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.717+0000 7fcfb04c3b80 20 client.16149 trim_cache size 0 max 16384 2023-12-14T14:16:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.734+0000 7fcfb04c3b80 1 Processor -- start 2023-12-14T14:16:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.734+0000 7fcfb04c3b80 1 -- start start 2023-12-14T14:16:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.734+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.734+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229cc90 0x55e1722b9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e1722a7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1722b3480 con 0x55e17229c380 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1722b3ee0 con 0x55e1722a7b50 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1722a06f0 con 0x55e17229cc90 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa20d1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa20d1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39926/0 (socket says 172.21.15.69:39926) 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa20d1700 1 -- 172.21.15.69:0/2001567616 learned_addr learned my addr 172.21.15.69:0/2001567616 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa28d2700 1 --2- 172.21.15.69:0/2001567616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e1722a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa20d1700 1 -- 172.21.15.69:0/2001567616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229cc90 msgr2=0x55e1722b9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/2001567616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229cc90 0x55e1722b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa20d1700 1 -- 172.21.15.69:0/2001567616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 msgr2=0x55e1722a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/2001567616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e1722a7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa20d1700 1 -- 172.21.15.69:0/2001567616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1722944e0 con 0x55e17229c380 2023-12-14T14:16:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa28d2700 1 --2- 172.21.15.69:0/2001567616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e1722a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/2001567616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722ae5d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c015040 tx=0x7fcf8c010700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0efbb3a723f798 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcf915ad700 1 -- 172.21.15.69:0/2001567616 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c005b00 con 0x55e17229c380 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcf915ad700 1 -- 172.21.15.69:0/2001567616 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf8c032b60 con 0x55e17229c380 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.735+0000 7fcf915ad700 1 -- 172.21.15.69:0/2001567616 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c03bd40 con 0x55e17229c380 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2001567616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 msgr2=0x55e1722ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2001567616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722ae5d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c015040 tx=0x7fcf8c010700 comp rx=0 tx=0).stop 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2001567616 shutdown_connections 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2001567616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e1722a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2001567616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229c380 0x55e1722ae5d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/2001567616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229cc90 0x55e1722b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2001567616 >> 172.21.15.69:0/2001567616 conn(0x55e172292ca0 msgr2=0x55e1722b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2001567616 shutdown_connections 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/2001567616 wait complete. 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 -- start start 2023-12-14T14:16:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 Processor -- start 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 0x55e1722ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e17230a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17230a8f0 con 0x55e17229cc90 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17230aa30 con 0x55e1722a7b50 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17230ab70 con 0x55e17229c380 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfb04c3b80 10 client.0 _ll_register_callbacks cb 0x7fcf8c010b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.736+0000 7fcfa18d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa18d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722acce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39940/0 (socket says 172.21.15.69:39940) 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa18d0700 1 -- 172.21.15.69:0/3922961552 learned_addr learned my addr 172.21.15.69:0/3922961552 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa28d2700 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e17230a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 0x55e1722ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa18d0700 1 -- 172.21.15.69:0/3922961552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 msgr2=0x55e1722ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 0x55e1722ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa18d0700 1 -- 172.21.15.69:0/3922961552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 msgr2=0x55e17230a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e17230a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa18d0700 1 -- 172.21.15.69:0/3922961552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1721b5170 con 0x55e17229cc90 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa28d2700 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e17230a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfa18d0700 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722acce0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcf980a26e0 tx=0x7fcf98099ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868d1b7519d92461 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcf85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcf85ffb700 1 -- 172.21.15.69:0/3922961552 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980caea0 con 0x55e17229cc90 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcf85ffb700 1 -- 172.21.15.69:0/3922961552 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7fcf980967e0 con 0x55e17229cc90 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/3922961552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf9809e100 con 0x55e17229cc90 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcf85ffb700 1 -- 172.21.15.69:0/3922961552 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf98010710 con 0x55e17229cc90 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfb04c3b80 10 client.16155 fetch_fsmap learned FSMap version 28 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/3922961552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55e17201cb60 con 0x55e17229cc90 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcf85ffb700 1 -- 172.21.15.69:0/3922961552 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf980ca020 con 0x55e17229cc90 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcf85ffb700 1 -- 172.21.15.69:0/3922961552 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fcf9809a330 con 0x55e17229cc90 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfb04c3b80 10 client.16155 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfb04c3b80 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:16:33.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.737+0000 7fcfb04c3b80 20 client.16155 populate_metadata read hostname 'smithi069' 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e17230be40 0x55e17230e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 4 client.16155 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/3922961552 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e1721e7a00 con 0x55e17230be40 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e17230be40 0x55e17230e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcf85ffb700 10 client.16155 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfa20d1700 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e17230be40 0x55e17230e250 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c37789702be5635d server_cookie=cfb8a1ed863ebcb6 in_seq=0 out_seq=0 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcf85ffb700 1 -- 172.21.15.69:0/3922961552 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e1721e7a00 con 0x55e17230be40 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcf85ffb700 10 client.16155 handle_command_reply: tid=0 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 client.16155 shutdown 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/3922961552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 msgr2=0x55e1722acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722acce0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcf980a26e0 tx=0x7fcf98099ea0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/3922961552 shutdown_connections 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55e17230be40 0x55e17230e250 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1722a7b50 0x55e17230a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e17229c380 0x55e1722ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcf85ffb700 0 client.16155 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 --2- 172.21.15.69:0/3922961552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e17229cc90 0x55e1722acce0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/3922961552 >> 172.21.15.69:0/3922961552 conn(0x55e172292ca0 msgr2=0x55e1722b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.738+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/3922961552 shutdown_connections 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfb04c3b80 1 -- 172.21.15.69:0/3922961552 wait complete. 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfb04c3b80 20 client.16155 trim_cache size 0 max 16384 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stdout: "6ac35f34-16ae-4d21-a087-3da5b8baaf4c": { 2023-12-14T14:16:33.744 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:16:33.745 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6ac35f34-16ae-4d21-a087-3da5b8baaf4c", 2023-12-14T14:16:33.745 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:16:33.745 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:16:33.745 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:16:33.745 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:16:33.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 -- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fcf880a1340 msgr2=0x7fcf880a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:33.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fcf880a1340 0x7fcf880a37f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009be0 tx=0x7fcf8c009260 comp rx=0 tx=0).stop 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 -- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 msgr2=0x7fcf9c073330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 0x7fcf9c073330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800d950 tx=0x7fcf9800dd10 comp rx=0 tx=0).stop 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 -- 172.21.15.69:0/3878504502 shutdown_connections 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fcf880a1340 0x7fcf880a37f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9c106330 0x7fcf9c1a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf9c1009e0 0x7fcf9c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 --2- 172.21.15.69:0/3878504502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf9c101390 0x7fcf9c073330 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 -- 172.21.15.69:0/3878504502 >> 172.21.15.69:0/3878504502 conn(0x7fcf9c0775c0 msgr2=0x7fcf9c103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 -- 172.21.15.69:0/3878504502 shutdown_connections 2023-12-14T14:16:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:16:33.739+0000 7fcfa4335700 1 -- 172.21.15.69:0/3878504502 wait complete. 2023-12-14T14:16:33.749 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:33 smithi069 ceph-mon[42034]: pgmap v180: 97 pgs: 97 active+clean; 686 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 242 op/s 2023-12-14T14:16:33.750 INFO:tasks.cephfs.filesystem:scrub status for tag:6ac35f34-16ae-4d21-a087-3da5b8baaf4c - {'path': '/', 'tag': '6ac35f34-16ae-4d21-a087-3da5b8baaf4c', 'options': 'recursive,force'} 2023-12-14T14:16:33.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:33 smithi119 ceph-mon[43834]: pgmap v180: 97 pgs: 97 active+clean; 686 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 242 op/s 2023-12-14T14:16:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:33 smithi081 ceph-mon[43371]: pgmap v180: 97 pgs: 97 active+clean; 686 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 242 op/s 2023-12-14T14:16:35.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:35 smithi119 ceph-mon[43834]: pgmap v181: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 262 op/s 2023-12-14T14:16:35.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:35 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:16:35.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:35 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:16:35.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:35 smithi069 ceph-mon[42034]: pgmap v181: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 262 op/s 2023-12-14T14:16:35.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:35 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:16:35.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:35 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:16:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:35 smithi081 ceph-mon[43371]: pgmap v181: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 262 op/s 2023-12-14T14:16:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:35 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:16:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:35 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:16:36.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:36 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:16:36.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:36 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:16:36.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:36 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:16:37.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:37 smithi119 ceph-mon[43834]: pgmap v182: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 87 KiB/s wr, 108 op/s 2023-12-14T14:16:37.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:37 smithi069 ceph-mon[42034]: pgmap v182: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 87 KiB/s wr, 108 op/s 2023-12-14T14:16:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:37 smithi081 ceph-mon[43371]: pgmap v182: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 87 KiB/s wr, 108 op/s 2023-12-14T14:16:39.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:39 smithi119 ceph-mon[43834]: pgmap v183: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 87 KiB/s wr, 108 op/s 2023-12-14T14:16:39.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:39 smithi069 ceph-mon[42034]: pgmap v183: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 87 KiB/s wr, 108 op/s 2023-12-14T14:16:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:39 smithi081 ceph-mon[43371]: pgmap v183: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 87 KiB/s wr, 108 op/s 2023-12-14T14:16:40.165 INFO:tasks.workunit.client.0.smithi069.stdout:ok 2023-12-14T14:16:40.170 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T14:16:40.170 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T14:16:40.220 INFO:tasks.workunit:Running workunit fs/misc/filelock_interrupt.py... 2023-12-14T14:16:40.220 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/filelock_interrupt.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_interrupt.py 2023-12-14T14:16:41.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:41 smithi119 ceph-mon[43834]: pgmap v184: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 118 KiB/s wr, 112 op/s 2023-12-14T14:16:41.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:41 smithi069 ceph-mon[42034]: pgmap v184: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 118 KiB/s wr, 112 op/s 2023-12-14T14:16:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:41 smithi081 ceph-mon[43371]: pgmap v184: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 118 KiB/s wr, 112 op/s 2023-12-14T14:16:43.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:43 smithi119 ceph-mon[43834]: pgmap v185: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 70 KiB/s wr, 23 op/s 2023-12-14T14:16:43.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:43 smithi069 ceph-mon[42034]: pgmap v185: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 70 KiB/s wr, 23 op/s 2023-12-14T14:16:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:43 smithi081 ceph-mon[43371]: pgmap v185: 97 pgs: 97 active+clean; 687 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 70 KiB/s wr, 23 op/s 2023-12-14T14:16:45.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:45 smithi119 ceph-mon[43834]: pgmap v186: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 89 KiB/s wr, 27 op/s 2023-12-14T14:16:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:45 smithi069 ceph-mon[42034]: pgmap v186: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 89 KiB/s wr, 27 op/s 2023-12-14T14:16:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:45 smithi081 ceph-mon[43371]: pgmap v186: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 89 KiB/s wr, 27 op/s 2023-12-14T14:16:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:47 smithi081 ceph-mon[43371]: pgmap v187: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-12-14T14:16:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:47 smithi119 ceph-mon[43834]: pgmap v187: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-12-14T14:16:47.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:47 smithi069 ceph-mon[42034]: pgmap v187: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-12-14T14:16:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:49 smithi119 ceph-mon[43834]: pgmap v188: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-12-14T14:16:49.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:49 smithi069 ceph-mon[42034]: pgmap v188: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-12-14T14:16:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:49 smithi081 ceph-mon[43371]: pgmap v188: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-12-14T14:16:50.274 INFO:tasks.workunit.client.0.smithi069.stdout:ok 2023-12-14T14:16:50.279 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T14:16:50.279 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T14:16:50.326 INFO:tasks.workunit:Running workunit fs/misc/general_vxattrs.sh... 2023-12-14T14:16:50.326 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/general_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/general_vxattrs.sh 2023-12-14T14:16:50.366 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir -p dir 2023-12-14T14:16:50.369 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.pin dir 2023-12-14T14:16:50.369 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'ceph.dir.pin="-1"' 2023-12-14T14:16:50.370 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.dir.pin="-1" 2023-12-14T14:16:50.370 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin dir 2023-12-14T14:16:50.370 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.371 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.372 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin -v 1 dir 2023-12-14T14:16:50.373 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.pin dir 2023-12-14T14:16:50.373 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'ceph.dir.pin="1"' 2023-12-14T14:16:50.374 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.dir.pin="1" 2023-12-14T14:16:50.375 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.pin dir 2023-12-14T14:16:50.376 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.pin dir 2023-12-14T14:16:50.376 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'ceph.dir.pin="-1"' 2023-12-14T14:16:50.377 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.dir.pin="-1" 2023-12-14T14:16:50.378 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin.distributed dir 2023-12-14T14:16:50.378 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.379 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.379 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin.distributed -v 1 dir 2023-12-14T14:16:50.381 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.pin.distributed dir 2023-12-14T14:16:50.382 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin.random dir 2023-12-14T14:16:50.382 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.383 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.383 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin.random -v 0.01 dir 2023-12-14T14:16:50.385 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.pin.random dir 2023-12-14T14:16:50.387 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.quota.max_bytes dir 2023-12-14T14:16:50.387 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.388 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.388 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.quota.max_bytes -v 100000000 dir 2023-12-14T14:16:50.398 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.quota.max_bytes dir 2023-12-14T14:16:50.403 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.quota.max_files dir 2023-12-14T14:16:50.403 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.404 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.404 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.quota.max_files -v 10000 dir 2023-12-14T14:16:50.407 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.quota.max_files dir 2023-12-14T14:16:50.412 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir dir 2023-12-14T14:16:50.415 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo OK 2023-12-14T14:16:50.416 INFO:tasks.workunit.client.0.smithi069.stdout:OK 2023-12-14T14:16:50.416 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T14:16:50.417 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T14:16:50.497 INFO:tasks.workunit:Running workunit fs/misc/i_complete_vs_rename.sh... 2023-12-14T14:16:50.497 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/i_complete_vs_rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/i_complete_vs_rename.sh 2023-12-14T14:16:50.576 INFO:tasks.workunit.client.0.smithi069.stdout:a 2023-12-14T14:16:50.576 INFO:tasks.workunit.client.0.smithi069.stdout:b 2023-12-14T14:16:50.576 INFO:tasks.workunit.client.0.smithi069.stdout:c 2023-12-14T14:16:50.576 INFO:tasks.workunit.client.0.smithi069.stdout:d 2023-12-14T14:16:50.589 INFO:tasks.workunit.client.0.smithi069.stderr:stat: cannot statx 'e': No such file or directory 2023-12-14T14:16:50.594 INFO:tasks.workunit.client.0.smithi069.stdout:attempting rename over existing file... 2023-12-14T14:16:50.616 INFO:tasks.workunit.client.0.smithi069.stdout:f 2023-12-14T14:16:50.616 INFO:tasks.workunit.client.0.smithi069.stdout:rename over existing file is okay 2023-12-14T14:16:50.616 INFO:tasks.workunit.client.0.smithi069.stdout:attempting rename over negative dentry... 2023-12-14T14:16:50.626 INFO:tasks.workunit.client.0.smithi069.stdout:e 2023-12-14T14:16:50.626 INFO:tasks.workunit.client.0.smithi069.stdout:rename over negative dentry is ok 2023-12-14T14:16:50.626 INFO:tasks.workunit.client.0.smithi069.stdout:OK 2023-12-14T14:16:50.627 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T14:16:50.627 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T14:16:50.733 INFO:tasks.workunit:Running workunit fs/misc/layout_vxattrs.sh... 2023-12-14T14:16:50.733 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/layout_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh 2023-12-14T14:16:50.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ datapool= 2023-12-14T14:16:50.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ dir=. 2023-12-14T14:16:50.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T14:16:50.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo . 2023-12-14T14:16:50.757 INFO:tasks.workunit.client.0.smithi069.stdout:. 2023-12-14T14:16:50.757 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout.pool . --only-values 2023-12-14T14:16:50.758 INFO:tasks.workunit.client.0.smithi069.stderr:.: ceph.dir.layout.pool: No such attribute 2023-12-14T14:16:50.758 INFO:tasks.workunit.client.0.smithi069.stderr:+ datapool= 2023-12-14T14:16:50.758 INFO:tasks.workunit.client.0.smithi069.stderr:+ dir=./.. 2023-12-14T14:16:50.758 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T14:16:50.758 INFO:tasks.workunit.client.0.smithi069.stdout:./.. 2023-12-14T14:16:50.759 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo ./.. 2023-12-14T14:16:50.759 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout.pool ./.. --only-values 2023-12-14T14:16:50.759 INFO:tasks.workunit.client.0.smithi069.stderr:./..: ceph.dir.layout.pool: No such attribute 2023-12-14T14:16:50.759 INFO:tasks.workunit.client.0.smithi069.stderr:+ datapool= 2023-12-14T14:16:50.760 INFO:tasks.workunit.client.0.smithi069.stderr:+ dir=./../.. 2023-12-14T14:16:50.760 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T14:16:50.760 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo ./../.. 2023-12-14T14:16:50.760 INFO:tasks.workunit.client.0.smithi069.stdout:./../.. 2023-12-14T14:16:50.760 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout.pool ./../.. --only-values 2023-12-14T14:16:50.761 INFO:tasks.workunit.client.0.smithi069.stderr:+ datapool=cephfs_data 2023-12-14T14:16:50.761 INFO:tasks.workunit.client.0.smithi069.stderr:+ break 2023-12-14T14:16:50.761 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -f file file2 2023-12-14T14:16:50.761 INFO:tasks.workunit.client.0.smithi069.stderr:+ touch file file2 2023-12-14T14:16:50.764 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T14:16:50.765 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T14:16:50.765 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data" 2023-12-14T14:16:50.765 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T14:16:50.766 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T14:16:50.766 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q object_size= 2023-12-14T14:16:50.767 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T14:16:50.767 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q stripe_count= 2023-12-14T14:16:50.769 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T14:16:50.769 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q stripe_unit= 2023-12-14T14:16:50.770 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T14:16:50.770 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q pool= 2023-12-14T14:16:50.771 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file 2023-12-14T14:16:50.773 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T14:16:50.773 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.pool="cephfs_data" 2023-12-14T14:16:50.773 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T14:16:50.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file 2023-12-14T14:16:50.774 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T14:16:50.774 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.pool_namespace="" 2023-12-14T14:16:50.774 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T14:16:50.774 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file 2023-12-14T14:16:50.775 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T14:16:50.776 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.stripe_unit="4194304" 2023-12-14T14:16:50.776 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T14:16:50.776 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file 2023-12-14T14:16:50.777 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T14:16:50.777 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.stripe_count="1" 2023-12-14T14:16:50.777 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T14:16:50.777 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file 2023-12-14T14:16:50.778 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T14:16:50.778 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.object_size="4194304" 2023-12-14T14:16:50.778 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T14:16:50.779 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.bogus file 2023-12-14T14:16:50.779 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 'No such attribute' 2023-12-14T14:16:50.779 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout file 2023-12-14T14:16:50.779 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 'No such attribute' 2023-12-14T14:16:50.780 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.stripe_unit -v 1048576 file2 2023-12-14T14:16:50.786 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.stripe_count -v 8 file2 2023-12-14T14:16:50.791 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.object_size -v 10485760 file2 2023-12-14T14:16:50.797 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.pool -v cephfs_data file2 2023-12-14T14:16:50.804 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file2 2023-12-14T14:16:50.804 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T14:16:50.805 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.pool_namespace -v foons file2 2023-12-14T14:16:50.810 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T14:16:50.810 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q foons 2023-12-14T14:16:50.811 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool_namespace file2 2023-12-14T14:16:50.816 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T14:16:50.816 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q -v foons 2023-12-14T14:16:50.817 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2023-12-14T14:16:50.817 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 1048576 2023-12-14T14:16:50.819 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T14:16:50.819 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 8 2023-12-14T14:16:50.820 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file2 2023-12-14T14:16:50.820 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 10485760 2023-12-14T14:16:50.822 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=4194304 stripe_count=16 object_size=41943040 pool=cephfs_data pool_namespace=foons' file2 2023-12-14T14:16:50.826 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2023-12-14T14:16:50.826 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 4194304 2023-12-14T14:16:50.828 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T14:16:50.828 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 16 2023-12-14T14:16:50.829 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file2 2023-12-14T14:16:50.829 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 41943040 2023-12-14T14:16:50.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file2 2023-12-14T14:16:50.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T14:16:50.832 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T14:16:50.833 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q foons 2023-12-14T14:16:50.834 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v stripe_unit=1048576 file2 2023-12-14T14:16:50.841 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2023-12-14T14:16:50.841 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 1048576 2023-12-14T14:16:50.842 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T14:16:50.842 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 16 2023-12-14T14:16:50.844 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file2 2023-12-14T14:16:50.844 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 41943040 2023-12-14T14:16:50.845 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file2 2023-12-14T14:16:50.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T14:16:50.847 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T14:16:50.847 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q foons 2023-12-14T14:16:50.849 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=2097152 stripe_count=4 object_size=2097152 pool=cephfs_data pool_namespace=barns' file2 2023-12-14T14:16:50.854 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2023-12-14T14:16:50.854 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 2097152 2023-12-14T14:16:50.856 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T14:16:50.856 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 4 2023-12-14T14:16:50.857 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file2 2023-12-14T14:16:50.857 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 2097152 2023-12-14T14:16:50.859 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file2 2023-12-14T14:16:50.859 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T14:16:50.861 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T14:16:50.861 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q barns 2023-12-14T14:16:50.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -f dir/file 2023-12-14T14:16:50.863 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir dir 2023-12-14T14:16:50.864 INFO:tasks.workunit.client.0.smithi069.stderr:rmdir: failed to remove 'dir': No such file or directory 2023-12-14T14:16:50.864 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T14:16:50.864 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir -p dir 2023-12-14T14:16:50.866 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -d -m - dir 2023-12-14T14:16:50.866 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q ceph.dir.layout 2023-12-14T14:16:50.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T14:16:50.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -d -m - dir 2023-12-14T14:16:50.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q ceph.file.layout 2023-12-14T14:16:50.868 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T14:16:50.868 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T14:16:50.869 INFO:tasks.workunit.client.0.smithi069.stderr:dir: ceph.dir.layout: No such attribute 2023-12-14T14:16:50.869 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T14:16:50.869 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.stripe_unit -v 1048576 dir 2023-12-14T14:16:50.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.stripe_count -v 8 dir 2023-12-14T14:16:50.879 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.object_size -v 10485760 dir 2023-12-14T14:16:50.883 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.pool -v cephfs_data dir 2023-12-14T14:16:50.887 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.pool_namespace -v dirns dir 2023-12-14T14:16:50.891 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T14:16:50.892 INFO:tasks.workunit.client.0.smithi069.stdout:# file: dir 2023-12-14T14:16:50.892 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.dir.layout="stripe_unit=1048576 stripe_count=8 object_size=10485760 pool=cephfs_data pool_namespace=dirns" 2023-12-14T14:16:50.892 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T14:16:50.892 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T14:16:50.892 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q object_size=10485760 2023-12-14T14:16:50.893 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T14:16:50.893 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q stripe_count=8 2023-12-14T14:16:50.895 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T14:16:50.895 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q stripe_unit=1048576 2023-12-14T14:16:50.896 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T14:16:50.896 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q pool=cephfs_data 2023-12-14T14:16:50.898 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T14:16:50.898 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q pool_namespace=dirns 2023-12-14T14:16:50.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.pool dir 2023-12-14T14:16:50.900 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T14:16:50.901 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.stripe_unit dir 2023-12-14T14:16:50.901 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 1048576 2023-12-14T14:16:50.902 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.stripe_count dir 2023-12-14T14:16:50.902 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 8 2023-12-14T14:16:50.903 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.object_size dir 2023-12-14T14:16:50.904 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 10485760 2023-12-14T14:16:50.905 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.pool_namespace dir 2023-12-14T14:16:50.905 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q dirns 2023-12-14T14:16:50.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v stripe_count=16 file2 2023-12-14T14:16:50.907 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T14:16:50.908 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 16 2023-12-14T14:16:50.908 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v 'object_size=10485760 stripe_count=8 stripe_unit=1048576 pool=cephfs_data pool_namespace=dirns' file2 2023-12-14T14:16:50.913 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T14:16:50.913 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 8 2023-12-14T14:16:50.914 INFO:tasks.workunit.client.0.smithi069.stderr:+ touch dir/file 2023-12-14T14:16:50.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool dir/file 2023-12-14T14:16:50.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T14:16:50.917 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit dir/file 2023-12-14T14:16:50.917 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 1048576 2023-12-14T14:16:50.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count dir/file 2023-12-14T14:16:50.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 8 2023-12-14T14:16:50.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size dir/file 2023-12-14T14:16:50.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 10485760 2023-12-14T14:16:50.920 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace dir/file 2023-12-14T14:16:50.920 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q dirns 2023-12-14T14:16:50.922 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.pool dir 2023-12-14T14:16:50.922 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.926 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.pool_id dir 2023-12-14T14:16:50.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.928 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.pool_name dir 2023-12-14T14:16:50.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.930 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.930 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.stripe_unit dir 2023-12-14T14:16:50.931 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.932 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.932 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.stripe_count dir 2023-12-14T14:16:50.932 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.934 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.934 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.object_size dir 2023-12-14T14:16:50.934 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T14:16:50.936 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T14:16:50.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool dir/file 2023-12-14T14:16:50.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T14:16:50.937 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T14:16:50.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool_id dir/file 2023-12-14T14:16:50.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T14:16:50.938 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T14:16:50.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool_name dir/file 2023-12-14T14:16:50.939 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T14:16:50.939 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T14:16:50.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.stripe_unit dir/file 2023-12-14T14:16:50.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T14:16:50.940 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T14:16:50.941 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.stripe_count dir/file 2023-12-14T14:16:50.941 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T14:16:50.941 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T14:16:50.942 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.object_size dir/file 2023-12-14T14:16:50.942 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T14:16:50.942 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T14:16:50.943 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool_namespace dir/file 2023-12-14T14:16:50.947 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.pool_namespace dir 2023-12-14T14:16:50.952 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T14:16:50.952 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q -v pool_namespace=dirns 2023-12-14T14:16:50.953 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout dir 2023-12-14T14:16:50.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T14:16:50.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 'No such attribute' 2023-12-14T14:16:50.958 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout . 2023-12-14T14:16:50.958 INFO:tasks.workunit.client.0.smithi069.stderr:++ sed -n 2,2p 2023-12-14T14:16:50.959 INFO:tasks.workunit.client.0.smithi069.stderr:.: ceph.dir.layout: No such attribute 2023-12-14T14:16:50.959 INFO:tasks.workunit.client.0.smithi069.stderr:+ DEFAULT_LAYOUT= 2023-12-14T14:16:50.959 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout -v 'stripe_unit=131072 stripe_count=2 object_size=131072' . 2023-12-14T14:16:50.964 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout . 2023-12-14T14:16:50.964 INFO:tasks.workunit.client.0.smithi069.stderr:++ sed -n 2,2p 2023-12-14T14:16:50.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T14:16:50.966 INFO:tasks.workunit.client.0.smithi069.stderr:+ CHANGED_LAYOUT='ceph.dir.layout="stripe_unit=131072 stripe_count=2 object_size=131072 pool=cephfs_data"' 2023-12-14T14:16:50.966 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 'ceph.dir.layout="stripe_unit=131072 stripe_count=2 object_size=131072 pool=cephfs_data"' == 'ceph.dir.layout="stripe_unit=131072 stripe_count=2 object_size=131072 pool=cephfs.a.data"' ']' 2023-12-14T14:16:50.966 INFO:tasks.workunit:Stopping ['fs/misc'] on client.0... 2023-12-14T14:16:50.966 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-14T14:16:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:51 smithi119 ceph-mon[43834]: pgmap v189: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 11 op/s 2023-12-14T14:16:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:51 smithi069 ceph-mon[42034]: pgmap v189: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 11 op/s 2023-12-14T14:16:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:51 smithi081 ceph-mon[43371]: pgmap v189: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 11 op/s 2023-12-14T14:16:52.041 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi069 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh' 2023-12-14T14:16:52.145 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7177138649364c3d802a45aa3932a79e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi069 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh' 2023-12-14T14:16:52.148 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-12-14T14:16:52.157 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-12-14T14:16:52.157 INFO:teuthology.task.exec:Executing custom commands... 2023-12-14T14:16:52.158 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T14:16:52.158 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-12-14T14:16:52.204 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-12-14T14:16:53.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:53 smithi119 ceph-mon[43834]: pgmap v190: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-12-14T14:16:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:53 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:16:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:53 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:16:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:53 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:16:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:53 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:16:53.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:53 smithi069 ceph-mon[42034]: pgmap v190: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-12-14T14:16:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:53 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:16:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:53 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:16:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:53 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:16:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:53 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:16:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:53 smithi081 ceph-mon[43371]: pgmap v190: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-12-14T14:16:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:53 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:16:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:53 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:16:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:53 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:16:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:53 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:16:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:54 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:16:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:54 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:16:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:54 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:16:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:54 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:16:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:54 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:16:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:54 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:16:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:54 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:16:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:54 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:16:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:54 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:16:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:54 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:16:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:54 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:16:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:54 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:16:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:55 smithi119 ceph-mon[43834]: pgmap v191: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 13 op/s 2023-12-14T14:16:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:55 smithi069 ceph-mon[42034]: pgmap v191: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 13 op/s 2023-12-14T14:16:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:55 smithi081 ceph-mon[43371]: pgmap v191: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 13 op/s 2023-12-14T14:16:57.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:57 smithi081 ceph-mon[43371]: pgmap v192: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-12-14T14:16:57.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:57 smithi119 ceph-mon[43834]: pgmap v192: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-12-14T14:16:57.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:57 smithi069 ceph-mon[42034]: pgmap v192: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-12-14T14:16:59.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:16:59 smithi119 ceph-mon[43834]: pgmap v193: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-12-14T14:16:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:16:59 smithi069 ceph-mon[42034]: pgmap v193: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-12-14T14:16:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:16:59 smithi081 ceph-mon[43371]: pgmap v193: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-12-14T14:17:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:01 smithi119 ceph-mon[43834]: pgmap v194: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 13 op/s 2023-12-14T14:17:01.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:01 smithi069 ceph-mon[42034]: pgmap v194: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 13 op/s 2023-12-14T14:17:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:01 smithi081 ceph-mon[43371]: pgmap v194: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 13 op/s 2023-12-14T14:17:03.751 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:17:03.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:03 smithi119 ceph-mon[43834]: pgmap v195: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-12-14T14:17:03.781 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:03 smithi069 ceph-mon[42034]: pgmap v195: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-12-14T14:17:03.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 -- 172.21.15.69:0/864144492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5014104d70 msgr2=0x7f501410b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:03.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 --2- 172.21.15.69:0/864144492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5014104d70 0x7f501410b750 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f500c00b0d0 tx=0x7f500c00b3e0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 -- 172.21.15.69:0/864144492 shutdown_connections 2023-12-14T14:17:03.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 --2- 172.21.15.69:0/864144492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5014104d70 0x7f501410b750 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 --2- 172.21.15.69:0/864144492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50140ff6e0 0x7f50140ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 --2- 172.21.15.69:0/864144492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5014100080 0x7f5014104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 -- 172.21.15.69:0/864144492 >> 172.21.15.69:0/864144492 conn(0x7f5014074a60 msgr2=0x7f5014074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:03.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 -- 172.21.15.69:0/864144492 shutdown_connections 2023-12-14T14:17:03.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 -- 172.21.15.69:0/864144492 wait complete. 2023-12-14T14:17:03.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 Processor -- start 2023-12-14T14:17:03.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 -- start start 2023-12-14T14:17:03.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.888+0000 7f501be2f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50140ff6e0 0x7f5014195330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f501be2f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5014100080 0x7f5014195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f501be2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5014104d70 0x7f5014199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f501be2f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501419a310 con 0x7f50140ff6e0 2023-12-14T14:17:03.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f501be2f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501419a480 con 0x7f5014104d70 2023-12-14T14:17:03.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f501be2f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501419a640 con 0x7f5014100080 2023-12-14T14:17:03.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f5019bcb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50140ff6e0 0x7f5014195330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f5019bcb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50140ff6e0 0x7f5014195330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55462/0 (socket says 172.21.15.69:55462) 2023-12-14T14:17:03.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f5019bcb700 1 -- 172.21.15.69:0/1695465556 learned_addr learned my addr 172.21.15.69:0/1695465556 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:03.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f50193ca700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5014100080 0x7f5014195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f501a3cc700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5014104d70 0x7f5014199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f5019bcb700 1 -- 172.21.15.69:0/1695465556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5014100080 msgr2=0x7f5014195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:03.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5014100080 0x7f5014195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f5019bcb700 1 -- 172.21.15.69:0/1695465556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5014104d70 msgr2=0x7f5014199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:03.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5014104d70 0x7f5014199cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f5019bcb700 1 -- 172.21.15.69:0/1695465556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c009d00 con 0x7f50140ff6e0 2023-12-14T14:17:03.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f501a3cc700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5014104d70 0x7f5014199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:03.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50140ff6e0 0x7f5014195330 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5010007b50 tx=0x7f5010007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:03.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f500affd700 1 -- 172.21.15.69:0/1695465556 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010011070 con 0x7f50140ff6e0 2023-12-14T14:17:03.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f500affd700 1 -- 172.21.15.69:0/1695465556 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f501000c2e0 con 0x7f50140ff6e0 2023-12-14T14:17:03.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f501be2f700 1 -- 172.21.15.69:0/1695465556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501410f270 con 0x7f50140ff6e0 2023-12-14T14:17:03.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f500affd700 1 -- 172.21.15.69:0/1695465556 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000aa30 con 0x7f50140ff6e0 2023-12-14T14:17:03.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.889+0000 7f501be2f700 1 -- 172.21.15.69:0/1695465556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501410f0e0 con 0x7f50140ff6e0 2023-12-14T14:17:03.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:03 smithi081 ceph-mon[43371]: pgmap v195: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-12-14T14:17:03.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.891+0000 7f500affd700 1 -- 172.21.15.69:0/1695465556 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f501000ec80 con 0x7f50140ff6e0 2023-12-14T14:17:03.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.892+0000 7f500affd700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50000a12c0 0x7f50000a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.892+0000 7f500affd700 1 -- 172.21.15.69:0/1695465556 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f50100cdae0 con 0x7f50140ff6e0 2023-12-14T14:17:03.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.892+0000 7f50193ca700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50000a12c0 0x7f50000a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.892+0000 7f50193ca700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50000a12c0 0x7f50000a3770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5004005fd0 tx=0x7f500400a560 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:03.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.893+0000 7f5027fbdb80 1 Processor -- start 2023-12-14T14:17:03.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.893+0000 7f5027fbdb80 1 -- start start 2023-12-14T14:17:03.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.893+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251acc380 0x557251acc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.893+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 0x557251ad7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.893+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ad7b50 0x557251ad9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.893+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572519b65e0 con 0x557251acc380 2023-12-14T14:17:03.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.893+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557251a25870 con 0x557251accc90 2023-12-14T14:17:03.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.893+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557251a1ed00 con 0x557251ad7b50 2023-12-14T14:17:03.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.893+0000 7f5019bcb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251acc380 0x557251acc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f5019bcb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251acc380 0x557251acc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55476/0 (socket says 172.21.15.69:55476) 2023-12-14T14:17:03.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f5019bcb700 1 -- 172.21.15.69:0/1072031622 learned_addr learned my addr 172.21.15.69:0/1072031622 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:03.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f501a3cc700 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ad7b50 0x557251ad9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f50193ca700 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 0x557251ad7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f5019bcb700 1 -- 172.21.15.69:0/1072031622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ad7b50 msgr2=0x557251ad9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:03.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ad7b50 0x557251ad9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f5019bcb700 1 -- 172.21.15.69:0/1072031622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 msgr2=0x557251ad7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:03.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 0x557251ad7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f5019bcb700 1 -- 172.21.15.69:0/1072031622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572518a03b0 con 0x557251acc380 2023-12-14T14:17:03.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f501a3cc700 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ad7b50 0x557251ad9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:03.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f50193ca700 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 0x557251ad7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:03.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251acc380 0x557251acc750 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f501000c0a0 tx=0x7f5010000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b740f8a03804c90f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:03.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f4ffffff700 1 -- 172.21.15.69:0/1072031622 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50100a2fe0 con 0x557251acc380 2023-12-14T14:17:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f4ffffff700 1 -- 172.21.15.69:0/1072031622 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f501009adf0 con 0x557251acc380 2023-12-14T14:17:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.894+0000 7f4ffffff700 1 -- 172.21.15.69:0/1072031622 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50100a2db0 con 0x557251acc380 2023-12-14T14:17:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1072031622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251acc380 msgr2=0x557251acc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251acc380 0x557251acc750 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f501000c0a0 tx=0x7f5010000bc0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1072031622 shutdown_connections 2023-12-14T14:17:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ad7b50 0x557251ad9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251acc380 0x557251acc750 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1072031622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 0x557251ad7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1072031622 >> 172.21.15.69:0/1072031622 conn(0x557251ac2ca0 msgr2=0x557251ac87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1072031622 shutdown_connections 2023-12-14T14:17:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1072031622 wait complete. 2023-12-14T14:17:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 -- start start 2023-12-14T14:17:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.895+0000 7f5027fbdb80 1 Processor -- start 2023-12-14T14:17:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 0x557251ad7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251ad7b50 0x557251ad5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572519baf90 con 0x557251accc90 2023-12-14T14:17:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572519bac30 con 0x557251ad7b50 2023-12-14T14:17:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572518a26a0 con 0x557251acc380 2023-12-14T14:17:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f5027fbdb80 10 client.0 _ll_register_callbacks cb 0x5572519de910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f50193ca700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f50193ca700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55490/0 (socket says 172.21.15.69:55490) 2023-12-14T14:17:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f50193ca700 1 -- 172.21.15.69:0/1884971186 learned_addr learned my addr 172.21.15.69:0/1884971186 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 0x557251ad7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f501a3cc700 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251ad7b50 0x557251ad5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f50193ca700 1 -- 172.21.15.69:0/1884971186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 msgr2=0x557251ad7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f50193ca700 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 0x557251ad7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f50193ca700 1 -- 172.21.15.69:0/1884971186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251ad7b50 msgr2=0x557251ad5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f50193ca700 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251ad7b50 0x557251ad5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.896+0000 7f50193ca700 1 -- 172.21.15.69:0/1884971186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501410f0e0 con 0x557251accc90 2023-12-14T14:17:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f50193ca700 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad4920 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5014073280 tx=0x7f5004004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94821ec98360669f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f4ffd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1884971186 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500400a370 con 0x557251accc90 2023-12-14T14:17:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1884971186 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f5004004a30 con 0x557251accc90 2023-12-14T14:17:03.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1884971186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557251ac02b0 con 0x557251accc90 2023-12-14T14:17:03.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1884971186 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5004004bf0 con 0x557251accc90 2023-12-14T14:17:03.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f5027fbdb80 10 client.16167 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:03.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1884971186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5572519e5170 con 0x557251accc90 2023-12-14T14:17:03.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1884971186 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557251ac02b0 con 0x557251accc90 2023-12-14T14:17:03.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1884971186 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5004023030 con 0x557251accc90 2023-12-14T14:17:03.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f5027fbdb80 10 client.16167 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:03.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f5027fbdb80 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:03.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f5027fbdb80 20 client.16167 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:03.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557251ae7590 0x557251ae99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f5027fbdb80 4 client.16167 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:03.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.897+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1884971186 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557251a17ce0 con 0x557251ae7590 2023-12-14T14:17:03.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.898+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557251ae7590 0x557251ae99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.898+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557251ae7590 0x557251ae99a0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5c28b4b37870005 server_cookie=319e407bd2bece0a in_seq=0 out_seq=0 2023-12-14T14:17:03.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.898+0000 7f4ffd7fa700 10 client.16167 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:03.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1884971186 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557251a17ce0 con 0x557251ae7590 2023-12-14T14:17:03.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f4ffd7fa700 10 client.16167 handle_command_reply: tid=0 2023-12-14T14:17:03.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 client.16167 shutdown 2023-12-14T14:17:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1884971186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 msgr2=0x557251ad4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad4920 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5014073280 tx=0x7f5004004750 comp rx=0 tx=0).stop 2023-12-14T14:17:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1884971186 shutdown_connections 2023-12-14T14:17:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557251ae7590 0x557251ae99a0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251ad7b50 0x557251ad5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 0x557251ad7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1884971186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad4920 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f4ffd7fa700 0 client.16167 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1884971186 >> 172.21.15.69:0/1884971186 conn(0x557251ac2ca0 msgr2=0x557251ac83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:03.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1884971186 shutdown_connections 2023-12-14T14:17:03.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1884971186 wait complete. 2023-12-14T14:17:03.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.899+0000 7f5027fbdb80 20 client.16167 trim_cache size 0 max 16384 2023-12-14T14:17:03.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.915+0000 7f5027fbdb80 1 Processor -- start 2023-12-14T14:17:03.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5027fbdb80 1 -- start start 2023-12-14T14:17:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ac2ca0 0x557251ad70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251acc380 0x557251ad7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557251ac2820 con 0x557251accc90 2023-12-14T14:17:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557251ad5640 con 0x557251acc380 2023-12-14T14:17:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557251ac7650 con 0x557251ac2ca0 2023-12-14T14:17:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f501a3cc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f501a3cc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55496/0 (socket says 172.21.15.69:55496) 2023-12-14T14:17:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f501a3cc700 1 -- 172.21.15.69:0/2178032380 learned_addr learned my addr 172.21.15.69:0/2178032380 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f501a3cc700 1 -- 172.21.15.69:0/2178032380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ac2ca0 msgr2=0x557251ad70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f501a3cc700 1 --2- 172.21.15.69:0/2178032380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ac2ca0 0x557251ad70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f501a3cc700 1 -- 172.21.15.69:0/2178032380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251acc380 msgr2=0x557251ad7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f501a3cc700 1 --2- 172.21.15.69:0/2178032380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251acc380 0x557251ad7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f501a3cc700 1 -- 172.21.15.69:0/2178032380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572519e4ec0 con 0x557251accc90 2023-12-14T14:17:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f501a3cc700 1 --2- 172.21.15.69:0/2178032380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad41c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f500c0092d0 tx=0x7f500c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9986a55247c4f60 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5008ff9700 1 -- 172.21.15.69:0/2178032380 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00e040 con 0x557251accc90 2023-12-14T14:17:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5008ff9700 1 -- 172.21.15.69:0/2178032380 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f500c021070 con 0x557251accc90 2023-12-14T14:17:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.916+0000 7f5008ff9700 1 -- 172.21.15.69:0/2178032380 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c0055f0 con 0x557251accc90 2023-12-14T14:17:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 -- 172.21.15.69:0/2178032380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 msgr2=0x557251ad41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/2178032380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad41c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f500c0092d0 tx=0x7f500c009300 comp rx=0 tx=0).stop 2023-12-14T14:17:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 -- 172.21.15.69:0/2178032380 shutdown_connections 2023-12-14T14:17:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/2178032380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251accc90 0x557251ad41c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/2178032380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251ac2ca0 0x557251ad70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/2178032380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251acc380 0x557251ad7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 -- 172.21.15.69:0/2178032380 >> 172.21.15.69:0/2178032380 conn(0x557251ada200 msgr2=0x557251acfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 -- 172.21.15.69:0/2178032380 shutdown_connections 2023-12-14T14:17:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 -- 172.21.15.69:0/2178032380 wait complete. 2023-12-14T14:17:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 -- start start 2023-12-14T14:17:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.917+0000 7f5027fbdb80 1 Processor -- start 2023-12-14T14:17:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251ac2ca0 0x557251ade800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 0x557251adca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5027fbdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 0x557251add100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557251add7d0 con 0x557251ac2ca0 2023-12-14T14:17:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557251add940 con 0x557251accc90 2023-12-14T14:17:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5027fbdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557251b3b4e0 con 0x557251acc380 2023-12-14T14:17:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5027fbdb80 10 client.0 _ll_register_callbacks cb 0x7f500400ec10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5019bcb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251ac2ca0 0x557251ade800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5019bcb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251ac2ca0 0x557251ade800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55500/0 (socket says 172.21.15.69:55500) 2023-12-14T14:17:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5019bcb700 1 -- 172.21.15.69:0/1567457768 learned_addr learned my addr 172.21.15.69:0/1567457768 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f501a3cc700 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 0x557251add100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f50193ca700 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 0x557251adca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5019bcb700 1 -- 172.21.15.69:0/1567457768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 msgr2=0x557251adca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 0x557251adca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5019bcb700 1 -- 172.21.15.69:0/1567457768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 msgr2=0x557251add100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 0x557251add100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5019bcb700 1 -- 172.21.15.69:0/1567457768 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5014067540 con 0x557251ac2ca0 2023-12-14T14:17:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f5019bcb700 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251ac2ca0 0x557251ade800 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5010098ee0 tx=0x7f50100968d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cc1c19e762d039 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.918+0000 7f4ffd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1567457768 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501009a280 con 0x557251ac2ca0 2023-12-14T14:17:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1567457768 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f50100b3340 con 0x557251ac2ca0 2023-12-14T14:17:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1567457768 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f501009adf0 con 0x557251ac2ca0 2023-12-14T14:17:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1567457768 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50100a2b50 con 0x557251ac2ca0 2023-12-14T14:17:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f5027fbdb80 10 client.16173 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1567457768 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5572519cb9a0 con 0x557251ac2ca0 2023-12-14T14:17:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1567457768 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f501009adf0 con 0x557251ac2ca0 2023-12-14T14:17:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1567457768 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f501000ac90 con 0x557251ac2ca0 2023-12-14T14:17:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f5027fbdb80 10 client.16173 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f5027fbdb80 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f5027fbdb80 20 client.16173 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557251ad7b50 0x557251b3eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f5027fbdb80 4 client.16173 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:17:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1567457768 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557251a17a00 con 0x557251ad7b50 2023-12-14T14:17:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.919+0000 7f50193ca700 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557251ad7b50 0x557251b3eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f50193ca700 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557251ad7b50 0x557251b3eac0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3bf896b58b335ad server_cookie=415189919af88228 in_seq=0 out_seq=0 2023-12-14T14:17:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f4ffd7fa700 10 client.16173 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f4ffd7fa700 1 -- 172.21.15.69:0/1567457768 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557251a17a00 con 0x557251ad7b50 2023-12-14T14:17:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f4ffd7fa700 10 client.16173 handle_command_reply: tid=0 2023-12-14T14:17:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 client.16173 shutdown 2023-12-14T14:17:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1567457768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251ac2ca0 msgr2=0x557251ade800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251ac2ca0 0x557251ade800 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5010098ee0 tx=0x7f50100968d0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1567457768 shutdown_connections 2023-12-14T14:17:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557251ad7b50 0x557251b3eac0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557251accc90 0x557251add100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557251ac2ca0 0x557251ade800 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f4ffd7fa700 0 client.16173 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 --2- 172.21.15.69:0/1567457768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557251acc380 0x557251adca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1567457768 >> 172.21.15.69:0/1567457768 conn(0x557251ada200 msgr2=0x557251ad41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1567457768 shutdown_connections 2023-12-14T14:17:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 1 -- 172.21.15.69:0/1567457768 wait complete. 2023-12-14T14:17:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.920+0000 7f5027fbdb80 20 client.16173 trim_cache size 0 max 16384 2023-12-14T14:17:03.931 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:17:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:17:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:17:03.931 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:17:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 -- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50000a12c0 msgr2=0x7f50000a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50000a12c0 0x7f50000a3770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5004005fd0 tx=0x7f500400a560 comp rx=0 tx=0).stop 2023-12-14T14:17:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 -- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50140ff6e0 msgr2=0x7f5014195330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50140ff6e0 0x7f5014195330 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5010007b50 tx=0x7f5010007f10 comp rx=0 tx=0).stop 2023-12-14T14:17:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 -- 172.21.15.69:0/1695465556 shutdown_connections 2023-12-14T14:17:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50000a12c0 0x7f50000a3770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5014104d70 0x7f5014199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50140ff6e0 0x7f5014195330 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 --2- 172.21.15.69:0/1695465556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5014100080 0x7f5014195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 -- 172.21.15.69:0/1695465556 >> 172.21.15.69:0/1695465556 conn(0x7f5014074a60 msgr2=0x7f50140fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 -- 172.21.15.69:0/1695465556 shutdown_connections 2023-12-14T14:17:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:03.921+0000 7f501be2f700 1 -- 172.21.15.69:0/1695465556 wait complete. 2023-12-14T14:17:03.934 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:17:03.934 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:17:04.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.095+0000 7f9532d26700 1 -- 172.21.15.69:0/985893058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c1043d0 msgr2=0x7f952c10bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.095+0000 7f9532d26700 1 --2- 172.21.15.69:0/985893058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c1043d0 0x7f952c10bfa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f952400b0d0 tx=0x7f952400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.095+0000 7f9532d26700 1 -- 172.21.15.69:0/985893058 shutdown_connections 2023-12-14T14:17:04.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.095+0000 7f9532d26700 1 --2- 172.21.15.69:0/985893058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c1043d0 0x7f952c10bfa0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.095+0000 7f9532d26700 1 --2- 172.21.15.69:0/985893058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c0ff390 0x7f952c0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.095+0000 7f9532d26700 1 --2- 172.21.15.69:0/985893058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f952c0ffd30 0x7f952c103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.095+0000 7f9532d26700 1 -- 172.21.15.69:0/985893058 >> 172.21.15.69:0/985893058 conn(0x7f952c076370 msgr2=0x7f952c076770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.095+0000 7f9532d26700 1 -- 172.21.15.69:0/985893058 shutdown_connections 2023-12-14T14:17:04.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.095+0000 7f9532d26700 1 -- 172.21.15.69:0/985893058 wait complete. 2023-12-14T14:17:04.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9532d26700 1 Processor -- start 2023-12-14T14:17:04.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9532d26700 1 -- start start 2023-12-14T14:17:04.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9532d26700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c0ff390 0x7f952c197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9532d26700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c0ffd30 0x7f952c197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9532d26700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f952c1043d0 0x7f952c1a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9532d26700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c1981c0 con 0x7f952c0ff390 2023-12-14T14:17:04.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9532d26700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c1a2900 con 0x7f952c0ffd30 2023-12-14T14:17:04.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9532d26700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c1a2ac0 con 0x7f952c1043d0 2023-12-14T14:17:04.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9530ac2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c0ff390 0x7f952c197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9530ac2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c0ff390 0x7f952c197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55524/0 (socket says 172.21.15.69:55524) 2023-12-14T14:17:04.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9530ac2700 1 -- 172.21.15.69:0/3019054379 learned_addr learned my addr 172.21.15.69:0/3019054379 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f952bfff700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c0ffd30 0x7f952c197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f95312c3700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f952c1043d0 0x7f952c1a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9530ac2700 1 -- 172.21.15.69:0/3019054379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f952c1043d0 msgr2=0x7f952c1a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9530ac2700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f952c1043d0 0x7f952c1a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9530ac2700 1 -- 172.21.15.69:0/3019054379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c0ffd30 msgr2=0x7f952c197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9530ac2700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c0ffd30 0x7f952c197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f9530ac2700 1 -- 172.21.15.69:0/3019054379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524009d00 con 0x7f952c0ff390 2023-12-14T14:17:04.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f95312c3700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f952c1043d0 0x7f952c1a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:04.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.096+0000 7f952bfff700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c0ffd30 0x7f952c197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:04.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.097+0000 7f9530ac2700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c0ff390 0x7f952c197340 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f952000d950 tx=0x7f952000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.097+0000 7f9529ffb700 1 -- 172.21.15.69:0/3019054379 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520009b40 con 0x7f952c0ff390 2023-12-14T14:17:04.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.097+0000 7f9529ffb700 1 -- 172.21.15.69:0/3019054379 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9520009ca0 con 0x7f952c0ff390 2023-12-14T14:17:04.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.097+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c10f1a0 con 0x7f952c0ff390 2023-12-14T14:17:04.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.097+0000 7f9529ffb700 1 -- 172.21.15.69:0/3019054379 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000f620 con 0x7f952c0ff390 2023-12-14T14:17:04.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.097+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c10f010 con 0x7f952c0ff390 2023-12-14T14:17:04.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.098+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c10f330 con 0x7f952c0ff390 2023-12-14T14:17:04.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.099+0000 7f9529ffb700 1 -- 172.21.15.69:0/3019054379 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9520010460 con 0x7f952c0ff390 2023-12-14T14:17:04.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.099+0000 7f9529ffb700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f951c0a12c0 0x7f951c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.099+0000 7f952bfff700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f951c0a12c0 0x7f951c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.099+0000 7f9529ffb700 1 -- 172.21.15.69:0/3019054379 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f95200cd060 con 0x7f952c0ff390 2023-12-14T14:17:04.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.100+0000 7f952bfff700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f951c0a12c0 0x7f951c0a3770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f952c0686a0 tx=0x7f9518005d80 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.104+0000 7f9529ffb700 1 -- 172.21.15.69:0/3019054379 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f95200964b0 con 0x7f952c0ff390 2023-12-14T14:17:04.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.337+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f952c0683e0 con 0x7f952c0ff390 2023-12-14T14:17:04.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.338+0000 7f9529ffb700 1 -- 172.21.15.69:0/3019054379 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10810 (secure 0 0 0) 0x7f9520099ad0 con 0x7f952c0ff390 2023-12-14T14:17:04.339 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:17:04.339 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:14:13.438363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:17:04.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f951c0a12c0 msgr2=0x7f951c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f951c0a12c0 0x7f951c0a3770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f952c0686a0 tx=0x7f9518005d80 comp rx=0 tx=0).stop 2023-12-14T14:17:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c0ff390 msgr2=0x7f952c197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c0ff390 0x7f952c197340 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f952000d950 tx=0x7f952000dd10 comp rx=0 tx=0).stop 2023-12-14T14:17:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 shutdown_connections 2023-12-14T14:17:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f951c0a12c0 0x7f951c0a3770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f952c1043d0 0x7f952c1a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f952c0ff390 0x7f952c197340 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 --2- 172.21.15.69:0/3019054379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c0ffd30 0x7f952c197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.340+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 >> 172.21.15.69:0/3019054379 conn(0x7f952c076370 msgr2=0x7f952c0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.341+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 shutdown_connections 2023-12-14T14:17:04.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.341+0000 7f9532d26700 1 -- 172.21.15.69:0/3019054379 wait complete. 2023-12-14T14:17:04.343 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-12-14T14:17:04.354 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:17:04.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.478+0000 7f5a6ebab700 1 -- 172.21.15.69:0/2571114789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68105550 msgr2=0x7f5a6810d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.478+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/2571114789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68105550 0x7f5a6810d0d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000b0d0 tx=0x7f5a6000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.478+0000 7f5a6ebab700 1 -- 172.21.15.69:0/2571114789 shutdown_connections 2023-12-14T14:17:04.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.478+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/2571114789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68105550 0x7f5a6810d0d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.478+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/2571114789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a68100c50 0x7f5a68101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.478+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/2571114789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a681015f0 0x7f5a68104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.478+0000 7f5a6ebab700 1 -- 172.21.15.69:0/2571114789 >> 172.21.15.69:0/2571114789 conn(0x7f5a68077570 msgr2=0x7f5a68077970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.478+0000 7f5a6ebab700 1 -- 172.21.15.69:0/2571114789 shutdown_connections 2023-12-14T14:17:04.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.478+0000 7f5a6ebab700 1 -- 172.21.15.69:0/2571114789 wait complete. 2023-12-14T14:17:04.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6ebab700 1 Processor -- start 2023-12-14T14:17:04.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6ebab700 1 -- start start 2023-12-14T14:17:04.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6ebab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68100c50 0x7f5a68196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6ebab700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a681015f0 0x7f5a68196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6ebab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a68105550 0x7f5a6819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6ebab700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6819b540 con 0x7f5a68100c50 2023-12-14T14:17:04.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6ebab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6819b6b0 con 0x7f5a68105550 2023-12-14T14:17:04.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6ebab700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6819b870 con 0x7f5a681015f0 2023-12-14T14:17:04.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6c947700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68100c50 0x7f5a68196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6c947700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68100c50 0x7f5a68196560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55552/0 (socket says 172.21.15.69:55552) 2023-12-14T14:17:04.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6c947700 1 -- 172.21.15.69:0/264506141 learned_addr learned my addr 172.21.15.69:0/264506141 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a67fff700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a681015f0 0x7f5a68196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.479+0000 7f5a6d148700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a68105550 0x7f5a6819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a6c947700 1 -- 172.21.15.69:0/264506141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a681015f0 msgr2=0x7f5a68196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a6c947700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a681015f0 0x7f5a68196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a6c947700 1 -- 172.21.15.69:0/264506141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a68105550 msgr2=0x7f5a6819af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a6c947700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a68105550 0x7f5a6819af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a6c947700 1 -- 172.21.15.69:0/264506141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60009d00 con 0x7f5a68100c50 2023-12-14T14:17:04.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a6c947700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68100c50 0x7f5a68196560 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00d980 tx=0x7f5a5c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a65ffb700 1 -- 172.21.15.69:0/264506141 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c004a30 con 0x7f5a68100c50 2023-12-14T14:17:04.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a65ffb700 1 -- 172.21.15.69:0/264506141 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a5c0054e0 con 0x7f5a68100c50 2023-12-14T14:17:04.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a6ebab700 1 -- 172.21.15.69:0/264506141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a68110340 con 0x7f5a68100c50 2023-12-14T14:17:04.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a65ffb700 1 -- 172.21.15.69:0/264506141 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c009c90 con 0x7f5a68100c50 2023-12-14T14:17:04.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.480+0000 7f5a6ebab700 1 -- 172.21.15.69:0/264506141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a681101b0 con 0x7f5a68100c50 2023-12-14T14:17:04.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.482+0000 7f5a65ffb700 1 -- 172.21.15.69:0/264506141 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5a5c004c20 con 0x7f5a68100c50 2023-12-14T14:17:04.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.483+0000 7f5a65ffb700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a580a12c0 0x7f5a580a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.483+0000 7f5a65ffb700 1 -- 172.21.15.69:0/264506141 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f5a5c0ccbc0 con 0x7f5a68100c50 2023-12-14T14:17:04.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.483+0000 7f5a67fff700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a580a12c0 0x7f5a580a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.483+0000 7f5a67fff700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a580a12c0 0x7f5a580a3770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a68197b70 tx=0x7f5a5400b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a7ad39b80 1 Processor -- start 2023-12-14T14:17:04.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a7ad39b80 1 -- start start 2023-12-14T14:17:04.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 0x5653421ed750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421edc90 0x5653421f8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421faf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653420d75e0 con 0x5653421f8b50 2023-12-14T14:17:04.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565342146870 con 0x5653421edc90 2023-12-14T14:17:04.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56534213fd00 con 0x5653421ed380 2023-12-14T14:17:04.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a6d148700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a6d148700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421faf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55566/0 (socket says 172.21.15.69:55566) 2023-12-14T14:17:04.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a6d148700 1 -- 172.21.15.69:0/3268090804 learned_addr learned my addr 172.21.15.69:0/3268090804 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a67fff700 1 --2- 172.21.15.69:0/3268090804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421edc90 0x5653421f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.484+0000 7f5a6c947700 1 --2- 172.21.15.69:0/3268090804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 0x5653421ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.485+0000 7f5a6d148700 1 -- 172.21.15.69:0/3268090804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 msgr2=0x5653421ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.485+0000 7f5a6d148700 1 --2- 172.21.15.69:0/3268090804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 0x5653421ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.485+0000 7f5a6d148700 1 -- 172.21.15.69:0/3268090804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421edc90 msgr2=0x5653421f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.485+0000 7f5a6d148700 1 --2- 172.21.15.69:0/3268090804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421edc90 0x5653421f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.485+0000 7f5a6d148700 1 -- 172.21.15.69:0/3268090804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565341fc13b0 con 0x5653421f8b50 2023-12-14T14:17:04.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.485+0000 7f5a6d148700 1 --2- 172.21.15.69:0/3268090804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421faf30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009c30 tx=0x7f5a60009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c553593530c14337 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.487+0000 7f5a52ffd700 1 -- 172.21.15.69:0/3268090804 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6000e050 con 0x5653421f8b50 2023-12-14T14:17:04.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.487+0000 7f5a52ffd700 1 -- 172.21.15.69:0/3268090804 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a600092d0 con 0x5653421f8b50 2023-12-14T14:17:04.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.487+0000 7f5a52ffd700 1 -- 172.21.15.69:0/3268090804 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600052a0 con 0x5653421f8b50 2023-12-14T14:17:04.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.487+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3268090804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 msgr2=0x5653421faf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.487+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3268090804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421faf30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009c30 tx=0x7f5a60009c60 comp rx=0 tx=0).stop 2023-12-14T14:17:04.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.487+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3268090804 shutdown_connections 2023-12-14T14:17:04.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.487+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3268090804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421faf30 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.487+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3268090804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 0x5653421ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.487+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3268090804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421edc90 0x5653421f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3268090804 >> 172.21.15.69:0/3268090804 conn(0x5653421e3ca0 msgr2=0x5653421e97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3268090804 shutdown_connections 2023-12-14T14:17:04.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3268090804 wait complete. 2023-12-14T14:17:04.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 -- start start 2023-12-14T14:17:04.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 Processor -- start 2023-12-14T14:17:04.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421ed380 0x5653421f8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 0x5653421f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653420dbf90 con 0x5653421f8b50 2023-12-14T14:17:04.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653420dbc30 con 0x5653421ed380 2023-12-14T14:17:04.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.488+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x565341fc36a0 con 0x5653421edc90 2023-12-14T14:17:04.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a7ad39b80 10 client.0 _ll_register_callbacks cb 0x5653420ff910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:04.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6d148700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6c947700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421ed380 0x5653421f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6d148700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421f5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55576/0 (socket says 172.21.15.69:55576) 2023-12-14T14:17:04.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 0x5653421f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6d148700 1 -- 172.21.15.69:0/3725710590 learned_addr learned my addr 172.21.15.69:0/3725710590 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6d148700 1 -- 172.21.15.69:0/3725710590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 msgr2=0x5653421f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6d148700 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 0x5653421f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6d148700 1 -- 172.21.15.69:0/3725710590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421ed380 msgr2=0x5653421f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6d148700 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421ed380 0x5653421f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6d148700 1 -- 172.21.15.69:0/3725710590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6810d910 con 0x5653421f8b50 2023-12-14T14:17:04.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6c947700 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421ed380 0x5653421f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:17:04.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a6d148700 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421f5e00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000b820 tx=0x7f5a60004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89aca800a5e32a68 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.489+0000 7f5a47fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:04.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.490+0000 7f5a47fff700 1 -- 172.21.15.69:0/3725710590 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60007580 con 0x5653421f8b50 2023-12-14T14:17:04.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.490+0000 7f5a47fff700 1 -- 172.21.15.69:0/3725710590 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f5a60026660 con 0x5653421f8b50 2023-12-14T14:17:04.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.490+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3725710590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653421e12b0 con 0x5653421f8b50 2023-12-14T14:17:04.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a47fff700 1 -- 172.21.15.69:0/3725710590 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a60026820 con 0x5653421f8b50 2023-12-14T14:17:04.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a7ad39b80 10 client.16191 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:04.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3725710590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x565342106170 con 0x5653421f8b50 2023-12-14T14:17:04.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a47fff700 1 -- 172.21.15.69:0/3725710590 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5653421e12b0 con 0x5653421f8b50 2023-12-14T14:17:04.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a47fff700 1 -- 172.21.15.69:0/3725710590 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5a6000b100 con 0x5653421f8b50 2023-12-14T14:17:04.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a7ad39b80 10 client.16191 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:04.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a7ad39b80 10 client.16191 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:17:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a7ad39b80 20 client.16191 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x565342208010 0x56534220a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a7ad39b80 4 client.16191 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3725710590 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565342138ce0 con 0x565342208010 2023-12-14T14:17:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.491+0000 7f5a6c947700 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x565342208010 0x56534220a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a47fff700 10 client.16191 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:17:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a6c947700 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x565342208010 0x56534220a420 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5014847ea5bc60ce server_cookie=2825abb9e1c47e3f in_seq=0 out_seq=0 2023-12-14T14:17:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a47fff700 1 -- 172.21.15.69:0/3725710590 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x565342138ce0 con 0x565342208010 2023-12-14T14:17:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a47fff700 10 client.16191 handle_command_reply: tid=0 2023-12-14T14:17:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a7ad39b80 1 client.16191 shutdown 2023-12-14T14:17:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3725710590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 msgr2=0x5653421f5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421f5e00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000b820 tx=0x7f5a60004c80 comp rx=0 tx=0).stop 2023-12-14T14:17:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3725710590 shutdown_connections 2023-12-14T14:17:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x565342208010 0x56534220a420 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421f8b50 0x5653421f5e00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421ed380 0x5653421f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3725710590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 0x5653421f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a47fff700 0 client.16191 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:17:04.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.492+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3725710590 >> 172.21.15.69:0/3725710590 conn(0x5653421e3ca0 msgr2=0x5653421e93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.493+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3725710590 shutdown_connections 2023-12-14T14:17:04.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.493+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3725710590 wait complete. 2023-12-14T14:17:04.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.493+0000 7f5a7ad39b80 20 client.16191 trim_cache size 0 max 16384 2023-12-14T14:17:04.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.505+0000 7f5a7ad39b80 1 Processor -- start 2023-12-14T14:17:04.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.505+0000 7f5a7ad39b80 1 -- start start 2023-12-14T14:17:04.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 0x5653421ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421edc90 0x5653421f8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 0x5653421f8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653421eed30 con 0x5653421edc90 2023-12-14T14:17:04.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653421ffb60 con 0x5653421f8b50 2023-12-14T14:17:04.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653421f4d80 con 0x5653421ed380 2023-12-14T14:17:04.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a67fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421edc90 0x5653421f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a67fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421edc90 0x5653421f8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55586/0 (socket says 172.21.15.69:55586) 2023-12-14T14:17:04.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a67fff700 1 -- 172.21.15.69:0/3211736553 learned_addr learned my addr 172.21.15.69:0/3211736553 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a6c947700 1 --2- 172.21.15.69:0/3211736553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 0x5653421ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a6d148700 1 --2- 172.21.15.69:0/3211736553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 0x5653421f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a67fff700 1 -- 172.21.15.69:0/3211736553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 msgr2=0x5653421ff620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a67fff700 1 --2- 172.21.15.69:0/3211736553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 0x5653421ff620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a67fff700 1 -- 172.21.15.69:0/3211736553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 msgr2=0x5653421f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a67fff700 1 --2- 172.21.15.69:0/3211736553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 0x5653421f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a67fff700 1 -- 172.21.15.69:0/3211736553 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565342105ec0 con 0x5653421edc90 2023-12-14T14:17:04.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a67fff700 1 --2- 172.21.15.69:0/3211736553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421edc90 0x5653421f8000 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5a681019c0 tx=0x7f5a54013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3210fe312b37bbb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.506+0000 7f5a537fe700 1 -- 172.21.15.69:0/3211736553 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54024070 con 0x5653421edc90 2023-12-14T14:17:04.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a537fe700 1 -- 172.21.15.69:0/3211736553 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a54015070 con 0x5653421edc90 2023-12-14T14:17:04.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a537fe700 1 -- 172.21.15.69:0/3211736553 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54005280 con 0x5653421edc90 2023-12-14T14:17:04.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3211736553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421edc90 msgr2=0x5653421f8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3211736553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421edc90 0x5653421f8000 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5a681019c0 tx=0x7f5a54013000 comp rx=0 tx=0).stop 2023-12-14T14:17:04.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3211736553 shutdown_connections 2023-12-14T14:17:04.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3211736553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 0x5653421f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3211736553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421ed380 0x5653421ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/3211736553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421edc90 0x5653421f8000 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3211736553 >> 172.21.15.69:0/3211736553 conn(0x5653421e3ca0 msgr2=0x565342204800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3211736553 shutdown_connections 2023-12-14T14:17:04.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/3211736553 wait complete. 2023-12-14T14:17:04.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.507+0000 7f5a7ad39b80 1 -- start start 2023-12-14T14:17:04.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a7ad39b80 1 Processor -- start 2023-12-14T14:17:04.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421ed380 0x5653421fe960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 0x5653421feea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a7ad39b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 0x56534225aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56534225b430 con 0x5653421ed380 2023-12-14T14:17:04.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56534225b570 con 0x5653421f8b50 2023-12-14T14:17:04.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a7ad39b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56534225b6b0 con 0x5653421edc90 2023-12-14T14:17:04.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a7ad39b80 10 client.0 _ll_register_callbacks cb 0x7f5a5400b8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:04.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a6c947700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421ed380 0x5653421fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a6c947700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421ed380 0x5653421fe960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55596/0 (socket says 172.21.15.69:55596) 2023-12-14T14:17:04.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a6c947700 1 -- 172.21.15.69:0/1338895639 learned_addr learned my addr 172.21.15.69:0/1338895639 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a67fff700 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 0x5653421feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a6d148700 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 0x56534225aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a6c947700 1 -- 172.21.15.69:0/1338895639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 msgr2=0x5653421feea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a6c947700 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 0x5653421feea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a6c947700 1 -- 172.21.15.69:0/1338895639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 msgr2=0x56534225aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a6c947700 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 0x56534225aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.508+0000 7f5a6c947700 1 -- 172.21.15.69:0/1338895639 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a54010db0 con 0x5653421ed380 2023-12-14T14:17:04.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a6c947700 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421ed380 0x5653421fe960 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0961d0 tx=0x7f5a5c096090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55538ff86cd52574 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a47fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:04.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a47fff700 1 -- 172.21.15.69:0/1338895639 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c09c040 con 0x5653421ed380 2023-12-14T14:17:04.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a47fff700 1 -- 172.21.15.69:0/1338895639 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f5a5c0a2120 con 0x5653421ed380 2023-12-14T14:17:04.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/1338895639 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a600092d0 con 0x5653421ed380 2023-12-14T14:17:04.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a47fff700 1 -- 172.21.15.69:0/1338895639 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a5c0b2240 con 0x5653421ed380 2023-12-14T14:17:04.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a7ad39b80 10 client.16197 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:04.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/1338895639 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5653420ec9a0 con 0x5653421ed380 2023-12-14T14:17:04.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a47fff700 1 -- 172.21.15.69:0/1338895639 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a600092d0 con 0x5653421ed380 2023-12-14T14:17:04.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a47fff700 1 -- 172.21.15.69:0/1338895639 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5a5c099fc0 con 0x5653421ed380 2023-12-14T14:17:04.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a7ad39b80 10 client.16197 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:04.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a7ad39b80 10 client.16197 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:17:04.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a7ad39b80 20 client.16197 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:04.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56534225ce70 0x56534225f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a7ad39b80 4 client.16197 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:17:04.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/1338895639 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x565342138a00 con 0x56534225ce70 2023-12-14T14:17:04.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.509+0000 7f5a67fff700 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56534225ce70 0x56534225f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a47fff700 10 client.16197 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:17:04.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a67fff700 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56534225ce70 0x56534225f280 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=348816c052fbce54 server_cookie=5853125f0a6b4da8 in_seq=0 out_seq=0 2023-12-14T14:17:04.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a47fff700 1 -- 172.21.15.69:0/1338895639 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x565342138a00 con 0x56534225ce70 2023-12-14T14:17:04.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a47fff700 10 client.16197 handle_command_reply: tid=0 2023-12-14T14:17:04.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 client.16197 shutdown 2023-12-14T14:17:04.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/1338895639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421ed380 msgr2=0x5653421fe960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421ed380 0x5653421fe960 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0961d0 tx=0x7f5a5c096090 comp rx=0 tx=0).stop 2023-12-14T14:17:04.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/1338895639 shutdown_connections 2023-12-14T14:17:04.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653421f8b50 0x56534225aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56534225ce70 0x56534225f280 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5653421ed380 0x5653421fe960 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 --2- 172.21.15.69:0/1338895639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653421edc90 0x5653421feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a47fff700 0 client.16197 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:17:04.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/1338895639 >> 172.21.15.69:0/1338895639 conn(0x5653421e3ca0 msgr2=0x5653421f0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/1338895639 shutdown_connections 2023-12-14T14:17:04.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 1 -- 172.21.15.69:0/1338895639 wait complete. 2023-12-14T14:17:04.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.510+0000 7f5a7ad39b80 20 client.16197 trim_cache size 0 max 16384 2023-12-14T14:17:04.522 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:17:04.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 -- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a580a12c0 msgr2=0x7f5a580a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a580a12c0 0x7f5a580a3770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a68197b70 tx=0x7f5a5400b410 comp rx=0 tx=0).stop 2023-12-14T14:17:04.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 -- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68100c50 msgr2=0x7f5a68196560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68100c50 0x7f5a68196560 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00d980 tx=0x7f5a5c00dc90 comp rx=0 tx=0).stop 2023-12-14T14:17:04.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 -- 172.21.15.69:0/264506141 shutdown_connections 2023-12-14T14:17:04.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a580a12c0 0x7f5a580a3770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a68105550 0x7f5a6819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a68100c50 0x7f5a68196560 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 --2- 172.21.15.69:0/264506141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a681015f0 0x7f5a68196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 -- 172.21.15.69:0/264506141 >> 172.21.15.69:0/264506141 conn(0x7f5a68077570 msgr2=0x7f5a680feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 -- 172.21.15.69:0/264506141 shutdown_connections 2023-12-14T14:17:04.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.511+0000 7f5a6ebab700 1 -- 172.21.15.69:0/264506141 wait complete. 2023-12-14T14:17:04.526 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:17:04.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 -- 172.21.15.69:0/1570797002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d80ffd70 msgr2=0x7f64d8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 --2- 172.21.15.69:0/1570797002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d80ffd70 0x7f64d8103d30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f64c80099c0 tx=0x7f64c8009cd0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 -- 172.21.15.69:0/1570797002 shutdown_connections 2023-12-14T14:17:04.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 --2- 172.21.15.69:0/1570797002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64d8104410 0x7f64d810bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 --2- 172.21.15.69:0/1570797002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d80ff3d0 0x7f64d80ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 --2- 172.21.15.69:0/1570797002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d80ffd70 0x7f64d8103d30 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 -- 172.21.15.69:0/1570797002 >> 172.21.15.69:0/1570797002 conn(0x7f64d8076230 msgr2=0x7f64d8076630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 -- 172.21.15.69:0/1570797002 shutdown_connections 2023-12-14T14:17:04.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 -- 172.21.15.69:0/1570797002 wait complete. 2023-12-14T14:17:04.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.650+0000 7f64de211700 1 Processor -- start 2023-12-14T14:17:04.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64de211700 1 -- start start 2023-12-14T14:17:04.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64de211700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d80ff3d0 0x7f64d8197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64de211700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64d80ffd70 0x7f64d8197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64de211700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d8104410 0x7f64d81a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64de211700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d81980b0 con 0x7f64d8104410 2023-12-14T14:17:04.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64de211700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d81a27f0 con 0x7f64d80ffd70 2023-12-14T14:17:04.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64de211700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d81a29b0 con 0x7f64d80ff3d0 2023-12-14T14:17:04.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d8104410 0x7f64d81a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d8104410 0x7f64d81a22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55612/0 (socket says 172.21.15.69:55612) 2023-12-14T14:17:04.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d7fff700 1 -- 172.21.15.69:0/202409422 learned_addr learned my addr 172.21.15.69:0/202409422 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64d80ffd70 0x7f64d8197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d77fe700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d80ff3d0 0x7f64d8197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d7fff700 1 -- 172.21.15.69:0/202409422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d80ff3d0 msgr2=0x7f64d8197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d7fff700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d80ff3d0 0x7f64d8197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d7fff700 1 -- 172.21.15.69:0/202409422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64d80ffd70 msgr2=0x7f64d8197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d7fff700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64d80ffd70 0x7f64d8197770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d7fff700 1 -- 172.21.15.69:0/202409422 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c80095f0 con 0x7f64d8104410 2023-12-14T14:17:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d7fff700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d8104410 0x7f64d81a22b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f64d0007ee0 tx=0x7f64d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d4ff9700 1 -- 172.21.15.69:0/202409422 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000ddd0 con 0x7f64d8104410 2023-12-14T14:17:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64d4ff9700 1 -- 172.21.15.69:0/202409422 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64d000f040 con 0x7f64d8104410 2023-12-14T14:17:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.651+0000 7f64de211700 1 -- 172.21.15.69:0/202409422 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d810f1e0 con 0x7f64d8104410 2023-12-14T14:17:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.652+0000 7f64d4ff9700 1 -- 172.21.15.69:0/202409422 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d00048e0 con 0x7f64d8104410 2023-12-14T14:17:04.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.652+0000 7f64de211700 1 -- 172.21.15.69:0/202409422 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d810f050 con 0x7f64d8104410 2023-12-14T14:17:04.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.653+0000 7f64d4ff9700 1 -- 172.21.15.69:0/202409422 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f64d0003a00 con 0x7f64d8104410 2023-12-14T14:17:04.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.654+0000 7f64d4ff9700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f64c00a12c0 0x7f64c00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.654+0000 7f64d77fe700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f64c00a12c0 0x7f64c00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.654+0000 7f64d4ff9700 1 -- 172.21.15.69:0/202409422 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f64d00cc530 con 0x7f64d8104410 2023-12-14T14:17:04.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.654+0000 7f64d77fe700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f64c00a12c0 0x7f64c00a3770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009bf0 tx=0x7f64cc009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64ea39fb80 1 Processor -- start 2023-12-14T14:17:04.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64ea39fb80 1 -- start start 2023-12-14T14:17:04.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 0x55cd8ed8c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed97610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed99f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ec765e0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ece5870 con 0x55cd8ed8c380 2023-12-14T14:17:04.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ecded00 con 0x55cd8ed97b50 2023-12-14T14:17:04.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64d6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed97610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64d6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed97610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55616/0 (socket says 172.21.15.69:55616) 2023-12-14T14:17:04.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.655+0000 7f64d6ffd700 1 -- 172.21.15.69:0/1018777520 learned_addr learned my addr 172.21.15.69:0/1018777520 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64d7fff700 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed99f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64d77fe700 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 0x55cd8ed8c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64d6ffd700 1 -- 172.21.15.69:0/1018777520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 msgr2=0x55cd8ed99f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed99f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64d6ffd700 1 -- 172.21.15.69:0/1018777520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 msgr2=0x55cd8ed8c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 0x55cd8ed8c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64d6ffd700 1 -- 172.21.15.69:0/1018777520 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd8eb603b0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64d7fff700 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed99f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:04.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed97610 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f64c8004800 tx=0x7f64c8005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a79add1eb5a4e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64bdffb700 1 -- 172.21.15.69:0/1018777520 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800ba90 con 0x55cd8ed8cc90 2023-12-14T14:17:04.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64bdffb700 1 -- 172.21.15.69:0/1018777520 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64c801e040 con 0x55cd8ed8cc90 2023-12-14T14:17:04.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.656+0000 7f64bdffb700 1 -- 172.21.15.69:0/1018777520 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8024400 con 0x55cd8ed8cc90 2023-12-14T14:17:04.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1018777520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 msgr2=0x55cd8ed97610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed97610 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f64c8004800 tx=0x7f64c8005bc0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1018777520 shutdown_connections 2023-12-14T14:17:04.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed99f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 0x55cd8ed8c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1018777520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed97610 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1018777520 >> 172.21.15.69:0/1018777520 conn(0x55cd8ed82ca0 msgr2=0x55cd8ed887e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1018777520 shutdown_connections 2023-12-14T14:17:04.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1018777520 wait complete. 2023-12-14T14:17:04.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 -- start start 2023-12-14T14:17:04.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 Processor -- start 2023-12-14T14:17:04.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 0x55cd8ed97500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.657+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed94d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ec7af90 con 0x55cd8ed8cc90 2023-12-14T14:17:04.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ec7ac30 con 0x55cd8ed8c380 2023-12-14T14:17:04.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8eb626a0 con 0x55cd8ed97b50 2023-12-14T14:17:04.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64ea39fb80 10 client.0 _ll_register_callbacks cb 0x55cd8ec9e910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:04.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55620/0 (socket says 172.21.15.69:55620) 2023-12-14T14:17:04.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d6ffd700 1 -- 172.21.15.69:0/734990735 learned_addr learned my addr 172.21.15.69:0/734990735 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d7fff700 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed94d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d77fe700 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 0x55cd8ed97500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d6ffd700 1 -- 172.21.15.69:0/734990735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 msgr2=0x55cd8ed94d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed94d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d6ffd700 1 -- 172.21.15.69:0/734990735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 msgr2=0x55cd8ed97500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 0x55cd8ed97500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d6ffd700 1 -- 172.21.15.69:0/734990735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d810c820 con 0x55cd8ed8cc90 2023-12-14T14:17:04.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d7fff700 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed94d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:04.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed947b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009990 tx=0x7f64c800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324e98fc43022564 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:04.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64b6ffd700 1 -- 172.21.15.69:0/734990735 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8035070 con 0x55cd8ed8cc90 2023-12-14T14:17:04.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64b6ffd700 1 -- 172.21.15.69:0/734990735 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f64c800f9c0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64ea39fb80 1 -- 172.21.15.69:0/734990735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd8ed802b0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64b6ffd700 1 -- 172.21.15.69:0/734990735 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64c800fba0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64ea39fb80 10 client.16209 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:04.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.658+0000 7f64ea39fb80 1 -- 172.21.15.69:0/734990735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55cd8eca5170 con 0x55cd8ed8cc90 2023-12-14T14:17:04.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.659+0000 7f64b6ffd700 1 -- 172.21.15.69:0/734990735 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cd8ed802b0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.659+0000 7f64b6ffd700 1 -- 172.21.15.69:0/734990735 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f64c8038030 con 0x55cd8ed8cc90 2023-12-14T14:17:04.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.659+0000 7f64ea39fb80 10 client.16209 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:04.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.659+0000 7f64ea39fb80 10 client.16209 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:17:04.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.659+0000 7f64ea39fb80 20 client.16209 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:04.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.659+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55cd8eda6f60 0x55cd8eda9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.659+0000 7f64ea39fb80 4 client.16209 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:04.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.659+0000 7f64ea39fb80 1 -- 172.21.15.69:0/734990735 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd8ecd7ce0 con 0x55cd8eda6f60 2023-12-14T14:17:04.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.659+0000 7f64d77fe700 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55cd8eda6f60 0x55cd8eda9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64d77fe700 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55cd8eda6f60 0x55cd8eda9340 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1653fecfefac70ae server_cookie=196f579dd405896a in_seq=0 out_seq=0 2023-12-14T14:17:04.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64b6ffd700 10 client.16209 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:17:04.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64b6ffd700 1 -- 172.21.15.69:0/734990735 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cd8ecd7ce0 con 0x55cd8eda6f60 2023-12-14T14:17:04.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64b6ffd700 10 client.16209 handle_command_reply: tid=0 2023-12-14T14:17:04.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 client.16209 shutdown 2023-12-14T14:17:04.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 -- 172.21.15.69:0/734990735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 msgr2=0x55cd8ed947b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed947b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009990 tx=0x7f64c800f510 comp rx=0 tx=0).stop 2023-12-14T14:17:04.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 -- 172.21.15.69:0/734990735 shutdown_connections 2023-12-14T14:17:04.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8ed94d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8c380 0x55cd8ed97500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55cd8eda6f60 0x55cd8eda9340 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/734990735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed947b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 -- 172.21.15.69:0/734990735 >> 172.21.15.69:0/734990735 conn(0x55cd8ed82ca0 msgr2=0x55cd8ed883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64b6ffd700 0 client.16209 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:17:04.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.660+0000 7f64ea39fb80 1 -- 172.21.15.69:0/734990735 shutdown_connections 2023-12-14T14:17:04.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.661+0000 7f64ea39fb80 1 -- 172.21.15.69:0/734990735 wait complete. 2023-12-14T14:17:04.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.661+0000 7f64ea39fb80 20 client.16209 trim_cache size 0 max 16384 2023-12-14T14:17:04.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.673+0000 7f64ea39fb80 1 Processor -- start 2023-12-14T14:17:04.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.673+0000 7f64ea39fb80 1 -- start start 2023-12-14T14:17:04.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.673+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed8c380 0x55cd8ed99f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.673+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed96fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed97b50 0x55cd8ed97500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ed82ab0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ed8d110 con 0x55cd8ed97b50 2023-12-14T14:17:04.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ed8d580 con 0x55cd8ed8c380 2023-12-14T14:17:04.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed96fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed96fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55634/0 (socket says 172.21.15.69:55634) 2023-12-14T14:17:04.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d6ffd700 1 -- 172.21.15.69:0/3476408048 learned_addr learned my addr 172.21.15.69:0/3476408048 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d7fff700 1 --2- 172.21.15.69:0/3476408048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed97b50 0x55cd8ed97500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d77fe700 1 --2- 172.21.15.69:0/3476408048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed8c380 0x55cd8ed99f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d6ffd700 1 -- 172.21.15.69:0/3476408048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed8c380 msgr2=0x55cd8ed99f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/3476408048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed8c380 0x55cd8ed99f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d6ffd700 1 -- 172.21.15.69:0/3476408048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed97b50 msgr2=0x55cd8ed97500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/3476408048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed97b50 0x55cd8ed97500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d6ffd700 1 -- 172.21.15.69:0/3476408048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd8eca4ec0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/3476408048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed96fc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f64c8024480 tx=0x7f64c8009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f382db005c99ab server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64be7fc700 1 -- 172.21.15.69:0/3476408048 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c802c5a0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64be7fc700 1 -- 172.21.15.69:0/3476408048 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64c800fe80 con 0x55cd8ed8cc90 2023-12-14T14:17:04.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.674+0000 7f64be7fc700 1 -- 172.21.15.69:0/3476408048 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8003a50 con 0x55cd8ed8cc90 2023-12-14T14:17:04.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 -- 172.21.15.69:0/3476408048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 msgr2=0x55cd8ed96fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/3476408048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed96fc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f64c8024480 tx=0x7f64c8009fd0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 -- 172.21.15.69:0/3476408048 shutdown_connections 2023-12-14T14:17:04.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/3476408048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed97b50 0x55cd8ed97500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/3476408048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed8c380 0x55cd8ed99f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/3476408048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed96fc0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 -- 172.21.15.69:0/3476408048 >> 172.21.15.69:0/3476408048 conn(0x55cd8ed82ca0 msgr2=0x55cd8eda3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 -- 172.21.15.69:0/3476408048 shutdown_connections 2023-12-14T14:17:04.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 -- 172.21.15.69:0/3476408048 wait complete. 2023-12-14T14:17:04.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 -- start start 2023-12-14T14:17:04.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.675+0000 7f64ea39fb80 1 Processor -- start 2023-12-14T14:17:04.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8c380 0x55cd8ed9a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed9ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8edf9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ed9b330 con 0x55cd8ed8c380 2023-12-14T14:17:04.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8ed9b4a0 con 0x55cd8ed8cc90 2023-12-14T14:17:04.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8edfa330 con 0x55cd8ed97b50 2023-12-14T14:17:04.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 10 client.0 _ll_register_callbacks cb 0x7f64c8005ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:04.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8c380 0x55cd8ed9a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8c380 0x55cd8ed9a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55648/0 (socket says 172.21.15.69:55648) 2023-12-14T14:17:04.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d77fe700 1 -- 172.21.15.69:0/1839033507 learned_addr learned my addr 172.21.15.69:0/1839033507 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed9ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d7fff700 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8edf9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d77fe700 1 -- 172.21.15.69:0/1839033507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 msgr2=0x55cd8edf9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d77fe700 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8edf9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d77fe700 1 -- 172.21.15.69:0/1839033507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8cc90 msgr2=0x55cd8ed9ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d77fe700 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed9ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d77fe700 1 -- 172.21.15.69:0/1839033507 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd8eca5170 con 0x55cd8ed8c380 2023-12-14T14:17:04.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64d77fe700 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8c380 0x55cd8ed9a5e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f64cc011770 tx=0x7f64cc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446331b9071f5739 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:04.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64b6ffd700 1 -- 172.21.15.69:0/1839033507 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc024070 con 0x55cd8ed8c380 2023-12-14T14:17:04.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64b6ffd700 1 -- 172.21.15.69:0/1839033507 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f64cc018070 con 0x55cd8ed8c380 2023-12-14T14:17:04.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1839033507 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd8ecd7a00 con 0x55cd8ed8c380 2023-12-14T14:17:04.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64b6ffd700 1 -- 172.21.15.69:0/1839033507 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64cc026420 con 0x55cd8ed8c380 2023-12-14T14:17:04.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 10 client.16215 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:04.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.676+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1839033507 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55cd8ec8b9a0 con 0x55cd8ed8c380 2023-12-14T14:17:04.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.677+0000 7f64b6ffd700 1 -- 172.21.15.69:0/1839033507 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cd8ecd7a00 con 0x55cd8ed8c380 2023-12-14T14:17:04.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.677+0000 7f64b6ffd700 1 -- 172.21.15.69:0/1839033507 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f64cc02c070 con 0x55cd8ed8c380 2023-12-14T14:17:04.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.677+0000 7f64ea39fb80 10 client.16215 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:04.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.677+0000 7f64ea39fb80 10 client.16215 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:17:04.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.677+0000 7f64ea39fb80 20 client.16215 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:04.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.677+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55cd8edfbb00 0x55cd8edfdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.677+0000 7f64ea39fb80 4 client.16215 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:17:04.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.677+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1839033507 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cd8eb2dcf0 con 0x55cd8edfbb00 2023-12-14T14:17:04.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.677+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55cd8edfbb00 0x55cd8edfdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64b6ffd700 10 client.16215 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:17:04.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64d6ffd700 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55cd8edfbb00 0x55cd8edfdf10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f7645239d91742aa server_cookie=43c54497092064c3 in_seq=0 out_seq=0 2023-12-14T14:17:04.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64b6ffd700 1 -- 172.21.15.69:0/1839033507 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cd8eb2dcf0 con 0x55cd8edfbb00 2023-12-14T14:17:04.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64b6ffd700 10 client.16215 handle_command_reply: tid=0 2023-12-14T14:17:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 client.16215 shutdown 2023-12-14T14:17:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1839033507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8c380 msgr2=0x55cd8ed9a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8c380 0x55cd8ed9a5e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f64cc011770 tx=0x7f64cc0047c0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1839033507 shutdown_connections 2023-12-14T14:17:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd8ed97b50 0x55cd8edf9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55cd8edfbb00 0x55cd8edfdf10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd8ed8c380 0x55cd8ed9a5e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64b6ffd700 0 client.16215 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:17:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 --2- 172.21.15.69:0/1839033507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cd8ed8cc90 0x55cd8ed9ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1839033507 >> 172.21.15.69:0/1839033507 conn(0x55cd8ed82ca0 msgr2=0x55cd8ed8fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1839033507 shutdown_connections 2023-12-14T14:17:04.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 1 -- 172.21.15.69:0/1839033507 wait complete. 2023-12-14T14:17:04.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64ea39fb80 20 client.16215 trim_cache size 0 max 16384 2023-12-14T14:17:04.691 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:17:04.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64de211700 1 -- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f64c00a12c0 msgr2=0x7f64c00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64de211700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f64c00a12c0 0x7f64c00a3770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009bf0 tx=0x7f64cc009260 comp rx=0 tx=0).stop 2023-12-14T14:17:04.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64de211700 1 -- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d8104410 msgr2=0x7f64d81a22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.678+0000 7f64de211700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d8104410 0x7f64d81a22b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f64d0007ee0 tx=0x7f64d000d3b0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.679+0000 7f64de211700 1 -- 172.21.15.69:0/202409422 shutdown_connections 2023-12-14T14:17:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.679+0000 7f64de211700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f64c00a12c0 0x7f64c00a3770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.679+0000 7f64de211700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64d8104410 0x7f64d81a22b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.679+0000 7f64de211700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d80ff3d0 0x7f64d8197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.679+0000 7f64de211700 1 --2- 172.21.15.69:0/202409422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64d80ffd70 0x7f64d8197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.679+0000 7f64de211700 1 -- 172.21.15.69:0/202409422 >> 172.21.15.69:0/202409422 conn(0x7f64d8076230 msgr2=0x7f64d80fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.679+0000 7f64de211700 1 -- 172.21.15.69:0/202409422 shutdown_connections 2023-12-14T14:17:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.679+0000 7f64de211700 1 -- 172.21.15.69:0/202409422 wait complete. 2023-12-14T14:17:04.694 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:04 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3019054379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:17:04.695 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:17:04.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:04 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3019054379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:17:04.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.817+0000 7f59fa3de700 1 -- 172.21.15.69:0/395115585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f40ff3d0 msgr2=0x7f59f40ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.817+0000 7f59fa3de700 1 --2- 172.21.15.69:0/395115585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f40ff3d0 0x7f59f40ff7a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00b0d0 tx=0x7f59ec00b3e0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.817+0000 7f59fa3de700 1 -- 172.21.15.69:0/395115585 shutdown_connections 2023-12-14T14:17:04.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.817+0000 7f59fa3de700 1 --2- 172.21.15.69:0/395115585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59f4104410 0x7f59f410bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.817+0000 7f59fa3de700 1 --2- 172.21.15.69:0/395115585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f40ff3d0 0x7f59f40ff7a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.817+0000 7f59fa3de700 1 --2- 172.21.15.69:0/395115585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59f40ffd70 0x7f59f4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.817+0000 7f59fa3de700 1 -- 172.21.15.69:0/395115585 >> 172.21.15.69:0/395115585 conn(0x7f59f4076000 msgr2=0x7f59f4076400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.817+0000 7f59fa3de700 1 -- 172.21.15.69:0/395115585 shutdown_connections 2023-12-14T14:17:04.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.817+0000 7f59fa3de700 1 -- 172.21.15.69:0/395115585 wait complete. 2023-12-14T14:17:04.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.818+0000 7f59fa3de700 1 Processor -- start 2023-12-14T14:17:04.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.818+0000 7f59fa3de700 1 -- start start 2023-12-14T14:17:04.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.818+0000 7f59fa3de700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59f40ff3d0 0x7f59f4197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.818+0000 7f59fa3de700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59f40ffd70 0x7f59f4197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.818+0000 7f59fa3de700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f4104410 0x7f59f41a2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.818+0000 7f59fa3de700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f4198190 con 0x7f59f4104410 2023-12-14T14:17:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.818+0000 7f59fa3de700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f41a28d0 con 0x7f59f40ff3d0 2023-12-14T14:17:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.818+0000 7f59fa3de700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f41a2a90 con 0x7f59f40ffd70 2023-12-14T14:17:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f897b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f4104410 0x7f59f41a2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f897b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f4104410 0x7f59f41a2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55668/0 (socket says 172.21.15.69:55668) 2023-12-14T14:17:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f897b700 1 -- 172.21.15.69:0/2330738855 learned_addr learned my addr 172.21.15.69:0/2330738855 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f37fe700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59f40ffd70 0x7f59f4197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f3fff700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59f40ff3d0 0x7f59f4197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f897b700 1 -- 172.21.15.69:0/2330738855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59f40ffd70 msgr2=0x7f59f4197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f897b700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59f40ffd70 0x7f59f4197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f897b700 1 -- 172.21.15.69:0/2330738855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59f40ff3d0 msgr2=0x7f59f4197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f897b700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59f40ff3d0 0x7f59f4197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f897b700 1 -- 172.21.15.69:0/2330738855 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec009d00 con 0x7f59f4104410 2023-12-14T14:17:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f897b700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f4104410 0x7f59f41a2390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c900 tx=0x7f59e400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f17fa700 1 -- 172.21.15.69:0/2330738855 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4007b00 con 0x7f59f4104410 2023-12-14T14:17:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f17fa700 1 -- 172.21.15.69:0/2330738855 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59e400ce50 con 0x7f59f4104410 2023-12-14T14:17:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59f17fa700 1 -- 172.21.15.69:0/2330738855 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4018660 con 0x7f59f4104410 2023-12-14T14:17:04.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59fa3de700 1 -- 172.21.15.69:0/2330738855 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f410f220 con 0x7f59f4104410 2023-12-14T14:17:04.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.819+0000 7f59fa3de700 1 -- 172.21.15.69:0/2330738855 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f410f090 con 0x7f59f4104410 2023-12-14T14:17:04.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.822+0000 7f59f17fa700 1 -- 172.21.15.69:0/2330738855 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f59e400f450 con 0x7f59f4104410 2023-12-14T14:17:04.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.822+0000 7f59f17fa700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f59e00a12c0 0x7f59e00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.823+0000 7f59f3fff700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f59e00a12c0 0x7f59e00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.823+0000 7f59f17fa700 1 -- 172.21.15.69:0/2330738855 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f59e40ccb30 con 0x7f59f4104410 2023-12-14T14:17:04.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.823+0000 7f59f3fff700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f59e00a12c0 0x7f59e00a3770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009fd0 tx=0x7f59ec00b040 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.823+0000 7f5a0656cb80 1 Processor -- start 2023-12-14T14:17:04.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f5a0656cb80 1 -- start start 2023-12-14T14:17:04.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605380 0x557e8d605750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 0x557e8d610610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d610b50 0x557e8d612f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d4ef5e0 con 0x557e8d605380 2023-12-14T14:17:04.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d55e870 con 0x557e8d605c90 2023-12-14T14:17:04.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d557d00 con 0x557e8d610b50 2023-12-14T14:17:04.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605380 0x557e8d605750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605380 0x557e8d605750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55674/0 (socket says 172.21.15.69:55674) 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f3fff700 1 -- 172.21.15.69:0/2061560218 learned_addr learned my addr 172.21.15.69:0/2061560218 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f37fe700 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 0x557e8d610610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f897b700 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d610b50 0x557e8d612f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f3fff700 1 -- 172.21.15.69:0/2061560218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d610b50 msgr2=0x557e8d612f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f3fff700 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d610b50 0x557e8d612f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f3fff700 1 -- 172.21.15.69:0/2061560218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 msgr2=0x557e8d610610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f3fff700 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 0x557e8d610610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f3fff700 1 -- 172.21.15.69:0/2061560218 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e8d3d93b0 con 0x557e8d605380 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f897b700 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d610b50 0x557e8d612f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:04.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f37fe700 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 0x557e8d610610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:04.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59f3fff700 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605380 0x557e8d605750 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009510 tx=0x7f59ec01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf0351ee89ee95b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59ea7fc700 1 -- 172.21.15.69:0/2061560218 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0076a0 con 0x557e8d605380 2023-12-14T14:17:04.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59ea7fc700 1 -- 172.21.15.69:0/2061560218 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59ec007800 con 0x557e8d605380 2023-12-14T14:17:04.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.824+0000 7f59ea7fc700 1 -- 172.21.15.69:0/2061560218 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec01b690 con 0x557e8d605380 2023-12-14T14:17:04.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 -- 172.21.15.69:0/2061560218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605380 msgr2=0x557e8d605750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605380 0x557e8d605750 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009510 tx=0x7f59ec01b000 comp rx=0 tx=0).stop 2023-12-14T14:17:04.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 -- 172.21.15.69:0/2061560218 shutdown_connections 2023-12-14T14:17:04.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d610b50 0x557e8d612f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605380 0x557e8d605750 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/2061560218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 0x557e8d610610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 -- 172.21.15.69:0/2061560218 >> 172.21.15.69:0/2061560218 conn(0x557e8d5fbca0 msgr2=0x557e8d6017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 -- 172.21.15.69:0/2061560218 shutdown_connections 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 -- 172.21.15.69:0/2061560218 wait complete. 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.825+0000 7f5a0656cb80 1 -- start start 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f5a0656cb80 1 Processor -- start 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 0x557e8d6104e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 0x557e8d60d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d4f3f90 con 0x557e8d610b50 2023-12-14T14:17:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d4f3c30 con 0x557e8d605c90 2023-12-14T14:17:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d3db6a0 con 0x557e8d605380 2023-12-14T14:17:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f5a0656cb80 10 client.0 _ll_register_callbacks cb 0x557e8d517910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f59f897b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f59f897b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55676/0 (socket says 172.21.15.69:55676) 2023-12-14T14:17:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f59f897b700 1 -- 172.21.15.69:0/408665542 learned_addr learned my addr 172.21.15.69:0/408665542 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f59f3fff700 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 0x557e8d6104e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.826+0000 7f59f37fe700 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 0x557e8d60d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59f897b700 1 -- 172.21.15.69:0/408665542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 msgr2=0x557e8d6104e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59f897b700 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 0x557e8d6104e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59f897b700 1 -- 172.21.15.69:0/408665542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 msgr2=0x557e8d60d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59f897b700 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 0x557e8d60d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59f897b700 1 -- 172.21.15.69:0/408665542 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f410c820 con 0x557e8d610b50 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59f897b700 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60dda0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f59e40966b0 tx=0x7f59e400fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ec8258ff139afa server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59d37fe700 1 -- 172.21.15.69:0/408665542 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40b1070 con 0x557e8d610b50 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59d37fe700 1 -- 172.21.15.69:0/408665542 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f59e40a2090 con 0x557e8d610b50 2023-12-14T14:17:04.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f5a0656cb80 1 -- 172.21.15.69:0/408665542 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e8d5f92b0 con 0x557e8d610b50 2023-12-14T14:17:04.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59d37fe700 1 -- 172.21.15.69:0/408665542 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59e4096350 con 0x557e8d610b50 2023-12-14T14:17:04.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f5a0656cb80 10 client.16227 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:04.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f5a0656cb80 1 -- 172.21.15.69:0/408665542 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557e8d51e170 con 0x557e8d610b50 2023-12-14T14:17:04.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59d37fe700 1 -- 172.21.15.69:0/408665542 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59e40c8080 con 0x557e8d610b50 2023-12-14T14:17:04.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f59d37fe700 1 -- 172.21.15.69:0/408665542 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f59e4099130 con 0x557e8d610b50 2023-12-14T14:17:04.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f5a0656cb80 10 client.16227 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:04.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f5a0656cb80 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:04.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f5a0656cb80 20 client.16227 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:04.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557e8d620400 0x557e8d622810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f5a0656cb80 4 client.16227 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.827+0000 7f5a0656cb80 1 -- 172.21.15.69:0/408665542 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e8d550ce0 con 0x557e8d620400 2023-12-14T14:17:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.828+0000 7f59f3fff700 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557e8d620400 0x557e8d622810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.828+0000 7f59d37fe700 10 client.16227 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.828+0000 7f59f3fff700 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557e8d620400 0x557e8d622810 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317db4afa1ccbf4b server_cookie=5ac87d565618e239 in_seq=0 out_seq=0 2023-12-14T14:17:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f59d37fe700 1 -- 172.21.15.69:0/408665542 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557e8d550ce0 con 0x557e8d620400 2023-12-14T14:17:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f59d37fe700 10 client.16227 handle_command_reply: tid=0 2023-12-14T14:17:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 client.16227 shutdown 2023-12-14T14:17:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 -- 172.21.15.69:0/408665542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 msgr2=0x557e8d60dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60dda0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f59e40966b0 tx=0x7f59e400fed0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 -- 172.21.15.69:0/408665542 shutdown_connections 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557e8d620400 0x557e8d622810 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60dda0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 0x557e8d6104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/408665542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605c90 0x557e8d60d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f59d37fe700 0 client.16227 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 -- 172.21.15.69:0/408665542 >> 172.21.15.69:0/408665542 conn(0x557e8d5fbca0 msgr2=0x557e8d6013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 -- 172.21.15.69:0/408665542 shutdown_connections 2023-12-14T14:17:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 1 -- 172.21.15.69:0/408665542 wait complete. 2023-12-14T14:17:04.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.829+0000 7f5a0656cb80 20 client.16227 trim_cache size 0 max 16384 2023-12-14T14:17:04.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f5a0656cb80 1 Processor -- start 2023-12-14T14:17:04.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f5a0656cb80 1 -- start start 2023-12-14T14:17:04.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605380 0x557e8d617650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605c90 0x557e8d61c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d61dac0 con 0x557e8d610b50 2023-12-14T14:17:04.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d6065b0 con 0x557e8d605380 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d606330 con 0x557e8d605c90 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f897b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f897b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55684/0 (socket says 172.21.15.69:55684) 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f897b700 1 -- 172.21.15.69:0/3672301612 learned_addr learned my addr 172.21.15.69:0/3672301612 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f3fff700 1 --2- 172.21.15.69:0/3672301612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605380 0x557e8d617650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f897b700 1 -- 172.21.15.69:0/3672301612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605c90 msgr2=0x557e8d61c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f897b700 1 --2- 172.21.15.69:0/3672301612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605c90 0x557e8d61c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f897b700 1 -- 172.21.15.69:0/3672301612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605380 msgr2=0x557e8d617650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f897b700 1 --2- 172.21.15.69:0/3672301612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605380 0x557e8d617650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f897b700 1 -- 172.21.15.69:0/3672301612 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e8d51dec0 con 0x557e8d610b50 2023-12-14T14:17:04.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.842+0000 7f59f897b700 1 --2- 172.21.15.69:0/3672301612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60ffa0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f59e4099940 tx=0x7f59e40981f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabae671fdf5af45 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f59eaffd700 1 -- 172.21.15.69:0/3672301612 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40b1040 con 0x557e8d610b50 2023-12-14T14:17:04.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f59eaffd700 1 -- 172.21.15.69:0/3672301612 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557e8d5f92b0 con 0x557e8d610b50 2023-12-14T14:17:04.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f59eaffd700 1 -- 172.21.15.69:0/3672301612 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40adb80 con 0x557e8d610b50 2023-12-14T14:17:04.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 -- 172.21.15.69:0/3672301612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 msgr2=0x557e8d60ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/3672301612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60ffa0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f59e4099940 tx=0x7f59e40981f0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 -- 172.21.15.69:0/3672301612 shutdown_connections 2023-12-14T14:17:04.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/3672301612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d610b50 0x557e8d60ffa0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/3672301612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d605380 0x557e8d617650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/3672301612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605c90 0x557e8d61c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 -- 172.21.15.69:0/3672301612 >> 172.21.15.69:0/3672301612 conn(0x557e8d5fbca0 msgr2=0x557e8d5fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 -- 172.21.15.69:0/3672301612 shutdown_connections 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 -- 172.21.15.69:0/3672301612 wait complete. 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.843+0000 7f5a0656cb80 1 -- start start 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f5a0656cb80 1 Processor -- start 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 0x557e8d613820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605c90 0x557e8d613d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f5a0656cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d610b50 0x557e8d6732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d6737f0 con 0x557e8d605c90 2023-12-14T14:17:04.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d673930 con 0x557e8d610b50 2023-12-14T14:17:04.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f5a0656cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8d673a70 con 0x557e8d605380 2023-12-14T14:17:04.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f5a0656cb80 10 client.0 _ll_register_callbacks cb 0x7f59e4099850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:04.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605c90 0x557e8d613d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605c90 0x557e8d613d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55688/0 (socket says 172.21.15.69:55688) 2023-12-14T14:17:04.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f37fe700 1 -- 172.21.15.69:0/1525096965 learned_addr learned my addr 172.21.15.69:0/1525096965 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:04.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f897b700 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d610b50 0x557e8d6732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f3fff700 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 0x557e8d613820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f37fe700 1 -- 172.21.15.69:0/1525096965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 msgr2=0x557e8d613820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f37fe700 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 0x557e8d613820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f37fe700 1 -- 172.21.15.69:0/1525096965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d610b50 msgr2=0x557e8d6732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f37fe700 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d610b50 0x557e8d6732b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f37fe700 1 -- 172.21.15.69:0/1525096965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e8d51e170 con 0x557e8d605c90 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.844+0000 7f59f3fff700 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 0x557e8d613820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f59f37fe700 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605c90 0x557e8d613d60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f59f4105a40 tx=0x7f59dc012a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cd5e8da2c21545 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f59d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f59d37fe700 1 -- 172.21.15.69:0/1525096965 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc017070 con 0x557e8d605c90 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f5a0656cb80 1 -- 172.21.15.69:0/1525096965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59ec007800 con 0x557e8d605c90 2023-12-14T14:17:04.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f59d37fe700 1 -- 172.21.15.69:0/1525096965 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f59dc010700 con 0x557e8d605c90 2023-12-14T14:17:04.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f59d37fe700 1 -- 172.21.15.69:0/1525096965 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59dc010900 con 0x557e8d605c90 2023-12-14T14:17:04.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f5a0656cb80 10 client.16233 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:04.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f5a0656cb80 1 -- 172.21.15.69:0/1525096965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557e8d5049a0 con 0x557e8d605c90 2023-12-14T14:17:04.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f59d37fe700 1 -- 172.21.15.69:0/1525096965 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59ec007800 con 0x557e8d605c90 2023-12-14T14:17:04.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f59d37fe700 1 -- 172.21.15.69:0/1525096965 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f59dc01bbf0 con 0x557e8d605c90 2023-12-14T14:17:04.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f5a0656cb80 10 client.16233 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:04.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f5a0656cb80 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:04.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f5a0656cb80 20 client.16233 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:04.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557e8d6751f0 0x557e8d677600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f5a0656cb80 4 client.16233 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f5a0656cb80 1 -- 172.21.15.69:0/1525096965 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557e8d550a00 con 0x557e8d6751f0 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.845+0000 7f59f3fff700 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557e8d6751f0 0x557e8d677600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f59d37fe700 10 client.16233 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f59f3fff700 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557e8d6751f0 0x557e8d677600 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8858ba70d1493eb server_cookie=9bb82fea43c5448f in_seq=0 out_seq=0 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f59d37fe700 1 -- 172.21.15.69:0/1525096965 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f59ec00f020 con 0x557e8d6751f0 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f59d37fe700 10 client.16233 handle_command_reply: tid=0 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 client.16233 shutdown 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 -- 172.21.15.69:0/1525096965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605c90 msgr2=0x557e8d613d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605c90 0x557e8d613d60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f59f4105a40 tx=0x7f59dc012a20 comp rx=0 tx=0).stop 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 -- 172.21.15.69:0/1525096965 shutdown_connections 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x557e8d6751f0 0x557e8d677600 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e8d610b50 0x557e8d6732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557e8d605380 0x557e8d613820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 --2- 172.21.15.69:0/1525096965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e8d605c90 0x557e8d613d60 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f59d37fe700 0 client.16233 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 -- 172.21.15.69:0/1525096965 >> 172.21.15.69:0/1525096965 conn(0x557e8d5fbca0 msgr2=0x557e8d608b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 -- 172.21.15.69:0/1525096965 shutdown_connections 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 1 -- 172.21.15.69:0/1525096965 wait complete. 2023-12-14T14:17:04.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.846+0000 7f5a0656cb80 20 client.16233 trim_cache size 0 max 16384 2023-12-14T14:17:04.856 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:17:04.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 -- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f59e00a12c0 msgr2=0x7f59e00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f59e00a12c0 0x7f59e00a3770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009fd0 tx=0x7f59ec00b040 comp rx=0 tx=0).stop 2023-12-14T14:17:04.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 -- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f4104410 msgr2=0x7f59f41a2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:04.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f4104410 0x7f59f41a2390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c900 tx=0x7f59e400cc10 comp rx=0 tx=0).stop 2023-12-14T14:17:04.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 -- 172.21.15.69:0/2330738855 shutdown_connections 2023-12-14T14:17:04.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f59e00a12c0 0x7f59e00a3770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59f4104410 0x7f59f41a2390 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59f40ff3d0 0x7f59f4197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 --2- 172.21.15.69:0/2330738855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59f40ffd70 0x7f59f4197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:04.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.847+0000 7f59fa3de700 1 -- 172.21.15.69:0/2330738855 >> 172.21.15.69:0/2330738855 conn(0x7f59f4076000 msgr2=0x7f59f40fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:04.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.848+0000 7f59fa3de700 1 -- 172.21.15.69:0/2330738855 shutdown_connections 2023-12-14T14:17:04.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:04.848+0000 7f59fa3de700 1 -- 172.21.15.69:0/2330738855 wait complete. 2023-12-14T14:17:04.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:04 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3019054379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:17:05.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:05 smithi119 ceph-mon[43834]: pgmap v196: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 81 KiB/s wr, 28 op/s 2023-12-14T14:17:05.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:05 smithi069 ceph-mon[42034]: pgmap v196: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 81 KiB/s wr, 28 op/s 2023-12-14T14:17:05.861 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:17:05.861 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:17:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:05 smithi081 ceph-mon[43371]: pgmap v196: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 81 KiB/s wr, 28 op/s 2023-12-14T14:17:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.000+0000 7f4cb0004700 1 -- 172.21.15.69:0/1275420472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff470 msgr2=0x7f4ca81064d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.000+0000 7f4cb0004700 1 --2- 172.21.15.69:0/1275420472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff470 0x7f4ca81064d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009990 tx=0x7f4c98009ca0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.000+0000 7f4cb0004700 1 -- 172.21.15.69:0/1275420472 shutdown_connections 2023-12-14T14:17:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.000+0000 7f4cb0004700 1 --2- 172.21.15.69:0/1275420472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca81113c0 0x7f4ca81137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.000+0000 7f4cb0004700 1 --2- 172.21.15.69:0/1275420472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff470 0x7f4ca81064d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.000+0000 7f4cb0004700 1 --2- 172.21.15.69:0/1275420472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80ff840 0x7f4ca80ffcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.000+0000 7f4cb0004700 1 -- 172.21.15.69:0/1275420472 >> 172.21.15.69:0/1275420472 conn(0x7f4ca8074a60 msgr2=0x7f4ca8074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.000+0000 7f4cb0004700 1 -- 172.21.15.69:0/1275420472 shutdown_connections 2023-12-14T14:17:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.000+0000 7f4cb0004700 1 -- 172.21.15.69:0/1275420472 wait complete. 2023-12-14T14:17:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cb0004700 1 Processor -- start 2023-12-14T14:17:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cb0004700 1 -- start start 2023-12-14T14:17:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cb0004700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80ff470 0x7f4ca819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cb0004700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff840 0x7f4ca819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cb0004700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca81113c0 0x7f4ca81a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cb0004700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81a1930 con 0x7f4ca80ff840 2023-12-14T14:17:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cb0004700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81a1aa0 con 0x7f4ca81113c0 2023-12-14T14:17:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cb0004700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81a1c60 con 0x7f4ca80ff470 2023-12-14T14:17:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cad59f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff840 0x7f4ca819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cad59f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff840 0x7f4ca819ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55706/0 (socket says 172.21.15.69:55706) 2023-12-14T14:17:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cad59f700 1 -- 172.21.15.69:0/2413015998 learned_addr learned my addr 172.21.15.69:0/2413015998 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cadda0700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80ff470 0x7f4ca819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cad59f700 1 -- 172.21.15.69:0/2413015998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80ff470 msgr2=0x7f4ca819c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cad59f700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80ff470 0x7f4ca819c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cad59f700 1 -- 172.21.15.69:0/2413015998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca81113c0 msgr2=0x7f4ca81a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cad59f700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca81113c0 0x7f4ca81a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.001+0000 7f4cad59f700 1 -- 172.21.15.69:0/2413015998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c980095f0 con 0x7f4ca80ff840 2023-12-14T14:17:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.002+0000 7f4cad59f700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff840 0x7f4ca819ced0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400d950 tx=0x7f4ca400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.002+0000 7f4c9effd700 1 -- 172.21.15.69:0/2413015998 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4009b40 con 0x7f4ca80ff840 2023-12-14T14:17:06.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.002+0000 7f4c9effd700 1 -- 172.21.15.69:0/2413015998 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ca4009ca0 con 0x7f4ca80ff840 2023-12-14T14:17:06.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.002+0000 7f4cb0004700 1 -- 172.21.15.69:0/2413015998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca81168a0 con 0x7f4ca80ff840 2023-12-14T14:17:06.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.002+0000 7f4c9effd700 1 -- 172.21.15.69:0/2413015998 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca400f620 con 0x7f4ca80ff840 2023-12-14T14:17:06.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.002+0000 7f4cb0004700 1 -- 172.21.15.69:0/2413015998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8116710 con 0x7f4ca80ff840 2023-12-14T14:17:06.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.004+0000 7f4c9effd700 1 -- 172.21.15.69:0/2413015998 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4ca4010460 con 0x7f4ca80ff840 2023-12-14T14:17:06.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.004+0000 7f4c9effd700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c940a12c0 0x7f4c940a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.005+0000 7f4c9effd700 1 -- 172.21.15.69:0/2413015998 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4ca40cd060 con 0x7f4ca80ff840 2023-12-14T14:17:06.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.005+0000 7f4cadda0700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c940a12c0 0x7f4c940a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.005+0000 7f4cadda0700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c940a12c0 0x7f4c940a3770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c98003730 tx=0x7f4c980036a0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.005+0000 7f4cbc192b80 1 Processor -- start 2023-12-14T14:17:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.005+0000 7f4cbc192b80 1 -- start start 2023-12-14T14:17:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5353c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 0x55ad53547690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53549fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad53426660 con 0x55ad5353c400 2023-12-14T14:17:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad534958f0 con 0x55ad5353cd10 2023-12-14T14:17:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad5348ed80 con 0x55ad53547bd0 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cadda0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5353c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cadda0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5353c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55712/0 (socket says 172.21.15.69:55712) 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cadda0700 1 -- 172.21.15.69:0/1094366696 learned_addr learned my addr 172.21.15.69:0/1094366696 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cae5a1700 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53549fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cad59f700 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 0x55ad53547690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cadda0700 1 -- 172.21.15.69:0/1094366696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 msgr2=0x55ad53549fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cadda0700 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53549fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cadda0700 1 -- 172.21.15.69:0/1094366696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 msgr2=0x55ad53547690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cadda0700 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 0x55ad53547690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cadda0700 1 -- 172.21.15.69:0/1094366696 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad53310430 con 0x55ad5353c400 2023-12-14T14:17:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cad59f700 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 0x55ad53547690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cadda0700 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5353c7d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009990 tx=0x7f4c9801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136a76d71796b4b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4c93fff700 1 -- 172.21.15.69:0/1094366696 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800bab0 con 0x55ad5353c400 2023-12-14T14:17:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4c93fff700 1 -- 172.21.15.69:0/1094366696 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c9801d040 con 0x55ad5353c400 2023-12-14T14:17:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4c93fff700 1 -- 172.21.15.69:0/1094366696 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98024a50 con 0x55ad5353c400 2023-12-14T14:17:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 -- 172.21.15.69:0/1094366696 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 msgr2=0x55ad5353c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5353c7d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009990 tx=0x7f4c9801e000 comp rx=0 tx=0).stop 2023-12-14T14:17:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 -- 172.21.15.69:0/1094366696 shutdown_connections 2023-12-14T14:17:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53549fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5353c7d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/1094366696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 0x55ad53547690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 -- 172.21.15.69:0/1094366696 >> 172.21.15.69:0/1094366696 conn(0x55ad53532d20 msgr2=0x55ad53538860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 -- 172.21.15.69:0/1094366696 shutdown_connections 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.007+0000 7f4cbc192b80 1 -- 172.21.15.69:0/1094366696 wait complete. 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cbc192b80 1 -- start start 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cbc192b80 1 Processor -- start 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 0x55ad53547530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353cd10 0x55ad535447e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53544d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad5342b010 con 0x55ad5353cd10 2023-12-14T14:17:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad5342acb0 con 0x55ad5353c400 2023-12-14T14:17:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad53312720 con 0x55ad53547bd0 2023-12-14T14:17:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cbc192b80 10 client.0 _ll_register_callbacks cb 0x55ad5344e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cad59f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353cd10 0x55ad535447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cad59f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353cd10 0x55ad535447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55722/0 (socket says 172.21.15.69:55722) 2023-12-14T14:17:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cad59f700 1 -- 172.21.15.69:0/804320161 learned_addr learned my addr 172.21.15.69:0/804320161 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cae5a1700 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53544d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.008+0000 7f4cadda0700 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 0x55ad53547530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cad59f700 1 -- 172.21.15.69:0/804320161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 msgr2=0x55ad53544d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cad59f700 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53544d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cad59f700 1 -- 172.21.15.69:0/804320161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 msgr2=0x55ad53547530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cad59f700 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 0x55ad53547530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cad59f700 1 -- 172.21.15.69:0/804320161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8113ed0 con 0x55ad5353cd10 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cad59f700 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353cd10 0x55ad535447e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4ca409a100 tx=0x7f4ca409a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e101eb7f0613c8a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4c917fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4c917fa700 1 -- 172.21.15.69:0/804320161 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4010910 con 0x55ad5353cd10 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4c917fa700 1 -- 172.21.15.69:0/804320161 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4ca409a3d0 con 0x55ad5353cd10 2023-12-14T14:17:06.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cbc192b80 1 -- 172.21.15.69:0/804320161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad53530330 con 0x55ad5353cd10 2023-12-14T14:17:06.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4c917fa700 1 -- 172.21.15.69:0/804320161 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ca409a590 con 0x55ad5353cd10 2023-12-14T14:17:06.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cbc192b80 10 client.16245 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:06.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cbc192b80 1 -- 172.21.15.69:0/804320161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ad534551f0 con 0x55ad5353cd10 2023-12-14T14:17:06.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4c917fa700 1 -- 172.21.15.69:0/804320161 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ad53530330 con 0x55ad5353cd10 2023-12-14T14:17:06.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4c917fa700 1 -- 172.21.15.69:0/804320161 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4ca40a2130 con 0x55ad5353cd10 2023-12-14T14:17:06.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cbc192b80 10 client.16245 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:06.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cbc192b80 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:06.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cbc192b80 20 client.16245 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:06.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ad53557390 0x55ad535597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cbc192b80 4 client.16245 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.009+0000 7f4cbc192b80 1 -- 172.21.15.69:0/804320161 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad53487d60 con 0x55ad53557390 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.010+0000 7f4cadda0700 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ad53557390 0x55ad535597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.010+0000 7f4c917fa700 10 client.16245 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.010+0000 7f4cadda0700 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ad53557390 0x55ad535597a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c3432437ce1f7c server_cookie=78202049a9d0f6db in_seq=0 out_seq=0 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4c917fa700 1 -- 172.21.15.69:0/804320161 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ad53487d60 con 0x55ad53557390 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4c917fa700 10 client.16245 handle_command_reply: tid=0 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 client.16245 shutdown 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 -- 172.21.15.69:0/804320161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353cd10 msgr2=0x55ad535447e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353cd10 0x55ad535447e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4ca409a100 tx=0x7f4ca409a2b0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 -- 172.21.15.69:0/804320161 shutdown_connections 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ad53557390 0x55ad535597a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53544d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4c917fa700 0 client.16245 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 0x55ad53547530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/804320161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353cd10 0x55ad535447e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 -- 172.21.15.69:0/804320161 >> 172.21.15.69:0/804320161 conn(0x55ad53532d20 msgr2=0x55ad53538450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 -- 172.21.15.69:0/804320161 shutdown_connections 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 1 -- 172.21.15.69:0/804320161 wait complete. 2023-12-14T14:17:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.011+0000 7f4cbc192b80 20 client.16245 trim_cache size 0 max 16384 2023-12-14T14:17:06.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cbc192b80 1 Processor -- start 2023-12-14T14:17:06.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cbc192b80 1 -- start start 2023-12-14T14:17:06.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 0x55ad5354e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad5353cd10 0x55ad53546ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad53547bd0 0x55ad53547530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad53540670 con 0x55ad53547bd0 2023-12-14T14:17:06.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad5353ddb0 con 0x55ad5353c400 2023-12-14T14:17:06.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad5354ebe0 con 0x55ad5353cd10 2023-12-14T14:17:06.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cae5a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad53547bd0 0x55ad53547530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cae5a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad53547bd0 0x55ad53547530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55730/0 (socket says 172.21.15.69:55730) 2023-12-14T14:17:06.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cae5a1700 1 -- 172.21.15.69:0/238647165 learned_addr learned my addr 172.21.15.69:0/238647165 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cadda0700 1 --2- 172.21.15.69:0/238647165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 0x55ad5354e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cae5a1700 1 -- 172.21.15.69:0/238647165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad5353cd10 msgr2=0x55ad53546ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cae5a1700 1 --2- 172.21.15.69:0/238647165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad5353cd10 0x55ad53546ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cae5a1700 1 -- 172.21.15.69:0/238647165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 msgr2=0x55ad5354e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cae5a1700 1 --2- 172.21.15.69:0/238647165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 0x55ad5354e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cae5a1700 1 -- 172.21.15.69:0/238647165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad53534560 con 0x55ad53547bd0 2023-12-14T14:17:06.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cadda0700 1 --2- 172.21.15.69:0/238647165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 0x55ad5354e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:06.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.028+0000 7f4cae5a1700 1 --2- 172.21.15.69:0/238647165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad53547bd0 0x55ad53547530 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009890 tx=0x7f4ca00098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42f6e63bb3588dd server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4c9cff9700 1 -- 172.21.15.69:0/238647165 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0004450 con 0x55ad53547bd0 2023-12-14T14:17:06.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4c9cff9700 1 -- 172.21.15.69:0/238647165 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ca000f040 con 0x55ad53547bd0 2023-12-14T14:17:06.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4c9cff9700 1 -- 172.21.15.69:0/238647165 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00073e0 con 0x55ad53547bd0 2023-12-14T14:17:06.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4cbc192b80 1 -- 172.21.15.69:0/238647165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad53547bd0 msgr2=0x55ad53547530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/238647165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad53547bd0 0x55ad53547530 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009890 tx=0x7f4ca00098c0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4cbc192b80 1 -- 172.21.15.69:0/238647165 shutdown_connections 2023-12-14T14:17:06.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/238647165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad53547bd0 0x55ad53547530 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/238647165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353c400 0x55ad5354e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/238647165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad5353cd10 0x55ad53546ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4cbc192b80 1 -- 172.21.15.69:0/238647165 >> 172.21.15.69:0/238647165 conn(0x55ad53532d20 msgr2=0x55ad53538360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4cbc192b80 1 -- 172.21.15.69:0/238647165 shutdown_connections 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.029+0000 7f4cbc192b80 1 -- 172.21.15.69:0/238647165 wait complete. 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cbc192b80 1 -- start start 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cbc192b80 1 Processor -- start 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5354e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 0x55ad53541990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cbc192b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53541ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad53542410 con 0x55ad5353c400 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad53542580 con 0x55ad5353cd10 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cbc192b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad53542740 con 0x55ad53547bd0 2023-12-14T14:17:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cbc192b80 10 client.0 _ll_register_callbacks cb 0x7f4ca4099ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cadda0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5354e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cadda0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5354e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55742/0 (socket says 172.21.15.69:55742) 2023-12-14T14:17:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cadda0700 1 -- 172.21.15.69:0/3150625504 learned_addr learned my addr 172.21.15.69:0/3150625504 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cad59f700 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 0x55ad53541990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cadda0700 1 -- 172.21.15.69:0/3150625504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 msgr2=0x55ad53541ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cae5a1700 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53541ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cadda0700 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53541ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cadda0700 1 -- 172.21.15.69:0/3150625504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 msgr2=0x55ad53541990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cadda0700 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 0x55ad53541990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.030+0000 7f4cadda0700 1 -- 172.21.15.69:0/3150625504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca0003cd0 con 0x55ad5353c400 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cadda0700 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5354e1f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4c98000c00 tx=0x7f4c9801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793d1ba0d0cf2425 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4c917fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4c917fa700 1 -- 172.21.15.69:0/3150625504 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98034040 con 0x55ad5353c400 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4c917fa700 1 -- 172.21.15.69:0/3150625504 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4c98003df0 con 0x55ad5353c400 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cbc192b80 1 -- 172.21.15.69:0/3150625504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad5353d440 con 0x55ad5353c400 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4c917fa700 1 -- 172.21.15.69:0/3150625504 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c9803b9d0 con 0x55ad5353c400 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cbc192b80 10 client.16251 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cbc192b80 1 -- 172.21.15.69:0/3150625504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ad532bcbe0 con 0x55ad5353c400 2023-12-14T14:17:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4c917fa700 1 -- 172.21.15.69:0/3150625504 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ad5353d440 con 0x55ad5353c400 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4c917fa700 1 -- 172.21.15.69:0/3150625504 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4c98024660 con 0x55ad5353c400 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cbc192b80 10 client.16251 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cbc192b80 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cbc192b80 20 client.16251 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ad535ad1c0 0x55ad535af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cbc192b80 4 client.16251 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cbc192b80 1 -- 172.21.15.69:0/3150625504 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f4c9801d040 con 0x55ad535ad1c0 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.031+0000 7f4cad59f700 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ad535ad1c0 0x55ad535af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.032+0000 7f4c917fa700 10 client.16251 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.032+0000 7f4cad59f700 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ad535ad1c0 0x55ad535af5d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a06e4cb25123f334 server_cookie=780b5002fd386d3f in_seq=0 out_seq=0 2023-12-14T14:17:06.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4c917fa700 1 -- 172.21.15.69:0/3150625504 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f4c9801d040 con 0x55ad535ad1c0 2023-12-14T14:17:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4c917fa700 10 client.16251 handle_command_reply: tid=0 2023-12-14T14:17:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 client.16251 shutdown 2023-12-14T14:17:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 -- 172.21.15.69:0/3150625504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 msgr2=0x55ad5354e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5354e1f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4c98000c00 tx=0x7f4c9801a040 comp rx=0 tx=0).stop 2023-12-14T14:17:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 -- 172.21.15.69:0/3150625504 shutdown_connections 2023-12-14T14:17:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ad535ad1c0 0x55ad535af5d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad53547bd0 0x55ad53541ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4c917fa700 0 client.16251 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad5353c400 0x55ad5354e1f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 --2- 172.21.15.69:0/3150625504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad5353cd10 0x55ad53541990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 -- 172.21.15.69:0/3150625504 >> 172.21.15.69:0/3150625504 conn(0x55ad53532d20 msgr2=0x55ad53542fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 -- 172.21.15.69:0/3150625504 shutdown_connections 2023-12-14T14:17:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 1 -- 172.21.15.69:0/3150625504 wait complete. 2023-12-14T14:17:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.033+0000 7f4cbc192b80 20 client.16251 trim_cache size 0 max 16384 2023-12-14T14:17:06.042 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:17:06.042 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:17:06.043 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "6aba221f-d288-4462-850b-5defe10ece36", 2023-12-14T14:17:06.043 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:17:06.043 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:17:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 -- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c940a12c0 msgr2=0x7f4c940a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c940a12c0 0x7f4c940a3770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c98003730 tx=0x7f4c980036a0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 -- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff840 msgr2=0x7f4ca819ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff840 0x7f4ca819ced0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400d950 tx=0x7f4ca400dd10 comp rx=0 tx=0).stop 2023-12-14T14:17:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 -- 172.21.15.69:0/2413015998 shutdown_connections 2023-12-14T14:17:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c940a12c0 0x7f4c940a3770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca81113c0 0x7f4ca81a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80ff470 0x7f4ca819c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 --2- 172.21.15.69:0/2413015998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca80ff840 0x7f4ca819ced0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 -- 172.21.15.69:0/2413015998 >> 172.21.15.69:0/2413015998 conn(0x7f4ca8074a60 msgr2=0x7f4ca80fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 -- 172.21.15.69:0/2413015998 shutdown_connections 2023-12-14T14:17:06.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.034+0000 7f4cb0004700 1 -- 172.21.15.69:0/2413015998 wait complete. 2023-12-14T14:17:06.046 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:17:06.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.169+0000 7f4c7fef8700 1 -- 172.21.15.69:0/2012283648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 msgr2=0x7f4c7810c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.169+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/2012283648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 0x7f4c7810c000 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000b0d0 tx=0x7f4c7000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.169+0000 7f4c7fef8700 1 -- 172.21.15.69:0/2012283648 shutdown_connections 2023-12-14T14:17:06.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.169+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/2012283648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 0x7f4c7810c000 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.169+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/2012283648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c780ff3f0 0x7f4c780ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.169+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/2012283648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c780ffd90 0x7f4c78103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.169+0000 7f4c7fef8700 1 -- 172.21.15.69:0/2012283648 >> 172.21.15.69:0/2012283648 conn(0x7f4c78075fd0 msgr2=0x7f4c780763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.169+0000 7f4c7fef8700 1 -- 172.21.15.69:0/2012283648 shutdown_connections 2023-12-14T14:17:06.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.169+0000 7f4c7fef8700 1 -- 172.21.15.69:0/2012283648 wait complete. 2023-12-14T14:17:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7fef8700 1 Processor -- start 2023-12-14T14:17:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7fef8700 1 -- start start 2023-12-14T14:17:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7fef8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c780ff3f0 0x7f4c781972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7fef8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c780ffd90 0x7f4c78197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7fef8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 0x7f4c781a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7fef8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781a2880 con 0x7f4c78104430 2023-12-14T14:17:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7fef8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781a29c0 con 0x7f4c780ff3f0 2023-12-14T14:17:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7fef8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781a2b00 con 0x7f4c780ffd90 2023-12-14T14:17:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7e495700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 0x7f4c781a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7e495700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 0x7f4c781a2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55758/0 (socket says 172.21.15.69:55758) 2023-12-14T14:17:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7e495700 1 -- 172.21.15.69:0/1944760292 learned_addr learned my addr 172.21.15.69:0/1944760292 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c780ff3f0 0x7f4c781972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7d493700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c780ffd90 0x7f4c78197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7e495700 1 -- 172.21.15.69:0/1944760292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c780ffd90 msgr2=0x7f4c78197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7e495700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c780ffd90 0x7f4c78197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7e495700 1 -- 172.21.15.69:0/1944760292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c780ff3f0 msgr2=0x7f4c781972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7e495700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c780ff3f0 0x7f4c781972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.170+0000 7f4c7e495700 1 -- 172.21.15.69:0/1944760292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c70009d00 con 0x7f4c78104430 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.171+0000 7f4c7e495700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 0x7f4c781a2340 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4c70007940 tx=0x7f4c70007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.171+0000 7f4c6effd700 1 -- 172.21.15.69:0/1944760292 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000e040 con 0x7f4c78104430 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.171+0000 7f4c7fef8700 1 -- 172.21.15.69:0/1944760292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7810f270 con 0x7f4c78104430 2023-12-14T14:17:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.171+0000 7f4c6effd700 1 -- 172.21.15.69:0/1944760292 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c70003e10 con 0x7f4c78104430 2023-12-14T14:17:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.171+0000 7f4c6effd700 1 -- 172.21.15.69:0/1944760292 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70012a60 con 0x7f4c78104430 2023-12-14T14:17:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.171+0000 7f4c7fef8700 1 -- 172.21.15.69:0/1944760292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7810f0e0 con 0x7f4c78104430 2023-12-14T14:17:06.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.173+0000 7f4c6effd700 1 -- 172.21.15.69:0/1944760292 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4c70005730 con 0x7f4c78104430 2023-12-14T14:17:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.173+0000 7f4c6effd700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c640a12c0 0x7f4c640a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.174+0000 7f4c6effd700 1 -- 172.21.15.69:0/1944760292 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4c700ce3d0 con 0x7f4c78104430 2023-12-14T14:17:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.174+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c640a12c0 0x7f4c640a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.174+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c640a12c0 0x7f4c640a3770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009a10 tx=0x7f4c74009190 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.174+0000 7f4c8c086b80 1 Processor -- start 2023-12-14T14:17:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.174+0000 7f4c8c086b80 1 -- start start 2023-12-14T14:17:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdece750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 0x5622fdedbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fddb85e0 con 0x5622fdece380 2023-12-14T14:17:06.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fde27870 con 0x5622fded9b50 2023-12-14T14:17:06.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fde20d00 con 0x5622fdecec90 2023-12-14T14:17:06.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7dc94700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdece750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7dc94700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdece750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55774/0 (socket says 172.21.15.69:55774) 2023-12-14T14:17:06.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7dc94700 1 -- 172.21.15.69:0/3259225501 learned_addr learned my addr 172.21.15.69:0/3259225501 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7e495700 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 0x5622fdedbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7d493700 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7dc94700 1 -- 172.21.15.69:0/3259225501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 msgr2=0x5622fded9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7dc94700 1 -- 172.21.15.69:0/3259225501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 msgr2=0x5622fdedbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 0x5622fdedbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7dc94700 1 -- 172.21.15.69:0/3259225501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622fdca23b0 con 0x5622fdece380 2023-12-14T14:17:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7d493700 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdece750 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400ea00 tx=0x7f4c74011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce0173b44abf209 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c63fff700 1 -- 172.21.15.69:0/3259225501 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7400eec0 con 0x5622fdece380 2023-12-14T14:17:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c63fff700 1 -- 172.21.15.69:0/3259225501 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c74015940 con 0x5622fdece380 2023-12-14T14:17:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.175+0000 7f4c63fff700 1 -- 172.21.15.69:0/3259225501 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74013970 con 0x5622fdece380 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3259225501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 msgr2=0x5622fdece750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdece750 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400ea00 tx=0x7f4c74011000 comp rx=0 tx=0).stop 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3259225501 shutdown_connections 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 0x5622fdedbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdece750 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3259225501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3259225501 >> 172.21.15.69:0/3259225501 conn(0x5622fdec4ca0 msgr2=0x5622fdeca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3259225501 shutdown_connections 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3259225501 wait complete. 2023-12-14T14:17:06.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.176+0000 7f4c8c086b80 1 -- start start 2023-12-14T14:17:06.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c8c086b80 1 Processor -- start 2023-12-14T14:17:06.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 0x5622fded94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fded9b50 0x5622fded6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fddbcf90 con 0x5622fded9b50 2023-12-14T14:17:06.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fddbcc30 con 0x5622fdece380 2023-12-14T14:17:06.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fdca46a0 con 0x5622fdecec90 2023-12-14T14:17:06.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c8c086b80 10 client.0 _ll_register_callbacks cb 0x5622fdde0910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:06.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7e495700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fded9b50 0x5622fded6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7e495700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fded9b50 0x5622fded6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55788/0 (socket says 172.21.15.69:55788) 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7e495700 1 -- 172.21.15.69:0/977735907 learned_addr learned my addr 172.21.15.69:0/977735907 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 0x5622fded94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7d493700 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7e495700 1 -- 172.21.15.69:0/977735907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 msgr2=0x5622fded6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7e495700 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7e495700 1 -- 172.21.15.69:0/977735907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 msgr2=0x5622fded94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7e495700 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 0x5622fded94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.177+0000 7f4c7e495700 1 -- 172.21.15.69:0/977735907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7400e6e0 con 0x5622fded9b50 2023-12-14T14:17:06.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c7e495700 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fded9b50 0x5622fded6ce0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4c70007a90 tx=0x7f4c7000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b223f0c16299605a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c617fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c617fa700 1 -- 172.21.15.69:0/977735907 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7009f5a0 con 0x5622fded9b50 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c617fa700 1 -- 172.21.15.69:0/977735907 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4c700a3930 con 0x5622fded9b50 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c8c086b80 1 -- 172.21.15.69:0/977735907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622fdec22b0 con 0x5622fded9b50 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c617fa700 1 -- 172.21.15.69:0/977735907 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c7009f170 con 0x5622fded9b50 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c8c086b80 10 client.16263 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c8c086b80 1 -- 172.21.15.69:0/977735907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5622fdde7170 con 0x5622fded9b50 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c617fa700 1 -- 172.21.15.69:0/977735907 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c700c9020 con 0x5622fded9b50 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c617fa700 1 -- 172.21.15.69:0/977735907 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4c700cd030 con 0x5622fded9b50 2023-12-14T14:17:06.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c8c086b80 10 client.16263 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c8c086b80 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c8c086b80 20 client.16263 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5622fdee9280 0x5622fdeeb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c8c086b80 4 client.16263 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.178+0000 7f4c8c086b80 1 -- 172.21.15.69:0/977735907 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622fde19ce0 con 0x5622fdee9280 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.179+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5622fdee9280 0x5622fdeeb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.179+0000 7f4c617fa700 10 client.16263 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.179+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5622fdee9280 0x5622fdeeb690 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11a8a976e979352a server_cookie=b9fdc4ef9f248959 in_seq=0 out_seq=0 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c617fa700 1 -- 172.21.15.69:0/977735907 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5622fde19ce0 con 0x5622fdee9280 2023-12-14T14:17:06.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c617fa700 10 client.16263 handle_command_reply: tid=0 2023-12-14T14:17:06.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 client.16263 shutdown 2023-12-14T14:17:06.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 -- 172.21.15.69:0/977735907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fded9b50 msgr2=0x5622fded6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fded9b50 0x5622fded6ce0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4c70007a90 tx=0x7f4c7000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 -- 172.21.15.69:0/977735907 shutdown_connections 2023-12-14T14:17:06.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5622fdee9280 0x5622fdeeb690 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fded9b50 0x5622fded6ce0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 0x5622fded94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/977735907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c617fa700 0 client.16263 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:06.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 -- 172.21.15.69:0/977735907 >> 172.21.15.69:0/977735907 conn(0x5622fdec4ca0 msgr2=0x5622fdeca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 -- 172.21.15.69:0/977735907 shutdown_connections 2023-12-14T14:17:06.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 1 -- 172.21.15.69:0/977735907 wait complete. 2023-12-14T14:17:06.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.180+0000 7f4c8c086b80 20 client.16263 trim_cache size 0 max 16384 2023-12-14T14:17:06.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.196+0000 7f4c8c086b80 1 Processor -- start 2023-12-14T14:17:06.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.196+0000 7f4c8c086b80 1 -- start start 2023-12-14T14:17:06.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdee06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 0x5622fded94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fde19ce0 con 0x5622fdece380 2023-12-14T14:17:06.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fdecf390 con 0x5622fded9b50 2023-12-14T14:17:06.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fdecf5b0 con 0x5622fdecec90 2023-12-14T14:17:06.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7dc94700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdee06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7dc94700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdee06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55792/0 (socket says 172.21.15.69:55792) 2023-12-14T14:17:06.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7dc94700 1 -- 172.21.15.69:0/3166109927 learned_addr learned my addr 172.21.15.69:0/3166109927 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7dc94700 1 -- 172.21.15.69:0/3166109927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 msgr2=0x5622fded8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/3166109927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7dc94700 1 -- 172.21.15.69:0/3166109927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 msgr2=0x5622fded94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7e495700 1 --2- 172.21.15.69:0/3166109927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 0x5622fded94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/3166109927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 0x5622fded94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7dc94700 1 -- 172.21.15.69:0/3166109927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622fdde6ec0 con 0x5622fdece380 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7e495700 1 --2- 172.21.15.69:0/3166109927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 0x5622fded94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/3166109927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdee06b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4c74017010 tx=0x7f4c74015f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce51fe9d992c697 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c6cff9700 1 -- 172.21.15.69:0/3166109927 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c740313f0 con 0x5622fdece380 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c6cff9700 1 -- 172.21.15.69:0/3166109927 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c74031550 con 0x5622fdece380 2023-12-14T14:17:06.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.197+0000 7f4c6cff9700 1 -- 172.21.15.69:0/3166109927 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74013860 con 0x5622fdece380 2023-12-14T14:17:06.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3166109927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 msgr2=0x5622fdee06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3166109927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdee06b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4c74017010 tx=0x7f4c74015f40 comp rx=0 tx=0).stop 2023-12-14T14:17:06.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3166109927 shutdown_connections 2023-12-14T14:17:06.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3166109927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fded9b50 0x5622fded94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3166109927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdece380 0x5622fdee06b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3166109927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fdecec90 0x5622fded8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3166109927 >> 172.21.15.69:0/3166109927 conn(0x5622fdec4ca0 msgr2=0x5622fdeca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3166109927 shutdown_connections 2023-12-14T14:17:06.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3166109927 wait complete. 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 -- start start 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.198+0000 7f4c8c086b80 1 Processor -- start 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 0x5622fdee04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdecec90 0x5622fdedc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c8c086b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fded9b50 0x5622fdedcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fdedd250 con 0x5622fdecec90 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fdedd3c0 con 0x5622fdece380 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c8c086b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622fdedd580 con 0x5622fded9b50 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c8c086b80 10 client.0 _ll_register_callbacks cb 0x7f4c7009b0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:06.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7d493700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdecec90 0x5622fdedc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7d493700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdecec90 0x5622fdedc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55800/0 (socket says 172.21.15.69:55800) 2023-12-14T14:17:06.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7d493700 1 -- 172.21.15.69:0/3115753010 learned_addr learned my addr 172.21.15.69:0/3115753010 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:06.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 0x5622fdee04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7e495700 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fded9b50 0x5622fdedcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7d493700 1 -- 172.21.15.69:0/3115753010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fded9b50 msgr2=0x5622fdedcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7d493700 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fded9b50 0x5622fdedcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7d493700 1 -- 172.21.15.69:0/3115753010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 msgr2=0x5622fdee04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:06.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7d493700 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 0x5622fdee04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7d493700 1 -- 172.21.15.69:0/3115753010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622fdca23b0 con 0x5622fdecec90 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7e495700 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fded9b50 0x5622fdedcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c7d493700 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdecec90 0x5622fdedc7d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4c78067d50 tx=0x7f4c6800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f232fc681b61a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c617fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c617fa700 1 -- 172.21.15.69:0/3115753010 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68014070 con 0x5622fdecec90 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c617fa700 1 -- 172.21.15.69:0/3115753010 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8454+0+0 (secure 0 0 0) 0x7f4c6800e6e0 con 0x5622fdecec90 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.199+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3115753010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c74015940 con 0x5622fdecec90 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c617fa700 1 -- 172.21.15.69:0/3115753010 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c6800e8e0 con 0x5622fdecec90 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c8c086b80 10 client.16269 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3115753010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5622fddcd9a0 con 0x5622fdecec90 2023-12-14T14:17:06.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c617fa700 1 -- 172.21.15.69:0/3115753010 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c74015940 con 0x5622fdecec90 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c617fa700 1 -- 172.21.15.69:0/3115753010 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4c6800dbe0 con 0x5622fdecec90 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c8c086b80 10 client.16269 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c8c086b80 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c8c086b80 20 client.16269 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5622fdf3e5b0 0x5622fdf409c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c8c086b80 4 client.16269 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3115753010 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5622fde19a00 con 0x5622fdf3e5b0 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.200+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5622fdf3e5b0 0x5622fdf409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c617fa700 10 client.16269 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:06.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c7dc94700 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5622fdf3e5b0 0x5622fdf409c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e121da80669c6210 server_cookie=7f651a800fcb3591 in_seq=0 out_seq=0 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c617fa700 1 -- 172.21.15.69:0/3115753010 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5622fde19a00 con 0x5622fdf3e5b0 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c617fa700 10 client.16269 handle_command_reply: tid=0 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 client.16269 shutdown 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3115753010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdecec90 msgr2=0x5622fdedc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdecec90 0x5622fdedc7d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4c78067d50 tx=0x7f4c6800fae0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3115753010 shutdown_connections 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5622fdf3e5b0 0x5622fdf409c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622fded9b50 0x5622fdedcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622fdece380 0x5622fdee04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 --2- 172.21.15.69:0/3115753010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5622fdecec90 0x5622fdedc7d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c617fa700 0 client.16269 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:06.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3115753010 >> 172.21.15.69:0/3115753010 conn(0x5622fdec4ca0 msgr2=0x5622fded02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3115753010 shutdown_connections 2023-12-14T14:17:06.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 1 -- 172.21.15.69:0/3115753010 wait complete. 2023-12-14T14:17:06.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c8c086b80 20 client.16269 trim_cache size 0 max 16384 2023-12-14T14:17:06.211 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:17:06.211 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:17:06.211 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:17:06.212 INFO:teuthology.orchestra.run.smithi069.stdout: "6aba221f-d288-4462-850b-5defe10ece36": { 2023-12-14T14:17:06.212 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:17:06.212 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6aba221f-d288-4462-850b-5defe10ece36", 2023-12-14T14:17:06.212 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:17:06.212 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:17:06.212 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:17:06.212 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:17:06.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c7fef8700 1 -- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c640a12c0 msgr2=0x7f4c640a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c640a12c0 0x7f4c640a3770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009a10 tx=0x7f4c74009190 comp rx=0 tx=0).stop 2023-12-14T14:17:06.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c7fef8700 1 -- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 msgr2=0x7f4c781a2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:06.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.201+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 0x7f4c781a2340 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4c70007940 tx=0x7f4c70007970 comp rx=0 tx=0).stop 2023-12-14T14:17:06.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.202+0000 7f4c7fef8700 1 -- 172.21.15.69:0/1944760292 shutdown_connections 2023-12-14T14:17:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.202+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4c640a12c0 0x7f4c640a3770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.202+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c78104430 0x7f4c781a2340 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.202+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c780ff3f0 0x7f4c781972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.202+0000 7f4c7fef8700 1 --2- 172.21.15.69:0/1944760292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c780ffd90 0x7f4c78197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.202+0000 7f4c7fef8700 1 -- 172.21.15.69:0/1944760292 >> 172.21.15.69:0/1944760292 conn(0x7f4c78075fd0 msgr2=0x7f4c780fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.202+0000 7f4c7fef8700 1 -- 172.21.15.69:0/1944760292 shutdown_connections 2023-12-14T14:17:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:06.202+0000 7f4c7fef8700 1 -- 172.21.15.69:0/1944760292 wait complete. 2023-12-14T14:17:06.215 INFO:tasks.cephfs.filesystem:scrub status for tag:6aba221f-d288-4462-850b-5defe10ece36 - {'path': '/', 'tag': '6aba221f-d288-4462-850b-5defe10ece36', 'options': 'recursive,force'} 2023-12-14T14:17:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:07 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:17:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:07 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:07 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:17:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:07 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:17:07.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:07 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:07.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:07 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:07.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:07 smithi081 ceph-mon[43371]: pgmap v197: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 56 KiB/s wr, 22 op/s 2023-12-14T14:17:07.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:07 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:17:07.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:07 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:07.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:07 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:17:07.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:07 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:17:07.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:07 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:07.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:07 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:07.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:07 smithi119 ceph-mon[43834]: pgmap v197: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 56 KiB/s wr, 22 op/s 2023-12-14T14:17:07.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:07 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:17:07.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:07 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:07.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:07 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:17:07.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:07 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:17:07.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:07 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:07.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:07 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:07.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:07 smithi069 ceph-mon[42034]: pgmap v197: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 56 KiB/s wr, 22 op/s 2023-12-14T14:17:09.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:09 smithi119 ceph-mon[43834]: pgmap v198: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 56 KiB/s wr, 22 op/s 2023-12-14T14:17:09.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:09 smithi069 ceph-mon[42034]: pgmap v198: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 56 KiB/s wr, 22 op/s 2023-12-14T14:17:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:09 smithi081 ceph-mon[43371]: pgmap v198: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 56 KiB/s wr, 22 op/s 2023-12-14T14:17:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:11 smithi119 ceph-mon[43834]: pgmap v199: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 56 KiB/s wr, 25 op/s 2023-12-14T14:17:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:11 smithi119 ceph-mon[43834]: osdmap e86: 12 total, 12 up, 12 in 2023-12-14T14:17:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:11 smithi069 ceph-mon[42034]: pgmap v199: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 56 KiB/s wr, 25 op/s 2023-12-14T14:17:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:11 smithi069 ceph-mon[42034]: osdmap e86: 12 total, 12 up, 12 in 2023-12-14T14:17:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:11 smithi081 ceph-mon[43371]: pgmap v199: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 56 KiB/s wr, 25 op/s 2023-12-14T14:17:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:11 smithi081 ceph-mon[43371]: osdmap e86: 12 total, 12 up, 12 in 2023-12-14T14:17:13.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:13 smithi119 ceph-mon[43834]: pgmap v201: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 64 KiB/s wr, 26 op/s 2023-12-14T14:17:13.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:13 smithi069 ceph-mon[42034]: pgmap v201: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 64 KiB/s wr, 26 op/s 2023-12-14T14:17:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:13 smithi081 ceph-mon[43371]: pgmap v201: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 64 KiB/s wr, 26 op/s 2023-12-14T14:17:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:15 smithi119 ceph-mon[43834]: pgmap v202: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2023-12-14T14:17:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:15 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:17:15.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:15 smithi069 ceph-mon[42034]: pgmap v202: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2023-12-14T14:17:15.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:15 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:17:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:15 smithi081 ceph-mon[43371]: pgmap v202: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2023-12-14T14:17:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:15 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:17:16.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:16 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:17:16.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:16 smithi119 ceph-mon[43834]: osdmap e87: 12 total, 12 up, 12 in 2023-12-14T14:17:16.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:16 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:17:16.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:16 smithi069 ceph-mon[42034]: osdmap e87: 12 total, 12 up, 12 in 2023-12-14T14:17:16.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:16 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:17:16.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:16 smithi081 ceph-mon[43371]: osdmap e87: 12 total, 12 up, 12 in 2023-12-14T14:17:17.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:17 smithi119 ceph-mon[43834]: pgmap v204: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2023-12-14T14:17:17.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:17 smithi069 ceph-mon[42034]: pgmap v204: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2023-12-14T14:17:17.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:17 smithi081 ceph-mon[43371]: pgmap v204: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2023-12-14T14:17:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:19 smithi119 ceph-mon[43834]: pgmap v205: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2023-12-14T14:17:19.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:19 smithi069 ceph-mon[42034]: pgmap v205: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2023-12-14T14:17:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:19 smithi081 ceph-mon[43371]: pgmap v205: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2023-12-14T14:17:21.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:21 smithi119 ceph-mon[43834]: pgmap v206: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-12-14T14:17:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:21 smithi069 ceph-mon[42034]: pgmap v206: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-12-14T14:17:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:21 smithi081 ceph-mon[43371]: pgmap v206: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-12-14T14:17:23.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:23 smithi119 ceph-mon[43834]: pgmap v207: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-12-14T14:17:23.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:23 smithi069 ceph-mon[42034]: pgmap v207: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-12-14T14:17:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:23 smithi081 ceph-mon[43371]: pgmap v207: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-12-14T14:17:25.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:25 smithi119 ceph-mon[43834]: pgmap v208: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-12-14T14:17:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:25 smithi069 ceph-mon[42034]: pgmap v208: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-12-14T14:17:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:25 smithi081 ceph-mon[43371]: pgmap v208: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-12-14T14:17:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:27 smithi081 ceph-mon[43371]: pgmap v209: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-12-14T14:17:27.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:27 smithi119 ceph-mon[43834]: pgmap v209: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-12-14T14:17:27.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:27 smithi069 ceph-mon[42034]: pgmap v209: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-12-14T14:17:29.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:29 smithi119 ceph-mon[43834]: pgmap v210: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 5 op/s 2023-12-14T14:17:29.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:29 smithi069 ceph-mon[42034]: pgmap v210: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 5 op/s 2023-12-14T14:17:29.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:29 smithi081 ceph-mon[43371]: pgmap v210: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 5 op/s 2023-12-14T14:17:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:31 smithi119 ceph-mon[43834]: pgmap v211: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.4 KiB/s wr, 8 op/s 2023-12-14T14:17:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:31 smithi069 ceph-mon[42034]: pgmap v211: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.4 KiB/s wr, 8 op/s 2023-12-14T14:17:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:31 smithi081 ceph-mon[43371]: pgmap v211: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.4 KiB/s wr, 8 op/s 2023-12-14T14:17:33.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:33 smithi119 ceph-mon[43834]: pgmap v212: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2023-12-14T14:17:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:33 smithi069 ceph-mon[42034]: pgmap v212: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2023-12-14T14:17:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:33 smithi081 ceph-mon[43371]: pgmap v212: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2023-12-14T14:17:35.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:35 smithi119 ceph-mon[43834]: pgmap v213: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-12-14T14:17:35.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:35 smithi069 ceph-mon[42034]: pgmap v213: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-12-14T14:17:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:35 smithi081 ceph-mon[43371]: pgmap v213: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-12-14T14:17:36.216 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:17:36.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.376+0000 7fbafe621700 1 -- 172.21.15.69:0/3813572631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80ff9b0 msgr2=0x7fbaf80ffe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.376+0000 7fbafe621700 1 --2- 172.21.15.69:0/3813572631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80ff9b0 0x7fbaf80ffe20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009990 tx=0x7fbae0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.376+0000 7fbafe621700 1 -- 172.21.15.69:0/3813572631 shutdown_connections 2023-12-14T14:17:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.376+0000 7fbafe621700 1 --2- 172.21.15.69:0/3813572631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf810a880 0x7fbaf810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.376+0000 7fbafe621700 1 --2- 172.21.15.69:0/3813572631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf80760f0 0x7fbaf80ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.376+0000 7fbafe621700 1 --2- 172.21.15.69:0/3813572631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80ff9b0 0x7fbaf80ffe20 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.376+0000 7fbafe621700 1 -- 172.21.15.69:0/3813572631 >> 172.21.15.69:0/3813572631 conn(0x7fbaf8074a60 msgr2=0x7fbaf8074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.376+0000 7fbafe621700 1 -- 172.21.15.69:0/3813572631 shutdown_connections 2023-12-14T14:17:36.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.376+0000 7fbafe621700 1 -- 172.21.15.69:0/3813572631 wait complete. 2023-12-14T14:17:36.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbafe621700 1 Processor -- start 2023-12-14T14:17:36.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbafe621700 1 -- start start 2023-12-14T14:17:36.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbafe621700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80760f0 0x7fbaf81963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbafe621700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf80ff9b0 0x7fbaf8196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbafe621700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf810a880 0x7fbaf819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbafe621700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf819b3a0 con 0x7fbaf80760f0 2023-12-14T14:17:36.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbafe621700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf819b510 con 0x7fbaf80ff9b0 2023-12-14T14:17:36.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbafe621700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf819b6d0 con 0x7fbaf810a880 2023-12-14T14:17:36.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbaf7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80760f0 0x7fbaf81963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbaf7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80760f0 0x7fbaf81963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34434/0 (socket says 172.21.15.69:34434) 2023-12-14T14:17:36.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.377+0000 7fbaf7fff700 1 -- 172.21.15.69:0/2779057724 learned_addr learned my addr 172.21.15.69:0/2779057724 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbafcbbe700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf810a880 0x7fbaf819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf80ff9b0 0x7fbaf8196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf7fff700 1 -- 172.21.15.69:0/2779057724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf810a880 msgr2=0x7fbaf819ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf810a880 0x7fbaf819ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf7fff700 1 -- 172.21.15.69:0/2779057724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf80ff9b0 msgr2=0x7fbaf8196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf80ff9b0 0x7fbaf8196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf7fff700 1 -- 172.21.15.69:0/2779057724 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00095f0 con 0x7fbaf80760f0 2023-12-14T14:17:36.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80760f0 0x7fbaf81963c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbae800d950 tx=0x7fbae800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf57fa700 1 -- 172.21.15.69:0/2779057724 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8009b40 con 0x7fbaf80760f0 2023-12-14T14:17:36.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbafe621700 1 -- 172.21.15.69:0/2779057724 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf81102c0 con 0x7fbaf80760f0 2023-12-14T14:17:36.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf57fa700 1 -- 172.21.15.69:0/2779057724 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbae8009ca0 con 0x7fbaf80760f0 2023-12-14T14:17:36.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbaf57fa700 1 -- 172.21.15.69:0/2779057724 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800f620 con 0x7fbaf80760f0 2023-12-14T14:17:36.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.378+0000 7fbafe621700 1 -- 172.21.15.69:0/2779057724 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf8110130 con 0x7fbaf80760f0 2023-12-14T14:17:36.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.380+0000 7fbaf57fa700 1 -- 172.21.15.69:0/2779057724 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fbae8010460 con 0x7fbaf80760f0 2023-12-14T14:17:36.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.381+0000 7fbaf57fa700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fbae40a12c0 0x7fbae40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.381+0000 7fbaf57fa700 1 -- 172.21.15.69:0/2779057724 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fbae80cd090 con 0x7fbaf80760f0 2023-12-14T14:17:36.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.381+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fbae40a12c0 0x7fbae40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.381+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fbae40a12c0 0x7fbae40a3770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbae000b5c0 tx=0x7fbae0005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbb0a7afb80 1 Processor -- start 2023-12-14T14:17:36.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbb0a7afb80 1 -- start start 2023-12-14T14:17:36.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 0x55cb19100750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb1910b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 0x55cb1910df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb18fea5e0 con 0x55cb19100c90 2023-12-14T14:17:36.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb19059870 con 0x55cb1910bb50 2023-12-14T14:17:36.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb19052d00 con 0x55cb19100380 2023-12-14T14:17:36.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb1910b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb1910b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34442/0 (socket says 172.21.15.69:34442) 2023-12-14T14:17:36.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbaf77fe700 1 -- 172.21.15.69:0/2628484432 learned_addr learned my addr 172.21.15.69:0/2628484432 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbafcbbe700 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 0x55cb1910df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 0x55cb19100750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbaf77fe700 1 -- 172.21.15.69:0/2628484432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 msgr2=0x55cb19100750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 0x55cb19100750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbaf77fe700 1 -- 172.21.15.69:0/2628484432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 msgr2=0x55cb1910df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 0x55cb1910df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbaf77fe700 1 -- 172.21.15.69:0/2628484432 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb18ed43b0 con 0x55cb19100c90 2023-12-14T14:17:36.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.382+0000 7fbafcbbe700 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 0x55cb1910df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:36.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb1910b610 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbae0015000 tx=0x7fbae001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b19e15c13fb7d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbaee7fc700 1 -- 172.21.15.69:0/2628484432 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae002b070 con 0x55cb19100c90 2023-12-14T14:17:36.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbaee7fc700 1 -- 172.21.15.69:0/2628484432 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbae001e040 con 0x55cb19100c90 2023-12-14T14:17:36.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbaee7fc700 1 -- 172.21.15.69:0/2628484432 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae00248a0 con 0x55cb19100c90 2023-12-14T14:17:36.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/2628484432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 msgr2=0x55cb1910b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb1910b610 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbae0015000 tx=0x7fbae001f000 comp rx=0 tx=0).stop 2023-12-14T14:17:36.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/2628484432 shutdown_connections 2023-12-14T14:17:36.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 0x55cb1910df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 0x55cb19100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/2628484432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb1910b610 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/2628484432 >> 172.21.15.69:0/2628484432 conn(0x55cb190f6ca0 msgr2=0x55cb190fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/2628484432 shutdown_connections 2023-12-14T14:17:36.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.383+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/2628484432 wait complete. 2023-12-14T14:17:36.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.384+0000 7fbb0a7afb80 1 -- start start 2023-12-14T14:17:36.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.384+0000 7fbb0a7afb80 1 Processor -- start 2023-12-14T14:17:36.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.384+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 0x55cb1910b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.384+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb191087b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 0x55cb19108d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb18feef90 con 0x55cb19100c90 2023-12-14T14:17:36.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb18feec30 con 0x55cb1910bb50 2023-12-14T14:17:36.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb18ed66a0 con 0x55cb19100380 2023-12-14T14:17:36.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbb0a7afb80 10 client.0 _ll_register_callbacks cb 0x55cb19012910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:36.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb191087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb191087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34454/0 (socket says 172.21.15.69:34454) 2023-12-14T14:17:36.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf77fe700 1 -- 172.21.15.69:0/1223927574 learned_addr learned my addr 172.21.15.69:0/1223927574 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 0x55cb1910b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbafcbbe700 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 0x55cb19108d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf77fe700 1 -- 172.21.15.69:0/1223927574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 msgr2=0x55cb1910b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 0x55cb1910b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf77fe700 1 -- 172.21.15.69:0/1223927574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 msgr2=0x55cb19108d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 0x55cb19108d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf77fe700 1 -- 172.21.15.69:0/1223927574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf810d8d0 con 0x55cb19100c90 2023-12-14T14:17:36.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb191087b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbae0031040 tx=0x7fbae000fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eead13a30f17dd13 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbad77fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:36.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbad77fe700 1 -- 172.21.15.69:0/1223927574 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae002b070 con 0x55cb19100c90 2023-12-14T14:17:36.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/1223927574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb190f42b0 con 0x55cb19100c90 2023-12-14T14:17:36.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbad77fe700 1 -- 172.21.15.69:0/1223927574 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fbae0024930 con 0x55cb19100c90 2023-12-14T14:17:36.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbad77fe700 1 -- 172.21.15.69:0/1223927574 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbae0024af0 con 0x55cb19100c90 2023-12-14T14:17:36.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.385+0000 7fbb0a7afb80 10 client.16281 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:36.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/1223927574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55cb19019170 con 0x55cb19100c90 2023-12-14T14:17:36.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbad77fe700 1 -- 172.21.15.69:0/1223927574 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cb190f42b0 con 0x55cb19100c90 2023-12-14T14:17:36.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbad77fe700 1 -- 172.21.15.69:0/1223927574 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fbae0037cc0 con 0x55cb19100c90 2023-12-14T14:17:36.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbb0a7afb80 10 client.16281 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:36.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbb0a7afb80 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:36.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbb0a7afb80 20 client.16281 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:36.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55cb1911afc0 0x55cb1911d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbb0a7afb80 4 client.16281 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:36.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/1223927574 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb1904bce0 con 0x55cb1911afc0 2023-12-14T14:17:36.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.386+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55cb1911afc0 0x55cb1911d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbad77fe700 10 client.16281 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:36.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55cb1911afc0 0x55cb1911d3d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e06478c1c6d9a4bd server_cookie=1e6b1f809c167f25 in_seq=0 out_seq=0 2023-12-14T14:17:36.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbad77fe700 1 -- 172.21.15.69:0/1223927574 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cb1904bce0 con 0x55cb1911afc0 2023-12-14T14:17:36.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbad77fe700 10 client.16281 handle_command_reply: tid=0 2023-12-14T14:17:36.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbb0a7afb80 1 client.16281 shutdown 2023-12-14T14:17:36.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/1223927574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 msgr2=0x55cb191087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb191087b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbae0031040 tx=0x7fbae000fc40 comp rx=0 tx=0).stop 2023-12-14T14:17:36.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/1223927574 shutdown_connections 2023-12-14T14:17:36.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55cb1911afc0 0x55cb1911d3d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb1910bb50 0x55cb19108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbad77fe700 0 client.16281 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:36.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb19100380 0x55cb1910b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.387+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/1223927574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb191087b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.388+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/1223927574 >> 172.21.15.69:0/1223927574 conn(0x55cb190f6ca0 msgr2=0x55cb190fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.388+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/1223927574 shutdown_connections 2023-12-14T14:17:36.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.388+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/1223927574 wait complete. 2023-12-14T14:17:36.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.388+0000 7fbb0a7afb80 20 client.16281 trim_cache size 0 max 16384 2023-12-14T14:17:36.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbb0a7afb80 1 Processor -- start 2023-12-14T14:17:36.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbb0a7afb80 1 -- start start 2023-12-14T14:17:36.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100380 0x55cb191177a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100c90 0x55cb1910afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 0x55cb1910b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb19104600 con 0x55cb19100380 2023-12-14T14:17:36.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb1910e2f0 con 0x55cb19100c90 2023-12-14T14:17:36.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb19108d30 con 0x55cb1910bb50 2023-12-14T14:17:36.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbaf7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100380 0x55cb191177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbaf7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100380 0x55cb191177a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34462/0 (socket says 172.21.15.69:34462) 2023-12-14T14:17:36.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.404+0000 7fbaf7fff700 1 -- 172.21.15.69:0/681140720 learned_addr learned my addr 172.21.15.69:0/681140720 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbafcbbe700 1 --2- 172.21.15.69:0/681140720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 0x55cb1910b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbaf7fff700 1 -- 172.21.15.69:0/681140720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 msgr2=0x55cb1910b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/681140720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 0x55cb1910b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbaf7fff700 1 -- 172.21.15.69:0/681140720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100c90 msgr2=0x55cb1910afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/681140720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100c90 0x55cb1910afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbaf7fff700 1 -- 172.21.15.69:0/681140720 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb19018ec0 con 0x55cb19100380 2023-12-14T14:17:36.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/681140720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100380 0x55cb191177a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbae8096be0 tx=0x7fbae8005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a846dad7e67a843d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbaeeffd700 1 -- 172.21.15.69:0/681140720 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae809e1a0 con 0x55cb19100380 2023-12-14T14:17:36.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbaeeffd700 1 -- 172.21.15.69:0/681140720 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbae8014050 con 0x55cb19100380 2023-12-14T14:17:36.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbaeeffd700 1 -- 172.21.15.69:0/681140720 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8010970 con 0x55cb19100380 2023-12-14T14:17:36.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/681140720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100380 msgr2=0x55cb191177a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.405+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/681140720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100380 0x55cb191177a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbae8096be0 tx=0x7fbae8005910 comp rx=0 tx=0).stop 2023-12-14T14:17:36.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/681140720 shutdown_connections 2023-12-14T14:17:36.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/681140720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 0x55cb1910b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/681140720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100380 0x55cb191177a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/681140720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100c90 0x55cb1910afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/681140720 >> 172.21.15.69:0/681140720 conn(0x55cb190f6ca0 msgr2=0x55cb19121cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/681140720 shutdown_connections 2023-12-14T14:17:36.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/681140720 wait complete. 2023-12-14T14:17:36.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 -- start start 2023-12-14T14:17:36.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 Processor -- start 2023-12-14T14:17:36.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100380 0x55cb19112440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb19110770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 0x55cb19110cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb191111f0 con 0x55cb19100c90 2023-12-14T14:17:36.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb19111360 con 0x55cb19100380 2023-12-14T14:17:36.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb19111520 con 0x55cb1910bb50 2023-12-14T14:17:36.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbb0a7afb80 10 client.0 _ll_register_callbacks cb 0x7fbae000bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:36.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.406+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb19110770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb19110770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34472/0 (socket says 172.21.15.69:34472) 2023-12-14T14:17:36.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf77fe700 1 -- 172.21.15.69:0/3569386220 learned_addr learned my addr 172.21.15.69:0/3569386220 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbafcbbe700 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 0x55cb19110cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100380 0x55cb19112440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf77fe700 1 -- 172.21.15.69:0/3569386220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 msgr2=0x55cb19110cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 0x55cb19110cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf77fe700 1 -- 172.21.15.69:0/3569386220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100380 msgr2=0x55cb19112440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100380 0x55cb19112440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf77fe700 1 -- 172.21.15.69:0/3569386220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf8110130 con 0x55cb19100c90 2023-12-14T14:17:36.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100380 0x55cb19112440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:36.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbaf77fe700 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb19110770 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbae0003730 tx=0x7fbae000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382c4b2ae7457859 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbad77fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:36.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbad77fe700 1 -- 172.21.15.69:0/3569386220 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae002b070 con 0x55cb19100c90 2023-12-14T14:17:36.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbad77fe700 1 -- 172.21.15.69:0/3569386220 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fbae002fbc0 con 0x55cb19100c90 2023-12-14T14:17:36.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/3569386220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbae001e040 con 0x55cb19100c90 2023-12-14T14:17:36.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbad77fe700 1 -- 172.21.15.69:0/3569386220 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbae002fd80 con 0x55cb19100c90 2023-12-14T14:17:36.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbb0a7afb80 10 client.16287 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:36.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/3569386220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55cb18fff9a0 con 0x55cb19100c90 2023-12-14T14:17:36.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.407+0000 7fbad77fe700 1 -- 172.21.15.69:0/3569386220 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbae001e040 con 0x55cb19100c90 2023-12-14T14:17:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbad77fe700 1 -- 172.21.15.69:0/3569386220 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fbae0040720 con 0x55cb19100c90 2023-12-14T14:17:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbb0a7afb80 10 client.16287 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbb0a7afb80 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbb0a7afb80 20 client.16287 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55cb1916fea0 0x55cb191722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbb0a7afb80 4 client.16287 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:17:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/3569386220 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cb1904ba00 con 0x55cb1916fea0 2023-12-14T14:17:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55cb1916fea0 0x55cb191722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbad77fe700 10 client.16287 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbaf7fff700 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55cb1916fea0 0x55cb191722b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3185f129db20ea3d server_cookie=ae87349c2303c94e in_seq=0 out_seq=0 2023-12-14T14:17:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbad77fe700 1 -- 172.21.15.69:0/3569386220 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55cb1904ba00 con 0x55cb1916fea0 2023-12-14T14:17:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbad77fe700 10 client.16287 handle_command_reply: tid=0 2023-12-14T14:17:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.408+0000 7fbb0a7afb80 1 client.16287 shutdown 2023-12-14T14:17:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/3569386220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 msgr2=0x55cb19110770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb19110770 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbae0003730 tx=0x7fbae000bab0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/3569386220 shutdown_connections 2023-12-14T14:17:36.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55cb1916fea0 0x55cb191722b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb1910bb50 0x55cb19110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbad77fe700 0 client.16287 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:36.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb19100380 0x55cb19112440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 --2- 172.21.15.69:0/3569386220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb19100c90 0x55cb19110770 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/3569386220 >> 172.21.15.69:0/3569386220 conn(0x55cb190f6ca0 msgr2=0x55cb191177a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/3569386220 shutdown_connections 2023-12-14T14:17:36.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 1 -- 172.21.15.69:0/3569386220 wait complete. 2023-12-14T14:17:36.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbb0a7afb80 20 client.16287 trim_cache size 0 max 16384 2023-12-14T14:17:36.423 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:17:36.423 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:17:36.423 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:17:36.424 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:17:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 -- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fbae40a12c0 msgr2=0x7fbae40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fbae40a12c0 0x7fbae40a3770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbae000b5c0 tx=0x7fbae0005fb0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 -- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80760f0 msgr2=0x7fbaf81963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80760f0 0x7fbaf81963c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbae800d950 tx=0x7fbae800dd10 comp rx=0 tx=0).stop 2023-12-14T14:17:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 -- 172.21.15.69:0/2779057724 shutdown_connections 2023-12-14T14:17:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fbae40a12c0 0x7fbae40a3770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaf810a880 0x7fbaf819ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaf80760f0 0x7fbaf81963c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 --2- 172.21.15.69:0/2779057724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf80ff9b0 0x7fbaf8196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 -- 172.21.15.69:0/2779057724 >> 172.21.15.69:0/2779057724 conn(0x7fbaf8074a60 msgr2=0x7fbaf8102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 -- 172.21.15.69:0/2779057724 shutdown_connections 2023-12-14T14:17:36.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.409+0000 7fbafe621700 1 -- 172.21.15.69:0/2779057724 wait complete. 2023-12-14T14:17:36.427 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:17:36.427 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:17:36.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.548+0000 7f7cf168d700 1 -- 172.21.15.69:0/1832307206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 msgr2=0x7f7cec0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.548+0000 7f7cf168d700 1 --2- 172.21.15.69:0/1832307206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 0x7f7cec0ff7a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0099c0 tx=0x7f7cdc009cd0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.548+0000 7f7cf168d700 1 -- 172.21.15.69:0/1832307206 shutdown_connections 2023-12-14T14:17:36.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.548+0000 7f7cf168d700 1 --2- 172.21.15.69:0/1832307206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cec104410 0x7f7cec10bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.548+0000 7f7cf168d700 1 --2- 172.21.15.69:0/1832307206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 0x7f7cec0ff7a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.548+0000 7f7cf168d700 1 --2- 172.21.15.69:0/1832307206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cec0ffd70 0x7f7cec103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.548+0000 7f7cf168d700 1 -- 172.21.15.69:0/1832307206 >> 172.21.15.69:0/1832307206 conn(0x7f7cec075fa0 msgr2=0x7f7cec0763a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.548+0000 7f7cf168d700 1 -- 172.21.15.69:0/1832307206 shutdown_connections 2023-12-14T14:17:36.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.548+0000 7f7cf168d700 1 -- 172.21.15.69:0/1832307206 wait complete. 2023-12-14T14:17:36.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7cf168d700 1 Processor -- start 2023-12-14T14:17:36.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7cf168d700 1 -- start start 2023-12-14T14:17:36.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7cf168d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 0x7f7cec1963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7cf168d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cec0ffd70 0x7f7cec196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7cf168d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cec104410 0x7f7cec19ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7cf168d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec19b3a0 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7cf168d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec19b510 con 0x7f7cec0ffd70 2023-12-14T14:17:36.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7cf168d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec19b6d0 con 0x7f7cec104410 2023-12-14T14:17:36.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7ceaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 0x7f7cec1963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.549+0000 7f7ceaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 0x7f7cec1963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34498/0 (socket says 172.21.15.69:34498) 2023-12-14T14:17:36.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7ceaffd700 1 -- 172.21.15.69:0/355399916 learned_addr learned my addr 172.21.15.69:0/355399916 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7ceb7fe700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cec104410 0x7f7cec19ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7cea7fc700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cec0ffd70 0x7f7cec196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7ceaffd700 1 -- 172.21.15.69:0/355399916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cec104410 msgr2=0x7f7cec19ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7ceaffd700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cec104410 0x7f7cec19ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7ceaffd700 1 -- 172.21.15.69:0/355399916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cec0ffd70 msgr2=0x7f7cec196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7ceaffd700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cec0ffd70 0x7f7cec196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7ceaffd700 1 -- 172.21.15.69:0/355399916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc0095f0 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7cea7fc700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cec0ffd70 0x7f7cec196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:36.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7ceaffd700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 0x7f7cec1963c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00b580 tx=0x7f7cdc00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7cd3fff700 1 -- 172.21.15.69:0/355399916 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc01d070 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec10f1d0 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7cd3fff700 1 -- 172.21.15.69:0/355399916 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cdc0054f0 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7cd3fff700 1 -- 172.21.15.69:0/355399916 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc004bd0 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.550+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec10f040 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.551+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cec10f360 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.552+0000 7f7cd3fff700 1 -- 172.21.15.69:0/355399916 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7cdc00fc30 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.553+0000 7f7cd3fff700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7cd40a12c0 0x7f7cd40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.553+0000 7f7cd3fff700 1 -- 172.21.15.69:0/355399916 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f7cdc0cdf60 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.553+0000 7f7cea7fc700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7cd40a12c0 0x7f7cd40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.553+0000 7f7cea7fc700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7cd40a12c0 0x7f7cd40a3770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7cec1979d0 tx=0x7f7ce0009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.556+0000 7f7cd3fff700 1 -- 172.21.15.69:0/355399916 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7cdc097410 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.788+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cec067e40 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.788+0000 7f7cd3fff700 1 -- 172.21.15.69:0/355399916 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10810 (secure 0 0 0) 0x7f7cdc09aa30 con 0x7f7cec0ff3d0 2023-12-14T14:17:36.789 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:17:36.789 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:14:13.438363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:17:36.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7cd40a12c0 msgr2=0x7f7cd40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7cd40a12c0 0x7f7cd40a3770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7cec1979d0 tx=0x7f7ce0009260 comp rx=0 tx=0).stop 2023-12-14T14:17:36.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 msgr2=0x7f7cec1963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 0x7f7cec1963c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00b580 tx=0x7f7cdc00f740 comp rx=0 tx=0).stop 2023-12-14T14:17:36.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 shutdown_connections 2023-12-14T14:17:36.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7cd40a12c0 0x7f7cd40a3770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cec104410 0x7f7cec19ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cec0ff3d0 0x7f7cec1963c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 --2- 172.21.15.69:0/355399916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cec0ffd70 0x7f7cec196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.790+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 >> 172.21.15.69:0/355399916 conn(0x7f7cec075fa0 msgr2=0x7f7cec103010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.791+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 shutdown_connections 2023-12-14T14:17:36.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.791+0000 7f7cf168d700 1 -- 172.21.15.69:0/355399916 wait complete. 2023-12-14T14:17:36.793 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-12-14T14:17:36.804 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:17:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.926+0000 7fecadb77700 1 -- 172.21.15.69:0/540749907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca80ff3b0 msgr2=0x7feca80ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.926+0000 7fecadb77700 1 --2- 172.21.15.69:0/540749907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca80ff3b0 0x7feca80ff780 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fec980099c0 tx=0x7fec98009cd0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.926+0000 7fecadb77700 1 -- 172.21.15.69:0/540749907 shutdown_connections 2023-12-14T14:17:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.926+0000 7fecadb77700 1 --2- 172.21.15.69:0/540749907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca81043f0 0x7feca810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.926+0000 7fecadb77700 1 --2- 172.21.15.69:0/540749907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca80ff3b0 0x7feca80ff780 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.926+0000 7fecadb77700 1 --2- 172.21.15.69:0/540749907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca80ffd50 0x7feca8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.926+0000 7fecadb77700 1 -- 172.21.15.69:0/540749907 >> 172.21.15.69:0/540749907 conn(0x7feca80763a0 msgr2=0x7feca80767a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 -- 172.21.15.69:0/540749907 shutdown_connections 2023-12-14T14:17:36.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 -- 172.21.15.69:0/540749907 wait complete. 2023-12-14T14:17:36.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 Processor -- start 2023-12-14T14:17:36.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 -- start start 2023-12-14T14:17:36.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca80ff3b0 0x7feca81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca80ffd50 0x7feca81968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca81043f0 0x7feca819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca819b380 con 0x7feca81043f0 2023-12-14T14:17:36.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca819b4f0 con 0x7feca80ffd50 2023-12-14T14:17:36.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.927+0000 7fecadb77700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca819b6b0 con 0x7feca80ff3b0 2023-12-14T14:17:36.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca81043f0 0x7feca819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca81043f0 0x7feca819ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34514/0 (socket says 172.21.15.69:34514) 2023-12-14T14:17:36.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca7fff700 1 -- 172.21.15.69:0/4051601579 learned_addr learned my addr 172.21.15.69:0/4051601579 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca6ffd700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca80ffd50 0x7feca81968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca77fe700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca80ff3b0 0x7feca81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca7fff700 1 -- 172.21.15.69:0/4051601579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca80ff3b0 msgr2=0x7feca81963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca7fff700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca80ff3b0 0x7feca81963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca7fff700 1 -- 172.21.15.69:0/4051601579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca80ffd50 msgr2=0x7feca81968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca7fff700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca80ffd50 0x7feca81968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca7fff700 1 -- 172.21.15.69:0/4051601579 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980095f0 con 0x7feca81043f0 2023-12-14T14:17:36.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca7fff700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca81043f0 0x7feca819ad40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7feca000cca0 tx=0x7feca000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca4ff9700 1 -- 172.21.15.69:0/4051601579 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000aaf0 con 0x7feca81043f0 2023-12-14T14:17:36.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7fecadb77700 1 -- 172.21.15.69:0/4051601579 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca810f1b0 con 0x7feca81043f0 2023-12-14T14:17:36.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca4ff9700 1 -- 172.21.15.69:0/4051601579 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feca000ac50 con 0x7feca81043f0 2023-12-14T14:17:36.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7feca4ff9700 1 -- 172.21.15.69:0/4051601579 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00115e0 con 0x7feca81043f0 2023-12-14T14:17:36.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.928+0000 7fecadb77700 1 -- 172.21.15.69:0/4051601579 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca810f020 con 0x7feca81043f0 2023-12-14T14:17:36.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.930+0000 7feca4ff9700 1 -- 172.21.15.69:0/4051601579 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7feca0012420 con 0x7feca81043f0 2023-12-14T14:17:36.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.931+0000 7feca4ff9700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fec900a12c0 0x7fec900a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.931+0000 7feca4ff9700 1 -- 172.21.15.69:0/4051601579 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7feca00ccd10 con 0x7feca81043f0 2023-12-14T14:17:36.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.931+0000 7feca77fe700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fec900a12c0 0x7fec900a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca77fe700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fec900a12c0 0x7fec900a3770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec98009fd0 tx=0x7fec98005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7fecb9d05b80 1 Processor -- start 2023-12-14T14:17:36.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7fecb9d05b80 1 -- start start 2023-12-14T14:17:36.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e56750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e61610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e61b50 0x5571f2e63f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2d405e0 con 0x5571f2e61b50 2023-12-14T14:17:36.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2daf870 con 0x5571f2e56380 2023-12-14T14:17:36.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2da8d00 con 0x5571f2e56c90 2023-12-14T14:17:36.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e61b50 0x5571f2e63f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e61b50 0x5571f2e63f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34520/0 (socket says 172.21.15.69:34520) 2023-12-14T14:17:36.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca7fff700 1 -- 172.21.15.69:0/1709048498 learned_addr learned my addr 172.21.15.69:0/1709048498 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca6ffd700 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e61610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca77fe700 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e56750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca7fff700 1 -- 172.21.15.69:0/1709048498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 msgr2=0x5571f2e61610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca7fff700 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e61610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca7fff700 1 -- 172.21.15.69:0/1709048498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 msgr2=0x5571f2e56750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca7fff700 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e56750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca7fff700 1 -- 172.21.15.69:0/1709048498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571f2c2a3b0 con 0x5571f2e61b50 2023-12-14T14:17:36.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.932+0000 7feca6ffd700 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e61610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:36.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7feca7fff700 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e61b50 0x5571f2e63f30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7feca0096400 tx=0x7feca0096370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddae3f9fbef0b821 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fec8dffb700 1 -- 172.21.15.69:0/1709048498 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000adc0 con 0x5571f2e61b50 2023-12-14T14:17:36.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fec8dffb700 1 -- 172.21.15.69:0/1709048498 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feca0099f00 con 0x5571f2e61b50 2023-12-14T14:17:36.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fec8dffb700 1 -- 172.21.15.69:0/1709048498 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca009a3c0 con 0x5571f2e61b50 2023-12-14T14:17:36.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fecb9d05b80 1 -- 172.21.15.69:0/1709048498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e61b50 msgr2=0x5571f2e63f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e61b50 0x5571f2e63f30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7feca0096400 tx=0x7feca0096370 comp rx=0 tx=0).stop 2023-12-14T14:17:36.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fecb9d05b80 1 -- 172.21.15.69:0/1709048498 shutdown_connections 2023-12-14T14:17:36.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e61b50 0x5571f2e63f30 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e56750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/1709048498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e61610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fecb9d05b80 1 -- 172.21.15.69:0/1709048498 >> 172.21.15.69:0/1709048498 conn(0x5571f2e4cca0 msgr2=0x5571f2e527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fecb9d05b80 1 -- 172.21.15.69:0/1709048498 shutdown_connections 2023-12-14T14:17:36.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.933+0000 7fecb9d05b80 1 -- 172.21.15.69:0/1709048498 wait complete. 2023-12-14T14:17:36.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7fecb9d05b80 1 -- start start 2023-12-14T14:17:36.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7fecb9d05b80 1 Processor -- start 2023-12-14T14:17:36.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e61580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e5e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e61b50 0x5571f2e5ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2d44f90 con 0x5571f2e56c90 2023-12-14T14:17:36.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2d44c30 con 0x5571f2e56380 2023-12-14T14:17:36.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2c2c6a0 con 0x5571f2e61b50 2023-12-14T14:17:36.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7fecb9d05b80 10 client.0 _ll_register_callbacks cb 0x5571f2d68910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:36.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7feca6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e5e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7feca6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e5e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34526/0 (socket says 172.21.15.69:34526) 2023-12-14T14:17:36.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7feca6ffd700 1 -- 172.21.15.69:0/329652812 learned_addr learned my addr 172.21.15.69:0/329652812 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7feca77fe700 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e61580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.934+0000 7feca7fff700 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e61b50 0x5571f2e5ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7feca6ffd700 1 -- 172.21.15.69:0/329652812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e61b50 msgr2=0x5571f2e5ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7feca6ffd700 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e61b50 0x5571f2e5ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7feca6ffd700 1 -- 172.21.15.69:0/329652812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 msgr2=0x5571f2e61580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7feca6ffd700 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e61580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7feca6ffd700 1 -- 172.21.15.69:0/329652812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca810f020 con 0x5571f2e56c90 2023-12-14T14:17:36.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7feca6ffd700 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e5e830 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0136e0 tx=0x7fec9c0139f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f0c1c6cac4a6ef server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fec86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:36.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fec86ffd700 1 -- 172.21.15.69:0/329652812 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c004460 con 0x5571f2e56c90 2023-12-14T14:17:36.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fec86ffd700 1 -- 172.21.15.69:0/329652812 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fec9c003680 con 0x5571f2e56c90 2023-12-14T14:17:36.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fecb9d05b80 1 -- 172.21.15.69:0/329652812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571f2e4a2b0 con 0x5571f2e56c90 2023-12-14T14:17:36.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fec86ffd700 1 -- 172.21.15.69:0/329652812 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec9c003840 con 0x5571f2e56c90 2023-12-14T14:17:36.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fecb9d05b80 10 client.16305 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:36.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fecb9d05b80 1 -- 172.21.15.69:0/329652812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5571f2d6f170 con 0x5571f2e56c90 2023-12-14T14:17:36.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fec86ffd700 1 -- 172.21.15.69:0/329652812 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec9c028080 con 0x5571f2e56c90 2023-12-14T14:17:36.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fec86ffd700 1 -- 172.21.15.69:0/329652812 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fec9c011b90 con 0x5571f2e56c90 2023-12-14T14:17:36.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fecb9d05b80 10 client.16305 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:36.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fecb9d05b80 10 client.16305 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:17:36.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fecb9d05b80 20 client.16305 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:36.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.935+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5571f2e71540 0x5571f2e73950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.936+0000 7fecb9d05b80 4 client.16305 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:36.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.936+0000 7fecb9d05b80 1 -- 172.21.15.69:0/329652812 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571f2da1ce0 con 0x5571f2e71540 2023-12-14T14:17:36.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.936+0000 7feca77fe700 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5571f2e71540 0x5571f2e73950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.936+0000 7fec86ffd700 10 client.16305 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:17:36.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.936+0000 7feca77fe700 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5571f2e71540 0x5571f2e73950 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67f6458812c66432 server_cookie=f4d7cc0433cb1416 in_seq=0 out_seq=0 2023-12-14T14:17:36.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fec86ffd700 1 -- 172.21.15.69:0/329652812 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5571f2da1ce0 con 0x5571f2e71540 2023-12-14T14:17:36.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fec86ffd700 10 client.16305 handle_command_reply: tid=0 2023-12-14T14:17:36.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 client.16305 shutdown 2023-12-14T14:17:36.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 -- 172.21.15.69:0/329652812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 msgr2=0x5571f2e5e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e5e830 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0136e0 tx=0x7fec9c0139f0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 -- 172.21.15.69:0/329652812 shutdown_connections 2023-12-14T14:17:36.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e61b50 0x5571f2e5ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e61580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5571f2e71540 0x5571f2e73950 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/329652812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e5e830 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fec86ffd700 0 client.16305 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:17:36.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 -- 172.21.15.69:0/329652812 >> 172.21.15.69:0/329652812 conn(0x5571f2e4cca0 msgr2=0x5571f2e52370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 -- 172.21.15.69:0/329652812 shutdown_connections 2023-12-14T14:17:36.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 1 -- 172.21.15.69:0/329652812 wait complete. 2023-12-14T14:17:36.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.937+0000 7fecb9d05b80 20 client.16305 trim_cache size 0 max 16384 2023-12-14T14:17:36.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7fecb9d05b80 1 Processor -- start 2023-12-14T14:17:36.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7fecb9d05b80 1 -- start start 2023-12-14T14:17:36.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e4cca0 0x5571f2e61040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e61580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e5e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2e5f5b0 con 0x5571f2e4cca0 2023-12-14T14:17:36.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2e5f940 con 0x5571f2e56380 2023-12-14T14:17:36.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2e6df20 con 0x5571f2e56c90 2023-12-14T14:17:36.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7feca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e4cca0 0x5571f2e61040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7feca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e4cca0 0x5571f2e61040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34532/0 (socket says 172.21.15.69:34532) 2023-12-14T14:17:36.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7feca77fe700 1 -- 172.21.15.69:0/4202502556 learned_addr learned my addr 172.21.15.69:0/4202502556 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.950+0000 7feca6ffd700 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e61580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7feca7fff700 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e5e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7feca77fe700 1 -- 172.21.15.69:0/4202502556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 msgr2=0x5571f2e5e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7feca77fe700 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e5e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7feca77fe700 1 -- 172.21.15.69:0/4202502556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 msgr2=0x5571f2e61580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7feca77fe700 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e61580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7feca77fe700 1 -- 172.21.15.69:0/4202502556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571f2d6eec0 con 0x5571f2e4cca0 2023-12-14T14:17:36.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7feca7fff700 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e5e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:17:36.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7feca77fe700 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e4cca0 0x5571f2e61040 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fec980036c0 tx=0x7fec98022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda0b5a12d6946f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fec8e7fc700 1 -- 172.21.15.69:0/4202502556 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9802b040 con 0x5571f2e4cca0 2023-12-14T14:17:36.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fec8e7fc700 1 -- 172.21.15.69:0/4202502556 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec9802c040 con 0x5571f2e4cca0 2023-12-14T14:17:36.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fec8e7fc700 1 -- 172.21.15.69:0/4202502556 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800f8c0 con 0x5571f2e4cca0 2023-12-14T14:17:36.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fecb9d05b80 1 -- 172.21.15.69:0/4202502556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e4cca0 msgr2=0x5571f2e61040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e4cca0 0x5571f2e61040 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fec980036c0 tx=0x7fec98022000 comp rx=0 tx=0).stop 2023-12-14T14:17:36.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fecb9d05b80 1 -- 172.21.15.69:0/4202502556 shutdown_connections 2023-12-14T14:17:36.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e56c90 0x5571f2e5e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e4cca0 0x5571f2e61040 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/4202502556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e61580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.951+0000 7fecb9d05b80 1 -- 172.21.15.69:0/4202502556 >> 172.21.15.69:0/4202502556 conn(0x5571f2e64200 msgr2=0x5571f2e59b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 -- 172.21.15.69:0/4202502556 shutdown_connections 2023-12-14T14:17:36.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 -- 172.21.15.69:0/4202502556 wait complete. 2023-12-14T14:17:36.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 -- start start 2023-12-14T14:17:36.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 Processor -- start 2023-12-14T14:17:36.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e4cca0 0x5571f2e683c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e66640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e66b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2e68c90 con 0x5571f2e56c90 2023-12-14T14:17:36.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2e670c0 con 0x5571f2e56380 2023-12-14T14:17:36.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f2e67280 con 0x5571f2e4cca0 2023-12-14T14:17:36.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7fecb9d05b80 10 client.0 _ll_register_callbacks cb 0x7fec9c009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:36.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7feca7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e66b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7feca7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e66b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34548/0 (socket says 172.21.15.69:34548) 2023-12-14T14:17:36.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.952+0000 7feca7fff700 1 -- 172.21.15.69:0/3928626736 learned_addr learned my addr 172.21.15.69:0/3928626736 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:36.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7feca77fe700 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e4cca0 0x5571f2e683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7feca6ffd700 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e66640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7feca7fff700 1 -- 172.21.15.69:0/3928626736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e4cca0 msgr2=0x5571f2e683c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7feca7fff700 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e4cca0 0x5571f2e683c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7feca7fff700 1 -- 172.21.15.69:0/3928626736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 msgr2=0x5571f2e66640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:36.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7feca7fff700 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e66640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7feca7fff700 1 -- 172.21.15.69:0/3928626736 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca810c800 con 0x5571f2e56c90 2023-12-14T14:17:36.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7feca77fe700 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e4cca0 0x5571f2e683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:36.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7feca7fff700 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e66b80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feca000a3b0 tx=0x7feca0012ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307f30989aa2caa0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:36.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fec86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:36.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fec86ffd700 1 -- 172.21.15.69:0/3928626736 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00b82d0 con 0x5571f2e56c90 2023-12-14T14:17:36.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fec86ffd700 1 -- 172.21.15.69:0/3928626736 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7feca00128e0 con 0x5571f2e56c90 2023-12-14T14:17:36.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fecb9d05b80 1 -- 172.21.15.69:0/3928626736 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feca0099f00 con 0x5571f2e56c90 2023-12-14T14:17:36.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fec86ffd700 1 -- 172.21.15.69:0/3928626736 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7feca00a2350 con 0x5571f2e56c90 2023-12-14T14:17:36.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fecb9d05b80 10 client.16311 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:36.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fecb9d05b80 1 -- 172.21.15.69:0/3928626736 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5571f2d559a0 con 0x5571f2e56c90 2023-12-14T14:17:36.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fec86ffd700 1 -- 172.21.15.69:0/3928626736 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feca0099f00 con 0x5571f2e56c90 2023-12-14T14:17:36.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fec86ffd700 1 -- 172.21.15.69:0/3928626736 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7feca009a160 con 0x5571f2e56c90 2023-12-14T14:17:36.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fecb9d05b80 10 client.16311 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:36.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fecb9d05b80 10 client.16311 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:17:36.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fecb9d05b80 20 client.16311 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:36.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5571f2e61b50 0x5571f2ec8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:36.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fecb9d05b80 4 client.16311 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:17:36.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.953+0000 7fecb9d05b80 1 -- 172.21.15.69:0/3928626736 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5571f2da1a00 con 0x5571f2e61b50 2023-12-14T14:17:36.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.954+0000 7feca77fe700 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5571f2e61b50 0x5571f2ec8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:36.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.954+0000 7fec86ffd700 10 client.16311 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:17:36.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.954+0000 7feca77fe700 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5571f2e61b50 0x5571f2ec8360 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c4f1b6069e21326 server_cookie=10cc811b012e75b0 in_seq=0 out_seq=0 2023-12-14T14:17:36.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.954+0000 7fec86ffd700 1 -- 172.21.15.69:0/3928626736 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5571f2da1a00 con 0x5571f2e61b50 2023-12-14T14:17:36.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.954+0000 7fec86ffd700 10 client.16311 handle_command_reply: tid=0 2023-12-14T14:17:36.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.954+0000 7fecb9d05b80 1 client.16311 shutdown 2023-12-14T14:17:36.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.954+0000 7fecb9d05b80 1 -- 172.21.15.69:0/3928626736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 msgr2=0x5571f2e66b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.954+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e66b80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feca000a3b0 tx=0x7feca0012ae0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecb9d05b80 1 -- 172.21.15.69:0/3928626736 shutdown_connections 2023-12-14T14:17:36.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x5571f2e61b50 0x5571f2ec8360 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5571f2e56c90 0x5571f2e66b80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fec86ffd700 0 client.16311 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:17:36.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f2e4cca0 0x5571f2e683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecb9d05b80 1 --2- 172.21.15.69:0/3928626736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571f2e56380 0x5571f2e66640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecb9d05b80 1 -- 172.21.15.69:0/3928626736 >> 172.21.15.69:0/3928626736 conn(0x5571f2e64200 msgr2=0x5571f2e58350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecb9d05b80 1 -- 172.21.15.69:0/3928626736 shutdown_connections 2023-12-14T14:17:36.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecb9d05b80 1 -- 172.21.15.69:0/3928626736 wait complete. 2023-12-14T14:17:36.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecb9d05b80 20 client.16311 trim_cache size 0 max 16384 2023-12-14T14:17:36.974 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:17:36.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 -- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fec900a12c0 msgr2=0x7fec900a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fec900a12c0 0x7fec900a3770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec98009fd0 tx=0x7fec98005fb0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 -- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca81043f0 msgr2=0x7feca819ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:36.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca81043f0 0x7feca819ad40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7feca000cca0 tx=0x7feca000a060 comp rx=0 tx=0).stop 2023-12-14T14:17:36.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 -- 172.21.15.69:0/4051601579 shutdown_connections 2023-12-14T14:17:36.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fec900a12c0 0x7fec900a3770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feca81043f0 0x7feca819ad40 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca80ff3b0 0x7feca81963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 --2- 172.21.15.69:0/4051601579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca80ffd50 0x7feca81968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:36.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 -- 172.21.15.69:0/4051601579 >> 172.21.15.69:0/4051601579 conn(0x7feca80763a0 msgr2=0x7feca8068fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:36.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 -- 172.21.15.69:0/4051601579 shutdown_connections 2023-12-14T14:17:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:36.955+0000 7fecadb77700 1 -- 172.21.15.69:0/4051601579 wait complete. 2023-12-14T14:17:36.978 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:17:37.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.101+0000 7f0e702f6700 1 -- 172.21.15.69:0/3063210294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e681043d0 msgr2=0x7f0e6810bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.101+0000 7f0e702f6700 1 --2- 172.21.15.69:0/3063210294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e681043d0 0x7f0e6810bfa0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000b0d0 tx=0x7f0e6000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.101+0000 7f0e702f6700 1 -- 172.21.15.69:0/3063210294 shutdown_connections 2023-12-14T14:17:37.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.101+0000 7f0e702f6700 1 --2- 172.21.15.69:0/3063210294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e681043d0 0x7f0e6810bfa0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.101+0000 7f0e702f6700 1 --2- 172.21.15.69:0/3063210294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e680ff390 0x7f0e680ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.101+0000 7f0e702f6700 1 --2- 172.21.15.69:0/3063210294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e680ffd30 0x7f0e68103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.101+0000 7f0e702f6700 1 -- 172.21.15.69:0/3063210294 >> 172.21.15.69:0/3063210294 conn(0x7f0e68075fd0 msgr2=0x7f0e680763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 -- 172.21.15.69:0/3063210294 shutdown_connections 2023-12-14T14:17:37.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 -- 172.21.15.69:0/3063210294 wait complete. 2023-12-14T14:17:37.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 Processor -- start 2023-12-14T14:17:37.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 -- start start 2023-12-14T14:17:37.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e680ff390 0x7f0e68195410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e680ffd30 0x7f0e68195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e681043d0 0x7f0e68199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6819a3f0 con 0x7f0e680ffd30 2023-12-14T14:17:37.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6819a560 con 0x7f0e681043d0 2023-12-14T14:17:37.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e702f6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6819a720 con 0x7f0e680ff390 2023-12-14T14:17:37.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e6d891700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e680ffd30 0x7f0e68195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e6d891700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e680ffd30 0x7f0e68195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34564/0 (socket says 172.21.15.69:34564) 2023-12-14T14:17:37.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.102+0000 7f0e6d891700 1 -- 172.21.15.69:0/2051684665 learned_addr learned my addr 172.21.15.69:0/2051684665 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e6e092700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e680ff390 0x7f0e68195410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e6d891700 1 -- 172.21.15.69:0/2051684665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e680ff390 msgr2=0x7f0e68195410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e6d891700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e680ff390 0x7f0e68195410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e6d891700 1 -- 172.21.15.69:0/2051684665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e681043d0 msgr2=0x7f0e68199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e6e893700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e681043d0 0x7f0e68199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e6d891700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e681043d0 0x7f0e68199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e6d891700 1 -- 172.21.15.69:0/2051684665 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009d00 con 0x7f0e680ffd30 2023-12-14T14:17:37.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e6e092700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e680ff390 0x7f0e68195410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:37.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e6d891700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e680ffd30 0x7f0e68195950 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0e640078b0 tx=0x7f0e64007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e5f7fe700 1 -- 172.21.15.69:0/2051684665 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64012070 con 0x7f0e680ffd30 2023-12-14T14:17:37.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e5f7fe700 1 -- 172.21.15.69:0/2051684665 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e64004cf0 con 0x7f0e680ffd30 2023-12-14T14:17:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e702f6700 1 -- 172.21.15.69:0/2051684665 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6810f1f0 con 0x7f0e680ffd30 2023-12-14T14:17:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e5f7fe700 1 -- 172.21.15.69:0/2051684665 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64009990 con 0x7f0e680ffd30 2023-12-14T14:17:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.103+0000 7f0e702f6700 1 -- 172.21.15.69:0/2051684665 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6810f060 con 0x7f0e680ffd30 2023-12-14T14:17:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.105+0000 7f0e5f7fe700 1 -- 172.21.15.69:0/2051684665 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0e64016070 con 0x7f0e680ffd30 2023-12-14T14:17:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.106+0000 7f0e5f7fe700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0e540a12c0 0x7f0e540a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.106+0000 7f0e6e092700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0e540a12c0 0x7f0e540a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.106+0000 7f0e5f7fe700 1 -- 172.21.15.69:0/2051684665 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f0e640cdc30 con 0x7f0e680ffd30 2023-12-14T14:17:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.106+0000 7f0e6e092700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0e540a12c0 0x7f0e540a3770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e58005950 tx=0x7f0e580058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.106+0000 7f0e7c484b80 1 Processor -- start 2023-12-14T14:17:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e7c484b80 1 -- start start 2023-12-14T14:17:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4380 0x55ad08bd4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 0x55ad08bdf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08be1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08abe5e0 con 0x55ad08bdfb50 2023-12-14T14:17:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08b2d870 con 0x55ad08bd4380 2023-12-14T14:17:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08b26d00 con 0x55ad08bd4c90 2023-12-14T14:17:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e6e893700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08be1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e6e893700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08be1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34570/0 (socket says 172.21.15.69:34570) 2023-12-14T14:17:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e6e893700 1 -- 172.21.15.69:0/1956831776 learned_addr learned my addr 172.21.15.69:0/1956831776 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e6e092700 1 --2- 172.21.15.69:0/1956831776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4380 0x55ad08bd4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e6d891700 1 --2- 172.21.15.69:0/1956831776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 0x55ad08bdf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e6e893700 1 -- 172.21.15.69:0/1956831776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 msgr2=0x55ad08bdf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.107+0000 7f0e6e893700 1 --2- 172.21.15.69:0/1956831776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 0x55ad08bdf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.108+0000 7f0e6e893700 1 -- 172.21.15.69:0/1956831776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4380 msgr2=0x55ad08bd4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.108+0000 7f0e6e893700 1 --2- 172.21.15.69:0/1956831776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4380 0x55ad08bd4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.108+0000 7f0e6e893700 1 -- 172.21.15.69:0/1956831776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad089a83b0 con 0x55ad08bdfb50 2023-12-14T14:17:37.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.108+0000 7f0e6e893700 1 --2- 172.21.15.69:0/1956831776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08be1f30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009c20 tx=0x7f0e60009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97bb6a3ec3c8973 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.108+0000 7f0e5cdac700 1 -- 172.21.15.69:0/1956831776 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000e070 con 0x55ad08bdfb50 2023-12-14T14:17:37.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.108+0000 7f0e5cdac700 1 -- 172.21.15.69:0/1956831776 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e60004a50 con 0x55ad08bdfb50 2023-12-14T14:17:37.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.108+0000 7f0e5cdac700 1 -- 172.21.15.69:0/1956831776 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60005040 con 0x55ad08bdfb50 2023-12-14T14:17:37.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.108+0000 7f0e7c484b80 1 -- 172.21.15.69:0/1956831776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 msgr2=0x55ad08be1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.108+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/1956831776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08be1f30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009c20 tx=0x7f0e60009c50 comp rx=0 tx=0).stop 2023-12-14T14:17:37.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 -- 172.21.15.69:0/1956831776 shutdown_connections 2023-12-14T14:17:37.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/1956831776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08be1f30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/1956831776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4380 0x55ad08bd4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/1956831776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 0x55ad08bdf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 -- 172.21.15.69:0/1956831776 >> 172.21.15.69:0/1956831776 conn(0x55ad08bcaca0 msgr2=0x55ad08bd07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 -- 172.21.15.69:0/1956831776 shutdown_connections 2023-12-14T14:17:37.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 -- 172.21.15.69:0/1956831776 wait complete. 2023-12-14T14:17:37.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 -- start start 2023-12-14T14:17:37.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 Processor -- start 2023-12-14T14:17:37.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bd4380 0x55ad08bdf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 0x55ad08bdc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bdfb50 0x55ad08bdcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08ac2f90 con 0x55ad08bd4380 2023-12-14T14:17:37.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08ac2c30 con 0x55ad08bdfb50 2023-12-14T14:17:37.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad089aa6a0 con 0x55ad08bd4c90 2023-12-14T14:17:37.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e7c484b80 10 client.0 _ll_register_callbacks cb 0x55ad08ae6910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:37.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e6e092700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bd4380 0x55ad08bdf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e6e092700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bd4380 0x55ad08bdf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34586/0 (socket says 172.21.15.69:34586) 2023-12-14T14:17:37.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.109+0000 7f0e6e092700 1 -- 172.21.15.69:0/2736539587 learned_addr learned my addr 172.21.15.69:0/2736539587 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e6d891700 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 0x55ad08bdc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e6e092700 1 -- 172.21.15.69:0/2736539587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 msgr2=0x55ad08bdc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e6e092700 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 0x55ad08bdc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e6e092700 1 -- 172.21.15.69:0/2736539587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bdfb50 msgr2=0x55ad08bdcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e6e092700 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bdfb50 0x55ad08bdcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e6e092700 1 -- 172.21.15.69:0/2736539587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6810c7e0 con 0x55ad08bd4380 2023-12-14T14:17:37.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e6d891700 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 0x55ad08bdc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:37.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e6e092700 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bd4380 0x55ad08bdf4d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0e580042e0 tx=0x7f0e58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6235e5b57821f3f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:37.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e51ffb700 1 -- 172.21.15.69:0/2736539587 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58017040 con 0x55ad08bd4380 2023-12-14T14:17:37.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e51ffb700 1 -- 172.21.15.69:0/2736539587 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f0e5800fe70 con 0x55ad08bd4380 2023-12-14T14:17:37.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e7c484b80 1 -- 172.21.15.69:0/2736539587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad08bc82b0 con 0x55ad08bd4380 2023-12-14T14:17:37.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e51ffb700 1 -- 172.21.15.69:0/2736539587 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e58003d10 con 0x55ad08bd4380 2023-12-14T14:17:37.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e7c484b80 10 client.16323 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:37.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e7c484b80 1 -- 172.21.15.69:0/2736539587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ad08aed170 con 0x55ad08bd4380 2023-12-14T14:17:37.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e51ffb700 1 -- 172.21.15.69:0/2736539587 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ad08bc82b0 con 0x55ad08bd4380 2023-12-14T14:17:37.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.110+0000 7f0e51ffb700 1 -- 172.21.15.69:0/2736539587 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0e580204a0 con 0x55ad08bd4380 2023-12-14T14:17:37.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.111+0000 7f0e7c484b80 10 client.16323 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:37.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.111+0000 7f0e7c484b80 10 client.16323 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:17:37.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.111+0000 7f0e7c484b80 20 client.16323 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:37.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.111+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ad08bef510 0x55ad08bf1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.111+0000 7f0e7c484b80 4 client.16323 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:37.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.111+0000 7f0e7c484b80 1 -- 172.21.15.69:0/2736539587 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad08b1fce0 con 0x55ad08bef510 2023-12-14T14:17:37.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.111+0000 7f0e6d891700 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ad08bef510 0x55ad08bf1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.111+0000 7f0e51ffb700 10 client.16323 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:17:37.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.111+0000 7f0e6d891700 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ad08bef510 0x55ad08bf1920 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac8ce68dfab80d3b server_cookie=d8e224a96a24c474 in_seq=0 out_seq=0 2023-12-14T14:17:37.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e51ffb700 1 -- 172.21.15.69:0/2736539587 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ad08b1fce0 con 0x55ad08bef510 2023-12-14T14:17:37.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e51ffb700 10 client.16323 handle_command_reply: tid=0 2023-12-14T14:17:37.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 client.16323 shutdown 2023-12-14T14:17:37.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 -- 172.21.15.69:0/2736539587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bd4380 msgr2=0x55ad08bdf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bd4380 0x55ad08bdf4d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0e580042e0 tx=0x7f0e58004750 comp rx=0 tx=0).stop 2023-12-14T14:17:37.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 -- 172.21.15.69:0/2736539587 shutdown_connections 2023-12-14T14:17:37.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bdfb50 0x55ad08bdcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ad08bef510 0x55ad08bf1920 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bd4380 0x55ad08bdf4d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e51ffb700 0 client.16323 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:17:37.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/2736539587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4c90 0x55ad08bdc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 -- 172.21.15.69:0/2736539587 >> 172.21.15.69:0/2736539587 conn(0x55ad08bcaca0 msgr2=0x55ad08bd03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 -- 172.21.15.69:0/2736539587 shutdown_connections 2023-12-14T14:17:37.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.112+0000 7f0e7c484b80 1 -- 172.21.15.69:0/2736539587 wait complete. 2023-12-14T14:17:37.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.113+0000 7f0e7c484b80 20 client.16323 trim_cache size 0 max 16384 2023-12-14T14:17:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.125+0000 7f0e7c484b80 1 Processor -- start 2023-12-14T14:17:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.125+0000 7f0e7c484b80 1 -- start start 2023-12-14T14:17:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.125+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 0x55ad08bdef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.125+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 0x55ad08bdf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08bd7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08bd41c0 con 0x55ad08bdfb50 2023-12-14T14:17:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08bdad00 con 0x55ad08bd4c90 2023-12-14T14:17:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08bd8610 con 0x55ad08bd4380 2023-12-14T14:17:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e893700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08bd7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e893700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08bd7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34598/0 (socket says 172.21.15.69:34598) 2023-12-14T14:17:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e893700 1 -- 172.21.15.69:0/97411813 learned_addr learned my addr 172.21.15.69:0/97411813 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e092700 1 --2- 172.21.15.69:0/97411813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 0x55ad08bdef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6d891700 1 --2- 172.21.15.69:0/97411813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 0x55ad08bdf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e893700 1 -- 172.21.15.69:0/97411813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 msgr2=0x55ad08bdef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e893700 1 --2- 172.21.15.69:0/97411813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 0x55ad08bdef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e893700 1 -- 172.21.15.69:0/97411813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 msgr2=0x55ad08bdf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e893700 1 --2- 172.21.15.69:0/97411813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 0x55ad08bdf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e893700 1 -- 172.21.15.69:0/97411813 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad08aecec0 con 0x55ad08bdfb50 2023-12-14T14:17:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e6e893700 1 --2- 172.21.15.69:0/97411813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08bd7ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000b0d0 tx=0x7f0e6000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acc7796404ead46 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e5d5ad700 1 -- 172.21.15.69:0/97411813 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000e040 con 0x55ad08bdfb50 2023-12-14T14:17:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e5d5ad700 1 -- 172.21.15.69:0/97411813 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e60004bc0 con 0x55ad08bdfb50 2023-12-14T14:17:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.126+0000 7f0e5d5ad700 1 -- 172.21.15.69:0/97411813 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6001b690 con 0x55ad08bdfb50 2023-12-14T14:17:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 -- 172.21.15.69:0/97411813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 msgr2=0x55ad08bd7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/97411813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08bd7ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000b0d0 tx=0x7f0e6000cf50 comp rx=0 tx=0).stop 2023-12-14T14:17:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 -- 172.21.15.69:0/97411813 shutdown_connections 2023-12-14T14:17:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/97411813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08bd7ad0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/97411813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 0x55ad08bdef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/97411813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 0x55ad08bdf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 -- 172.21.15.69:0/97411813 >> 172.21.15.69:0/97411813 conn(0x55ad08bcaca0 msgr2=0x55ad08beb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 -- 172.21.15.69:0/97411813 shutdown_connections 2023-12-14T14:17:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 -- 172.21.15.69:0/97411813 wait complete. 2023-12-14T14:17:37.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 -- start start 2023-12-14T14:17:37.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 Processor -- start 2023-12-14T14:17:37.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 0x55ad08be4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 0x55ad08be4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08c42410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08be54e0 con 0x55ad08bdfb50 2023-12-14T14:17:37.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08c42980 con 0x55ad08bd4c90 2023-12-14T14:17:37.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad08c42b40 con 0x55ad08bd4380 2023-12-14T14:17:37.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e7c484b80 10 client.0 _ll_register_callbacks cb 0x7f0e5800fcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:37.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e6e893700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08c42410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e6e893700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08c42410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34614/0 (socket says 172.21.15.69:34614) 2023-12-14T14:17:37.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e6e893700 1 -- 172.21.15.69:0/3847032509 learned_addr learned my addr 172.21.15.69:0/3847032509 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.127+0000 7f0e6e092700 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 0x55ad08be4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e6d891700 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 0x55ad08be4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e6e893700 1 -- 172.21.15.69:0/3847032509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 msgr2=0x55ad08be4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e6e893700 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 0x55ad08be4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e6e893700 1 -- 172.21.15.69:0/3847032509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 msgr2=0x55ad08be4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e6e893700 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 0x55ad08be4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e6e893700 1 -- 172.21.15.69:0/3847032509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad089a83b0 con 0x55ad08bdfb50 2023-12-14T14:17:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e6d891700 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 0x55ad08be4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e6e893700 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08c42410 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000b420 tx=0x7f0e60009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83934fe46a791669 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e51ffb700 1 -- 172.21.15.69:0/3847032509 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000e070 con 0x55ad08bdfb50 2023-12-14T14:17:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e51ffb700 1 -- 172.21.15.69:0/3847032509 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f0e6001b840 con 0x55ad08bdfb50 2023-12-14T14:17:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e7c484b80 1 -- 172.21.15.69:0/3847032509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e60004a50 con 0x55ad08bdfb50 2023-12-14T14:17:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e51ffb700 1 -- 172.21.15.69:0/3847032509 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e6001ba00 con 0x55ad08bdfb50 2023-12-14T14:17:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e7c484b80 10 client.16329 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e7c484b80 1 -- 172.21.15.69:0/3847032509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ad08ad39a0 con 0x55ad08bdfb50 2023-12-14T14:17:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e51ffb700 1 -- 172.21.15.69:0/3847032509 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e60004a50 con 0x55ad08bdfb50 2023-12-14T14:17:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e51ffb700 1 -- 172.21.15.69:0/3847032509 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0e6000b100 con 0x55ad08bdfb50 2023-12-14T14:17:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e7c484b80 10 client.16329 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e7c484b80 10 client.16329 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:17:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e7c484b80 20 client.16329 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ad08c43e90 0x55ad08c462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.128+0000 7f0e7c484b80 4 client.16329 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:17:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 -- 172.21.15.69:0/3847032509 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ad08b1fa00 con 0x55ad08c43e90 2023-12-14T14:17:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e6e092700 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ad08c43e90 0x55ad08c462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e51ffb700 10 client.16329 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:17:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e6e092700 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ad08c43e90 0x55ad08c462a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66d156fcd8080c32 server_cookie=54f4a99bc18538d6 in_seq=0 out_seq=0 2023-12-14T14:17:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e51ffb700 1 -- 172.21.15.69:0/3847032509 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ad08b1fa00 con 0x55ad08c43e90 2023-12-14T14:17:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e51ffb700 10 client.16329 handle_command_reply: tid=0 2023-12-14T14:17:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 client.16329 shutdown 2023-12-14T14:17:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 -- 172.21.15.69:0/3847032509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 msgr2=0x55ad08c42410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08c42410 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000b420 tx=0x7f0e60009380 comp rx=0 tx=0).stop 2023-12-14T14:17:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 -- 172.21.15.69:0/3847032509 shutdown_connections 2023-12-14T14:17:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55ad08c43e90 0x55ad08c462a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ad08bdfb50 0x55ad08c42410 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e51ffb700 0 client.16329 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:17:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad08bd4380 0x55ad08be4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 --2- 172.21.15.69:0/3847032509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad08bd4c90 0x55ad08be4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 -- 172.21.15.69:0/3847032509 >> 172.21.15.69:0/3847032509 conn(0x55ad08bcaca0 msgr2=0x55ad08bd7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.129+0000 7f0e7c484b80 1 -- 172.21.15.69:0/3847032509 shutdown_connections 2023-12-14T14:17:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e7c484b80 1 -- 172.21.15.69:0/3847032509 wait complete. 2023-12-14T14:17:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e7c484b80 20 client.16329 trim_cache size 0 max 16384 2023-12-14T14:17:37.144 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:17:37.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 -- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0e540a12c0 msgr2=0x7f0e540a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0e540a12c0 0x7f0e540a3770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e58005950 tx=0x7f0e580058e0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 -- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e680ffd30 msgr2=0x7f0e68195950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e680ffd30 0x7f0e68195950 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0e640078b0 tx=0x7f0e64007c70 comp rx=0 tx=0).stop 2023-12-14T14:17:37.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 -- 172.21.15.69:0/2051684665 shutdown_connections 2023-12-14T14:17:37.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0e540a12c0 0x7f0e540a3770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e681043d0 0x7f0e68199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e680ff390 0x7f0e68195410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 --2- 172.21.15.69:0/2051684665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e680ffd30 0x7f0e68195950 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 -- 172.21.15.69:0/2051684665 >> 172.21.15.69:0/2051684665 conn(0x7f0e68075fd0 msgr2=0x7f0e680fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 -- 172.21.15.69:0/2051684665 shutdown_connections 2023-12-14T14:17:37.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.130+0000 7f0e702f6700 1 -- 172.21.15.69:0/2051684665 wait complete. 2023-12-14T14:17:37.147 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:17:37.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.270+0000 7f1e84631700 1 -- 172.21.15.69:0/29191228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c100580 msgr2=0x7f1e7c100950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.270+0000 7f1e84631700 1 --2- 172.21.15.69:0/29191228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c100580 0x7f1e7c100950 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009990 tx=0x7f1e78009ca0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 -- 172.21.15.69:0/29191228 shutdown_connections 2023-12-14T14:17:37.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 --2- 172.21.15.69:0/29191228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7c109b30 0x7f1e7c10bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 --2- 172.21.15.69:0/29191228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c100580 0x7f1e7c100950 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 --2- 172.21.15.69:0/29191228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e7c100e90 0x7f1e7c1095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 -- 172.21.15.69:0/29191228 >> 172.21.15.69:0/29191228 conn(0x7f1e7c074a60 msgr2=0x7f1e7c074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 -- 172.21.15.69:0/29191228 shutdown_connections 2023-12-14T14:17:37.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 -- 172.21.15.69:0/29191228 wait complete. 2023-12-14T14:17:37.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 Processor -- start 2023-12-14T14:17:37.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 -- start start 2023-12-14T14:17:37.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7c100580 0x7f1e7c196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e7c100e90 0x7f1e7c1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.271+0000 7f1e84631700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c109b30 0x7f1e7c19ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e84631700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c19b340 con 0x7f1e7c109b30 2023-12-14T14:17:37.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e84631700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c19b4b0 con 0x7f1e7c100580 2023-12-14T14:17:37.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e84631700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c19b670 con 0x7f1e7c100e90 2023-12-14T14:17:37.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e82bce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c109b30 0x7f1e7c19ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e82bce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c109b30 0x7f1e7c19ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34632/0 (socket says 172.21.15.69:34632) 2023-12-14T14:17:37.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e82bce700 1 -- 172.21.15.69:0/1506728940 learned_addr learned my addr 172.21.15.69:0/1506728940 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e823cd700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7c100580 0x7f1e7c196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e81bcc700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e7c100e90 0x7f1e7c1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e82bce700 1 -- 172.21.15.69:0/1506728940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e7c100e90 msgr2=0x7f1e7c1968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e82bce700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e7c100e90 0x7f1e7c1968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e82bce700 1 -- 172.21.15.69:0/1506728940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7c100580 msgr2=0x7f1e7c196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e82bce700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7c100580 0x7f1e7c196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e82bce700 1 -- 172.21.15.69:0/1506728940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780095f0 con 0x7f1e7c109b30 2023-12-14T14:17:37.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e81bcc700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e7c100e90 0x7f1e7c1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:37.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e82bce700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c109b30 0x7f1e7c19ad00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400ada0 tx=0x7f1e7400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e737fe700 1 -- 172.21.15.69:0/1506728940 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400f070 con 0x7f1e7c109b30 2023-12-14T14:17:37.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e737fe700 1 -- 172.21.15.69:0/1506728940 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e74007af0 con 0x7f1e7c109b30 2023-12-14T14:17:37.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e84631700 1 -- 172.21.15.69:0/1506728940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c10f1c0 con 0x7f1e7c109b30 2023-12-14T14:17:37.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e737fe700 1 -- 172.21.15.69:0/1506728940 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74004290 con 0x7f1e7c109b30 2023-12-14T14:17:37.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.272+0000 7f1e84631700 1 -- 172.21.15.69:0/1506728940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c10f030 con 0x7f1e7c109b30 2023-12-14T14:17:37.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.274+0000 7f1e737fe700 1 -- 172.21.15.69:0/1506728940 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1e74003a20 con 0x7f1e7c109b30 2023-12-14T14:17:37.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.275+0000 7f1e737fe700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1e680a12c0 0x7f1e680a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.275+0000 7f1e737fe700 1 -- 172.21.15.69:0/1506728940 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1e740cbe50 con 0x7f1e7c109b30 2023-12-14T14:17:37.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.275+0000 7f1e823cd700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1e680a12c0 0x7f1e680a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.275+0000 7f1e823cd700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1e680a12c0 0x7f1e680a3770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800b2e0 tx=0x7f1e78005fd0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.276+0000 7f1e907bfb80 1 Processor -- start 2023-12-14T14:17:37.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.276+0000 7f1e907bfb80 1 -- start start 2023-12-14T14:17:37.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.276+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.276+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 0x56080b7ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.276+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 0x56080b7d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.276+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b6ad5e0 con 0x56080b7c3380 2023-12-14T14:17:37.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.276+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b71c870 con 0x56080b7ceb50 2023-12-14T14:17:37.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.276+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b715d00 con 0x56080b7c3c90 2023-12-14T14:17:37.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e823cd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e823cd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34648/0 (socket says 172.21.15.69:34648) 2023-12-14T14:17:37.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e823cd700 1 -- 172.21.15.69:0/2682100315 learned_addr learned my addr 172.21.15.69:0/2682100315 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e81bcc700 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 0x56080b7ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e82bce700 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 0x56080b7d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e823cd700 1 -- 172.21.15.69:0/2682100315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 msgr2=0x56080b7ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e823cd700 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 0x56080b7ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e823cd700 1 -- 172.21.15.69:0/2682100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 msgr2=0x56080b7d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e823cd700 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 0x56080b7d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e823cd700 1 -- 172.21.15.69:0/2682100315 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080b5973b0 con 0x56080b7c3380 2023-12-14T14:17:37.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e82bce700 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 0x56080b7d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:37.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e823cd700 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7c3750 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1e78015000 tx=0x7f1e78020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9814d8ea21091ad4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e70ff9700 1 -- 172.21.15.69:0/2682100315 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7802b070 con 0x56080b7c3380 2023-12-14T14:17:37.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e70ff9700 1 -- 172.21.15.69:0/2682100315 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e7801e040 con 0x56080b7c3380 2023-12-14T14:17:37.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.277+0000 7f1e70ff9700 1 -- 172.21.15.69:0/2682100315 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800f800 con 0x56080b7c3380 2023-12-14T14:17:37.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 -- 172.21.15.69:0/2682100315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 msgr2=0x56080b7c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7c3750 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1e78015000 tx=0x7f1e78020000 comp rx=0 tx=0).stop 2023-12-14T14:17:37.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 -- 172.21.15.69:0/2682100315 shutdown_connections 2023-12-14T14:17:37.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 0x56080b7d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7c3750 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/2682100315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 0x56080b7ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 -- 172.21.15.69:0/2682100315 >> 172.21.15.69:0/2682100315 conn(0x56080b7b9ca0 msgr2=0x56080b7bf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 -- 172.21.15.69:0/2682100315 shutdown_connections 2023-12-14T14:17:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 -- 172.21.15.69:0/2682100315 wait complete. 2023-12-14T14:17:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 -- start start 2023-12-14T14:17:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.278+0000 7f1e907bfb80 1 Processor -- start 2023-12-14T14:17:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3380 0x56080b7ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3c90 0x56080b7cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 0x56080b7cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b6b1f90 con 0x56080b7c3c90 2023-12-14T14:17:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b6b1c30 con 0x56080b7ceb50 2023-12-14T14:17:37.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b5996a0 con 0x56080b7c3380 2023-12-14T14:17:37.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 10 client.0 _ll_register_callbacks cb 0x56080b6d5910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:37.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e81bcc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3c90 0x56080b7cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e81bcc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3c90 0x56080b7cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34662/0 (socket says 172.21.15.69:34662) 2023-12-14T14:17:37.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e81bcc700 1 -- 172.21.15.69:0/1774073895 learned_addr learned my addr 172.21.15.69:0/1774073895 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e823cd700 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3380 0x56080b7ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e81bcc700 1 -- 172.21.15.69:0/1774073895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3380 msgr2=0x56080b7ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e81bcc700 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3380 0x56080b7ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e81bcc700 1 -- 172.21.15.69:0/1774073895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 msgr2=0x56080b7cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e81bcc700 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 0x56080b7cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e81bcc700 1 -- 172.21.15.69:0/1774073895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c10c800 con 0x56080b7c3c90 2023-12-14T14:17:37.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e81bcc700 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3c90 0x56080b7cb7b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c012740 tx=0x7f1e6c012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c55842e537907e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:37.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e65ffb700 1 -- 172.21.15.69:0/1774073895 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c017070 con 0x56080b7c3c90 2023-12-14T14:17:37.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e65ffb700 1 -- 172.21.15.69:0/1774073895 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1e6c004020 con 0x56080b7c3c90 2023-12-14T14:17:37.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 1 -- 172.21.15.69:0/1774073895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56080b7b72b0 con 0x56080b7c3c90 2023-12-14T14:17:37.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e65ffb700 1 -- 172.21.15.69:0/1774073895 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e6c004220 con 0x56080b7c3c90 2023-12-14T14:17:37.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 10 client.16341 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:37.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.279+0000 7f1e907bfb80 1 -- 172.21.15.69:0/1774073895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56080b6dc170 con 0x56080b7c3c90 2023-12-14T14:17:37.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.280+0000 7f1e65ffb700 1 -- 172.21.15.69:0/1774073895 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56080b7b72b0 con 0x56080b7c3c90 2023-12-14T14:17:37.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.280+0000 7f1e65ffb700 1 -- 172.21.15.69:0/1774073895 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1e6c023070 con 0x56080b7c3c90 2023-12-14T14:17:37.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.280+0000 7f1e907bfb80 10 client.16341 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:37.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.280+0000 7f1e907bfb80 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:37.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.280+0000 7f1e907bfb80 20 client.16341 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:37.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.280+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080b7de4d0 0x56080b7e08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.280+0000 7f1e907bfb80 4 client.16341 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:37.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.280+0000 7f1e907bfb80 1 -- 172.21.15.69:0/1774073895 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56080b70ece0 con 0x56080b7de4d0 2023-12-14T14:17:37.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.280+0000 7f1e823cd700 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080b7de4d0 0x56080b7e08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e65ffb700 10 client.16341 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:37.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e823cd700 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080b7de4d0 0x56080b7e08e0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f077a7963d5bfc27 server_cookie=2a36f412d2c8b372 in_seq=0 out_seq=0 2023-12-14T14:17:37.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e65ffb700 1 -- 172.21.15.69:0/1774073895 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56080b70ece0 con 0x56080b7de4d0 2023-12-14T14:17:37.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e65ffb700 10 client.16341 handle_command_reply: tid=0 2023-12-14T14:17:37.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 client.16341 shutdown 2023-12-14T14:17:37.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 -- 172.21.15.69:0/1774073895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3c90 msgr2=0x56080b7cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3c90 0x56080b7cb7b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c012740 tx=0x7f1e6c012b00 comp rx=0 tx=0).stop 2023-12-14T14:17:37.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 -- 172.21.15.69:0/1774073895 shutdown_connections 2023-12-14T14:17:37.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080b7de4d0 0x56080b7e08e0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7ceb50 0x56080b7cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e65ffb700 0 client.16341 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:37.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3380 0x56080b7ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/1774073895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3c90 0x56080b7cb7b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 -- 172.21.15.69:0/1774073895 >> 172.21.15.69:0/1774073895 conn(0x56080b7b9ca0 msgr2=0x56080b7bf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 -- 172.21.15.69:0/1774073895 shutdown_connections 2023-12-14T14:17:37.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 1 -- 172.21.15.69:0/1774073895 wait complete. 2023-12-14T14:17:37.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.281+0000 7f1e907bfb80 20 client.16341 trim_cache size 0 max 16384 2023-12-14T14:17:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.294+0000 7f1e907bfb80 1 Processor -- start 2023-12-14T14:17:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.294+0000 7f1e907bfb80 1 -- start start 2023-12-14T14:17:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.294+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.294+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3c90 0x56080b7da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.294+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7ceb50 0x56080b7cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b70ece0 con 0x56080b7c3380 2023-12-14T14:17:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b7dbad0 con 0x56080b7c3c90 2023-12-14T14:17:37.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b7cc370 con 0x56080b7ceb50 2023-12-14T14:17:37.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e823cd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e823cd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34678/0 (socket says 172.21.15.69:34678) 2023-12-14T14:17:37.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e823cd700 1 -- 172.21.15.69:0/3115565061 learned_addr learned my addr 172.21.15.69:0/3115565061 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e82bce700 1 --2- 172.21.15.69:0/3115565061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7ceb50 0x56080b7cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e823cd700 1 -- 172.21.15.69:0/3115565061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7ceb50 msgr2=0x56080b7cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e823cd700 1 --2- 172.21.15.69:0/3115565061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7ceb50 0x56080b7cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e823cd700 1 -- 172.21.15.69:0/3115565061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3c90 msgr2=0x56080b7da7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e81bcc700 1 --2- 172.21.15.69:0/3115565061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3c90 0x56080b7da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e823cd700 1 --2- 172.21.15.69:0/3115565061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3c90 0x56080b7da7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e823cd700 1 -- 172.21.15.69:0/3115565061 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080b6dbec0 con 0x56080b7c3380 2023-12-14T14:17:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e823cd700 1 --2- 172.21.15.69:0/3115565061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7cb770 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1e78031040 tx=0x7f1e78023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268169c4da88cb18 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e717fa700 1 -- 172.21.15.69:0/3115565061 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7802b050 con 0x56080b7c3380 2023-12-14T14:17:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e717fa700 1 -- 172.21.15.69:0/3115565061 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e7802c040 con 0x56080b7c3380 2023-12-14T14:17:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.295+0000 7f1e717fa700 1 -- 172.21.15.69:0/3115565061 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78004950 con 0x56080b7c3380 2023-12-14T14:17:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3115565061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 msgr2=0x56080b7cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3115565061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7cb770 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1e78031040 tx=0x7f1e78023000 comp rx=0 tx=0).stop 2023-12-14T14:17:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3115565061 shutdown_connections 2023-12-14T14:17:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3115565061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7ceb50 0x56080b7cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3115565061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7c3380 0x56080b7cb770 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3115565061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3c90 0x56080b7da7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3115565061 >> 172.21.15.69:0/3115565061 conn(0x56080b7b9ca0 msgr2=0x56080b7e5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3115565061 shutdown_connections 2023-12-14T14:17:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3115565061 wait complete. 2023-12-14T14:17:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 -- start start 2023-12-14T14:17:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 Processor -- start 2023-12-14T14:17:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3380 0x56080b7d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 0x56080b7d33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7ceb50 0x56080b7d3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b831560 con 0x56080b7ceb50 2023-12-14T14:17:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b8316d0 con 0x56080b7c3380 2023-12-14T14:17:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080b831890 con 0x56080b7c3c90 2023-12-14T14:17:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.296+0000 7f1e907bfb80 10 client.0 _ll_register_callbacks cb 0x7f1e6c009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:37.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e82bce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7ceb50 0x56080b7d3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e82bce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7ceb50 0x56080b7d3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34684/0 (socket says 172.21.15.69:34684) 2023-12-14T14:17:37.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e82bce700 1 -- 172.21.15.69:0/3156108159 learned_addr learned my addr 172.21.15.69:0/3156108159 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:37.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e81bcc700 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 0x56080b7d33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e823cd700 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3380 0x56080b7d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e82bce700 1 -- 172.21.15.69:0/3156108159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 msgr2=0x56080b7d33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e82bce700 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 0x56080b7d33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e82bce700 1 -- 172.21.15.69:0/3156108159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3380 msgr2=0x56080b7d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:37.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e82bce700 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3380 0x56080b7d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e82bce700 1 -- 172.21.15.69:0/3156108159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56080b5973b0 con 0x56080b7ceb50 2023-12-14T14:17:37.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e82bce700 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7ceb50 0x56080b7d3960 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1e740c9610 tx=0x7f1e7409d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cb83063ce24477 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:37.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:37.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e65ffb700 1 -- 172.21.15.69:0/3156108159 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74099390 con 0x56080b7ceb50 2023-12-14T14:17:37.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e65ffb700 1 -- 172.21.15.69:0/3156108159 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1e74098420 con 0x56080b7ceb50 2023-12-14T14:17:37.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3156108159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e7801e040 con 0x56080b7ceb50 2023-12-14T14:17:37.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e65ffb700 1 -- 172.21.15.69:0/3156108159 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e740b7300 con 0x56080b7ceb50 2023-12-14T14:17:37.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e907bfb80 10 client.16347 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3156108159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56080b6c29a0 con 0x56080b7ceb50 2023-12-14T14:17:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e65ffb700 1 -- 172.21.15.69:0/3156108159 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e740c7020 con 0x56080b7ceb50 2023-12-14T14:17:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e65ffb700 1 -- 172.21.15.69:0/3156108159 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1e74094d20 con 0x56080b7ceb50 2023-12-14T14:17:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.297+0000 7f1e907bfb80 10 client.16347 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 20 client.16347 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080b832fe0 0x56080b8353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 4 client.16347 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:17:37.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3156108159 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56080b70ea00 con 0x56080b832fe0 2023-12-14T14:17:37.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e823cd700 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080b832fe0 0x56080b8353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:37.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e65ffb700 10 client.16347 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:37.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e823cd700 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080b832fe0 0x56080b8353f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a00a2abd76d1c2fb server_cookie=749af99d02893e3c in_seq=0 out_seq=0 2023-12-14T14:17:37.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e65ffb700 1 -- 172.21.15.69:0/3156108159 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56080b70ea00 con 0x56080b832fe0 2023-12-14T14:17:37.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e65ffb700 10 client.16347 handle_command_reply: tid=0 2023-12-14T14:17:37.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 client.16347 shutdown 2023-12-14T14:17:37.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3156108159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7ceb50 msgr2=0x56080b7d3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7ceb50 0x56080b7d3960 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1e740c9610 tx=0x7f1e7409d090 comp rx=0 tx=0).stop 2023-12-14T14:17:37.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3156108159 shutdown_connections 2023-12-14T14:17:37.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080b832fe0 0x56080b8353f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080b7ceb50 0x56080b7d3960 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e65ffb700 0 client.16347 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:37.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080b7c3380 0x56080b7d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 --2- 172.21.15.69:0/3156108159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080b7c3c90 0x56080b7d33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3156108159 >> 172.21.15.69:0/3156108159 conn(0x56080b7b9ca0 msgr2=0x56080b7da7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3156108159 shutdown_connections 2023-12-14T14:17:37.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.298+0000 7f1e907bfb80 1 -- 172.21.15.69:0/3156108159 wait complete. 2023-12-14T14:17:37.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e907bfb80 20 client.16347 trim_cache size 0 max 16384 2023-12-14T14:17:37.312 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:17:37.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 -- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1e680a12c0 msgr2=0x7f1e680a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1e680a12c0 0x7f1e680a3770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800b2e0 tx=0x7f1e78005fd0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 -- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c109b30 msgr2=0x7f1e7c19ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:37.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c109b30 0x7f1e7c19ad00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400ada0 tx=0x7f1e7400c330 comp rx=0 tx=0).stop 2023-12-14T14:17:37.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 -- 172.21.15.69:0/1506728940 shutdown_connections 2023-12-14T14:17:37.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1e680a12c0 0x7f1e680a3770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c109b30 0x7f1e7c19ad00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7c100580 0x7f1e7c196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 --2- 172.21.15.69:0/1506728940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e7c100e90 0x7f1e7c1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:37.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 -- 172.21.15.69:0/1506728940 >> 172.21.15.69:0/1506728940 conn(0x7f1e7c074a60 msgr2=0x7f1e7c0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:37.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 -- 172.21.15.69:0/1506728940 shutdown_connections 2023-12-14T14:17:37.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:37.299+0000 7f1e84631700 1 -- 172.21.15.69:0/1506728940 wait complete. 2023-12-14T14:17:37.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:37 smithi069 ceph-mon[42034]: pgmap v214: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2023-12-14T14:17:37.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:37 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/355399916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:17:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:37 smithi081 ceph-mon[43371]: pgmap v214: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2023-12-14T14:17:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:37 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/355399916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:17:37.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:37 smithi119 ceph-mon[43834]: pgmap v214: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2023-12-14T14:17:37.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:37 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/355399916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:17:38.315 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:17:38.316 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:17:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.457+0000 7f90b4721700 1 -- 172.21.15.69:0/3937049946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ff360 msgr2=0x7f90ac0ff730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.457+0000 7f90b4721700 1 --2- 172.21.15.69:0/3937049946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ff360 0x7f90ac0ff730 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f90a80099c0 tx=0x7f90a8009cd0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.457+0000 7f90b4721700 1 -- 172.21.15.69:0/3937049946 shutdown_connections 2023-12-14T14:17:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.457+0000 7f90b4721700 1 --2- 172.21.15.69:0/3937049946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac1043a0 0x7f90ac10bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.457+0000 7f90b4721700 1 --2- 172.21.15.69:0/3937049946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ff360 0x7f90ac0ff730 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.457+0000 7f90b4721700 1 --2- 172.21.15.69:0/3937049946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac0ffd00 0x7f90ac103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.457+0000 7f90b4721700 1 -- 172.21.15.69:0/3937049946 >> 172.21.15.69:0/3937049946 conn(0x7f90ac076200 msgr2=0x7f90ac076600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.458+0000 7f90b4721700 1 -- 172.21.15.69:0/3937049946 shutdown_connections 2023-12-14T14:17:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.458+0000 7f90b4721700 1 -- 172.21.15.69:0/3937049946 wait complete. 2023-12-14T14:17:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.458+0000 7f90b4721700 1 Processor -- start 2023-12-14T14:17:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.458+0000 7f90b4721700 1 -- start start 2023-12-14T14:17:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b4721700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0ff360 0x7f90ac195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b4721700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ffd00 0x7f90ac1957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b4721700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac1043a0 0x7f90ac199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b4721700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac19a200 con 0x7f90ac0ffd00 2023-12-14T14:17:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b4721700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac19a370 con 0x7f90ac0ff360 2023-12-14T14:17:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b4721700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac19a530 con 0x7f90ac1043a0 2023-12-14T14:17:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b1cbc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ffd00 0x7f90ac1957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b1cbc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ffd00 0x7f90ac1957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34700/0 (socket says 172.21.15.69:34700) 2023-12-14T14:17:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b1cbc700 1 -- 172.21.15.69:0/1981798590 learned_addr learned my addr 172.21.15.69:0/1981798590 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b24bd700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0ff360 0x7f90ac195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac1043a0 0x7f90ac199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b1cbc700 1 -- 172.21.15.69:0/1981798590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac1043a0 msgr2=0x7f90ac199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac1043a0 0x7f90ac199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b1cbc700 1 -- 172.21.15.69:0/1981798590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0ff360 msgr2=0x7f90ac195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0ff360 0x7f90ac195270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b1cbc700 1 -- 172.21.15.69:0/1981798590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80095f0 con 0x7f90ac0ffd00 2023-12-14T14:17:38.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ffd00 0x7f90ac1957b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f90a000d950 tx=0x7f90a000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.459+0000 7f909f7fe700 1 -- 172.21.15.69:0/1981798590 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a000f890 con 0x7f90ac0ffd00 2023-12-14T14:17:38.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.460+0000 7f90b4721700 1 -- 172.21.15.69:0/1981798590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac10f1b0 con 0x7f90ac0ffd00 2023-12-14T14:17:38.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.460+0000 7f909f7fe700 1 -- 172.21.15.69:0/1981798590 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90a0010460 con 0x7f90ac0ffd00 2023-12-14T14:17:38.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.460+0000 7f909f7fe700 1 -- 172.21.15.69:0/1981798590 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a000e610 con 0x7f90ac0ffd00 2023-12-14T14:17:38.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.460+0000 7f90b4721700 1 -- 172.21.15.69:0/1981798590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ac10f020 con 0x7f90ac0ffd00 2023-12-14T14:17:38.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.462+0000 7f909f7fe700 1 -- 172.21.15.69:0/1981798590 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f90a00105d0 con 0x7f90ac0ffd00 2023-12-14T14:17:38.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.463+0000 7f909f7fe700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f90980a12c0 0x7f90980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.463+0000 7f90b24bd700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f90980a12c0 0x7f90980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.463+0000 7f909f7fe700 1 -- 172.21.15.69:0/1981798590 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f90a00cc7c0 con 0x7f90ac0ffd00 2023-12-14T14:17:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.463+0000 7f90c08afb80 1 Processor -- start 2023-12-14T14:17:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90c08afb80 1 -- start start 2023-12-14T14:17:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b24bd700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f90980a12c0 0x7f90980a3770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90a8006010 tx=0x7f90a8009f10 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27bad10 0x5644f27c5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27c5bd0 0x5644f27c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90c08afb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f26a4660 con 0x5644f27c5bd0 2023-12-14T14:17:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90c08afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f27138f0 con 0x5644f27ba400 2023-12-14T14:17:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90c08afb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f270cd80 con 0x5644f27bad10 2023-12-14T14:17:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b2cbe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27c5bd0 0x5644f27c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b2cbe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27c5bd0 0x5644f27c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34706/0 (socket says 172.21.15.69:34706) 2023-12-14T14:17:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b1cbc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27bad10 0x5644f27c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b2cbe700 1 -- 172.21.15.69:0/1800588601 learned_addr learned my addr 172.21.15.69:0/1800588601 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b24bd700 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b2cbe700 1 -- 172.21.15.69:0/1800588601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27bad10 msgr2=0x5644f27c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27bad10 0x5644f27c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b2cbe700 1 -- 172.21.15.69:0/1800588601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 msgr2=0x5644f27ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27ba7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b2cbe700 1 -- 172.21.15.69:0/1800588601 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644f258e430 con 0x5644f27c5bd0 2023-12-14T14:17:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.464+0000 7f90b24bd700 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27ba7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.465+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27bad10 0x5644f27c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:17:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.465+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27c5bd0 0x5644f27c7fb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f90a4003fa0 tx=0x7f90a4009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e97f9be9cbd5c6f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.465+0000 7f909cff9700 1 -- 172.21.15.69:0/1800588601 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4019070 con 0x5644f27c5bd0 2023-12-14T14:17:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.465+0000 7f909cff9700 1 -- 172.21.15.69:0/1800588601 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90a400f040 con 0x5644f27c5bd0 2023-12-14T14:17:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.465+0000 7f909cff9700 1 -- 172.21.15.69:0/1800588601 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40079c0 con 0x5644f27c5bd0 2023-12-14T14:17:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 -- 172.21.15.69:0/1800588601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27c5bd0 msgr2=0x5644f27c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27c5bd0 0x5644f27c7fb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f90a4003fa0 tx=0x7f90a4009ba0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 -- 172.21.15.69:0/1800588601 shutdown_connections 2023-12-14T14:17:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27c5bd0 0x5644f27c7fb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27ba7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 --2- 172.21.15.69:0/1800588601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27bad10 0x5644f27c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 -- 172.21.15.69:0/1800588601 >> 172.21.15.69:0/1800588601 conn(0x5644f27b0d20 msgr2=0x5644f27b6860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 -- 172.21.15.69:0/1800588601 shutdown_connections 2023-12-14T14:17:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 -- 172.21.15.69:0/1800588601 wait complete. 2023-12-14T14:17:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 -- start start 2023-12-14T14:17:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 Processor -- start 2023-12-14T14:17:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27ba400 0x5644f27c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27bad10 0x5644f27c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27c5bd0 0x5644f27c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f26a9010 con 0x5644f27ba400 2023-12-14T14:17:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f26a8cb0 con 0x5644f27bad10 2023-12-14T14:17:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.466+0000 7f90c08afb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f2590720 con 0x5644f27c5bd0 2023-12-14T14:17:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90c08afb80 10 client.0 _ll_register_callbacks cb 0x5644f26cc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b24bd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27ba400 0x5644f27c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b24bd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27ba400 0x5644f27c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34708/0 (socket says 172.21.15.69:34708) 2023-12-14T14:17:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b24bd700 1 -- 172.21.15.69:0/3147517818 learned_addr learned my addr 172.21.15.69:0/3147517818 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27c5bd0 0x5644f27c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27bad10 0x5644f27c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b24bd700 1 -- 172.21.15.69:0/3147517818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27c5bd0 msgr2=0x5644f27c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b24bd700 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27c5bd0 0x5644f27c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b24bd700 1 -- 172.21.15.69:0/3147517818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27bad10 msgr2=0x5644f27c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b24bd700 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27bad10 0x5644f27c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b24bd700 1 -- 172.21.15.69:0/3147517818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a4003bd0 con 0x5644f27ba400 2023-12-14T14:17:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90b24bd700 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27ba400 0x5644f27c5550 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f90a80099c0 tx=0x7f90a801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658318ce6d988790 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f9095ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f9095ffb700 1 -- 172.21.15.69:0/3147517818 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a8003d20 con 0x5644f27ba400 2023-12-14T14:17:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f9095ffb700 1 -- 172.21.15.69:0/3147517818 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f90a8003e80 con 0x5644f27ba400 2023-12-14T14:17:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f90c08afb80 1 -- 172.21.15.69:0/3147517818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644f27ae330 con 0x5644f27ba400 2023-12-14T14:17:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.467+0000 7f9095ffb700 1 -- 172.21.15.69:0/3147517818 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90a8004040 con 0x5644f27ba400 2023-12-14T14:17:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f90c08afb80 10 client.16359 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f90c08afb80 1 -- 172.21.15.69:0/3147517818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5644f26d31f0 con 0x5644f27ba400 2023-12-14T14:17:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f9095ffb700 1 -- 172.21.15.69:0/3147517818 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90a803d020 con 0x5644f27ba400 2023-12-14T14:17:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f9095ffb700 1 -- 172.21.15.69:0/3147517818 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f90a800f460 con 0x5644f27ba400 2023-12-14T14:17:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f90c08afb80 10 client.16359 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f90c08afb80 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f90c08afb80 20 client.16359 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5644f27d54c0 0x5644f27d78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f90c08afb80 4 client.16359 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f90c08afb80 1 -- 172.21.15.69:0/3147517818 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644f2705d60 con 0x5644f27d54c0 2023-12-14T14:17:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.468+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5644f27d54c0 0x5644f27d78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f9095ffb700 10 client.16359 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5644f27d54c0 0x5644f27d78d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f686fc88599a24 server_cookie=5034d07035eee93e in_seq=0 out_seq=0 2023-12-14T14:17:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f9095ffb700 1 -- 172.21.15.69:0/3147517818 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5644f2705d60 con 0x5644f27d54c0 2023-12-14T14:17:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f9095ffb700 10 client.16359 handle_command_reply: tid=0 2023-12-14T14:17:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 client.16359 shutdown 2023-12-14T14:17:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 -- 172.21.15.69:0/3147517818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27ba400 msgr2=0x5644f27c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27ba400 0x5644f27c5550 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f90a80099c0 tx=0x7f90a801a050 comp rx=0 tx=0).stop 2023-12-14T14:17:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 -- 172.21.15.69:0/3147517818 shutdown_connections 2023-12-14T14:17:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5644f27d54c0 0x5644f27d78d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27c5bd0 0x5644f27c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f9095ffb700 0 client.16359 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27ba400 0x5644f27c5550 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3147517818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27bad10 0x5644f27c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 -- 172.21.15.69:0/3147517818 >> 172.21.15.69:0/3147517818 conn(0x5644f27b0d20 msgr2=0x5644f27b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.469+0000 7f90c08afb80 1 -- 172.21.15.69:0/3147517818 shutdown_connections 2023-12-14T14:17:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.470+0000 7f90c08afb80 1 -- 172.21.15.69:0/3147517818 wait complete. 2023-12-14T14:17:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.470+0000 7f90c08afb80 20 client.16359 trim_cache size 0 max 16384 2023-12-14T14:17:38.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.486+0000 7f90c08afb80 1 Processor -- start 2023-12-14T14:17:38.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.486+0000 7f90c08afb80 1 -- start start 2023-12-14T14:17:38.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 0x5644f27c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27c5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90c08afb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f27d1fa0 con 0x5644f27bad10 2023-12-14T14:17:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90c08afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f27c0d60 con 0x5644f27ba400 2023-12-14T14:17:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90c08afb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f27b5630 con 0x5644f27b0d20 2023-12-14T14:17:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b2cbe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b24bd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 0x5644f27c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b2cbe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34718/0 (socket says 172.21.15.69:34718) 2023-12-14T14:17:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b2cbe700 1 -- 172.21.15.69:0/3738767361 learned_addr learned my addr 172.21.15.69:0/3738767361 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b2cbe700 1 -- 172.21.15.69:0/3738767361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 msgr2=0x5644f27c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 0x5644f27c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b2cbe700 1 -- 172.21.15.69:0/3738767361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 msgr2=0x5644f27c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b2cbe700 1 -- 172.21.15.69:0/3738767361 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644f26d2f40 con 0x5644f27bad10 2023-12-14T14:17:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b24bd700 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 0x5644f27c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:17:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:17:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.487+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27c5550 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f90a40075e0 tx=0x7f90a4009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5490f4461ee7cb93 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.488+0000 7f909d7fa700 1 -- 172.21.15.69:0/3738767361 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4019040 con 0x5644f27bad10 2023-12-14T14:17:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.488+0000 7f909d7fa700 1 -- 172.21.15.69:0/3738767361 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90a40057a0 con 0x5644f27bad10 2023-12-14T14:17:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.488+0000 7f909d7fa700 1 -- 172.21.15.69:0/3738767361 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40156e0 con 0x5644f27bad10 2023-12-14T14:17:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 -- 172.21.15.69:0/3738767361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 msgr2=0x5644f27c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27c5550 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f90a40075e0 tx=0x7f90a4009460 comp rx=0 tx=0).stop 2023-12-14T14:17:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 -- 172.21.15.69:0/3738767361 shutdown_connections 2023-12-14T14:17:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27c5550 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 0x5644f27c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 --2- 172.21.15.69:0/3738767361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f27c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 -- 172.21.15.69:0/3738767361 >> 172.21.15.69:0/3738767361 conn(0x5644f27c8280 msgr2=0x5644f27c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 -- 172.21.15.69:0/3738767361 shutdown_connections 2023-12-14T14:17:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 -- 172.21.15.69:0/3738767361 wait complete. 2023-12-14T14:17:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 -- start start 2023-12-14T14:17:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.489+0000 7f90c08afb80 1 Processor -- start 2023-12-14T14:17:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 0x5644f2822740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f2822c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90c08afb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90c08afb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f27cbe40 con 0x5644f27bad10 2023-12-14T14:17:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90c08afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f27cbfb0 con 0x5644f27ba400 2023-12-14T14:17:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90c08afb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f27cc170 con 0x5644f27b0d20 2023-12-14T14:17:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90c08afb80 10 client.0 _ll_register_callbacks cb 0x7f90a8005500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b2cbe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b2cbe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34732/0 (socket says 172.21.15.69:34732) 2023-12-14T14:17:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b2cbe700 1 -- 172.21.15.69:0/4052402961 learned_addr learned my addr 172.21.15.69:0/4052402961 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b24bd700 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 0x5644f2822740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f2822c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b2cbe700 1 -- 172.21.15.69:0/4052402961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 msgr2=0x5644f2822740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 0x5644f2822740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b2cbe700 1 -- 172.21.15.69:0/4052402961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 msgr2=0x5644f2822c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f2822c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b2cbe700 1 -- 172.21.15.69:0/4052402961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644f26d31f0 con 0x5644f27bad10 2023-12-14T14:17:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b1cbc700 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f2822c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90b2cbe700 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27cb730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009610 tx=0x7f90a4007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad786501407f746a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f9095ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f9095ffb700 1 -- 172.21.15.69:0/4052402961 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4019030 con 0x5644f27bad10 2023-12-14T14:17:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f9095ffb700 1 -- 172.21.15.69:0/4052402961 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f90a4015480 con 0x5644f27bad10 2023-12-14T14:17:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f90c08afb80 1 -- 172.21.15.69:0/4052402961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90a400f040 con 0x5644f27bad10 2023-12-14T14:17:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.490+0000 7f9095ffb700 1 -- 172.21.15.69:0/4052402961 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90a4015640 con 0x5644f27bad10 2023-12-14T14:17:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90c08afb80 10 client.16365 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90c08afb80 1 -- 172.21.15.69:0/4052402961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f90ac10f1b0 con 0x5644f27bad10 2023-12-14T14:17:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f9095ffb700 1 -- 172.21.15.69:0/4052402961 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90a400f040 con 0x5644f27bad10 2023-12-14T14:17:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f9095ffb700 1 -- 172.21.15.69:0/4052402961 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f90a4037020 con 0x5644f27bad10 2023-12-14T14:17:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90c08afb80 10 client.16365 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90c08afb80 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90c08afb80 20 client.16365 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90c08afb80 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5644f27c5bd0 0x5644f282d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90c08afb80 4 client.16365 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:17:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90c08afb80 1 -- 172.21.15.69:0/4052402961 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5644f2705a80 con 0x5644f27c5bd0 2023-12-14T14:17:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90b24bd700 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5644f27c5bd0 0x5644f282d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f9095ffb700 10 client.16365 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.491+0000 7f90b24bd700 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5644f27c5bd0 0x5644f282d280 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2676ef237ac0f584 server_cookie=b6e9fcc39bfde3d3 in_seq=0 out_seq=0 2023-12-14T14:17:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f9095ffb700 1 -- 172.21.15.69:0/4052402961 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5644f2705a80 con 0x5644f27c5bd0 2023-12-14T14:17:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f9095ffb700 10 client.16365 handle_command_reply: tid=0 2023-12-14T14:17:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 client.16365 shutdown 2023-12-14T14:17:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 -- 172.21.15.69:0/4052402961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 msgr2=0x5644f27cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27cb730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009610 tx=0x7f90a4007420 comp rx=0 tx=0).stop 2023-12-14T14:17:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 -- 172.21.15.69:0/4052402961 shutdown_connections 2023-12-14T14:17:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5644f27c5bd0 0x5644f282d280 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5644f27bad10 0x5644f27cb730 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f9095ffb700 0 client.16365 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644f27b0d20 0x5644f2822740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 --2- 172.21.15.69:0/4052402961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644f27ba400 0x5644f2822c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 -- 172.21.15.69:0/4052402961 >> 172.21.15.69:0/4052402961 conn(0x5644f27c8280 msgr2=0x5644f27bc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 -- 172.21.15.69:0/4052402961 shutdown_connections 2023-12-14T14:17:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 1 -- 172.21.15.69:0/4052402961 wait complete. 2023-12-14T14:17:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90c08afb80 20 client.16365 trim_cache size 0 max 16384 2023-12-14T14:17:38.506 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:17:38.506 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:17:38.507 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "d371f440-d97c-4ccb-a5ef-4fb1abe04b75", 2023-12-14T14:17:38.507 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:17:38.507 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:17:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90b4721700 1 -- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f90980a12c0 msgr2=0x7f90980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90b4721700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f90980a12c0 0x7f90980a3770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90a8006010 tx=0x7f90a8009f10 comp rx=0 tx=0).stop 2023-12-14T14:17:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90b4721700 1 -- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ffd00 msgr2=0x7f90ac1957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90b4721700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ffd00 0x7f90ac1957b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f90a000d950 tx=0x7f90a000dc60 comp rx=0 tx=0).stop 2023-12-14T14:17:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90b4721700 1 -- 172.21.15.69:0/1981798590 shutdown_connections 2023-12-14T14:17:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90b4721700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f90980a12c0 0x7f90980a3770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90b4721700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac1043a0 0x7f90ac199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90b4721700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0ff360 0x7f90ac195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.493+0000 7f90b4721700 1 --2- 172.21.15.69:0/1981798590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90ac0ffd00 0x7f90ac1957b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.494+0000 7f90b4721700 1 -- 172.21.15.69:0/1981798590 >> 172.21.15.69:0/1981798590 conn(0x7f90ac076200 msgr2=0x7f90ac0fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.494+0000 7f90b4721700 1 -- 172.21.15.69:0/1981798590 shutdown_connections 2023-12-14T14:17:38.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.494+0000 7f90b4721700 1 -- 172.21.15.69:0/1981798590 wait complete. 2023-12-14T14:17:38.511 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:17:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.633+0000 7f68ec9df700 1 -- 172.21.15.69:0/1248766251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e8101d40 msgr2=0x7f68e810a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.633+0000 7f68ec9df700 1 --2- 172.21.15.69:0/1248766251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e8101d40 0x7f68e810a230 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009990 tx=0x7f68dc009ca0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.634+0000 7f68ec9df700 1 -- 172.21.15.69:0/1248766251 shutdown_connections 2023-12-14T14:17:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.634+0000 7f68ec9df700 1 --2- 172.21.15.69:0/1248766251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68e810a800 0x7f68e810cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.634+0000 7f68ec9df700 1 --2- 172.21.15.69:0/1248766251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e8101430 0x7f68e8101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.634+0000 7f68ec9df700 1 --2- 172.21.15.69:0/1248766251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e8101d40 0x7f68e810a230 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.634+0000 7f68ec9df700 1 -- 172.21.15.69:0/1248766251 >> 172.21.15.69:0/1248766251 conn(0x7f68e80763a0 msgr2=0x7f68e80767a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.634+0000 7f68ec9df700 1 -- 172.21.15.69:0/1248766251 shutdown_connections 2023-12-14T14:17:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.634+0000 7f68ec9df700 1 -- 172.21.15.69:0/1248766251 wait complete. 2023-12-14T14:17:38.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.634+0000 7f68ec9df700 1 Processor -- start 2023-12-14T14:17:38.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.634+0000 7f68ec9df700 1 -- start start 2023-12-14T14:17:38.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68ec9df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e8101430 0x7f68e8196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68ec9df700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68e8101d40 0x7f68e8196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68ec9df700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e810a800 0x7f68e819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68ec9df700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e819b3e0 con 0x7f68e810a800 2023-12-14T14:17:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68ec9df700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e819b550 con 0x7f68e8101430 2023-12-14T14:17:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68ec9df700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e819b710 con 0x7f68e8101d40 2023-12-14T14:17:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e810a800 0x7f68e819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e810a800 0x7f68e819ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34738/0 (socket says 172.21.15.69:34738) 2023-12-14T14:17:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e6d9d700 1 -- 172.21.15.69:0/309026085 learned_addr learned my addr 172.21.15.69:0/309026085 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e5d9b700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68e8101d40 0x7f68e8196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e659c700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e8101430 0x7f68e8196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e6d9d700 1 -- 172.21.15.69:0/309026085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68e8101d40 msgr2=0x7f68e8196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68e8101d40 0x7f68e8196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e6d9d700 1 -- 172.21.15.69:0/309026085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e8101430 msgr2=0x7f68e8196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e8101430 0x7f68e8196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e6d9d700 1 -- 172.21.15.69:0/309026085 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0095f0 con 0x7f68e810a800 2023-12-14T14:17:38.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e5d9b700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68e8101d40 0x7f68e8196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:38.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e810a800 0x7f68e819ada0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f68e000efc0 tx=0x7f68e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68d77fe700 1 -- 172.21.15.69:0/309026085 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0018070 con 0x7f68e810a800 2023-12-14T14:17:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68ec9df700 1 -- 172.21.15.69:0/309026085 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e8110270 con 0x7f68e810a800 2023-12-14T14:17:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68d77fe700 1 -- 172.21.15.69:0/309026085 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68e000f040 con 0x7f68e810a800 2023-12-14T14:17:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68d77fe700 1 -- 172.21.15.69:0/309026085 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e000cd30 con 0x7f68e810a800 2023-12-14T14:17:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.635+0000 7f68ec9df700 1 -- 172.21.15.69:0/309026085 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e81100e0 con 0x7f68e810a800 2023-12-14T14:17:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.638+0000 7f68d77fe700 1 -- 172.21.15.69:0/309026085 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f68e0003a00 con 0x7f68e810a800 2023-12-14T14:17:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.638+0000 7f68d77fe700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68d00a12c0 0x7f68d00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.638+0000 7f68d77fe700 1 -- 172.21.15.69:0/309026085 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f68e00cc7d0 con 0x7f68e810a800 2023-12-14T14:17:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.638+0000 7f68e659c700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68d00a12c0 0x7f68d00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68e659c700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68d00a12c0 0x7f68d00a3770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f68d8005fd0 tx=0x7f68d800a560 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68f8b6db80 1 Processor -- start 2023-12-14T14:17:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68f8b6db80 1 -- start start 2023-12-14T14:17:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba882750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba891a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba894340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba76c5e0 con 0x55d7ba891f60 2023-12-14T14:17:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba7db870 con 0x55d7ba882c90 2023-12-14T14:17:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba7d4d00 con 0x55d7ba882380 2023-12-14T14:17:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba894340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba894340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34744/0 (socket says 172.21.15.69:34744) 2023-12-14T14:17:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68e6d9d700 1 -- 172.21.15.69:0/1218105938 learned_addr learned my addr 172.21.15.69:0/1218105938 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68e5d9b700 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba891a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.639+0000 7f68e659c700 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba882750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68e6d9d700 1 -- 172.21.15.69:0/1218105938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 msgr2=0x55d7ba882750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba882750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68e6d9d700 1 -- 172.21.15.69:0/1218105938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 msgr2=0x55d7ba891a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba891a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68e6d9d700 1 -- 172.21.15.69:0/1218105938 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7ba6563b0 con 0x55d7ba891f60 2023-12-14T14:17:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68e5d9b700 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba891a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba894340 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f68e00090a0 tx=0x7f68e0099670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5317ec51431312d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68d4ff9700 1 -- 172.21.15.69:0/1218105938 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e009d8d0 con 0x55d7ba891f60 2023-12-14T14:17:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68d4ff9700 1 -- 172.21.15.69:0/1218105938 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68e00a1c60 con 0x55d7ba891f60 2023-12-14T14:17:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.640+0000 7f68d4ff9700 1 -- 172.21.15.69:0/1218105938 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0099d90 con 0x55d7ba891f60 2023-12-14T14:17:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 -- 172.21.15.69:0/1218105938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 msgr2=0x55d7ba894340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba894340 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f68e00090a0 tx=0x7f68e0099670 comp rx=0 tx=0).stop 2023-12-14T14:17:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 -- 172.21.15.69:0/1218105938 shutdown_connections 2023-12-14T14:17:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba894340 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba882750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/1218105938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba891a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 -- 172.21.15.69:0/1218105938 >> 172.21.15.69:0/1218105938 conn(0x55d7ba878ca0 msgr2=0x55d7ba87e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 -- 172.21.15.69:0/1218105938 shutdown_connections 2023-12-14T14:17:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 -- 172.21.15.69:0/1218105938 wait complete. 2023-12-14T14:17:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 -- start start 2023-12-14T14:17:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 Processor -- start 2023-12-14T14:17:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba891a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba88ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba88f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba770f90 con 0x55d7ba891f60 2023-12-14T14:17:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba770c30 con 0x55d7ba882c90 2023-12-14T14:17:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba6586a0 con 0x55d7ba882380 2023-12-14T14:17:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.641+0000 7f68f8b6db80 10 client.0 _ll_register_callbacks cb 0x55d7ba794910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba88f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba891a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba88f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34760/0 (socket says 172.21.15.69:34760) 2023-12-14T14:17:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba891a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:48206/0 (socket says 172.21.15.69:48206) 2023-12-14T14:17:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e6d9d700 1 -- 172.21.15.69:0/2720895418 learned_addr learned my addr 172.21.15.69:0/2720895418 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e5d9b700 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba88ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e6d9d700 1 -- 172.21.15.69:0/2720895418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 msgr2=0x55d7ba891a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba891a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e6d9d700 1 -- 172.21.15.69:0/2720895418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 msgr2=0x55d7ba88ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba88ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e6d9d700 1 -- 172.21.15.69:0/2720895418 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e81100e0 con 0x55d7ba891f60 2023-12-14T14:17:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba88f3f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f68e0096310 tx=0x7f68e00c9ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24cc907d513f865 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68cdffb700 1 -- 172.21.15.69:0/2720895418 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00b92c0 con 0x55d7ba891f60 2023-12-14T14:17:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68cdffb700 1 -- 172.21.15.69:0/2720895418 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f68e00b7e40 con 0x55d7ba891f60 2023-12-14T14:17:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2720895418 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7ba8762b0 con 0x55d7ba891f60 2023-12-14T14:17:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68cdffb700 1 -- 172.21.15.69:0/2720895418 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68e0098d90 con 0x55d7ba891f60 2023-12-14T14:17:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68f8b6db80 10 client.16377 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2720895418 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d7ba79b170 con 0x55d7ba891f60 2023-12-14T14:17:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.642+0000 7f68cdffb700 1 -- 172.21.15.69:0/2720895418 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68e0063080 con 0x55d7ba891f60 2023-12-14T14:17:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68cdffb700 1 -- 172.21.15.69:0/2720895418 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f68e00a17d0 con 0x55d7ba891f60 2023-12-14T14:17:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68f8b6db80 10 client.16377 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68f8b6db80 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68f8b6db80 20 client.16377 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d7ba8a1530 0x55d7ba8a3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68f8b6db80 4 client.16377 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:17:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2720895418 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7ba7cdce0 con 0x55d7ba8a1530 2023-12-14T14:17:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68e659c700 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d7ba8a1530 0x55d7ba8a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68cdffb700 10 client.16377 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.643+0000 7f68e659c700 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d7ba8a1530 0x55d7ba8a3910 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf6c71b8538d1a60 server_cookie=4effc637b85f0a2c in_seq=0 out_seq=0 2023-12-14T14:17:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68cdffb700 1 -- 172.21.15.69:0/2720895418 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d7ba7cdce0 con 0x55d7ba8a1530 2023-12-14T14:17:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68cdffb700 10 client.16377 handle_command_reply: tid=0 2023-12-14T14:17:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 client.16377 shutdown 2023-12-14T14:17:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2720895418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 msgr2=0x55d7ba88f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba88f3f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f68e0096310 tx=0x7f68e00c9ea0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2720895418 shutdown_connections 2023-12-14T14:17:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d7ba8a1530 0x55d7ba8a3910 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba88f3f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68cdffb700 0 client.16377 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba891a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2720895418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba88ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2720895418 >> 172.21.15.69:0/2720895418 conn(0x55d7ba878ca0 msgr2=0x55d7ba87e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2720895418 shutdown_connections 2023-12-14T14:17:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2720895418 wait complete. 2023-12-14T14:17:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.644+0000 7f68f8b6db80 20 client.16377 trim_cache size 0 max 16384 2023-12-14T14:17:38.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68f8b6db80 1 Processor -- start 2023-12-14T14:17:38.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68f8b6db80 1 -- start start 2023-12-14T14:17:38.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882380 0x55d7ba89dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882c90 0x55d7ba8914c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba891a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba88eec0 con 0x55d7ba891f60 2023-12-14T14:17:38.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba88f000 con 0x55d7ba882380 2023-12-14T14:17:38.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba89e250 con 0x55d7ba882c90 2023-12-14T14:17:38.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba891a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba891a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34776/0 (socket says 172.21.15.69:34776) 2023-12-14T14:17:38.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e6d9d700 1 -- 172.21.15.69:0/3527885672 learned_addr learned my addr 172.21.15.69:0/3527885672 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e5d9b700 1 --2- 172.21.15.69:0/3527885672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882c90 0x55d7ba8914c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e6d9d700 1 -- 172.21.15.69:0/3527885672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882c90 msgr2=0x55d7ba8914c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/3527885672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882c90 0x55d7ba8914c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e6d9d700 1 -- 172.21.15.69:0/3527885672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882380 msgr2=0x55d7ba89dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/3527885672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882380 0x55d7ba89dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e6d9d700 1 -- 172.21.15.69:0/3527885672 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7ba79aec0 con 0x55d7ba891f60 2023-12-14T14:17:38.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.661+0000 7f68e5d9b700 1 --2- 172.21.15.69:0/3527885672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882c90 0x55d7ba8914c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:17:38.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/3527885672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba891a00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f68e00c9f90 tx=0x7f68e0097e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3407884664ea308c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68d57fa700 1 -- 172.21.15.69:0/3527885672 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00993e0 con 0x55d7ba891f60 2023-12-14T14:17:38.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68d57fa700 1 -- 172.21.15.69:0/3527885672 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d7ba8762b0 con 0x55d7ba891f60 2023-12-14T14:17:38.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68d57fa700 1 -- 172.21.15.69:0/3527885672 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0098ff0 con 0x55d7ba891f60 2023-12-14T14:17:38.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68f8b6db80 1 -- 172.21.15.69:0/3527885672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 msgr2=0x55d7ba891a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/3527885672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba891a00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f68e00c9f90 tx=0x7f68e0097e50 comp rx=0 tx=0).stop 2023-12-14T14:17:38.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68f8b6db80 1 -- 172.21.15.69:0/3527885672 shutdown_connections 2023-12-14T14:17:38.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/3527885672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba891a00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/3527885672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882380 0x55d7ba89dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/3527885672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882c90 0x55d7ba8914c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68f8b6db80 1 -- 172.21.15.69:0/3527885672 >> 172.21.15.69:0/3527885672 conn(0x55d7ba878ca0 msgr2=0x55d7ba8a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68f8b6db80 1 -- 172.21.15.69:0/3527885672 shutdown_connections 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.662+0000 7f68f8b6db80 1 -- 172.21.15.69:0/3527885672 wait complete. 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68f8b6db80 1 -- start start 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68f8b6db80 1 Processor -- start 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba898850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba896b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68f8b6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba8970c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba897600 con 0x55d7ba891f60 2023-12-14T14:17:38.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba897770 con 0x55d7ba882c90 2023-12-14T14:17:38.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68f8b6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ba897930 con 0x55d7ba882380 2023-12-14T14:17:38.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68f8b6db80 10 client.0 _ll_register_callbacks cb 0x7f68e0095be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:17:38.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba8970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba8970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34792/0 (socket says 172.21.15.69:34792) 2023-12-14T14:17:38.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e6d9d700 1 -- 172.21.15.69:0/2976209594 learned_addr learned my addr 172.21.15.69:0/2976209594 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:17:38.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e5d9b700 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba896b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e659c700 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba898850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e6d9d700 1 -- 172.21.15.69:0/2976209594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 msgr2=0x55d7ba898850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba898850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e6d9d700 1 -- 172.21.15.69:0/2976209594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 msgr2=0x55d7ba896b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:17:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba896b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.663+0000 7f68e6d9d700 1 -- 172.21.15.69:0/2976209594 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7ba79b170 con 0x55d7ba891f60 2023-12-14T14:17:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68e6d9d700 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba8970c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f68e00ca530 tx=0x7f68e00955e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38b63833a3ada77 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:17:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:17:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68cdffb700 1 -- 172.21.15.69:0/2976209594 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00a1980 con 0x55d7ba891f60 2023-12-14T14:17:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68cdffb700 1 -- 172.21.15.69:0/2976209594 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f68e00b7e40 con 0x55d7ba891f60 2023-12-14T14:17:38.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2976209594 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68e00a1c60 con 0x55d7ba891f60 2023-12-14T14:17:38.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68cdffb700 1 -- 172.21.15.69:0/2976209594 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68e00993e0 con 0x55d7ba891f60 2023-12-14T14:17:38.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68f8b6db80 10 client.16383 fetch_fsmap learned FSMap version 28 2023-12-14T14:17:38.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2976209594 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d7ba7819a0 con 0x55d7ba891f60 2023-12-14T14:17:38.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68cdffb700 1 -- 172.21.15.69:0/2976209594 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68e00a1c60 con 0x55d7ba891f60 2023-12-14T14:17:38.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68cdffb700 1 -- 172.21.15.69:0/2976209594 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f68e0098800 con 0x55d7ba891f60 2023-12-14T14:17:38.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68f8b6db80 10 client.16383 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:17:38.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68f8b6db80 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:17:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68f8b6db80 20 client.16383 populate_metadata read hostname 'smithi069' 2023-12-14T14:17:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d7ba8f62e0 0x55d7ba8f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:17:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68f8b6db80 4 client.16383 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:17:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2976209594 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d7ba7cda00 con 0x55d7ba8f62e0 2023-12-14T14:17:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.664+0000 7f68e659c700 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d7ba8f62e0 0x55d7ba8f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:17:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68cdffb700 10 client.16383 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68e659c700 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d7ba8f62e0 0x55d7ba8f86c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57466b39c33b0ce3 server_cookie=cec959bd4f234de1 in_seq=0 out_seq=0 2023-12-14T14:17:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68cdffb700 1 -- 172.21.15.69:0/2976209594 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d7ba7cda00 con 0x55d7ba8f62e0 2023-12-14T14:17:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68cdffb700 10 client.16383 handle_command_reply: tid=0 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 client.16383 shutdown 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2976209594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 msgr2=0x55d7ba8970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba8970c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f68e00ca530 tx=0x7f68e00955e0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2976209594 shutdown_connections 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55d7ba8f62e0 0x55d7ba8f86c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7ba891f60 0x55d7ba8970c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ba882380 0x55d7ba898850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68cdffb700 0 client.16383 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 --2- 172.21.15.69:0/2976209594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7ba882c90 0x55d7ba896b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2976209594 >> 172.21.15.69:0/2976209594 conn(0x55d7ba878ca0 msgr2=0x55d7ba889fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2976209594 shutdown_connections 2023-12-14T14:17:38.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 1 -- 172.21.15.69:0/2976209594 wait complete. 2023-12-14T14:17:38.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.665+0000 7f68f8b6db80 20 client.16383 trim_cache size 0 max 16384 2023-12-14T14:17:38.676 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:17:38.676 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:17:38.676 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:17:38.677 INFO:teuthology.orchestra.run.smithi069.stdout: "d371f440-d97c-4ccb-a5ef-4fb1abe04b75": { 2023-12-14T14:17:38.677 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:17:38.677 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "d371f440-d97c-4ccb-a5ef-4fb1abe04b75", 2023-12-14T14:17:38.677 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:17:38.677 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:17:38.677 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:17:38.677 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:17:38.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 -- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68d00a12c0 msgr2=0x7f68d00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68d00a12c0 0x7f68d00a3770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f68d8005fd0 tx=0x7f68d800a560 comp rx=0 tx=0).stop 2023-12-14T14:17:38.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 -- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e810a800 msgr2=0x7f68e819ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:17:38.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e810a800 0x7f68e819ada0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f68e000efc0 tx=0x7f68e000c3a0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 -- 172.21.15.69:0/309026085 shutdown_connections 2023-12-14T14:17:38.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f68d00a12c0 0x7f68d00a3770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68e810a800 0x7f68e819ada0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e8101430 0x7f68e8196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 --2- 172.21.15.69:0/309026085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68e8101d40 0x7f68e8196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:17:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 -- 172.21.15.69:0/309026085 >> 172.21.15.69:0/309026085 conn(0x7f68e80763a0 msgr2=0x7f68e80fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:17:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 -- 172.21.15.69:0/309026085 shutdown_connections 2023-12-14T14:17:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:17:38.666+0000 7f68ec9df700 1 -- 172.21.15.69:0/309026085 wait complete. 2023-12-14T14:17:38.680 INFO:tasks.cephfs.filesystem:scrub status for tag:d371f440-d97c-4ccb-a5ef-4fb1abe04b75 - {'path': '/', 'tag': 'd371f440-d97c-4ccb-a5ef-4fb1abe04b75', 'options': 'recursive,force'} 2023-12-14T14:17:39.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:39 smithi119 ceph-mon[43834]: pgmap v215: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2023-12-14T14:17:39.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:39 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:17:39.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:39 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:39.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:39 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:17:39.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:39 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:17:39.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:39 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:39.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:39 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:39 smithi069 ceph-mon[42034]: pgmap v215: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2023-12-14T14:17:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:39 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:17:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:39 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:39 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:17:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:39 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:17:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:39 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:39.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:39 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:39 smithi081 ceph-mon[43371]: pgmap v215: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2023-12-14T14:17:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:39 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:17:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:39 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:39 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:17:39.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:39 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:17:39.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:39 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:39.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:39 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:17:41.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:41 smithi119 ceph-mon[43834]: pgmap v216: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-12-14T14:17:41.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:41 smithi069 ceph-mon[42034]: pgmap v216: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-12-14T14:17:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:41 smithi081 ceph-mon[43371]: pgmap v216: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-12-14T14:17:43.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:43 smithi119 ceph-mon[43834]: pgmap v217: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-12-14T14:17:43.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:43 smithi069 ceph-mon[42034]: pgmap v217: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-12-14T14:17:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:43 smithi081 ceph-mon[43371]: pgmap v217: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-12-14T14:17:45.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:45 smithi119 ceph-mon[43834]: pgmap v218: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T14:17:45.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:45 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:17:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:45 smithi069 ceph-mon[42034]: pgmap v218: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T14:17:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:45 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:17:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:45 smithi081 ceph-mon[43371]: pgmap v218: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T14:17:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:45 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:17:46.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:46 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:17:46.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:46 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:17:46.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:46 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:17:47.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:47 smithi119 ceph-mon[43834]: pgmap v219: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:17:47.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:47 smithi069 ceph-mon[42034]: pgmap v219: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:17:47.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:47 smithi081 ceph-mon[43371]: pgmap v219: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:17:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:49 smithi119 ceph-mon[43834]: pgmap v220: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:17:49.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:49 smithi069 ceph-mon[42034]: pgmap v220: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:17:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:49 smithi081 ceph-mon[43371]: pgmap v220: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:17:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:51 smithi119 ceph-mon[43834]: pgmap v221: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:17:51.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:51 smithi069 ceph-mon[42034]: pgmap v221: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:17:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:51 smithi081 ceph-mon[43371]: pgmap v221: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:17:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:53 smithi119 ceph-mon[43834]: pgmap v222: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:17:53.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:53 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:17:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:53 smithi069 ceph-mon[42034]: pgmap v222: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:17:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:53 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:17:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:53 smithi081 ceph-mon[43371]: pgmap v222: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:17:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:53 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:17:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:54 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:17:54.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:54 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:17:54.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:54 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:17:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:54 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:17:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:54 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:17:54.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:54 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:17:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:54 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:17:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:54 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:17:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:54 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:17:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:55 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:17:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:55 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:17:55.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:55 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:17:55.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:55 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:17:55.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:55 smithi119 ceph-mon[43834]: pgmap v223: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:17:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:55 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:17:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:55 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:17:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:55 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:17:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:55 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:17:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:55 smithi069 ceph-mon[42034]: pgmap v223: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:17:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:55 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:17:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:55 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:17:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:55 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:17:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:55 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:17:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:55 smithi081 ceph-mon[43371]: pgmap v223: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:17:57.649 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:57 smithi081 ceph-mon[43371]: pgmap v224: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:17:57.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:57 smithi119 ceph-mon[43834]: pgmap v224: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:17:57.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:57 smithi069 ceph-mon[42034]: pgmap v224: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:17:59.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:17:59 smithi119 ceph-mon[43834]: pgmap v225: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:17:59.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:17:59 smithi069 ceph-mon[42034]: pgmap v225: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:17:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:17:59 smithi081 ceph-mon[43371]: pgmap v225: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:01 smithi119 ceph-mon[43834]: pgmap v226: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.6 KiB/s wr, 7 op/s 2023-12-14T14:18:01.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:01 smithi069 ceph-mon[42034]: pgmap v226: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.6 KiB/s wr, 7 op/s 2023-12-14T14:18:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:01 smithi081 ceph-mon[43371]: pgmap v226: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.6 KiB/s wr, 7 op/s 2023-12-14T14:18:03.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:03 smithi119 ceph-mon[43834]: pgmap v227: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.6 KiB/s wr, 5 op/s 2023-12-14T14:18:03.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:03 smithi069 ceph-mon[42034]: pgmap v227: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.6 KiB/s wr, 5 op/s 2023-12-14T14:18:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:03 smithi081 ceph-mon[43371]: pgmap v227: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.6 KiB/s wr, 5 op/s 2023-12-14T14:18:05.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:05 smithi119 ceph-mon[43834]: pgmap v228: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 22 op/s 2023-12-14T14:18:05.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:05 smithi069 ceph-mon[42034]: pgmap v228: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 22 op/s 2023-12-14T14:18:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:05 smithi081 ceph-mon[43371]: pgmap v228: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 22 op/s 2023-12-14T14:18:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:07 smithi081 ceph-mon[43371]: pgmap v229: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 19 op/s 2023-12-14T14:18:07.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:07 smithi119 ceph-mon[43834]: pgmap v229: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 19 op/s 2023-12-14T14:18:07.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:07 smithi069 ceph-mon[42034]: pgmap v229: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 19 op/s 2023-12-14T14:18:08.681 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:18:08.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.818+0000 7ff54f332700 1 -- 172.21.15.69:0/2787609495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 msgr2=0x7ff54810bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.818+0000 7ff54f332700 1 --2- 172.21.15.69:0/2787609495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 0x7ff54810bf10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff54000b0a0 tx=0x7ff54000b3b0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.818+0000 7ff54f332700 1 -- 172.21.15.69:0/2787609495 shutdown_connections 2023-12-14T14:18:08.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.818+0000 7ff54f332700 1 --2- 172.21.15.69:0/2787609495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 0x7ff54810bf10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.818+0000 7ff54f332700 1 --2- 172.21.15.69:0/2787609495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff548100580 0x7ff548100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.818+0000 7ff54f332700 1 --2- 172.21.15.69:0/2787609495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff548100e90 0x7ff5481095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.818+0000 7ff54f332700 1 -- 172.21.15.69:0/2787609495 >> 172.21.15.69:0/2787609495 conn(0x7ff548074a60 msgr2=0x7ff548074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:08.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.818+0000 7ff54f332700 1 -- 172.21.15.69:0/2787609495 shutdown_connections 2023-12-14T14:18:08.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.818+0000 7ff54f332700 1 -- 172.21.15.69:0/2787609495 wait complete. 2023-12-14T14:18:08.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54f332700 1 Processor -- start 2023-12-14T14:18:08.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54f332700 1 -- start start 2023-12-14T14:18:08.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54f332700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff548100580 0x7ff5481952b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54f332700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff548100e90 0x7ff5481957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54f332700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 0x7ff548199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54f332700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54819a290 con 0x7ff548109b30 2023-12-14T14:18:08.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54f332700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54819a400 con 0x7ff548100e90 2023-12-14T14:18:08.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54f332700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54819a5c0 con 0x7ff548100580 2023-12-14T14:18:08.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54d8cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 0x7ff548199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54d8cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 0x7ff548199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36842/0 (socket says 172.21.15.69:36842) 2023-12-14T14:18:08.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54c8cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff548100e90 0x7ff5481957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.819+0000 7ff54d8cf700 1 -- 172.21.15.69:0/192794509 learned_addr learned my addr 172.21.15.69:0/192794509 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:08.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff548100580 0x7ff5481952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54d8cf700 1 -- 172.21.15.69:0/192794509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff548100580 msgr2=0x7ff5481952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54d8cf700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff548100580 0x7ff5481952b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54d8cf700 1 -- 172.21.15.69:0/192794509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff548100e90 msgr2=0x7ff5481957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54d8cf700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff548100e90 0x7ff5481957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54d8cf700 1 -- 172.21.15.69:0/192794509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540009d00 con 0x7ff548109b30 2023-12-14T14:18:08.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff548100580 0x7ff5481952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:08.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54d8cf700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 0x7ff548199c50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff5400062a0 tx=0x7ff5400079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:08.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff53e7fc700 1 -- 172.21.15.69:0/192794509 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54000e040 con 0x7ff548109b30 2023-12-14T14:18:08.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54f332700 1 -- 172.21.15.69:0/192794509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54810f140 con 0x7ff548109b30 2023-12-14T14:18:08.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff53e7fc700 1 -- 172.21.15.69:0/192794509 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff540004d60 con 0x7ff548109b30 2023-12-14T14:18:08.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff53e7fc700 1 -- 172.21.15.69:0/192794509 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54001d480 con 0x7ff548109b30 2023-12-14T14:18:08.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.820+0000 7ff54f332700 1 -- 172.21.15.69:0/192794509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54810efb0 con 0x7ff548109b30 2023-12-14T14:18:08.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.822+0000 7ff53e7fc700 1 -- 172.21.15.69:0/192794509 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff5400040b0 con 0x7ff548109b30 2023-12-14T14:18:08.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.823+0000 7ff53e7fc700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5340a12c0 0x7ff5340a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.823+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5340a12c0 0x7ff5340a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.823+0000 7ff53e7fc700 1 -- 172.21.15.69:0/192794509 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7ff5400ce3d0 con 0x7ff548109b30 2023-12-14T14:18:08.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.823+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5340a12c0 0x7ff5340a3770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff538005fd0 tx=0x7ff538005e20 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:08.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff55b4c0b80 1 Processor -- start 2023-12-14T14:18:08.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff55b4c0b80 1 -- start start 2023-12-14T14:18:08.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee250750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 0x5613ee260140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee13a5e0 con 0x5613ee250c90 2023-12-14T14:18:08.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee1a9870 con 0x5613ee250380 2023-12-14T14:18:08.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee1a2d00 con 0x5613ee25dd60 2023-12-14T14:18:08.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff54c8cd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff54c8cd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36844/0 (socket says 172.21.15.69:36844) 2023-12-14T14:18:08.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.824+0000 7ff54c8cd700 1 -- 172.21.15.69:0/2067478305 learned_addr learned my addr 172.21.15.69:0/2067478305 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:08.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff54d8cf700 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 0x5613ee260140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee250750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff54c8cd700 1 -- 172.21.15.69:0/2067478305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 msgr2=0x5613ee260140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:08.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 0x5613ee260140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff54c8cd700 1 -- 172.21.15.69:0/2067478305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 msgr2=0x5613ee250750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:08.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee250750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff54c8cd700 1 -- 172.21.15.69:0/2067478305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613ee0243b0 con 0x5613ee250c90 2023-12-14T14:18:08.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee250750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:08.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25d820 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff544007c90 tx=0x7ff5440103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360d5b80f5b03108 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:08.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff5337fe700 1 -- 172.21.15.69:0/2067478305 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544010d60 con 0x5613ee250c90 2023-12-14T14:18:08.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff5337fe700 1 -- 172.21.15.69:0/2067478305 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff544010ec0 con 0x5613ee250c90 2023-12-14T14:18:08.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.825+0000 7ff5337fe700 1 -- 172.21.15.69:0/2067478305 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54401a470 con 0x5613ee250c90 2023-12-14T14:18:08.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2067478305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 msgr2=0x5613ee25d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25d820 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff544007c90 tx=0x7ff5440103d0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2067478305 shutdown_connections 2023-12-14T14:18:08.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 0x5613ee260140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee250750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2067478305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25d820 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2067478305 >> 172.21.15.69:0/2067478305 conn(0x5613ee246ca0 msgr2=0x5613ee24c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:08.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2067478305 shutdown_connections 2023-12-14T14:18:08.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2067478305 wait complete. 2023-12-14T14:18:08.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 -- start start 2023-12-14T14:18:08.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.826+0000 7ff55b4c0b80 1 Processor -- start 2023-12-14T14:18:08.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250380 0x5613ee25d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 0x5613ee25aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 0x5613ee25b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee13ef90 con 0x5613ee250380 2023-12-14T14:18:08.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee13ec30 con 0x5613ee250c90 2023-12-14T14:18:08.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee0266a0 con 0x5613ee25dd60 2023-12-14T14:18:08.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff55b4c0b80 10 client.0 _ll_register_callbacks cb 0x5613ee162910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:08.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d0ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250380 0x5613ee25d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d0ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250380 0x5613ee25d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36860/0 (socket says 172.21.15.69:36860) 2023-12-14T14:18:08.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d0ce700 1 -- 172.21.15.69:0/2678200395 learned_addr learned my addr 172.21.15.69:0/2678200395 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:08.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d8cf700 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 0x5613ee25b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d0ce700 1 -- 172.21.15.69:0/2678200395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 msgr2=0x5613ee25b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:08.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 0x5613ee25aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 0x5613ee25b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d0ce700 1 -- 172.21.15.69:0/2678200395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 msgr2=0x5613ee25aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:08.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 0x5613ee25aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d0ce700 1 -- 172.21.15.69:0/2678200395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5440078c0 con 0x5613ee250380 2023-12-14T14:18:08.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 0x5613ee25aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:08.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250380 0x5613ee25d6f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff53800f6d0 tx=0x7ff538004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fb2187c6c1b98b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:08.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff530ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:08.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff530ff9700 1 -- 172.21.15.69:0/2678200395 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53801c620 con 0x5613ee250380 2023-12-14T14:18:08.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff530ff9700 1 -- 172.21.15.69:0/2678200395 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7ff53801c780 con 0x5613ee250380 2023-12-14T14:18:08.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.827+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2678200395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613ee19bce0 con 0x5613ee250380 2023-12-14T14:18:08.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff530ff9700 1 -- 172.21.15.69:0/2678200395 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff53801c940 con 0x5613ee250380 2023-12-14T14:18:08.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff55b4c0b80 10 client.16395 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:08.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2678200395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5613ee169170 con 0x5613ee250380 2023-12-14T14:18:08.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff530ff9700 1 -- 172.21.15.69:0/2678200395 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5613ee19bce0 con 0x5613ee250380 2023-12-14T14:18:08.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff530ff9700 1 -- 172.21.15.69:0/2678200395 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff53802b070 con 0x5613ee250380 2023-12-14T14:18:08.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff55b4c0b80 10 client.16395 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:08.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff55b4c0b80 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:08.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff55b4c0b80 20 client.16395 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:08.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5613ee26d740 0x5613ee26fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff55b4c0b80 4 client.16395 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:08.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2678200395 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613ee19ba00 con 0x5613ee26d740 2023-12-14T14:18:08.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.828+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5613ee26d740 0x5613ee26fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff530ff9700 10 client.16395 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:08.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5613ee26d740 0x5613ee26fb50 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d937de786114200 server_cookie=4745024a6a2018bd in_seq=0 out_seq=0 2023-12-14T14:18:08.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff530ff9700 1 -- 172.21.15.69:0/2678200395 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5613ee19ba00 con 0x5613ee26d740 2023-12-14T14:18:08.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff530ff9700 10 client.16395 handle_command_reply: tid=0 2023-12-14T14:18:08.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff55b4c0b80 1 client.16395 shutdown 2023-12-14T14:18:08.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2678200395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250380 msgr2=0x5613ee25d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250380 0x5613ee25d6f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff53800f6d0 tx=0x7ff538004750 comp rx=0 tx=0).stop 2023-12-14T14:18:08.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2678200395 shutdown_connections 2023-12-14T14:18:08.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5613ee26d740 0x5613ee26fb50 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee25dd60 0x5613ee25b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250380 0x5613ee25d6f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff530ff9700 0 client.16395 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:08.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2678200395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 0x5613ee25aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.829+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2678200395 >> 172.21.15.69:0/2678200395 conn(0x5613ee246ca0 msgr2=0x5613ee24c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:08.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.830+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2678200395 shutdown_connections 2023-12-14T14:18:08.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.830+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2678200395 wait complete. 2023-12-14T14:18:08.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.830+0000 7ff55b4c0b80 20 client.16395 trim_cache size 0 max 16384 2023-12-14T14:18:08.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff55b4c0b80 1 Processor -- start 2023-12-14T14:18:08.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff55b4c0b80 1 -- start start 2023-12-14T14:18:08.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee246ca0 0x5613ee25d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee25a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee26a180 con 0x5613ee250c90 2023-12-14T14:18:08.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee26ad90 con 0x5613ee250380 2023-12-14T14:18:08.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee258fe0 con 0x5613ee246ca0 2023-12-14T14:18:08.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff54d8cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff54d8cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36872/0 (socket says 172.21.15.69:36872) 2023-12-14T14:18:08.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff54d0ce700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee246ca0 0x5613ee25d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.846+0000 7ff54d8cf700 1 -- 172.21.15.69:0/2362284175 learned_addr learned my addr 172.21.15.69:0/2362284175 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:08.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/2362284175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee25a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff54d8cf700 1 -- 172.21.15.69:0/2362284175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee246ca0 msgr2=0x5613ee25d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:08.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff54d8cf700 1 --2- 172.21.15.69:0/2362284175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee246ca0 0x5613ee25d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff54d8cf700 1 -- 172.21.15.69:0/2362284175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 msgr2=0x5613ee25a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:08.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff54d8cf700 1 --2- 172.21.15.69:0/2362284175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee25a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff54d8cf700 1 -- 172.21.15.69:0/2362284175 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613ee168ec0 con 0x5613ee250c90 2023-12-14T14:18:08.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/2362284175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee25a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:08.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff54d8cf700 1 --2- 172.21.15.69:0/2362284175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25a780 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff54009b4d0 tx=0x7ff540009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340908abaa0cfcbf server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:08.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff533fff700 1 -- 172.21.15.69:0/2362284175 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54009aea0 con 0x5613ee250c90 2023-12-14T14:18:08.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff533fff700 1 -- 172.21.15.69:0/2362284175 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff540024360 con 0x5613ee250c90 2023-12-14T14:18:08.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff533fff700 1 -- 172.21.15.69:0/2362284175 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540097c50 con 0x5613ee250c90 2023-12-14T14:18:08.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2362284175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 msgr2=0x5613ee25a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.847+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2362284175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25a780 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff54009b4d0 tx=0x7ff540009040 comp rx=0 tx=0).stop 2023-12-14T14:18:08.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2362284175 shutdown_connections 2023-12-14T14:18:08.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2362284175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee250c90 0x5613ee25a780 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2362284175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee246ca0 0x5613ee25d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/2362284175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250380 0x5613ee25a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2362284175 >> 172.21.15.69:0/2362284175 conn(0x5613ee260410 msgr2=0x5613ee269a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:08.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2362284175 shutdown_connections 2023-12-14T14:18:08.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/2362284175 wait complete. 2023-12-14T14:18:08.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 -- start start 2023-12-14T14:18:08.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 Processor -- start 2023-12-14T14:18:08.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee246ca0 0x5613ee264530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee250380 0x5613ee264a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 0x5613ee262a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee263170 con 0x5613ee246ca0 2023-12-14T14:18:08.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee2632e0 con 0x5613ee250c90 2023-12-14T14:18:08.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ee2634a0 con 0x5613ee250380 2023-12-14T14:18:08.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff55b4c0b80 10 client.0 _ll_register_callbacks cb 0x7ff53800dc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.848+0000 7ff54d0ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee246ca0 0x5613ee264530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54d0ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee246ca0 0x5613ee264530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36888/0 (socket says 172.21.15.69:36888) 2023-12-14T14:18:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54d0ce700 1 -- 172.21.15.69:0/3556002313 learned_addr learned my addr 172.21.15.69:0/3556002313 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54d8cf700 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 0x5613ee262a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee250380 0x5613ee264a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54d0ce700 1 -- 172.21.15.69:0/3556002313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee250380 msgr2=0x5613ee264a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee250380 0x5613ee264a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54d0ce700 1 -- 172.21.15.69:0/3556002313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 msgr2=0x5613ee262a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 0x5613ee262a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54d0ce700 1 -- 172.21.15.69:0/3556002313 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54810efb0 con 0x5613ee246ca0 2023-12-14T14:18:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff54d0ce700 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee246ca0 0x5613ee264530 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff538000c00 tx=0x7ff53801b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d47e6ab61f6021 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff530ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff530ff9700 1 -- 172.21.15.69:0/3556002313 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800fb40 con 0x5613ee246ca0 2023-12-14T14:18:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff530ff9700 1 -- 172.21.15.69:0/3556002313 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7ff5380249b0 con 0x5613ee246ca0 2023-12-14T14:18:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/3556002313 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613ee2442b0 con 0x5613ee246ca0 2023-12-14T14:18:08.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff530ff9700 1 -- 172.21.15.69:0/3556002313 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff53801b9f0 con 0x5613ee246ca0 2023-12-14T14:18:08.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff55b4c0b80 10 client.16401 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:08.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/3556002313 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5613ee14f9a0 con 0x5613ee246ca0 2023-12-14T14:18:08.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.849+0000 7ff530ff9700 1 -- 172.21.15.69:0/3556002313 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5613ee2442b0 con 0x5613ee246ca0 2023-12-14T14:18:08.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff530ff9700 1 -- 172.21.15.69:0/3556002313 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff53800b050 con 0x5613ee246ca0 2023-12-14T14:18:08.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff55b4c0b80 10 client.16401 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:08.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff55b4c0b80 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:08.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff55b4c0b80 20 client.16401 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:08.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5613ee25dd60 0x5613ee2c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff55b4c0b80 4 client.16401 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:18:08.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/3556002313 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5613edff1cf0 con 0x5613ee25dd60 2023-12-14T14:18:08.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5613ee25dd60 0x5613ee2c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff530ff9700 10 client.16401 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:08.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff54c8cd700 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5613ee25dd60 0x5613ee2c4920 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6697bd254da88ee server_cookie=2e4cb228a156ebff in_seq=0 out_seq=0 2023-12-14T14:18:08.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff530ff9700 1 -- 172.21.15.69:0/3556002313 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5613edff1cf0 con 0x5613ee25dd60 2023-12-14T14:18:08.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff530ff9700 10 client.16401 handle_command_reply: tid=0 2023-12-14T14:18:08.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.850+0000 7ff55b4c0b80 1 client.16401 shutdown 2023-12-14T14:18:08.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/3556002313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee246ca0 msgr2=0x5613ee264530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee246ca0 0x5613ee264530 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff538000c00 tx=0x7ff53801b800 comp rx=0 tx=0).stop 2023-12-14T14:18:08.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/3556002313 shutdown_connections 2023-12-14T14:18:08.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5613ee25dd60 0x5613ee2c4920 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ee250c90 0x5613ee262a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff530ff9700 0 client.16401 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:08.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5613ee246ca0 0x5613ee264530 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 --2- 172.21.15.69:0/3556002313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5613ee250380 0x5613ee264a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/3556002313 >> 172.21.15.69:0/3556002313 conn(0x5613ee260410 msgr2=0x5613ee252260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:08.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/3556002313 shutdown_connections 2023-12-14T14:18:08.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 1 -- 172.21.15.69:0/3556002313 wait complete. 2023-12-14T14:18:08.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff55b4c0b80 20 client.16401 trim_cache size 0 max 16384 2023-12-14T14:18:08.862 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:18:08.862 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:18:08.863 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:18:08.863 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:18:08.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 -- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5340a12c0 msgr2=0x7ff5340a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5340a12c0 0x7ff5340a3770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff538005fd0 tx=0x7ff538005e20 comp rx=0 tx=0).stop 2023-12-14T14:18:08.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 -- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 msgr2=0x7ff548199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 0x7ff548199c50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff5400062a0 tx=0x7ff5400079b0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 -- 172.21.15.69:0/192794509 shutdown_connections 2023-12-14T14:18:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff5340a12c0 0x7ff5340a3770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff548109b30 0x7ff548199c50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff548100580 0x7ff5481952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 --2- 172.21.15.69:0/192794509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff548100e90 0x7ff5481957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 -- 172.21.15.69:0/192794509 >> 172.21.15.69:0/192794509 conn(0x7ff548074a60 msgr2=0x7ff548101560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 -- 172.21.15.69:0/192794509 shutdown_connections 2023-12-14T14:18:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.851+0000 7ff54f332700 1 -- 172.21.15.69:0/192794509 wait complete. 2023-12-14T14:18:08.866 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:18:08.866 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:18:08.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.987+0000 7fc72e099700 1 -- 172.21.15.69:0/33648670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100570 msgr2=0x7fc728100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.987+0000 7fc72e099700 1 --2- 172.21.15.69:0/33648670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100570 0x7fc728100940 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009990 tx=0x7fc71c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.988+0000 7fc72e099700 1 -- 172.21.15.69:0/33648670 shutdown_connections 2023-12-14T14:18:08.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.988+0000 7fc72e099700 1 --2- 172.21.15.69:0/33648670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc728109b20 0x7fc72810bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.988+0000 7fc72e099700 1 --2- 172.21.15.69:0/33648670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100570 0x7fc728100940 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.988+0000 7fc72e099700 1 --2- 172.21.15.69:0/33648670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728100e80 0x7fc7281095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.988+0000 7fc72e099700 1 -- 172.21.15.69:0/33648670 >> 172.21.15.69:0/33648670 conn(0x7fc728074a50 msgr2=0x7fc728074e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:08.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.988+0000 7fc72e099700 1 -- 172.21.15.69:0/33648670 shutdown_connections 2023-12-14T14:18:08.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.988+0000 7fc72e099700 1 -- 172.21.15.69:0/33648670 wait complete. 2023-12-14T14:18:08.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.988+0000 7fc72e099700 1 Processor -- start 2023-12-14T14:18:08.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.988+0000 7fc72e099700 1 -- start start 2023-12-14T14:18:08.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc72e099700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728100570 0x7fc7281970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc72e099700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100e80 0x7fc728197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc72e099700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc728109b20 0x7fc7281a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc72e099700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc728197f50 con 0x7fc728100e80 2023-12-14T14:18:08.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc72e099700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281a2690 con 0x7fc728100570 2023-12-14T14:18:08.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc72e099700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281a2850 con 0x7fc728109b20 2023-12-14T14:18:08.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc726ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100e80 0x7fc728197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc726ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100e80 0x7fc728197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36898/0 (socket says 172.21.15.69:36898) 2023-12-14T14:18:08.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc726ffd700 1 -- 172.21.15.69:0/2869760674 learned_addr learned my addr 172.21.15.69:0/2869760674 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:08.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc727fff700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc728109b20 0x7fc7281a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc7277fe700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728100570 0x7fc7281970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc726ffd700 1 -- 172.21.15.69:0/2869760674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc728109b20 msgr2=0x7fc7281a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc726ffd700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc728109b20 0x7fc7281a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc726ffd700 1 -- 172.21.15.69:0/2869760674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728100570 msgr2=0x7fc7281970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:08.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc726ffd700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728100570 0x7fc7281970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:08.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc726ffd700 1 -- 172.21.15.69:0/2869760674 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c0095f0 con 0x7fc728100e80 2023-12-14T14:18:08.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc7277fe700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728100570 0x7fc7281970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:08.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc726ffd700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100e80 0x7fc728197610 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc71800e9a0 tx=0x7fc71800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:08.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc724ff9700 1 -- 172.21.15.69:0/2869760674 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718009790 con 0x7fc728100e80 2023-12-14T14:18:08.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc724ff9700 1 -- 172.21.15.69:0/2869760674 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc71800cbd0 con 0x7fc728100e80 2023-12-14T14:18:08.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72810f1d0 con 0x7fc728100e80 2023-12-14T14:18:08.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc724ff9700 1 -- 172.21.15.69:0/2869760674 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718018680 con 0x7fc728100e80 2023-12-14T14:18:08.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.989+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72810f040 con 0x7fc728100e80 2023-12-14T14:18:08.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.990+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72810f360 con 0x7fc728100e80 2023-12-14T14:18:08.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.991+0000 7fc724ff9700 1 -- 172.21.15.69:0/2869760674 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc71800cd40 con 0x7fc728100e80 2023-12-14T14:18:08.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.992+0000 7fc724ff9700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc7100a12c0 0x7fc7100a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:08.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.992+0000 7fc7277fe700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc7100a12c0 0x7fc7100a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:08.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.992+0000 7fc724ff9700 1 -- 172.21.15.69:0/2869760674 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fc718014070 con 0x7fc728100e80 2023-12-14T14:18:08.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.993+0000 7fc7277fe700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc7100a12c0 0x7fc7100a3770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc71c006010 tx=0x7fc71c00b260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:08.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:08.996+0000 7fc724ff9700 1 -- 172.21.15.69:0/2869760674 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc718096660 con 0x7fc728100e80 2023-12-14T14:18:09.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.227+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc728104420 con 0x7fc728100e80 2023-12-14T14:18:09.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.228+0000 7fc724ff9700 1 -- 172.21.15.69:0/2869760674 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10810 (secure 0 0 0) 0x7fc718099c80 con 0x7fc728100e80 2023-12-14T14:18:09.227 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:18:09.228 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:14:13.438363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:18:09.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc7100a12c0 msgr2=0x7fc7100a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc7100a12c0 0x7fc7100a3770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc71c006010 tx=0x7fc71c00b260 comp rx=0 tx=0).stop 2023-12-14T14:18:09.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100e80 msgr2=0x7fc728197610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100e80 0x7fc728197610 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc71800e9a0 tx=0x7fc71800ecb0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 shutdown_connections 2023-12-14T14:18:09.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc7100a12c0 0x7fc7100a3770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc728109b20 0x7fc7281a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728100570 0x7fc7281970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 --2- 172.21.15.69:0/2869760674 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc728100e80 0x7fc728197610 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 >> 172.21.15.69:0/2869760674 conn(0x7fc728074a50 msgr2=0x7fc728101560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 shutdown_connections 2023-12-14T14:18:09.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.230+0000 7fc72e099700 1 -- 172.21.15.69:0/2869760674 wait complete. 2023-12-14T14:18:09.232 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-12-14T14:18:09.241 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:18:09.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.366+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/281617909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc100580 msgr2=0x7f1bcc100950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.366+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/281617909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc100580 0x7f1bcc100950 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009990 tx=0x7f1bc0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.366+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/281617909 shutdown_connections 2023-12-14T14:18:09.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.366+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/281617909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc109b30 0x7f1bcc10bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.366+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/281617909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc100580 0x7f1bcc100950 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.366+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/281617909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc100e90 0x7f1bcc1095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.366+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/281617909 >> 172.21.15.69:0/281617909 conn(0x7f1bcc074a60 msgr2=0x7f1bcc074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.366+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/281617909 shutdown_connections 2023-12-14T14:18:09.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.366+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/281617909 wait complete. 2023-12-14T14:18:09.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.367+0000 7f1bd2dcd700 1 Processor -- start 2023-12-14T14:18:09.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.367+0000 7f1bd2dcd700 1 -- start start 2023-12-14T14:18:09.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.367+0000 7f1bd2dcd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc100580 0x7f1bcc109fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.367+0000 7f1bd2dcd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc100e90 0x7f1bcc10a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.367+0000 7f1bd2dcd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc109b30 0x7f1bcc1a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.367+0000 7f1bd2dcd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc10ad40 con 0x7f1bcc109b30 2023-12-14T14:18:09.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.367+0000 7f1bd2dcd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1a4b60 con 0x7f1bcc100580 2023-12-14T14:18:09.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.367+0000 7f1bd2dcd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1a4ca0 con 0x7f1bcc100e90 2023-12-14T14:18:09.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.367+0000 7f1bd136a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc109b30 0x7f1bcc1a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd136a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc109b30 0x7f1bcc1a4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36928/0 (socket says 172.21.15.69:36928) 2023-12-14T14:18:09.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd136a700 1 -- 172.21.15.69:0/2239755362 learned_addr learned my addr 172.21.15.69:0/2239755362 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc100580 0x7f1bcc109fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc100e90 0x7f1bcc10a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd136a700 1 -- 172.21.15.69:0/2239755362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc100e90 msgr2=0x7f1bcc10a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd136a700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc100e90 0x7f1bcc10a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd136a700 1 -- 172.21.15.69:0/2239755362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc100580 msgr2=0x7f1bcc109fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd136a700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc100580 0x7f1bcc109fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd136a700 1 -- 172.21.15.69:0/2239755362 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00095f0 con 0x7f1bcc109b30 2023-12-14T14:18:09.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd136a700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc109b30 0x7f1bcc1a4620 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400ada0 tx=0x7f1bc400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bc9ffb700 1 -- 172.21.15.69:0/2239755362 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400f070 con 0x7f1bcc109b30 2023-12-14T14:18:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/2239755362 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc10f210 con 0x7f1bcc109b30 2023-12-14T14:18:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bc9ffb700 1 -- 172.21.15.69:0/2239755362 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bc4007af0 con 0x7f1bcc109b30 2023-12-14T14:18:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bc9ffb700 1 -- 172.21.15.69:0/2239755362 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4004290 con 0x7f1bcc109b30 2023-12-14T14:18:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.368+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/2239755362 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc10f080 con 0x7f1bcc109b30 2023-12-14T14:18:09.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.370+0000 7f1bc9ffb700 1 -- 172.21.15.69:0/2239755362 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1bc4003a20 con 0x7f1bcc109b30 2023-12-14T14:18:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.371+0000 7f1bc9ffb700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1bbc0a1340 0x7f1bbc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.371+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1bbc0a1340 0x7f1bbc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.371+0000 7f1bc9ffb700 1 -- 172.21.15.69:0/2239755362 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1bc40cbda0 con 0x7f1bcc109b30 2023-12-14T14:18:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.371+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1bbc0a1340 0x7f1bbc0a37f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b5c0 tx=0x7f1bc0005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bdef5bb80 1 Processor -- start 2023-12-14T14:18:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bdef5bb80 1 -- start start 2023-12-14T14:18:09.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 0x55f481427750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f481432610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481432b50 0x55f481434f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4813115e0 con 0x55f481432b50 2023-12-14T14:18:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f481380870 con 0x55f481427c90 2023-12-14T14:18:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f481379d00 con 0x55f481427380 2023-12-14T14:18:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bd136a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481432b50 0x55f481434f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bd136a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481432b50 0x55f481434f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36938/0 (socket says 172.21.15.69:36938) 2023-12-14T14:18:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bd136a700 1 -- 172.21.15.69:0/1371231890 learned_addr learned my addr 172.21.15.69:0/1371231890 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 0x55f481427750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f481432610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bd136a700 1 -- 172.21.15.69:0/1371231890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 msgr2=0x55f481427750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bd136a700 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 0x55f481427750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bd136a700 1 -- 172.21.15.69:0/1371231890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 msgr2=0x55f481432610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bd136a700 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f481432610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bd136a700 1 -- 172.21.15.69:0/1371231890 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4811fb3b0 con 0x55f481432b50 2023-12-14T14:18:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.372+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f481432610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:09.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bd136a700 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481432b50 0x55f481434f30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4095890 tx=0x7f1bc4098850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6179de1b8a217e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bb6ffd700 1 -- 172.21.15.69:0/1371231890 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40a1270 con 0x55f481432b50 2023-12-14T14:18:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bb6ffd700 1 -- 172.21.15.69:0/1371231890 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bc4096f60 con 0x55f481432b50 2023-12-14T14:18:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bb6ffd700 1 -- 172.21.15.69:0/1371231890 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40992e0 con 0x55f481432b50 2023-12-14T14:18:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/1371231890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481432b50 msgr2=0x55f481434f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481432b50 0x55f481434f30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4095890 tx=0x7f1bc4098850 comp rx=0 tx=0).stop 2023-12-14T14:18:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/1371231890 shutdown_connections 2023-12-14T14:18:09.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481432b50 0x55f481434f30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 0x55f481427750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/1371231890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f481432610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/1371231890 >> 172.21.15.69:0/1371231890 conn(0x55f48141dca0 msgr2=0x55f4814237e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/1371231890 shutdown_connections 2023-12-14T14:18:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.373+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/1371231890 wait complete. 2023-12-14T14:18:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bdef5bb80 1 -- start start 2023-12-14T14:18:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bdef5bb80 1 Processor -- start 2023-12-14T14:18:09.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f481432570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f48142f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 0x55f48142fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f481315f90 con 0x55f481427380 2023-12-14T14:18:09.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f481315c30 con 0x55f481427c90 2023-12-14T14:18:09.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4811fd6a0 con 0x55f481432b50 2023-12-14T14:18:09.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bdef5bb80 10 client.0 _ll_register_callbacks cb 0x55f481339910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:09.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bd0b69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f481432570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bd0b69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f481432570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36946/0 (socket says 172.21.15.69:36946) 2023-12-14T14:18:09.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bd0b69700 1 -- 172.21.15.69:0/2008745610 learned_addr learned my addr 172.21.15.69:0/2008745610 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f48142f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.374+0000 7f1bd136a700 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 0x55f48142fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bd0b69700 1 -- 172.21.15.69:0/2008745610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 msgr2=0x55f48142fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 0x55f48142fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bd0b69700 1 -- 172.21.15.69:0/2008745610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 msgr2=0x55f48142f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f48142f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bd0b69700 1 -- 172.21.15.69:0/2008745610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc10f080 con 0x55f481427380 2023-12-14T14:18:09.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f481432570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0015000 tx=0x7f1bc0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b33394ef33e805 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1babfff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:09.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1babfff700 1 -- 172.21.15.69:0/2008745610 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc002c040 con 0x55f481427380 2023-12-14T14:18:09.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1babfff700 1 -- 172.21.15.69:0/2008745610 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1bc0023660 con 0x55f481427380 2023-12-14T14:18:09.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2008745610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f48141b2b0 con 0x55f481427380 2023-12-14T14:18:09.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1babfff700 1 -- 172.21.15.69:0/2008745610 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bc0023820 con 0x55f481427380 2023-12-14T14:18:09.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bdef5bb80 10 client.16419 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:09.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2008745610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f481340170 con 0x55f481427380 2023-12-14T14:18:09.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1babfff700 1 -- 172.21.15.69:0/2008745610 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bc003d020 con 0x55f481427380 2023-12-14T14:18:09.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1babfff700 1 -- 172.21.15.69:0/2008745610 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1bc000f940 con 0x55f481427380 2023-12-14T14:18:09.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bdef5bb80 10 client.16419 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:09.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bdef5bb80 10 client.16419 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:18:09.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bdef5bb80 20 client.16419 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:09.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.375+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55f4814425c0 0x55f4814449d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.376+0000 7f1bdef5bb80 4 client.16419 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:09.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.376+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2008745610 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f481372ce0 con 0x55f4814425c0 2023-12-14T14:18:09.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.376+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55f4814425c0 0x55f4814449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.376+0000 7f1babfff700 10 client.16419 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:18:09.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.376+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55f4814425c0 0x55f4814449d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4543f537cc219630 server_cookie=4b71e63197b932cb in_seq=0 out_seq=0 2023-12-14T14:18:09.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1babfff700 1 -- 172.21.15.69:0/2008745610 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f481372ce0 con 0x55f4814425c0 2023-12-14T14:18:09.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1babfff700 10 client.16419 handle_command_reply: tid=0 2023-12-14T14:18:09.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 client.16419 shutdown 2023-12-14T14:18:09.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2008745610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 msgr2=0x55f481432570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f481432570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0015000 tx=0x7f1bc0020000 comp rx=0 tx=0).stop 2023-12-14T14:18:09.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2008745610 shutdown_connections 2023-12-14T14:18:09.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 0x55f48142fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55f4814425c0 0x55f4814449d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f481432570 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1babfff700 0 client.16419 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:18:09.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2008745610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f48142f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2008745610 >> 172.21.15.69:0/2008745610 conn(0x55f48141dca0 msgr2=0x55f4814233d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2008745610 shutdown_connections 2023-12-14T14:18:09.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2008745610 wait complete. 2023-12-14T14:18:09.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.377+0000 7f1bdef5bb80 20 client.16419 trim_cache size 0 max 16384 2023-12-14T14:18:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bdef5bb80 1 Processor -- start 2023-12-14T14:18:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bdef5bb80 1 -- start start 2023-12-14T14:18:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 0x55f481432030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427c90 0x55f481432570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481432b50 0x55f48142ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f481430450 con 0x55f481427c90 2023-12-14T14:18:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f48142a690 con 0x55f481432b50 2023-12-14T14:18:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f48143e540 con 0x55f481427380 2023-12-14T14:18:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bcbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427c90 0x55f481432570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bcbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427c90 0x55f481432570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36960/0 (socket says 172.21.15.69:36960) 2023-12-14T14:18:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bcbfff700 1 -- 172.21.15.69:0/2782828155 learned_addr learned my addr 172.21.15.69:0/2782828155 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/2782828155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 0x55f481432030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.390+0000 7f1bd136a700 1 --2- 172.21.15.69:0/2782828155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481432b50 0x55f48142ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bcbfff700 1 -- 172.21.15.69:0/2782828155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 msgr2=0x55f481432030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/2782828155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 0x55f481432030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bcbfff700 1 -- 172.21.15.69:0/2782828155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481432b50 msgr2=0x55f48142ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/2782828155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481432b50 0x55f48142ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bcbfff700 1 -- 172.21.15.69:0/2782828155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f48133fec0 con 0x55f481427c90 2023-12-14T14:18:09.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/2782828155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427c90 0x55f481432570 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8004790 tx=0x7f1bb80043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39816e4b5adb429c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bb77fe700 1 -- 172.21.15.69:0/2782828155 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8017040 con 0x55f481427c90 2023-12-14T14:18:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bb77fe700 1 -- 172.21.15.69:0/2782828155 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bb801c5a0 con 0x55f481427c90 2023-12-14T14:18:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bb77fe700 1 -- 172.21.15.69:0/2782828155 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80116a0 con 0x55f481427c90 2023-12-14T14:18:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2782828155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427c90 msgr2=0x55f481432570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2782828155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427c90 0x55f481432570 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8004790 tx=0x7f1bb80043d0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2782828155 shutdown_connections 2023-12-14T14:18:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2782828155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481432b50 0x55f48142ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2782828155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481427380 0x55f481432030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/2782828155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427c90 0x55f481432570 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2782828155 >> 172.21.15.69:0/2782828155 conn(0x55f48141dca0 msgr2=0x55f48143de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.391+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2782828155 shutdown_connections 2023-12-14T14:18:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.392+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/2782828155 wait complete. 2023-12-14T14:18:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.392+0000 7f1bdef5bb80 1 -- start start 2023-12-14T14:18:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.392+0000 7f1bdef5bb80 1 Processor -- start 2023-12-14T14:18:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.392+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f48148f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.392+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f48148fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.392+0000 7f1bdef5bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 0x55f481437670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.392+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f481437c40 con 0x55f481427380 2023-12-14T14:18:09.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.392+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f481437db0 con 0x55f481427c90 2023-12-14T14:18:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.392+0000 7f1bdef5bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f481437f70 con 0x55f481432b50 2023-12-14T14:18:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bdef5bb80 10 client.0 _ll_register_callbacks cb 0x7f1bc0003ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd0b69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f48148f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd0b69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f48148f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36976/0 (socket says 172.21.15.69:36976) 2023-12-14T14:18:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd0b69700 1 -- 172.21.15.69:0/9623902 learned_addr learned my addr 172.21.15.69:0/9623902 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f48148fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd136a700 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 0x55f481437670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd0b69700 1 -- 172.21.15.69:0/9623902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 msgr2=0x55f481437670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 0x55f481437670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd0b69700 1 -- 172.21.15.69:0/9623902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 msgr2=0x55f48148fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f48148fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd0b69700 1 -- 172.21.15.69:0/9623902 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb800baf0 con 0x55f481427380 2023-12-14T14:18:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bd0b69700 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f48148f760 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b890 tx=0x7f1bc000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4ec99ddff3768b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1babfff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1babfff700 1 -- 172.21.15.69:0/9623902 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc002c040 con 0x55f481427380 2023-12-14T14:18:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1babfff700 1 -- 172.21.15.69:0/9623902 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1bc003e080 con 0x55f481427380 2023-12-14T14:18:09.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/9623902 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1bc4096f60 con 0x55f481427380 2023-12-14T14:18:09.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1babfff700 1 -- 172.21.15.69:0/9623902 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bc000f870 con 0x55f481427380 2023-12-14T14:18:09.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bdef5bb80 10 client.16425 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:09.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/9623902 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f4813269a0 con 0x55f481427380 2023-12-14T14:18:09.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.393+0000 7f1babfff700 1 -- 172.21.15.69:0/9623902 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bc4096f60 con 0x55f481427380 2023-12-14T14:18:09.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1babfff700 1 -- 172.21.15.69:0/9623902 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1bc00234f0 con 0x55f481427380 2023-12-14T14:18:09.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1bdef5bb80 10 client.16425 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:09.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1bdef5bb80 10 client.16425 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:18:09.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1bdef5bb80 20 client.16425 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:09.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55f4814970b0 0x55f4814994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1bdef5bb80 4 client.16425 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:18:09.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/9623902 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f481372a00 con 0x55f4814970b0 2023-12-14T14:18:09.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55f4814970b0 0x55f4814994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1babfff700 10 client.16425 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:18:09.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1bcbfff700 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55f4814970b0 0x55f4814994c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1fc47c8e3a894eee server_cookie=1208eb05c6d855e3 in_seq=0 out_seq=0 2023-12-14T14:18:09.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1babfff700 1 -- 172.21.15.69:0/9623902 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f481372a00 con 0x55f4814970b0 2023-12-14T14:18:09.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1babfff700 10 client.16425 handle_command_reply: tid=0 2023-12-14T14:18:09.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.394+0000 7f1bdef5bb80 1 client.16425 shutdown 2023-12-14T14:18:09.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/9623902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 msgr2=0x55f48148f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f48148f760 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b890 tx=0x7f1bc000b6e0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/9623902 shutdown_connections 2023-12-14T14:18:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f481432b50 0x55f481437670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55f4814970b0 0x55f4814994c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f481427380 0x55f48148f760 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 --2- 172.21.15.69:0/9623902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f481427c90 0x55f48148fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1babfff700 0 client.16425 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:18:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/9623902 >> 172.21.15.69:0/9623902 conn(0x55f48141dca0 msgr2=0x55f48142ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/9623902 shutdown_connections 2023-12-14T14:18:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 1 -- 172.21.15.69:0/9623902 wait complete. 2023-12-14T14:18:09.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bdef5bb80 20 client.16425 trim_cache size 0 max 16384 2023-12-14T14:18:09.405 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:18:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1bbc0a1340 msgr2=0x7f1bbc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1bbc0a1340 0x7f1bbc0a37f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b5c0 tx=0x7f1bc0005fb0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc109b30 msgr2=0x7f1bcc1a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc109b30 0x7f1bcc1a4620 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400ada0 tx=0x7f1bc400c330 comp rx=0 tx=0).stop 2023-12-14T14:18:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/2239755362 shutdown_connections 2023-12-14T14:18:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1bbc0a1340 0x7f1bbc0a37f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bcc109b30 0x7f1bcc1a4620 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc100580 0x7f1bcc109fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 --2- 172.21.15.69:0/2239755362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc100e90 0x7f1bcc10a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/2239755362 >> 172.21.15.69:0/2239755362 conn(0x7f1bcc074a60 msgr2=0x7f1bcc0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/2239755362 shutdown_connections 2023-12-14T14:18:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.395+0000 7f1bd2dcd700 1 -- 172.21.15.69:0/2239755362 wait complete. 2023-12-14T14:18:09.408 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:18:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.533+0000 7f0eddc2e700 1 -- 172.21.15.69:0/4261855005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed81054f0 msgr2=0x7f0ed810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.533+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/4261855005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed81054f0 0x7f0ed810d0c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000b0d0 tx=0x7f0ed000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.533+0000 7f0eddc2e700 1 -- 172.21.15.69:0/4261855005 shutdown_connections 2023-12-14T14:18:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.533+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/4261855005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed81054f0 0x7f0ed810d0c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.533+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/4261855005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed8069310 0x7f0ed80696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.533+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/4261855005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed8069cb0 0x7f0ed8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.533+0000 7f0eddc2e700 1 -- 172.21.15.69:0/4261855005 >> 172.21.15.69:0/4261855005 conn(0x7f0ed8075f70 msgr2=0x7f0ed8076370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.533+0000 7f0eddc2e700 1 -- 172.21.15.69:0/4261855005 shutdown_connections 2023-12-14T14:18:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.533+0000 7f0eddc2e700 1 -- 172.21.15.69:0/4261855005 wait complete. 2023-12-14T14:18:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0eddc2e700 1 Processor -- start 2023-12-14T14:18:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0eddc2e700 1 -- start start 2023-12-14T14:18:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0eddc2e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed8069310 0x7f0ed8196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0eddc2e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed8069cb0 0x7f0ed8196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0eddc2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed81054f0 0x7f0ed819aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0eddc2e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed819b510 con 0x7f0ed8069cb0 2023-12-14T14:18:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0eddc2e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed819b680 con 0x7f0ed81054f0 2023-12-14T14:18:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0eddc2e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed819b840 con 0x7f0ed8069310 2023-12-14T14:18:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0ed6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed8069cb0 0x7f0ed8196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0ed6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed8069cb0 0x7f0ed8196a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36996/0 (socket says 172.21.15.69:36996) 2023-12-14T14:18:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/240206346 learned_addr learned my addr 172.21.15.69:0/240206346 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed8069310 0x7f0ed8196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.534+0000 7f0ed7fff700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed81054f0 0x7f0ed819aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/240206346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed8069310 msgr2=0x7f0ed8196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed8069310 0x7f0ed8196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/240206346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed81054f0 msgr2=0x7f0ed819aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed81054f0 0x7f0ed819aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/240206346 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec8009520 con 0x7f0ed8069cb0 2023-12-14T14:18:09.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed8069cb0 0x7f0ed8196a70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00d950 tx=0x7f0ecc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0ed4ff9700 1 -- 172.21.15.69:0/240206346 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc009930 con 0x7f0ed8069cb0 2023-12-14T14:18:09.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0ed4ff9700 1 -- 172.21.15.69:0/240206346 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ecc010460 con 0x7f0ed8069cb0 2023-12-14T14:18:09.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0eddc2e700 1 -- 172.21.15.69:0/240206346 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed0009d00 con 0x7f0ed8069cb0 2023-12-14T14:18:09.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0ed4ff9700 1 -- 172.21.15.69:0/240206346 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00f620 con 0x7f0ed8069cb0 2023-12-14T14:18:09.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.535+0000 7f0eddc2e700 1 -- 172.21.15.69:0/240206346 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed8110310 con 0x7f0ed8069cb0 2023-12-14T14:18:09.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.537+0000 7f0ed4ff9700 1 -- 172.21.15.69:0/240206346 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0ecc010860 con 0x7f0ed8069cb0 2023-12-14T14:18:09.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.537+0000 7f0ed4ff9700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0ec00a12c0 0x7f0ec00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.538+0000 7f0ed4ff9700 1 -- 172.21.15.69:0/240206346 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f0ecc0cc850 con 0x7f0ed8069cb0 2023-12-14T14:18:09.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.538+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0ec00a12c0 0x7f0ec00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.538+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0ec00a12c0 0x7f0ec00a3770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009df0 tx=0x7f0ec8009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.538+0000 7f0ee9dbcb80 1 Processor -- start 2023-12-14T14:18:09.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ee9dbcb80 1 -- start start 2023-12-14T14:18:09.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fc1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fc1c90 0x55e573fcc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fccb50 0x55e573fcef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e573eab5e0 con 0x55e573fccb50 2023-12-14T14:18:09.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e573f1a870 con 0x55e573fc1c90 2023-12-14T14:18:09.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e573f13d00 con 0x55e573fc1380 2023-12-14T14:18:09.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fccb50 0x55e573fcef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fccb50 0x55e573fcef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37006/0 (socket says 172.21.15.69:37006) 2023-12-14T14:18:09.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed7fff700 1 -- 172.21.15.69:0/1760025617 learned_addr learned my addr 172.21.15.69:0/1760025617 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/1760025617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fc1c90 0x55e573fcc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/1760025617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fc1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed7fff700 1 -- 172.21.15.69:0/1760025617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 msgr2=0x55e573fc1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed7fff700 1 --2- 172.21.15.69:0/1760025617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fc1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed7fff700 1 -- 172.21.15.69:0/1760025617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fc1c90 msgr2=0x55e573fcc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed7fff700 1 --2- 172.21.15.69:0/1760025617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fc1c90 0x55e573fcc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed7fff700 1 -- 172.21.15.69:0/1760025617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e573d953b0 con 0x55e573fccb50 2023-12-14T14:18:09.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.539+0000 7f0ed7fff700 1 --2- 172.21.15.69:0/1760025617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fccb50 0x55e573fcef30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009c50 tx=0x7f0ed0009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c164a9026d4e95 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ebdffb700 1 -- 172.21.15.69:0/1760025617 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed000e040 con 0x55e573fccb50 2023-12-14T14:18:09.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ebdffb700 1 -- 172.21.15.69:0/1760025617 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ed0009490 con 0x55e573fccb50 2023-12-14T14:18:09.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ebdffb700 1 -- 172.21.15.69:0/1760025617 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed001c640 con 0x55e573fccb50 2023-12-14T14:18:09.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1760025617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fccb50 msgr2=0x55e573fcef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1760025617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fccb50 0x55e573fcef30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009c50 tx=0x7f0ed0009c80 comp rx=0 tx=0).stop 2023-12-14T14:18:09.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1760025617 shutdown_connections 2023-12-14T14:18:09.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1760025617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fccb50 0x55e573fcef30 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1760025617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fc1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1760025617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fc1c90 0x55e573fcc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1760025617 >> 172.21.15.69:0/1760025617 conn(0x55e573fb7ca0 msgr2=0x55e573fbd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1760025617 shutdown_connections 2023-12-14T14:18:09.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.540+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1760025617 wait complete. 2023-12-14T14:18:09.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ee9dbcb80 1 -- start start 2023-12-14T14:18:09.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ee9dbcb80 1 Processor -- start 2023-12-14T14:18:09.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fc9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fc9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e573eaff90 con 0x55e573fc1c90 2023-12-14T14:18:09.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e573eafc30 con 0x55e573fccb50 2023-12-14T14:18:09.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e573d976a0 con 0x55e573fc1380 2023-12-14T14:18:09.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ee9dbcb80 10 client.0 _ll_register_callbacks cb 0x55e573ed3910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:09.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ed6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fc9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ed6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fc9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37010/0 (socket says 172.21.15.69:37010) 2023-12-14T14:18:09.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/1822663711 learned_addr learned my addr 172.21.15.69:0/1822663711 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.541+0000 7f0ed7fff700 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fc9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/1822663711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 msgr2=0x55e573fcc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/1822663711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 msgr2=0x55e573fc9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fc9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/1822663711 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed810d900 con 0x55e573fc1c90 2023-12-14T14:18:09.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fc9710 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009520 tx=0x7f0ecc0992b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd6df266a4ff31c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0eb6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:09.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/1822663711 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc099d30 con 0x55e573fc1c90 2023-12-14T14:18:09.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/1822663711 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f0ecc0a1d20 con 0x55e573fc1c90 2023-12-14T14:18:09.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1822663711 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e573fb52b0 con 0x55e573fc1c90 2023-12-14T14:18:09.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/1822663711 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ecc098dc0 con 0x55e573fc1c90 2023-12-14T14:18:09.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ee9dbcb80 10 client.16437 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:09.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1822663711 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55e573eda170 con 0x55e573fc1c90 2023-12-14T14:18:09.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/1822663711 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e573fb52b0 con 0x55e573fc1c90 2023-12-14T14:18:09.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/1822663711 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0ecc0b3030 con 0x55e573fc1c90 2023-12-14T14:18:09.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ee9dbcb80 10 client.16437 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:09.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ee9dbcb80 10 client.16437 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:18:09.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ee9dbcb80 20 client.16437 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:09.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55e573fdc320 0x55e573fde730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ee9dbcb80 4 client.16437 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:09.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.542+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1822663711 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e573f0cce0 con 0x55e573fdc320 2023-12-14T14:18:09.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.543+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55e573fdc320 0x55e573fde730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.543+0000 7f0eb6ffd700 10 client.16437 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:18:09.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.543+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55e573fdc320 0x55e573fde730 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf85f8160ab05db7 server_cookie=a57d56a2f9932b0f in_seq=0 out_seq=0 2023-12-14T14:18:09.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/1822663711 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e573f0cce0 con 0x55e573fdc320 2023-12-14T14:18:09.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0eb6ffd700 10 client.16437 handle_command_reply: tid=0 2023-12-14T14:18:09.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 client.16437 shutdown 2023-12-14T14:18:09.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1822663711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 msgr2=0x55e573fc9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fc9710 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009520 tx=0x7f0ecc0992b0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1822663711 shutdown_connections 2023-12-14T14:18:09.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fc9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55e573fdc320 0x55e573fde730 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/1822663711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fc9710 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0eb6ffd700 0 client.16437 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:18:09.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1822663711 >> 172.21.15.69:0/1822663711 conn(0x55e573fb7ca0 msgr2=0x55e573fbd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1822663711 shutdown_connections 2023-12-14T14:18:09.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/1822663711 wait complete. 2023-12-14T14:18:09.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.544+0000 7f0ee9dbcb80 20 client.16437 trim_cache size 0 max 16384 2023-12-14T14:18:09.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ee9dbcb80 1 Processor -- start 2023-12-14T14:18:09.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ee9dbcb80 1 -- start start 2023-12-14T14:18:09.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fcc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e573fc2f30 con 0x55e573fc1c90 2023-12-14T14:18:09.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e573fc5560 con 0x55e573fccb50 2023-12-14T14:18:09.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e573fc44b0 con 0x55e573fc1380 2023-12-14T14:18:09.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37020/0 (socket says 172.21.15.69:37020) 2023-12-14T14:18:09.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/3919851984 learned_addr learned my addr 172.21.15.69:0/3919851984 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed7fff700 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fcc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/3919851984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 msgr2=0x55e573fcef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/3919851984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 msgr2=0x55e573fcc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fcc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/3919851984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e573fc9280 con 0x55e573fc1c90 2023-12-14T14:18:09.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:09.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.557+0000 7f0ed7fff700 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fcc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:09.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcbf20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc096340 tx=0x7f0ecc097e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8640e7e605aac94 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ebe7fc700 1 -- 172.21.15.69:0/3919851984 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc09d170 con 0x55e573fc1c90 2023-12-14T14:18:09.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ebe7fc700 1 -- 172.21.15.69:0/3919851984 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ecc0a1d20 con 0x55e573fc1c90 2023-12-14T14:18:09.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ebe7fc700 1 -- 172.21.15.69:0/3919851984 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc099b30 con 0x55e573fc1c90 2023-12-14T14:18:09.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3919851984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 msgr2=0x55e573fcbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcbf20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc096340 tx=0x7f0ecc097e80 comp rx=0 tx=0).stop 2023-12-14T14:18:09.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3919851984 shutdown_connections 2023-12-14T14:18:09.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fcc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3919851984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcbf20 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3919851984 >> 172.21.15.69:0/3919851984 conn(0x55e573fb7ca0 msgr2=0x55e573fd8740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3919851984 shutdown_connections 2023-12-14T14:18:09.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.558+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3919851984 wait complete. 2023-12-14T14:18:09.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ee9dbcb80 1 -- start start 2023-12-14T14:18:09.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ee9dbcb80 1 Processor -- start 2023-12-14T14:18:09.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ee9dbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fd0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57402f380 con 0x55e573fc1c90 2023-12-14T14:18:09.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57402f4f0 con 0x55e573fccb50 2023-12-14T14:18:09.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ee9dbcb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57402f6b0 con 0x55e573fc1380 2023-12-14T14:18:09.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ee9dbcb80 10 client.0 _ll_register_callbacks cb 0x7f0ecc099410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:09.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ed6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ed6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37030/0 (socket says 172.21.15.69:37030) 2023-12-14T14:18:09.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.559+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/3693351766 learned_addr learned my addr 172.21.15.69:0/3693351766 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ed7fff700 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fd0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/3693351766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 msgr2=0x55e573fcf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/3693351766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 msgr2=0x55e573fd0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fd0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ed6ffd700 1 -- 172.21.15.69:0/3693351766 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e573eda170 con 0x55e573fc1c90 2023-12-14T14:18:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ed6ffd700 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcfb40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc012040 tx=0x7f0ecc0ca030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc82142e0df02dd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0eb6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:09.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/3693351766 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc099d30 con 0x55e573fc1c90 2023-12-14T14:18:09.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/3693351766 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f0ecc0956c0 con 0x55e573fc1c90 2023-12-14T14:18:09.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3693351766 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ed0009490 con 0x55e573fc1c90 2023-12-14T14:18:09.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/3693351766 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ecc095880 con 0x55e573fc1c90 2023-12-14T14:18:09.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ee9dbcb80 10 client.16443 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:09.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3693351766 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55e573d41b60 con 0x55e573fc1c90 2023-12-14T14:18:09.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/3693351766 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ed0009490 con 0x55e573fc1c90 2023-12-14T14:18:09.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/3693351766 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0ecc0b3050 con 0x55e573fc1c90 2023-12-14T14:18:09.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ee9dbcb80 10 client.16443 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:09.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ee9dbcb80 10 client.16443 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:18:09.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ee9dbcb80 20 client.16443 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:09.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55e574030880 0x55e574032c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ee9dbcb80 4 client.16443 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:18:09.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.560+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3693351766 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e573f0ca00 con 0x55e574030880 2023-12-14T14:18:09.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55e574030880 0x55e574032c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ed77fe700 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55e574030880 0x55e574032c90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ebad7656e3b67e08 server_cookie=8be32133a9a74e6b in_seq=0 out_seq=0 2023-12-14T14:18:09.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0eb6ffd700 10 client.16443 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:18:09.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0eb6ffd700 1 -- 172.21.15.69:0/3693351766 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e573f0ca00 con 0x55e574030880 2023-12-14T14:18:09.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0eb6ffd700 10 client.16443 handle_command_reply: tid=0 2023-12-14T14:18:09.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 client.16443 shutdown 2023-12-14T14:18:09.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3693351766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 msgr2=0x55e573fcfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcfb40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc012040 tx=0x7f0ecc0ca030 comp rx=0 tx=0).stop 2023-12-14T14:18:09.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3693351766 shutdown_connections 2023-12-14T14:18:09.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e573fccb50 0x55e573fd0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e573fc1380 0x55e573fcf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55e574030880 0x55e574032c90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 --2- 172.21.15.69:0/3693351766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e573fc1c90 0x55e573fcfb40 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3693351766 >> 172.21.15.69:0/3693351766 conn(0x55e573fb7ca0 msgr2=0x55e573fc9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0eb6ffd700 0 client.16443 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:18:09.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.561+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3693351766 shutdown_connections 2023-12-14T14:18:09.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0ee9dbcb80 1 -- 172.21.15.69:0/3693351766 wait complete. 2023-12-14T14:18:09.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0ee9dbcb80 20 client.16443 trim_cache size 0 max 16384 2023-12-14T14:18:09.576 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:18:09.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 -- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0ec00a12c0 msgr2=0x7f0ec00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0ec00a12c0 0x7f0ec00a3770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009df0 tx=0x7f0ec8009260 comp rx=0 tx=0).stop 2023-12-14T14:18:09.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 -- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed8069cb0 msgr2=0x7f0ed8196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed8069cb0 0x7f0ed8196a70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00d950 tx=0x7f0ecc00dc60 comp rx=0 tx=0).stop 2023-12-14T14:18:09.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 -- 172.21.15.69:0/240206346 shutdown_connections 2023-12-14T14:18:09.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0ec00a12c0 0x7f0ec00a3770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed81054f0 0x7f0ed819aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed8069310 0x7f0ed8196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 --2- 172.21.15.69:0/240206346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed8069cb0 0x7f0ed8196a70 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 -- 172.21.15.69:0/240206346 >> 172.21.15.69:0/240206346 conn(0x7f0ed8075f70 msgr2=0x7f0ed80fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 -- 172.21.15.69:0/240206346 shutdown_connections 2023-12-14T14:18:09.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.562+0000 7f0eddc2e700 1 -- 172.21.15.69:0/240206346 wait complete. 2023-12-14T14:18:09.579 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:18:09.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.704+0000 7fe4433b4700 1 -- 172.21.15.69:0/2414269263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 msgr2=0x7fe43c10bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.704+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2414269263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 0x7fe43c10bf10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00b0a0 tx=0x7fe42c00b3b0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.704+0000 7fe4433b4700 1 -- 172.21.15.69:0/2414269263 shutdown_connections 2023-12-14T14:18:09.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.704+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2414269263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 0x7fe43c10bf10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.704+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2414269263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe43c100580 0x7fe43c100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.704+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2414269263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe43c100e90 0x7fe43c1095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.704+0000 7fe4433b4700 1 -- 172.21.15.69:0/2414269263 >> 172.21.15.69:0/2414269263 conn(0x7fe43c074a60 msgr2=0x7fe43c074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.704+0000 7fe4433b4700 1 -- 172.21.15.69:0/2414269263 shutdown_connections 2023-12-14T14:18:09.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.704+0000 7fe4433b4700 1 -- 172.21.15.69:0/2414269263 wait complete. 2023-12-14T14:18:09.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe4433b4700 1 Processor -- start 2023-12-14T14:18:09.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe4433b4700 1 -- start start 2023-12-14T14:18:09.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe4433b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe43c100580 0x7fe43c195000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe4433b4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe43c100e90 0x7fe43c195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe4433b4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 0x7fe43c195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe4433b4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c1a4840 con 0x7fe43c109b30 2023-12-14T14:18:09.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe4433b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c1a49b0 con 0x7fe43c100580 2023-12-14T14:18:09.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe4433b4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c1a4b70 con 0x7fe43c100e90 2023-12-14T14:18:09.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe441951700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 0x7fe43c195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe441951700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 0x7fe43c195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37048/0 (socket says 172.21.15.69:37048) 2023-12-14T14:18:09.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe441951700 1 -- 172.21.15.69:0/2196922741 learned_addr learned my addr 172.21.15.69:0/2196922741 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe44094f700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe43c100e90 0x7fe43c195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe441150700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe43c100580 0x7fe43c195000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.705+0000 7fe441951700 1 -- 172.21.15.69:0/2196922741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe43c100e90 msgr2=0x7fe43c195540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe441951700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe43c100e90 0x7fe43c195540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe441951700 1 -- 172.21.15.69:0/2196922741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe43c100580 msgr2=0x7fe43c195000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe441951700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe43c100580 0x7fe43c195000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe441951700 1 -- 172.21.15.69:0/2196922741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c009d00 con 0x7fe43c109b30 2023-12-14T14:18:09.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe441150700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe43c100580 0x7fe43c195000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:09.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe441951700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 0x7fe43c195a80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00b780 tx=0x7fe42c007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe43a7fc700 1 -- 172.21.15.69:0/2196922741 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c00e040 con 0x7fe43c109b30 2023-12-14T14:18:09.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe4433b4700 1 -- 172.21.15.69:0/2196922741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c10f140 con 0x7fe43c109b30 2023-12-14T14:18:09.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe43a7fc700 1 -- 172.21.15.69:0/2196922741 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe42c00be40 con 0x7fe43c109b30 2023-12-14T14:18:09.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe43a7fc700 1 -- 172.21.15.69:0/2196922741 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c01b6c0 con 0x7fe43c109b30 2023-12-14T14:18:09.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.706+0000 7fe4433b4700 1 -- 172.21.15.69:0/2196922741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c10efb0 con 0x7fe43c109b30 2023-12-14T14:18:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.708+0000 7fe43a7fc700 1 -- 172.21.15.69:0/2196922741 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe42c01d470 con 0x7fe43c109b30 2023-12-14T14:18:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.709+0000 7fe43a7fc700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe4240a12c0 0x7fe4240a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.709+0000 7fe441150700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe4240a12c0 0x7fe4240a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.709+0000 7fe43a7fc700 1 -- 172.21.15.69:0/2196922741 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fe42c0cdd70 con 0x7fe43c109b30 2023-12-14T14:18:09.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.709+0000 7fe441150700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe4240a12c0 0x7fe4240a3770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe434009cb0 tx=0x7fe434009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.709+0000 7fe44f542b80 1 Processor -- start 2023-12-14T14:18:09.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe44f542b80 1 -- start start 2023-12-14T14:18:09.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 0x56080c43a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 0x56080c445610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe44f542b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c3245e0 con 0x56080c445b50 2023-12-14T14:18:09.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe44f542b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c393870 con 0x56080c43ac90 2023-12-14T14:18:09.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe44f542b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c38cd00 con 0x56080c43a380 2023-12-14T14:18:09.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441951700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441951700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37052/0 (socket says 172.21.15.69:37052) 2023-12-14T14:18:09.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441951700 1 -- 172.21.15.69:0/1074692935 learned_addr learned my addr 172.21.15.69:0/1074692935 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe44094f700 1 --2- 172.21.15.69:0/1074692935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 0x56080c445610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441150700 1 --2- 172.21.15.69:0/1074692935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 0x56080c43a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441951700 1 -- 172.21.15.69:0/1074692935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 msgr2=0x56080c43a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441951700 1 --2- 172.21.15.69:0/1074692935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 0x56080c43a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441951700 1 -- 172.21.15.69:0/1074692935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 msgr2=0x56080c445610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441951700 1 --2- 172.21.15.69:0/1074692935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 0x56080c445610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441951700 1 -- 172.21.15.69:0/1074692935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080c20e3b0 con 0x56080c445b50 2023-12-14T14:18:09.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe441951700 1 --2- 172.21.15.69:0/1074692935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447f30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0a2d10 tx=0x7fe42c09aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4034eb0b2393daa3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.710+0000 7fe4237fe700 1 -- 172.21.15.69:0/1074692935 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c09eeb0 con 0x56080c445b50 2023-12-14T14:18:09.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe4237fe700 1 -- 172.21.15.69:0/1074692935 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe42c0a3240 con 0x56080c445b50 2023-12-14T14:18:09.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe4237fe700 1 -- 172.21.15.69:0/1074692935 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c09b0e0 con 0x56080c445b50 2023-12-14T14:18:09.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe44f542b80 1 -- 172.21.15.69:0/1074692935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 msgr2=0x56080c447f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe44f542b80 1 --2- 172.21.15.69:0/1074692935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447f30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0a2d10 tx=0x7fe42c09aa40 comp rx=0 tx=0).stop 2023-12-14T14:18:09.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe44f542b80 1 -- 172.21.15.69:0/1074692935 shutdown_connections 2023-12-14T14:18:09.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe44f542b80 1 --2- 172.21.15.69:0/1074692935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447f30 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe44f542b80 1 --2- 172.21.15.69:0/1074692935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 0x56080c43a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe44f542b80 1 --2- 172.21.15.69:0/1074692935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 0x56080c445610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe44f542b80 1 -- 172.21.15.69:0/1074692935 >> 172.21.15.69:0/1074692935 conn(0x56080c430ca0 msgr2=0x56080c4367e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe44f542b80 1 -- 172.21.15.69:0/1074692935 shutdown_connections 2023-12-14T14:18:09.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.711+0000 7fe44f542b80 1 -- 172.21.15.69:0/1074692935 wait complete. 2023-12-14T14:18:09.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe44f542b80 1 -- start start 2023-12-14T14:18:09.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe44f542b80 1 Processor -- start 2023-12-14T14:18:09.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c43a380 0x56080c445f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 0x56080c446460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c445b50 0x56080c4469a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe44f542b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c328f90 con 0x56080c43a380 2023-12-14T14:18:09.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe44f542b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c328c30 con 0x56080c445b50 2023-12-14T14:18:09.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe44f542b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c2106a0 con 0x56080c43ac90 2023-12-14T14:18:09.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe44f542b80 10 client.0 _ll_register_callbacks cb 0x56080c34c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:09.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441150700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c43a380 0x56080c445f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441150700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c43a380 0x56080c445f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37062/0 (socket says 172.21.15.69:37062) 2023-12-14T14:18:09.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441150700 1 -- 172.21.15.69:0/3984328817 learned_addr learned my addr 172.21.15.69:0/3984328817 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441951700 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c445b50 0x56080c4469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441150700 1 -- 172.21.15.69:0/3984328817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 msgr2=0x56080c446460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441150700 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 0x56080c446460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441150700 1 -- 172.21.15.69:0/3984328817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c445b50 msgr2=0x56080c4469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441150700 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c445b50 0x56080c4469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441150700 1 -- 172.21.15.69:0/3984328817 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c10efb0 con 0x56080c43a380 2023-12-14T14:18:09.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.712+0000 7fe441951700 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c445b50 0x56080c4469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:09.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe441150700 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c43a380 0x56080c445f20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe434009690 tx=0x7fe4340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942af71350dcc9aa server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe420ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:09.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe420ff9700 1 -- 172.21.15.69:0/3984328817 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434012450 con 0x56080c43a380 2023-12-14T14:18:09.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe420ff9700 1 -- 172.21.15.69:0/3984328817 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fe434018070 con 0x56080c43a380 2023-12-14T14:18:09.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe44f542b80 1 -- 172.21.15.69:0/3984328817 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56080c42e2b0 con 0x56080c43a380 2023-12-14T14:18:09.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe420ff9700 1 -- 172.21.15.69:0/3984328817 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4340125b0 con 0x56080c43a380 2023-12-14T14:18:09.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe44f542b80 10 client.16455 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:09.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe44f542b80 1 -- 172.21.15.69:0/3984328817 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56080c353170 con 0x56080c43a380 2023-12-14T14:18:09.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe420ff9700 1 -- 172.21.15.69:0/3984328817 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56080c42e2b0 con 0x56080c43a380 2023-12-14T14:18:09.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe420ff9700 1 -- 172.21.15.69:0/3984328817 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe4340217c0 con 0x56080c43a380 2023-12-14T14:18:09.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe44f542b80 10 client.16455 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:09.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe44f542b80 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:09.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe44f542b80 20 client.16455 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:09.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080c4551c0 0x56080c4575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe44f542b80 4 client.16455 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:09.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.713+0000 7fe44f542b80 1 -- 172.21.15.69:0/3984328817 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56080c385ce0 con 0x56080c4551c0 2023-12-14T14:18:09.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.714+0000 7fe44094f700 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080c4551c0 0x56080c4575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.714+0000 7fe420ff9700 10 client.16455 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:09.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.714+0000 7fe44094f700 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080c4551c0 0x56080c4575d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20392ffa1415709e server_cookie=155d5cf8739060e6 in_seq=0 out_seq=0 2023-12-14T14:18:09.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe420ff9700 1 -- 172.21.15.69:0/3984328817 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56080c385ce0 con 0x56080c4551c0 2023-12-14T14:18:09.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe420ff9700 10 client.16455 handle_command_reply: tid=0 2023-12-14T14:18:09.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 client.16455 shutdown 2023-12-14T14:18:09.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 -- 172.21.15.69:0/3984328817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c43a380 msgr2=0x56080c445f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c43a380 0x56080c445f20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe434009690 tx=0x7fe4340047c0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 -- 172.21.15.69:0/3984328817 shutdown_connections 2023-12-14T14:18:09.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080c4551c0 0x56080c4575d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c445b50 0x56080c4469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c43a380 0x56080c445f20 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe420ff9700 0 client.16455 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:09.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3984328817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 0x56080c446460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 -- 172.21.15.69:0/3984328817 >> 172.21.15.69:0/3984328817 conn(0x56080c430ca0 msgr2=0x56080c4363d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 -- 172.21.15.69:0/3984328817 shutdown_connections 2023-12-14T14:18:09.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 1 -- 172.21.15.69:0/3984328817 wait complete. 2023-12-14T14:18:09.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.715+0000 7fe44f542b80 20 client.16455 trim_cache size 0 max 16384 2023-12-14T14:18:09.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44f542b80 1 Processor -- start 2023-12-14T14:18:09.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44f542b80 1 -- start start 2023-12-14T14:18:09.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43a380 0x56080c451460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 0x56080c434f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c4506e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44f542b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c4407f0 con 0x56080c445b50 2023-12-14T14:18:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44f542b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c445000 con 0x56080c43a380 2023-12-14T14:18:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44f542b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c443110 con 0x56080c43ac90 2023-12-14T14:18:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441951700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c4506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441951700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c4506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37078/0 (socket says 172.21.15.69:37078) 2023-12-14T14:18:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441951700 1 -- 172.21.15.69:0/3029144725 learned_addr learned my addr 172.21.15.69:0/3029144725 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441150700 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43a380 0x56080c451460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44094f700 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 0x56080c434f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441951700 1 -- 172.21.15.69:0/3029144725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 msgr2=0x56080c434f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441951700 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 0x56080c434f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441951700 1 -- 172.21.15.69:0/3029144725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43a380 msgr2=0x56080c451460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441951700 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43a380 0x56080c451460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441951700 1 -- 172.21.15.69:0/3029144725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080c445500 con 0x56080c445b50 2023-12-14T14:18:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe44094f700 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 0x56080c434f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.728+0000 7fe441951700 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c4506e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe42c006070 tx=0x7fe42c0972f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ddb7cb0724bc3b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe423fff700 1 -- 172.21.15.69:0/3029144725 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c09eeb0 con 0x56080c445b50 2023-12-14T14:18:09.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe423fff700 1 -- 172.21.15.69:0/3029144725 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe42c099220 con 0x56080c445b50 2023-12-14T14:18:09.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe423fff700 1 -- 172.21.15.69:0/3029144725 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c09b0e0 con 0x56080c445b50 2023-12-14T14:18:09.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe44f542b80 1 -- 172.21.15.69:0/3029144725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 msgr2=0x56080c4506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c4506e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe42c006070 tx=0x7fe42c0972f0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe44f542b80 1 -- 172.21.15.69:0/3029144725 shutdown_connections 2023-12-14T14:18:09.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c4506e0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43a380 0x56080c451460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe44f542b80 1 --2- 172.21.15.69:0/3029144725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43ac90 0x56080c434f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe44f542b80 1 -- 172.21.15.69:0/3029144725 >> 172.21.15.69:0/3029144725 conn(0x56080c430ca0 msgr2=0x56080c43f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe44f542b80 1 -- 172.21.15.69:0/3029144725 shutdown_connections 2023-12-14T14:18:09.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.729+0000 7fe44f542b80 1 -- 172.21.15.69:0/3029144725 wait complete. 2023-12-14T14:18:09.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44f542b80 1 -- start start 2023-12-14T14:18:09.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44f542b80 1 Processor -- start 2023-12-14T14:18:09.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 0x56080c4466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 0x56080c446c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44f542b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44f542b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c4a80b0 con 0x56080c445b50 2023-12-14T14:18:09.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44f542b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c4a8220 con 0x56080c43ac90 2023-12-14T14:18:09.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44f542b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080c4a83e0 con 0x56080c43a380 2023-12-14T14:18:09.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44f542b80 10 client.0 _ll_register_callbacks cb 0x7fe4340043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:09.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe441951700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe441951700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37084/0 (socket says 172.21.15.69:37084) 2023-12-14T14:18:09.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe441951700 1 -- 172.21.15.69:0/709820254 learned_addr learned my addr 172.21.15.69:0/709820254 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:09.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe441150700 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 0x56080c4466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe44094f700 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 0x56080c446c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe441951700 1 -- 172.21.15.69:0/709820254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 msgr2=0x56080c4466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe441951700 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 0x56080c4466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe441951700 1 -- 172.21.15.69:0/709820254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 msgr2=0x56080c446c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:09.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe441951700 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 0x56080c446c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.730+0000 7fe441951700 1 -- 172.21.15.69:0/709820254 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56080c20e3b0 con 0x56080c445b50 2023-12-14T14:18:09.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe441951700 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447140 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0978f0 tx=0x7fe42c009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4eb20867db26e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe420ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe420ff9700 1 -- 172.21.15.69:0/709820254 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0c9070 con 0x56080c445b50 2023-12-14T14:18:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe420ff9700 1 -- 172.21.15.69:0/709820254 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fe42c0cb2b0 con 0x56080c445b50 2023-12-14T14:18:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe44f542b80 1 -- 172.21.15.69:0/709820254 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe42c0a3240 con 0x56080c445b50 2023-12-14T14:18:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe420ff9700 1 -- 172.21.15.69:0/709820254 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe42c0cb900 con 0x56080c445b50 2023-12-14T14:18:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe44f542b80 10 client.16461 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe44f542b80 1 -- 172.21.15.69:0/709820254 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56080c1bab60 con 0x56080c445b50 2023-12-14T14:18:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe420ff9700 1 -- 172.21.15.69:0/709820254 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe42c066020 con 0x56080c445b50 2023-12-14T14:18:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe420ff9700 1 -- 172.21.15.69:0/709820254 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe42c0a2db0 con 0x56080c445b50 2023-12-14T14:18:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe44f542b80 10 client.16461 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe44f542b80 10 client.16461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe44f542b80 20 client.16461 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe44f542b80 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080c4a9580 0x56080c4ab990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe44f542b80 4 client.16461 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:18:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.731+0000 7fe44f542b80 1 -- 172.21.15.69:0/709820254 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56080c385a00 con 0x56080c4a9580 2023-12-14T14:18:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe441150700 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080c4a9580 0x56080c4ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe420ff9700 10 client.16461 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe441150700 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080c4a9580 0x56080c4ab990 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f5f5435f9d8af0 server_cookie=7cbec91cb011c196 in_seq=0 out_seq=0 2023-12-14T14:18:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe420ff9700 1 -- 172.21.15.69:0/709820254 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56080c385a00 con 0x56080c4a9580 2023-12-14T14:18:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe420ff9700 10 client.16461 handle_command_reply: tid=0 2023-12-14T14:18:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 client.16461 shutdown 2023-12-14T14:18:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 -- 172.21.15.69:0/709820254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 msgr2=0x56080c447140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447140 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0978f0 tx=0x7fe42c009c80 comp rx=0 tx=0).stop 2023-12-14T14:18:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 -- 172.21.15.69:0/709820254 shutdown_connections 2023-12-14T14:18:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56080c4a9580 0x56080c4ab990 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56080c445b50 0x56080c447140 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56080c43a380 0x56080c4466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe420ff9700 0 client.16461 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:09.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 --2- 172.21.15.69:0/709820254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56080c43ac90 0x56080c446c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 -- 172.21.15.69:0/709820254 >> 172.21.15.69:0/709820254 conn(0x56080c430ca0 msgr2=0x56080c451460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 -- 172.21.15.69:0/709820254 shutdown_connections 2023-12-14T14:18:09.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 1 -- 172.21.15.69:0/709820254 wait complete. 2023-12-14T14:18:09.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.732+0000 7fe44f542b80 20 client.16461 trim_cache size 0 max 16384 2023-12-14T14:18:09.746 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:18:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 -- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe4240a12c0 msgr2=0x7fe4240a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe4240a12c0 0x7fe4240a3770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe434009cb0 tx=0x7fe434009260 comp rx=0 tx=0).stop 2023-12-14T14:18:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 -- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 msgr2=0x7fe43c195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 0x7fe43c195a80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00b780 tx=0x7fe42c007990 comp rx=0 tx=0).stop 2023-12-14T14:18:09.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 -- 172.21.15.69:0/2196922741 shutdown_connections 2023-12-14T14:18:09.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe4240a12c0 0x7fe4240a3770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe43c109b30 0x7fe43c195a80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe43c100580 0x7fe43c195000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 --2- 172.21.15.69:0/2196922741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe43c100e90 0x7fe43c195540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:09.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 -- 172.21.15.69:0/2196922741 >> 172.21.15.69:0/2196922741 conn(0x7fe43c074a60 msgr2=0x7fe43c101560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:09.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 -- 172.21.15.69:0/2196922741 shutdown_connections 2023-12-14T14:18:09.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:09.733+0000 7fe4433b4700 1 -- 172.21.15.69:0/2196922741 wait complete. 2023-12-14T14:18:09.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:09 smithi119 ceph-mon[43834]: pgmap v230: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 19 op/s 2023-12-14T14:18:09.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:09 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/2869760674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:18:09.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:09 smithi069 ceph-mon[42034]: pgmap v230: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 19 op/s 2023-12-14T14:18:09.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:09 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/2869760674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:18:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:09 smithi081 ceph-mon[43371]: pgmap v230: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 19 op/s 2023-12-14T14:18:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:09 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/2869760674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:18:10.749 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:18:10.749 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:18:10.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 -- 172.21.15.69:0/4085465745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 msgr2=0x7f989c10c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:10.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/4085465745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 0x7f989c10c000 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f989400b0d0 tx=0x7f989400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 -- 172.21.15.69:0/4085465745 shutdown_connections 2023-12-14T14:18:10.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/4085465745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 0x7f989c10c000 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/4085465745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f989c0ff3f0 0x7f989c0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/4085465745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989c0ffd90 0x7f989c103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 -- 172.21.15.69:0/4085465745 >> 172.21.15.69:0/4085465745 conn(0x7f989c075fd0 msgr2=0x7f989c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:10.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 -- 172.21.15.69:0/4085465745 shutdown_connections 2023-12-14T14:18:10.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 -- 172.21.15.69:0/4085465745 wait complete. 2023-12-14T14:18:10.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.889+0000 7f98a0cdf700 1 Processor -- start 2023-12-14T14:18:10.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f98a0cdf700 1 -- start start 2023-12-14T14:18:10.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f98a0cdf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f989c0ff3f0 0x7f989c1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f98a0cdf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989c0ffd90 0x7f989c196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f98a0cdf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 0x7f989c19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f98a0cdf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c19b360 con 0x7f989c104430 2023-12-14T14:18:10.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f98a0cdf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c19b4d0 con 0x7f989c0ffd90 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f98a0cdf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c19b690 con 0x7f989c0ff3f0 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 0x7f989c19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 0x7f989c19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37100/0 (socket says 172.21.15.69:37100) 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989ad9d700 1 -- 172.21.15.69:0/2745040750 learned_addr learned my addr 172.21.15.69:0/2745040750 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f9899d9b700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989c0ffd90 0x7f989c196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989a59c700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f989c0ff3f0 0x7f989c1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989ad9d700 1 -- 172.21.15.69:0/2745040750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f989c0ff3f0 msgr2=0x7f989c1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989ad9d700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f989c0ff3f0 0x7f989c1963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989ad9d700 1 -- 172.21.15.69:0/2745040750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989c0ffd90 msgr2=0x7f989c196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:10.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989ad9d700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989c0ffd90 0x7f989c196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989ad9d700 1 -- 172.21.15.69:0/2745040750 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894009d00 con 0x7f989c104430 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f9899d9b700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989c0ffd90 0x7f989c196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989a59c700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f989c0ff3f0 0x7f989c1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f989ad9d700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 0x7f989c19ad20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9894007940 tx=0x7f9894007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.890+0000 7f988b7fe700 1 -- 172.21.15.69:0/2745040750 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400e040 con 0x7f989c104430 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.891+0000 7f988b7fe700 1 -- 172.21.15.69:0/2745040750 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9894003e10 con 0x7f989c104430 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.891+0000 7f98a0cdf700 1 -- 172.21.15.69:0/2745040750 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c10f200 con 0x7f989c104430 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.891+0000 7f988b7fe700 1 -- 172.21.15.69:0/2745040750 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894005620 con 0x7f989c104430 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.891+0000 7f98a0cdf700 1 -- 172.21.15.69:0/2745040750 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c10f070 con 0x7f989c104430 2023-12-14T14:18:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.893+0000 7f988b7fe700 1 -- 172.21.15.69:0/2745040750 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f98940057a0 con 0x7f989c104430 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.894+0000 7f988b7fe700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98840a1340 0x7f98840a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.894+0000 7f989a59c700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98840a1340 0x7f98840a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.894+0000 7f988b7fe700 1 -- 172.21.15.69:0/2745040750 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f98940ce600 con 0x7f989c104430 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.894+0000 7f989a59c700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98840a1340 0x7f98840a37f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f988c005fd0 tx=0x7f988c005e20 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f98ace6db80 1 Processor -- start 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f98ace6db80 1 -- start start 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36400 0x5627d6c367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c45aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 0x5627d6c483c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f98ace6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6b20660 con 0x5627d6c36d10 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f98ace6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6b8f8f0 con 0x5627d6c36400 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f98ace6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6b88d80 con 0x5627d6c45fe0 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f9899d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c45aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f9899d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c45aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37112/0 (socket says 172.21.15.69:37112) 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f9899d9b700 1 -- 172.21.15.69:0/933324365 learned_addr learned my addr 172.21.15.69:0/933324365 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f989a59c700 1 --2- 172.21.15.69:0/933324365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36400 0x5627d6c367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f989ad9d700 1 --2- 172.21.15.69:0/933324365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 0x5627d6c483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f9899d9b700 1 -- 172.21.15.69:0/933324365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 msgr2=0x5627d6c483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f9899d9b700 1 --2- 172.21.15.69:0/933324365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 0x5627d6c483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f9899d9b700 1 -- 172.21.15.69:0/933324365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36400 msgr2=0x5627d6c367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f9899d9b700 1 --2- 172.21.15.69:0/933324365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36400 0x5627d6c367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.895+0000 7f9899d9b700 1 -- 172.21.15.69:0/933324365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d6a0a430 con 0x5627d6c36d10 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.896+0000 7f9899d9b700 1 --2- 172.21.15.69:0/933324365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c45aa0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f989000bba0 tx=0x7f989000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fbf7210c4d0051 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.896+0000 7f9888ff9700 1 -- 172.21.15.69:0/933324365 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000dd30 con 0x5627d6c36d10 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.896+0000 7f9888ff9700 1 -- 172.21.15.69:0/933324365 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f989000de90 con 0x5627d6c36d10 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.896+0000 7f9888ff9700 1 -- 172.21.15.69:0/933324365 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000f7a0 con 0x5627d6c36d10 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 -- 172.21.15.69:0/933324365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 msgr2=0x5627d6c45aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 --2- 172.21.15.69:0/933324365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c45aa0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f989000bba0 tx=0x7f989000beb0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 -- 172.21.15.69:0/933324365 shutdown_connections 2023-12-14T14:18:10.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 --2- 172.21.15.69:0/933324365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 0x5627d6c483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 --2- 172.21.15.69:0/933324365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36400 0x5627d6c367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 --2- 172.21.15.69:0/933324365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c45aa0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 -- 172.21.15.69:0/933324365 >> 172.21.15.69:0/933324365 conn(0x5627d6c2cd20 msgr2=0x5627d6c32860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 -- 172.21.15.69:0/933324365 shutdown_connections 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 -- 172.21.15.69:0/933324365 wait complete. 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 -- start start 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 Processor -- start 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36400 0x5627d6c45990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c42c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 0x5627d6c43200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6b25010 con 0x5627d6c36d10 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6b24cb0 con 0x5627d6c45fe0 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6a0c720 con 0x5627d6c36400 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.897+0000 7f98ace6db80 10 client.0 _ll_register_callbacks cb 0x5627d6b48990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9899d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c42c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9899d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c42c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37122/0 (socket says 172.21.15.69:37122) 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f989a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36400 0x5627d6c45990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9899d9b700 1 -- 172.21.15.69:0/465233553 learned_addr learned my addr 172.21.15.69:0/465233553 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f989ad9d700 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 0x5627d6c43200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9899d9b700 1 -- 172.21.15.69:0/465233553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36400 msgr2=0x5627d6c45990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:10.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9899d9b700 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36400 0x5627d6c45990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9899d9b700 1 -- 172.21.15.69:0/465233553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 msgr2=0x5627d6c43200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:10.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9899d9b700 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 0x5627d6c43200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9899d9b700 1 -- 172.21.15.69:0/465233553 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989000b7d0 con 0x5627d6c36d10 2023-12-14T14:18:10.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9899d9b700 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c42c40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9890019040 tx=0x7f98900052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ceb9c84ad4be89 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:10.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9881ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:10.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9881ffb700 1 -- 172.21.15.69:0/465233553 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900056f0 con 0x5627d6c36d10 2023-12-14T14:18:10.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f98ace6db80 1 -- 172.21.15.69:0/465233553 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627d6c2a330 con 0x5627d6c36d10 2023-12-14T14:18:10.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9881ffb700 1 -- 172.21.15.69:0/465233553 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f9890013070 con 0x5627d6c36d10 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f9881ffb700 1 -- 172.21.15.69:0/465233553 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9890017420 con 0x5627d6c36d10 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f98ace6db80 10 client.16473 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.898+0000 7f98ace6db80 1 -- 172.21.15.69:0/465233553 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5627d6b4f1f0 con 0x5627d6c36d10 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f9881ffb700 1 -- 172.21.15.69:0/465233553 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5627d6c2a330 con 0x5627d6c36d10 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f9881ffb700 1 -- 172.21.15.69:0/465233553 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f989001f070 con 0x5627d6c36d10 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f98ace6db80 10 client.16473 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f98ace6db80 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f98ace6db80 20 client.16473 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f98ace6db80 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5627d6c55a60 0x5627d6c57e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f98ace6db80 4 client.16473 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f98ace6db80 1 -- 172.21.15.69:0/465233553 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627d6b81d60 con 0x5627d6c55a60 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f989a59c700 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5627d6c55a60 0x5627d6c57e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f9881ffb700 10 client.16473 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.899+0000 7f989a59c700 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5627d6c55a60 0x5627d6c57e70 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea31bd43263dc0ba server_cookie=60a03dc06decc4db in_seq=0 out_seq=0 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f9881ffb700 1 -- 172.21.15.69:0/465233553 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5627d6b81d60 con 0x5627d6c55a60 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f9881ffb700 10 client.16473 handle_command_reply: tid=0 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 client.16473 shutdown 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 -- 172.21.15.69:0/465233553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 msgr2=0x5627d6c42c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c42c40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9890019040 tx=0x7f98900052f0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 -- 172.21.15.69:0/465233553 shutdown_connections 2023-12-14T14:18:10.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5627d6c55a60 0x5627d6c57e70 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 0x5627d6c43200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36400 0x5627d6c45990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f9881ffb700 0 client.16473 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:10.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 --2- 172.21.15.69:0/465233553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36d10 0x5627d6c42c40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 -- 172.21.15.69:0/465233553 >> 172.21.15.69:0/465233553 conn(0x5627d6c2cd20 msgr2=0x5627d6c32450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:10.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 -- 172.21.15.69:0/465233553 shutdown_connections 2023-12-14T14:18:10.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 1 -- 172.21.15.69:0/465233553 wait complete. 2023-12-14T14:18:10.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.900+0000 7f98ace6db80 20 client.16473 trim_cache size 0 max 16384 2023-12-14T14:18:10.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.917+0000 7f98ace6db80 1 Processor -- start 2023-12-14T14:18:10.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98ace6db80 1 -- start start 2023-12-14T14:18:10.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6c51c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36d10 0x5627d6c3df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 0x5627d6c3e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98ace6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6c392f0 con 0x5627d6c36400 2023-12-14T14:18:10.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98ace6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6c584d0 con 0x5627d6c36d10 2023-12-14T14:18:10.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98ace6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6c411a0 con 0x5627d6c45fe0 2023-12-14T14:18:10.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6c51c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6c51c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37126/0 (socket says 172.21.15.69:37126) 2023-12-14T14:18:10.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989a59c700 1 -- 172.21.15.69:0/2431017110 learned_addr learned my addr 172.21.15.69:0/2431017110 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:10.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f9899d9b700 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36d10 0x5627d6c3df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989ad9d700 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 0x5627d6c3e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989a59c700 1 -- 172.21.15.69:0/2431017110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 msgr2=0x5627d6c3e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989a59c700 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 0x5627d6c3e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989a59c700 1 -- 172.21.15.69:0/2431017110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36d10 msgr2=0x5627d6c3df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989a59c700 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36d10 0x5627d6c3df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989a59c700 1 -- 172.21.15.69:0/2431017110 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d6c2e560 con 0x5627d6c36400 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f9899d9b700 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36d10 0x5627d6c3df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f989a59c700 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6c51c90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5627d6c58710 tx=0x7f988c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d854dc81f8179f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98897fa700 1 -- 172.21.15.69:0/2431017110 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c023040 con 0x5627d6c36400 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98897fa700 1 -- 172.21.15.69:0/2431017110 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f988c025860 con 0x5627d6c36400 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.918+0000 7f98897fa700 1 -- 172.21.15.69:0/2431017110 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c01db80 con 0x5627d6c36400 2023-12-14T14:18:10.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 -- 172.21.15.69:0/2431017110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 msgr2=0x5627d6c51c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6c51c90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5627d6c58710 tx=0x7f988c013000 comp rx=0 tx=0).stop 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 -- 172.21.15.69:0/2431017110 shutdown_connections 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c45fe0 0x5627d6c3e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6c51c90 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 --2- 172.21.15.69:0/2431017110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c36d10 0x5627d6c3df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 -- 172.21.15.69:0/2431017110 >> 172.21.15.69:0/2431017110 conn(0x5627d6c2cd20 msgr2=0x5627d6c30fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 -- 172.21.15.69:0/2431017110 shutdown_connections 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 -- 172.21.15.69:0/2431017110 wait complete. 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 -- start start 2023-12-14T14:18:10.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.919+0000 7f98ace6db80 1 Processor -- start 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6ca3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36d10 0x5627d6ca4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f98ace6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 0x5627d6c4bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f98ace6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6c4c330 con 0x5627d6c36400 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f98ace6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6c4c4a0 con 0x5627d6c45fe0 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f98ace6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6c4c660 con 0x5627d6c36d10 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f98ace6db80 10 client.0 _ll_register_callbacks cb 0x7f989000b9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6ca3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6ca3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37134/0 (socket says 172.21.15.69:37134) 2023-12-14T14:18:10.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989a59c700 1 -- 172.21.15.69:0/326370043 learned_addr learned my addr 172.21.15.69:0/326370043 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f9899d9b700 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36d10 0x5627d6ca4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989a59c700 1 -- 172.21.15.69:0/326370043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36d10 msgr2=0x5627d6ca4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989ad9d700 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 0x5627d6c4bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989a59c700 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36d10 0x5627d6ca4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989a59c700 1 -- 172.21.15.69:0/326370043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 msgr2=0x5627d6c4bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989a59c700 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 0x5627d6c4bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989a59c700 1 -- 172.21.15.69:0/326370043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c00dc70 con 0x5627d6c36400 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f9899d9b700 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36d10 0x5627d6ca4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f989a59c700 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6ca3fe0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f988c012040 tx=0x7f988c025da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9184d9ad0bccd3d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:10.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f9881ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f9881ffb700 1 -- 172.21.15.69:0/326370043 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c025700 con 0x5627d6c36400 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f9881ffb700 1 -- 172.21.15.69:0/326370043 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f988c01d790 con 0x5627d6c36400 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.920+0000 7f98ace6db80 1 -- 172.21.15.69:0/326370043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f989000de90 con 0x5627d6c36400 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f9881ffb700 1 -- 172.21.15.69:0/326370043 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f988c01d950 con 0x5627d6c36400 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f98ace6db80 10 client.16479 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f98ace6db80 1 -- 172.21.15.69:0/326370043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5627d6b4ef40 con 0x5627d6c36400 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f9881ffb700 1 -- 172.21.15.69:0/326370043 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f989000de90 con 0x5627d6c36400 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f9881ffb700 1 -- 172.21.15.69:0/326370043 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f988c00fcd0 con 0x5627d6c36400 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f98ace6db80 10 client.16479 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:10.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f98ace6db80 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:10.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f98ace6db80 20 client.16479 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:10.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f98ace6db80 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5627d6cabcd0 0x5627d6cae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:10.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f98ace6db80 4 client.16479 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:18:10.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f98ace6db80 1 -- 172.21.15.69:0/326370043 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5627d6b81a80 con 0x5627d6cabcd0 2023-12-14T14:18:10.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f9899d9b700 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5627d6cabcd0 0x5627d6cae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:10.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f9881ffb700 10 client.16479 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:10.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.921+0000 7f9899d9b700 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5627d6cabcd0 0x5627d6cae0e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71410bb705cdc450 server_cookie=b05f5dbec88c9851 in_seq=0 out_seq=0 2023-12-14T14:18:10.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.922+0000 7f9881ffb700 1 -- 172.21.15.69:0/326370043 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5627d6b81a80 con 0x5627d6cabcd0 2023-12-14T14:18:10.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.922+0000 7f9881ffb700 10 client.16479 handle_command_reply: tid=0 2023-12-14T14:18:10.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.922+0000 7f98ace6db80 1 client.16479 shutdown 2023-12-14T14:18:10.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 -- 172.21.15.69:0/326370043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 msgr2=0x5627d6ca3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6ca3fe0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f988c012040 tx=0x7f988c025da0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 -- 172.21.15.69:0/326370043 shutdown_connections 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5627d6cabcd0 0x5627d6cae0e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627d6c45fe0 0x5627d6c4bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d6c36400 0x5627d6ca3fe0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 --2- 172.21.15.69:0/326370043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d6c36d10 0x5627d6ca4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f9881ffb700 0 client.16479 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 -- 172.21.15.69:0/326370043 >> 172.21.15.69:0/326370043 conn(0x5627d6c2cd20 msgr2=0x5627d6c45500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 -- 172.21.15.69:0/326370043 shutdown_connections 2023-12-14T14:18:10.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 1 -- 172.21.15.69:0/326370043 wait complete. 2023-12-14T14:18:10.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98ace6db80 20 client.16479 trim_cache size 0 max 16384 2023-12-14T14:18:10.932 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:18:10.932 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:18:10.932 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "67913660-bd08-4841-b4f2-01fa69c39c3e", 2023-12-14T14:18:10.932 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:18:10.932 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:18:10.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 -- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98840a1340 msgr2=0x7f98840a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:10.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98840a1340 0x7f98840a37f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f988c005fd0 tx=0x7f988c005e20 comp rx=0 tx=0).stop 2023-12-14T14:18:10.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 -- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 msgr2=0x7f989c19ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:10.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 0x7f989c19ad20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9894007940 tx=0x7f9894007a20 comp rx=0 tx=0).stop 2023-12-14T14:18:10.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 -- 172.21.15.69:0/2745040750 shutdown_connections 2023-12-14T14:18:10.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98840a1340 0x7f98840a37f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f989c104430 0x7f989c19ad20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f989c0ff3f0 0x7f989c1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 --2- 172.21.15.69:0/2745040750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989c0ffd90 0x7f989c196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:10.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 -- 172.21.15.69:0/2745040750 >> 172.21.15.69:0/2745040750 conn(0x7f989c075fd0 msgr2=0x7f989c102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:10.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 -- 172.21.15.69:0/2745040750 shutdown_connections 2023-12-14T14:18:10.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:10.923+0000 7f98a0cdf700 1 -- 172.21.15.69:0/2745040750 wait complete. 2023-12-14T14:18:10.937 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:18:11.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.061+0000 7efd9499a700 1 -- 172.21.15.69:0/939347825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ffd50 msgr2=0x7efd90103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:11.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.061+0000 7efd9499a700 1 --2- 172.21.15.69:0/939347825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ffd50 0x7efd90103d10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efd800099c0 tx=0x7efd80009cd0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.061+0000 7efd9499a700 1 -- 172.21.15.69:0/939347825 shutdown_connections 2023-12-14T14:18:11.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.061+0000 7efd9499a700 1 --2- 172.21.15.69:0/939347825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd901043f0 0x7efd9010bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.061+0000 7efd9499a700 1 --2- 172.21.15.69:0/939347825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd900ff3b0 0x7efd900ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.061+0000 7efd9499a700 1 --2- 172.21.15.69:0/939347825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ffd50 0x7efd90103d10 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.061+0000 7efd9499a700 1 -- 172.21.15.69:0/939347825 >> 172.21.15.69:0/939347825 conn(0x7efd90075f70 msgr2=0x7efd90076370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:11.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.061+0000 7efd9499a700 1 -- 172.21.15.69:0/939347825 shutdown_connections 2023-12-14T14:18:11.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.061+0000 7efd9499a700 1 -- 172.21.15.69:0/939347825 wait complete. 2023-12-14T14:18:11.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd9499a700 1 Processor -- start 2023-12-14T14:18:11.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd9499a700 1 -- start start 2023-12-14T14:18:11.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd9499a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ff3b0 0x7efd90195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd9499a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd900ffd50 0x7efd90195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd9499a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd901043f0 0x7efd90199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd9499a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9019a320 con 0x7efd900ff3b0 2023-12-14T14:18:11.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd9499a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9019a490 con 0x7efd900ffd50 2023-12-14T14:18:11.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd9499a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9019a650 con 0x7efd901043f0 2023-12-14T14:18:11.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ff3b0 0x7efd90195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ff3b0 0x7efd90195340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37144/0 (socket says 172.21.15.69:37144) 2023-12-14T14:18:11.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8e59c700 1 -- 172.21.15.69:0/2495119994 learned_addr learned my addr 172.21.15.69:0/2495119994 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8ed9d700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd901043f0 0x7efd90199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd900ffd50 0x7efd90195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8e59c700 1 -- 172.21.15.69:0/2495119994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd901043f0 msgr2=0x7efd90199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8e59c700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd901043f0 0x7efd90199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8e59c700 1 -- 172.21.15.69:0/2495119994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd900ffd50 msgr2=0x7efd90195880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8e59c700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd900ffd50 0x7efd90195880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.062+0000 7efd8e59c700 1 -- 172.21.15.69:0/2495119994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd800095f0 con 0x7efd900ff3b0 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.063+0000 7efd8e59c700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ff3b0 0x7efd90195340 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efd8400c920 tx=0x7efd8400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.063+0000 7efd7f7fe700 1 -- 172.21.15.69:0/2495119994 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84007b00 con 0x7efd900ff3b0 2023-12-14T14:18:11.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.063+0000 7efd9499a700 1 -- 172.21.15.69:0/2495119994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9010f1c0 con 0x7efd900ff3b0 2023-12-14T14:18:11.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.063+0000 7efd7f7fe700 1 -- 172.21.15.69:0/2495119994 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd84004cf0 con 0x7efd900ff3b0 2023-12-14T14:18:11.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.063+0000 7efd7f7fe700 1 -- 172.21.15.69:0/2495119994 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84005520 con 0x7efd900ff3b0 2023-12-14T14:18:11.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.063+0000 7efd9499a700 1 -- 172.21.15.69:0/2495119994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9010f030 con 0x7efd900ff3b0 2023-12-14T14:18:11.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.065+0000 7efd7f7fe700 1 -- 172.21.15.69:0/2495119994 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7efd84004750 con 0x7efd900ff3b0 2023-12-14T14:18:11.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.065+0000 7efd7f7fe700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7efd780a12c0 0x7efd780a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.065+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7efd780a12c0 0x7efd780a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.065+0000 7efd7f7fe700 1 -- 172.21.15.69:0/2495119994 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8542+0+0 (secure 0 0 0) 0x7efd840cc9d0 con 0x7efd900ff3b0 2023-12-14T14:18:11.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.066+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7efd780a12c0 0x7efd780a3770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd80006010 tx=0x7efd80005c00 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:11.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.066+0000 7efda0b28b80 1 Processor -- start 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efda0b28b80 1 -- start start 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31a4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4c90 0x55bce31b1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 0x55bce31b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efda0b28b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce308e5e0 con 0x55bce31a4380 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efda0b28b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce30fd870 con 0x55bce31b1d60 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efda0b28b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce30f6d00 con 0x55bce31a4c90 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37158/0 (socket says 172.21.15.69:37158) 2023-12-14T14:18:11.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8e59c700 1 -- 172.21.15.69:0/2523446629 learned_addr learned my addr 172.21.15.69:0/2523446629 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8ed9d700 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 0x55bce31b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4c90 0x55bce31b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8e59c700 1 -- 172.21.15.69:0/2523446629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4c90 msgr2=0x55bce31b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8e59c700 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4c90 0x55bce31b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8e59c700 1 -- 172.21.15.69:0/2523446629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 msgr2=0x55bce31b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8e59c700 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 0x55bce31b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8e59c700 1 -- 172.21.15.69:0/2523446629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bce2f783b0 con 0x55bce31a4380 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4c90 0x55bce31b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd8e59c700 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31a4750 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efd84095f90 tx=0x7efd84099640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1758d85836642caf server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:11.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd7cff9700 1 -- 172.21.15.69:0/2523446629 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84099a90 con 0x55bce31a4380 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd7cff9700 1 -- 172.21.15.69:0/2523446629 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd8409dac0 con 0x55bce31a4380 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.067+0000 7efd7cff9700 1 -- 172.21.15.69:0/2523446629 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84099cf0 con 0x55bce31a4380 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.068+0000 7efda0b28b80 1 -- 172.21.15.69:0/2523446629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 msgr2=0x55bce31a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.068+0000 7efda0b28b80 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31a4750 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efd84095f90 tx=0x7efd84099640 comp rx=0 tx=0).stop 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.068+0000 7efda0b28b80 1 -- 172.21.15.69:0/2523446629 shutdown_connections 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.068+0000 7efda0b28b80 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 0x55bce31b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.068+0000 7efda0b28b80 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31a4750 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.068+0000 7efda0b28b80 1 --2- 172.21.15.69:0/2523446629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4c90 0x55bce31b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.068+0000 7efda0b28b80 1 -- 172.21.15.69:0/2523446629 >> 172.21.15.69:0/2523446629 conn(0x55bce319aca0 msgr2=0x55bce31a07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.068+0000 7efda0b28b80 1 -- 172.21.15.69:0/2523446629 shutdown_connections 2023-12-14T14:18:11.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.068+0000 7efda0b28b80 1 -- 172.21.15.69:0/2523446629 wait complete. 2023-12-14T14:18:11.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efda0b28b80 1 -- start start 2023-12-14T14:18:11.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efda0b28b80 1 Processor -- start 2023-12-14T14:18:11.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 0x55bce31aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31b1d60 0x55bce31af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efda0b28b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce3092f90 con 0x55bce31a4380 2023-12-14T14:18:11.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efda0b28b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce3092c30 con 0x55bce31a4c90 2023-12-14T14:18:11.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efda0b28b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce2f7a6a0 con 0x55bce31b1d60 2023-12-14T14:18:11.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efda0b28b80 10 client.0 _ll_register_callbacks cb 0x55bce30b6910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37166/0 (socket says 172.21.15.69:37166) 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8e59c700 1 -- 172.21.15.69:0/1843138454 learned_addr learned my addr 172.21.15.69:0/1843138454 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 0x55bce31aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8ed9d700 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31b1d60 0x55bce31af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8e59c700 1 -- 172.21.15.69:0/1843138454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31b1d60 msgr2=0x55bce31af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8e59c700 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31b1d60 0x55bce31af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8e59c700 1 -- 172.21.15.69:0/1843138454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 msgr2=0x55bce31aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8e59c700 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 0x55bce31aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8e59c700 1 -- 172.21.15.69:0/1843138454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9010f030 con 0x55bce31a4380 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd8e59c700 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b1700 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7efd84095f40 tx=0x7efd840a2010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738416f5fbf0024 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.069+0000 7efd75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efd75ffb700 1 -- 172.21.15.69:0/1843138454 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840b6070 con 0x55bce31a4380 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efd75ffb700 1 -- 172.21.15.69:0/1843138454 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8542+0+0 (secure 0 0 0) 0x7efd84099cf0 con 0x55bce31a4380 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efda0b28b80 1 -- 172.21.15.69:0/1843138454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bce31982b0 con 0x55bce31a4380 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efd75ffb700 1 -- 172.21.15.69:0/1843138454 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd840b22b0 con 0x55bce31a4380 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efda0b28b80 10 client.16491 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efda0b28b80 1 -- 172.21.15.69:0/1843138454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55bce30bd170 con 0x55bce31a4380 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efd75ffb700 1 -- 172.21.15.69:0/1843138454 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bce31982b0 con 0x55bce31a4380 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efd75ffb700 1 -- 172.21.15.69:0/1843138454 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7efd840989f0 con 0x55bce31a4380 2023-12-14T14:18:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efda0b28b80 10 client.16491 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efda0b28b80 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efda0b28b80 20 client.16491 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bce31c11b0 0x55bce31c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efda0b28b80 4 client.16491 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efda0b28b80 1 -- 172.21.15.69:0/1843138454 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bce30efce0 con 0x55bce31c11b0 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.070+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bce31c11b0 0x55bce31c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.071+0000 7efd75ffb700 10 client.16491 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.071+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bce31c11b0 0x55bce31c3590 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6721279cc6dc3ac4 server_cookie=7f7f1b1de59ffbb2 in_seq=0 out_seq=0 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.071+0000 7efd75ffb700 1 -- 172.21.15.69:0/1843138454 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bce30efce0 con 0x55bce31c11b0 2023-12-14T14:18:11.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.071+0000 7efd75ffb700 10 client.16491 handle_command_reply: tid=0 2023-12-14T14:18:11.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.071+0000 7efda0b28b80 1 client.16491 shutdown 2023-12-14T14:18:11.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.071+0000 7efda0b28b80 1 -- 172.21.15.69:0/1843138454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 msgr2=0x55bce31b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:11.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.071+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b1700 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7efd84095f40 tx=0x7efd840a2010 comp rx=0 tx=0).stop 2023-12-14T14:18:11.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efda0b28b80 1 -- 172.21.15.69:0/1843138454 shutdown_connections 2023-12-14T14:18:11.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bce31c11b0 0x55bce31c3590 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31b1d60 0x55bce31af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efd75ffb700 0 client.16491 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:11.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b1700 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1843138454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 0x55bce31aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efda0b28b80 1 -- 172.21.15.69:0/1843138454 >> 172.21.15.69:0/1843138454 conn(0x55bce319aca0 msgr2=0x55bce31a03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:11.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efda0b28b80 1 -- 172.21.15.69:0/1843138454 shutdown_connections 2023-12-14T14:18:11.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efda0b28b80 1 -- 172.21.15.69:0/1843138454 wait complete. 2023-12-14T14:18:11.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.072+0000 7efda0b28b80 20 client.16491 trim_cache size 0 max 16384 2023-12-14T14:18:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.088+0000 7efda0b28b80 1 Processor -- start 2023-12-14T14:18:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.088+0000 7efda0b28b80 1 -- start start 2023-12-14T14:18:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.088+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.088+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 0x55bce31bcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.088+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31b1d60 0x55bce31a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.088+0000 7efda0b28b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce31a13b0 con 0x55bce31a4380 2023-12-14T14:18:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.088+0000 7efda0b28b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce31aa8d0 con 0x55bce31a4c90 2023-12-14T14:18:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.088+0000 7efda0b28b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce31b8d10 con 0x55bce31b1d60 2023-12-14T14:18:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37168/0 (socket says 172.21.15.69:37168) 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8e59c700 1 -- 172.21.15.69:0/2352542941 learned_addr learned my addr 172.21.15.69:0/2352542941 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/2352542941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 0x55bce31bcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8e59c700 1 -- 172.21.15.69:0/2352542941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31b1d60 msgr2=0x55bce31a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8e59c700 1 --2- 172.21.15.69:0/2352542941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31b1d60 0x55bce31a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8e59c700 1 -- 172.21.15.69:0/2352542941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 msgr2=0x55bce31bcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8e59c700 1 --2- 172.21.15.69:0/2352542941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 0x55bce31bcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8e59c700 1 -- 172.21.15.69:0/2352542941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bce30bcec0 con 0x55bce31a4380 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/2352542941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 0x55bce31bcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:11.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd8e59c700 1 --2- 172.21.15.69:0/2352542941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b87d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efd840a19b0 tx=0x7efd8400a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c20f4601ecfb12 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd7d7fa700 1 -- 172.21.15.69:0/2352542941 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840b6070 con 0x55bce31a4380 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd7d7fa700 1 -- 172.21.15.69:0/2352542941 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd84099210 con 0x55bce31a4380 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.089+0000 7efd7d7fa700 1 -- 172.21.15.69:0/2352542941 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840a1cb0 con 0x55bce31a4380 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 -- 172.21.15.69:0/2352542941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 msgr2=0x55bce31b87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 --2- 172.21.15.69:0/2352542941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b87d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efd840a19b0 tx=0x7efd8400a5a0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 -- 172.21.15.69:0/2352542941 shutdown_connections 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 --2- 172.21.15.69:0/2352542941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31b1d60 0x55bce31a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 --2- 172.21.15.69:0/2352542941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4380 0x55bce31b87d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 --2- 172.21.15.69:0/2352542941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31a4c90 0x55bce31bcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 -- 172.21.15.69:0/2352542941 >> 172.21.15.69:0/2352542941 conn(0x55bce319aca0 msgr2=0x55bce31bda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:11.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 -- 172.21.15.69:0/2352542941 shutdown_connections 2023-12-14T14:18:11.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 -- 172.21.15.69:0/2352542941 wait complete. 2023-12-14T14:18:11.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 -- start start 2023-12-14T14:18:11.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 Processor -- start 2023-12-14T14:18:11.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4380 0x55bce31ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4c90 0x55bce31aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 0x55bce31ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce31acb90 con 0x55bce31a4c90 2023-12-14T14:18:11.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce31ab760 con 0x55bce31b1d60 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce31ab920 con 0x55bce31a4380 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efda0b28b80 10 client.0 _ll_register_callbacks cb 0x55bce30b6910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.090+0000 7efd8dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4c90 0x55bce31aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4c90 0x55bce31aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37174/0 (socket says 172.21.15.69:37174) 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8dd9b700 1 -- 172.21.15.69:0/1385427777 learned_addr learned my addr 172.21.15.69:0/1385427777 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8e59c700 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4380 0x55bce31ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8ed9d700 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 0x55bce31ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8dd9b700 1 -- 172.21.15.69:0/1385427777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4380 msgr2=0x55bce31ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4380 0x55bce31ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8dd9b700 1 -- 172.21.15.69:0/1385427777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 msgr2=0x55bce31ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 0x55bce31ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8dd9b700 1 -- 172.21.15.69:0/1385427777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bce30bd170 con 0x55bce31a4c90 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd8dd9b700 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4c90 0x55bce31aace0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efd800099c0 tx=0x7efd80009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de87b6b845beaf95 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd75ffb700 1 -- 172.21.15.69:0/1385427777 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80032a70 con 0x55bce31a4c90 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd75ffb700 1 -- 172.21.15.69:0/1385427777 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8542+0+0 (secure 0 0 0) 0x7efd80032bd0 con 0x55bce31a4c90 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efda0b28b80 1 -- 172.21.15.69:0/1385427777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd8409dac0 con 0x55bce31a4c90 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd75ffb700 1 -- 172.21.15.69:0/1385427777 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd80032d90 con 0x55bce31a4c90 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efda0b28b80 10 client.16497 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:11.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efda0b28b80 1 -- 172.21.15.69:0/1385427777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55bce30a39a0 con 0x55bce31a4c90 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd75ffb700 1 -- 172.21.15.69:0/1385427777 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd8409dac0 con 0x55bce31a4c90 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efd75ffb700 1 -- 172.21.15.69:0/1385427777 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7efd80003ca0 con 0x55bce31a4c90 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efda0b28b80 10 client.16497 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efda0b28b80 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.091+0000 7efda0b28b80 20 client.16497 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bce3218780 0x55bce321ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 4 client.16497 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 -- 172.21.15.69:0/1385427777 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bce30efa00 con 0x55bce3218780 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efd8e59c700 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bce3218780 0x55bce321ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:11.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efd75ffb700 10 client.16497 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efd8e59c700 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bce3218780 0x55bce321ab90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98ee0cd4056299b1 server_cookie=6d899cc615025bd6 in_seq=0 out_seq=0 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efd75ffb700 1 -- 172.21.15.69:0/1385427777 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55bce30efa00 con 0x55bce3218780 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efd75ffb700 10 client.16497 handle_command_reply: tid=0 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 client.16497 shutdown 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 -- 172.21.15.69:0/1385427777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4c90 msgr2=0x55bce31aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4c90 0x55bce31aace0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efd800099c0 tx=0x7efd80009cd0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 -- 172.21.15.69:0/1385427777 shutdown_connections 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bce3218780 0x55bce321ab90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce31b1d60 0x55bce31ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efd75ffb700 0 client.16497 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bce31a4380 0x55bce31ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 --2- 172.21.15.69:0/1385427777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bce31a4c90 0x55bce31aace0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 -- 172.21.15.69:0/1385427777 >> 172.21.15.69:0/1385427777 conn(0x55bce319aca0 msgr2=0x55bce31bcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 -- 172.21.15.69:0/1385427777 shutdown_connections 2023-12-14T14:18:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.092+0000 7efda0b28b80 1 -- 172.21.15.69:0/1385427777 wait complete. 2023-12-14T14:18:11.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efda0b28b80 20 client.16497 trim_cache size 0 max 16384 2023-12-14T14:18:11.102 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:18:11.102 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:18:11.103 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:18:11.103 INFO:teuthology.orchestra.run.smithi069.stdout: "67913660-bd08-4841-b4f2-01fa69c39c3e": { 2023-12-14T14:18:11.103 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:18:11.103 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "67913660-bd08-4841-b4f2-01fa69c39c3e", 2023-12-14T14:18:11.103 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:18:11.103 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:18:11.103 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:18:11.103 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:18:11.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 -- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7efd780a12c0 msgr2=0x7efd780a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:11.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7efd780a12c0 0x7efd780a3770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd80006010 tx=0x7efd80005c00 comp rx=0 tx=0).stop 2023-12-14T14:18:11.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 -- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ff3b0 msgr2=0x7efd90195340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:11.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ff3b0 0x7efd90195340 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efd8400c920 tx=0x7efd8400cce0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 -- 172.21.15.69:0/2495119994 shutdown_connections 2023-12-14T14:18:11.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7efd780a12c0 0x7efd780a3770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd901043f0 0x7efd90199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd900ff3b0 0x7efd90195340 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 --2- 172.21.15.69:0/2495119994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd900ffd50 0x7efd90195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 -- 172.21.15.69:0/2495119994 >> 172.21.15.69:0/2495119994 conn(0x7efd90075f70 msgr2=0x7efd900fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 -- 172.21.15.69:0/2495119994 shutdown_connections 2023-12-14T14:18:11.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:11.093+0000 7efd9499a700 1 -- 172.21.15.69:0/2495119994 wait complete. 2023-12-14T14:18:11.106 INFO:tasks.cephfs.filesystem:scrub status for tag:67913660-bd08-4841-b4f2-01fa69c39c3e - {'path': '/', 'tag': '67913660-bd08-4841-b4f2-01fa69c39c3e', 'options': 'recursive,force'} 2023-12-14T14:18:11.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:11 smithi119 ceph-mon[43834]: pgmap v231: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 48 KiB/s wr, 22 op/s 2023-12-14T14:18:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:11 smithi119 ceph-mon[43834]: osdmap e88: 12 total, 12 up, 12 in 2023-12-14T14:18:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:11 smithi069 ceph-mon[42034]: pgmap v231: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 48 KiB/s wr, 22 op/s 2023-12-14T14:18:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:11 smithi069 ceph-mon[42034]: osdmap e88: 12 total, 12 up, 12 in 2023-12-14T14:18:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:11 smithi081 ceph-mon[43371]: pgmap v231: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 48 KiB/s wr, 22 op/s 2023-12-14T14:18:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:11 smithi081 ceph-mon[43371]: osdmap e88: 12 total, 12 up, 12 in 2023-12-14T14:18:12.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:12 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:18:12.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:12 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:12.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:12 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:18:12.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:12 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:18:12.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:12 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:12.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:12 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:12.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:12 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:18:12.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:12 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:12.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:12 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:18:12.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:12 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:18:12.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:12 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:12.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:12 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:12 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:18:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:12 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:12 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:18:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:12 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:18:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:12 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:12.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:12 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:13.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:13 smithi119 ceph-mon[43834]: pgmap v233: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-12-14T14:18:13.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:13 smithi069 ceph-mon[42034]: pgmap v233: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-12-14T14:18:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:13 smithi081 ceph-mon[43371]: pgmap v233: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-12-14T14:18:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:15 smithi119 ceph-mon[43834]: pgmap v234: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2023-12-14T14:18:15.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:15 smithi069 ceph-mon[42034]: pgmap v234: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2023-12-14T14:18:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:15 smithi081 ceph-mon[43371]: pgmap v234: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2023-12-14T14:18:17.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:17 smithi081 ceph-mon[43371]: osdmap e89: 12 total, 12 up, 12 in 2023-12-14T14:18:17.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:17 smithi081 ceph-mon[43371]: pgmap v236: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2023-12-14T14:18:17.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:17 smithi119 ceph-mon[43834]: osdmap e89: 12 total, 12 up, 12 in 2023-12-14T14:18:17.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:17 smithi119 ceph-mon[43834]: pgmap v236: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2023-12-14T14:18:17.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:17 smithi069 ceph-mon[42034]: osdmap e89: 12 total, 12 up, 12 in 2023-12-14T14:18:17.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:17 smithi069 ceph-mon[42034]: pgmap v236: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2023-12-14T14:18:19.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:19 smithi119 ceph-mon[43834]: pgmap v237: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.4 KiB/s wr, 4 op/s 2023-12-14T14:18:19.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:19 smithi069 ceph-mon[42034]: pgmap v237: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.4 KiB/s wr, 4 op/s 2023-12-14T14:18:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:19 smithi081 ceph-mon[43371]: pgmap v237: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.4 KiB/s wr, 4 op/s 2023-12-14T14:18:20.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:20 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:18:20.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:20 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:18:20.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:20 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:18:21.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:21 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:18:21.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:21 smithi119 ceph-mon[43834]: pgmap v238: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.8 KiB/s wr, 7 op/s 2023-12-14T14:18:21.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:21 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:18:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:21 smithi069 ceph-mon[42034]: pgmap v238: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.8 KiB/s wr, 7 op/s 2023-12-14T14:18:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:21 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:18:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:21 smithi081 ceph-mon[43371]: pgmap v238: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.8 KiB/s wr, 7 op/s 2023-12-14T14:18:23.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:23 smithi119 ceph-mon[43834]: pgmap v239: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.8 KiB/s wr, 6 op/s 2023-12-14T14:18:23.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:23 smithi069 ceph-mon[42034]: pgmap v239: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.8 KiB/s wr, 6 op/s 2023-12-14T14:18:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:23 smithi081 ceph-mon[43371]: pgmap v239: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.8 KiB/s wr, 6 op/s 2023-12-14T14:18:25.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:25 smithi119 ceph-mon[43834]: pgmap v240: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-12-14T14:18:25.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:25 smithi069 ceph-mon[42034]: pgmap v240: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-12-14T14:18:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:25 smithi081 ceph-mon[43371]: pgmap v240: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-12-14T14:18:27.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:27 smithi081 ceph-mon[43371]: pgmap v241: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 304 B/s wr, 6 op/s 2023-12-14T14:18:27.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:27 smithi119 ceph-mon[43834]: pgmap v241: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 304 B/s wr, 6 op/s 2023-12-14T14:18:27.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:27 smithi069 ceph-mon[42034]: pgmap v241: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 304 B/s wr, 6 op/s 2023-12-14T14:18:29.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:29 smithi119 ceph-mon[43834]: pgmap v242: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-14T14:18:29.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:29 smithi069 ceph-mon[42034]: pgmap v242: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-14T14:18:29.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:29 smithi081 ceph-mon[43371]: pgmap v242: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-14T14:18:31.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:31 smithi119 ceph-mon[43834]: pgmap v243: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-14T14:18:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:31 smithi069 ceph-mon[42034]: pgmap v243: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-14T14:18:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:31 smithi081 ceph-mon[43371]: pgmap v243: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-14T14:18:33.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:33 smithi119 ceph-mon[43834]: pgmap v244: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:33 smithi069 ceph-mon[42034]: pgmap v244: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:33 smithi081 ceph-mon[43371]: pgmap v244: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:35.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:35 smithi119 ceph-mon[43834]: pgmap v245: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:18:35.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:35 smithi069 ceph-mon[42034]: pgmap v245: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:18:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:35 smithi081 ceph-mon[43371]: pgmap v245: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:18:37.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:37 smithi081 ceph-mon[43371]: pgmap v246: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:37.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:37 smithi119 ceph-mon[43834]: pgmap v246: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:37.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:37 smithi069 ceph-mon[42034]: pgmap v246: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:39.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:39 smithi119 ceph-mon[43834]: pgmap v247: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:39 smithi069 ceph-mon[42034]: pgmap v247: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:39 smithi081 ceph-mon[43371]: pgmap v247: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:41.107 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:18:41.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 -- 172.21.15.69:0/2522992582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 msgr2=0x7fe1240ff470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 --2- 172.21.15.69:0/2522992582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 0x7fe1240ff470 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe118009990 tx=0x7fe118009ca0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 -- 172.21.15.69:0/2522992582 shutdown_connections 2023-12-14T14:18:41.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 --2- 172.21.15.69:0/2522992582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12410a880 0x7fe12410cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 --2- 172.21.15.69:0/2522992582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 0x7fe1240ff470 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 --2- 172.21.15.69:0/2522992582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1240ff9b0 0x7fe1240ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 -- 172.21.15.69:0/2522992582 >> 172.21.15.69:0/2522992582 conn(0x7fe124074a60 msgr2=0x7fe124074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 -- 172.21.15.69:0/2522992582 shutdown_connections 2023-12-14T14:18:41.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 -- 172.21.15.69:0/2522992582 wait complete. 2023-12-14T14:18:41.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 Processor -- start 2023-12-14T14:18:41.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.246+0000 7fe12ad11700 1 -- start start 2023-12-14T14:18:41.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe12ad11700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 0x7fe124196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe12ad11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1240ff9b0 0x7fe124196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe12ad11700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe12410a880 0x7fe12419aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe12ad11700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12419b2e0 con 0x7fe1240760f0 2023-12-14T14:18:41.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe12ad11700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12419b450 con 0x7fe1240ff9b0 2023-12-14T14:18:41.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe12ad11700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12419b610 con 0x7fe12410a880 2023-12-14T14:18:41.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe128aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 0x7fe124196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe128aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 0x7fe124196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46762/0 (socket says 172.21.15.69:46762) 2023-12-14T14:18:41.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe128aad700 1 -- 172.21.15.69:0/3282539435 learned_addr learned my addr 172.21.15.69:0/3282539435 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe123fff700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1240ff9b0 0x7fe124196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe1292ae700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe12410a880 0x7fe12419aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe128aad700 1 -- 172.21.15.69:0/3282539435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe12410a880 msgr2=0x7fe12419aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe128aad700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe12410a880 0x7fe12419aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe128aad700 1 -- 172.21.15.69:0/3282539435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1240ff9b0 msgr2=0x7fe124196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe128aad700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1240ff9b0 0x7fe124196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe128aad700 1 -- 172.21.15.69:0/3282539435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1180095f0 con 0x7fe1240760f0 2023-12-14T14:18:41.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe123fff700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1240ff9b0 0x7fe124196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:41.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe1292ae700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe12410a880 0x7fe12419aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:41.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe128aad700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 0x7fe124196300 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe1180098e0 tx=0x7fe11800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe121ffb700 1 -- 172.21.15.69:0/3282539435 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11801d070 con 0x7fe1240760f0 2023-12-14T14:18:41.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe121ffb700 1 -- 172.21.15.69:0/3282539435 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe118005510 con 0x7fe1240760f0 2023-12-14T14:18:41.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe12ad11700 1 -- 172.21.15.69:0/3282539435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe124110270 con 0x7fe1240760f0 2023-12-14T14:18:41.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.247+0000 7fe121ffb700 1 -- 172.21.15.69:0/3282539435 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118004c90 con 0x7fe1240760f0 2023-12-14T14:18:41.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.248+0000 7fe12ad11700 1 -- 172.21.15.69:0/3282539435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1241100e0 con 0x7fe1240760f0 2023-12-14T14:18:41.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.249+0000 7fe121ffb700 1 -- 172.21.15.69:0/3282539435 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe11800fc10 con 0x7fe1240760f0 2023-12-14T14:18:41.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.250+0000 7fe121ffb700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe1140a13c0 0x7fe1140a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.250+0000 7fe121ffb700 1 -- 172.21.15.69:0/3282539435 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fe1180cdb50 con 0x7fe1240760f0 2023-12-14T14:18:41.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.250+0000 7fe123fff700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe1140a13c0 0x7fe1140a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.251+0000 7fe123fff700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe1140a13c0 0x7fe1140a3870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe110005950 tx=0x7fe1100058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.251+0000 7fe136e9fb80 1 Processor -- start 2023-12-14T14:18:41.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.251+0000 7fe136e9fb80 1 -- start start 2023-12-14T14:18:41.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.251+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x5630523f5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.251+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5c90 0x563052400610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.251+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x563052402f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.251+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630522df5e0 con 0x5630523f5380 2023-12-14T14:18:41.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.251+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305234e870 con 0x5630523f5c90 2023-12-14T14:18:41.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563052347d00 con 0x563052400b50 2023-12-14T14:18:41.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe128aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x5630523f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe128aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x5630523f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46766/0 (socket says 172.21.15.69:46766) 2023-12-14T14:18:41.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe128aad700 1 -- 172.21.15.69:0/2353368612 learned_addr learned my addr 172.21.15.69:0/2353368612 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe1292ae700 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x563052402f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe123fff700 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5c90 0x563052400610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe128aad700 1 -- 172.21.15.69:0/2353368612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 msgr2=0x563052402f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe128aad700 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x563052402f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe128aad700 1 -- 172.21.15.69:0/2353368612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5c90 msgr2=0x563052400610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe128aad700 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5c90 0x563052400610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe128aad700 1 -- 172.21.15.69:0/2353368612 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630521c93b0 con 0x5630523f5380 2023-12-14T14:18:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe123fff700 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5c90 0x563052400610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe1292ae700 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x563052402f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe128aad700 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x5630523f5750 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe1180976d0 tx=0x7fe11809a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f8ba006b1772a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe10effd700 1 -- 172.21.15.69:0/2353368612 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11809ec90 con 0x5630523f5380 2023-12-14T14:18:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe10effd700 1 -- 172.21.15.69:0/2353368612 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1180a3020 con 0x5630523f5380 2023-12-14T14:18:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.252+0000 7fe10effd700 1 -- 172.21.15.69:0/2353368612 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11809a3b0 con 0x5630523f5380 2023-12-14T14:18:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2353368612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 msgr2=0x5630523f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x5630523f5750 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe1180976d0 tx=0x7fe11809a5c0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2353368612 shutdown_connections 2023-12-14T14:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x563052402f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x5630523f5750 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/2353368612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5c90 0x563052400610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2353368612 >> 172.21.15.69:0/2353368612 conn(0x5630523ebca0 msgr2=0x5630523f17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2353368612 shutdown_connections 2023-12-14T14:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2353368612 wait complete. 2023-12-14T14:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 -- start start 2023-12-14T14:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.253+0000 7fe136e9fb80 1 Processor -- start 2023-12-14T14:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 0x563052400f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x563052401460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x5630524019a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630522e3f90 con 0x5630523f5c90 2023-12-14T14:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630522e3c30 con 0x5630523f5380 2023-12-14T14:18:41.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630521cb6a0 con 0x563052400b50 2023-12-14T14:18:41.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe136e9fb80 10 client.0 _ll_register_callbacks cb 0x563052307910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:41.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe123fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x563052401460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe123fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x563052401460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46782/0 (socket says 172.21.15.69:46782) 2023-12-14T14:18:41.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe123fff700 1 -- 172.21.15.69:0/922235657 learned_addr learned my addr 172.21.15.69:0/922235657 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe1292ae700 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x5630524019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe128aad700 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 0x563052400f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe123fff700 1 -- 172.21.15.69:0/922235657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 msgr2=0x5630524019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe123fff700 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x5630524019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe123fff700 1 -- 172.21.15.69:0/922235657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 msgr2=0x563052400f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe123fff700 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 0x563052400f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe123fff700 1 -- 172.21.15.69:0/922235657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1241100e0 con 0x5630523f5c90 2023-12-14T14:18:41.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe123fff700 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x563052401460 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe11000fe30 tx=0x7fe110004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55906a2da2155804 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.254+0000 7fe103fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:41.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe103fff700 1 -- 172.21.15.69:0/922235657 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110017040 con 0x5630523f5c90 2023-12-14T14:18:41.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe103fff700 1 -- 172.21.15.69:0/922235657 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fe11000fe60 con 0x5630523f5c90 2023-12-14T14:18:41.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe136e9fb80 1 -- 172.21.15.69:0/922235657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630523e92b0 con 0x5630523f5c90 2023-12-14T14:18:41.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe103fff700 1 -- 172.21.15.69:0/922235657 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe110003880 con 0x5630523f5c90 2023-12-14T14:18:41.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe136e9fb80 10 client.16509 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:41.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe136e9fb80 1 -- 172.21.15.69:0/922235657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56305230e170 con 0x5630523f5c90 2023-12-14T14:18:41.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe103fff700 1 -- 172.21.15.69:0/922235657 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5630523e92b0 con 0x5630523f5c90 2023-12-14T14:18:41.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe103fff700 1 -- 172.21.15.69:0/922235657 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe110011a90 con 0x5630523f5c90 2023-12-14T14:18:41.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe136e9fb80 10 client.16509 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:41.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe136e9fb80 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:41.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe136e9fb80 20 client.16509 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563052410110 0x563052412520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe136e9fb80 4 client.16509 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.255+0000 7fe136e9fb80 1 -- 172.21.15.69:0/922235657 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563052340ce0 con 0x563052410110 2023-12-14T14:18:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.256+0000 7fe128aad700 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563052410110 0x563052412520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.256+0000 7fe103fff700 10 client.16509 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.256+0000 7fe128aad700 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563052410110 0x563052412520 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b2e09b1ea474e2c server_cookie=e514802d3587d11f in_seq=0 out_seq=0 2023-12-14T14:18:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe103fff700 1 -- 172.21.15.69:0/922235657 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563052340ce0 con 0x563052410110 2023-12-14T14:18:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe103fff700 10 client.16509 handle_command_reply: tid=0 2023-12-14T14:18:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 client.16509 shutdown 2023-12-14T14:18:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 -- 172.21.15.69:0/922235657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 msgr2=0x563052401460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x563052401460 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe11000fe30 tx=0x7fe110004750 comp rx=0 tx=0).stop 2023-12-14T14:18:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 -- 172.21.15.69:0/922235657 shutdown_connections 2023-12-14T14:18:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563052410110 0x563052412520 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x5630524019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 0x563052400f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe103fff700 0 client.16509 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/922235657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x563052401460 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 -- 172.21.15.69:0/922235657 >> 172.21.15.69:0/922235657 conn(0x5630523ebca0 msgr2=0x5630523f13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 -- 172.21.15.69:0/922235657 shutdown_connections 2023-12-14T14:18:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 1 -- 172.21.15.69:0/922235657 wait complete. 2023-12-14T14:18:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.257+0000 7fe136e9fb80 20 client.16509 trim_cache size 0 max 16384 2023-12-14T14:18:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe136e9fb80 1 Processor -- start 2023-12-14T14:18:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe136e9fb80 1 -- start start 2023-12-14T14:18:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 0x563052404f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x5630523fa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x5630523f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563052340ce0 con 0x5630523f5c90 2023-12-14T14:18:41.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630523f65b0 con 0x5630523f5380 2023-12-14T14:18:41.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630523fe0d0 con 0x563052400b50 2023-12-14T14:18:41.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe123fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x5630523fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe123fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x5630523fa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46788/0 (socket says 172.21.15.69:46788) 2023-12-14T14:18:41.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe123fff700 1 -- 172.21.15.69:0/2925833192 learned_addr learned my addr 172.21.15.69:0/2925833192 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe128aad700 1 --2- 172.21.15.69:0/2925833192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 0x563052404f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe1292ae700 1 --2- 172.21.15.69:0/2925833192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x5630523f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe123fff700 1 -- 172.21.15.69:0/2925833192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 msgr2=0x5630523f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe123fff700 1 --2- 172.21.15.69:0/2925833192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x5630523f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe123fff700 1 -- 172.21.15.69:0/2925833192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 msgr2=0x563052404f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe123fff700 1 --2- 172.21.15.69:0/2925833192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 0x563052404f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe123fff700 1 -- 172.21.15.69:0/2925833192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630524004a0 con 0x5630523f5c90 2023-12-14T14:18:41.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.274+0000 7fe123fff700 1 --2- 172.21.15.69:0/2925833192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x5630523fa320 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe11002c040 tx=0x7fe11000ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551894582d0588f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe10f7fe700 1 -- 172.21.15.69:0/2925833192 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000fe60 con 0x5630523f5c90 2023-12-14T14:18:41.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe10f7fe700 1 -- 172.21.15.69:0/2925833192 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe11001fcd0 con 0x5630523f5c90 2023-12-14T14:18:41.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe10f7fe700 1 -- 172.21.15.69:0/2925833192 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110011980 con 0x5630523f5c90 2023-12-14T14:18:41.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2925833192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 msgr2=0x5630523fa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/2925833192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x5630523fa320 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe11002c040 tx=0x7fe11000ba90 comp rx=0 tx=0).stop 2023-12-14T14:18:41.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2925833192 shutdown_connections 2023-12-14T14:18:41.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/2925833192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563052400b50 0x5630523f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/2925833192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630523f5380 0x563052404f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/2925833192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5c90 0x5630523fa320 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2925833192 >> 172.21.15.69:0/2925833192 conn(0x5630523ebca0 msgr2=0x5630523ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2925833192 shutdown_connections 2023-12-14T14:18:41.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.275+0000 7fe136e9fb80 1 -- 172.21.15.69:0/2925833192 wait complete. 2023-12-14T14:18:41.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe136e9fb80 1 -- start start 2023-12-14T14:18:41.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe136e9fb80 1 Processor -- start 2023-12-14T14:18:41.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x563052458150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630523f5c90 0x563052458690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe136e9fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563052400b50 0x56305245c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305245c6a0 con 0x5630523f5380 2023-12-14T14:18:41.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305245c810 con 0x563052400b50 2023-12-14T14:18:41.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe136e9fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305245c9d0 con 0x5630523f5c90 2023-12-14T14:18:41.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe136e9fb80 10 client.0 _ll_register_callbacks cb 0x7fe11000be60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:41.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe128aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x563052458150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe128aad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x563052458150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46796/0 (socket says 172.21.15.69:46796) 2023-12-14T14:18:41.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe128aad700 1 -- 172.21.15.69:0/3667174563 learned_addr learned my addr 172.21.15.69:0/3667174563 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe123fff700 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630523f5c90 0x563052458690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe1292ae700 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563052400b50 0x56305245c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe128aad700 1 -- 172.21.15.69:0/3667174563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630523f5c90 msgr2=0x563052458690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe128aad700 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630523f5c90 0x563052458690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe128aad700 1 -- 172.21.15.69:0/3667174563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563052400b50 msgr2=0x56305245c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe128aad700 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563052400b50 0x56305245c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe128aad700 1 -- 172.21.15.69:0/3667174563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56305230e170 con 0x5630523f5380 2023-12-14T14:18:41.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.276+0000 7fe1292ae700 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563052400b50 0x56305245c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:41.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe128aad700 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x563052458150 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe11809ee50 tx=0x7fe11809ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea871e326f8654cd server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe103fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:41.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe103fff700 1 -- 172.21.15.69:0/3667174563 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1180b3130 con 0x5630523f5380 2023-12-14T14:18:41.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe103fff700 1 -- 172.21.15.69:0/3667174563 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fe1180b3290 con 0x5630523f5380 2023-12-14T14:18:41.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe136e9fb80 1 -- 172.21.15.69:0/3667174563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1180a3020 con 0x5630523f5380 2023-12-14T14:18:41.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe103fff700 1 -- 172.21.15.69:0/3667174563 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe11809a150 con 0x5630523f5380 2023-12-14T14:18:41.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe136e9fb80 10 client.16515 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:41.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe136e9fb80 1 -- 172.21.15.69:0/3667174563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x563052175b60 con 0x5630523f5380 2023-12-14T14:18:41.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe103fff700 1 -- 172.21.15.69:0/3667174563 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1180a3020 con 0x5630523f5380 2023-12-14T14:18:41.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe103fff700 1 -- 172.21.15.69:0/3667174563 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe1180840d0 con 0x5630523f5380 2023-12-14T14:18:41.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe136e9fb80 10 client.16515 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:41.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe136e9fb80 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:41.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe136e9fb80 20 client.16515 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:41.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563052464fa0 0x563052467380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe136e9fb80 4 client.16515 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:18:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.277+0000 7fe136e9fb80 1 -- 172.21.15.69:0/3667174563 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563052340a00 con 0x563052464fa0 2023-12-14T14:18:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe123fff700 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563052464fa0 0x563052467380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe103fff700 10 client.16515 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe123fff700 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563052464fa0 0x563052467380 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c49e6bcfe71d57d server_cookie=29c39184a5ff8bf0 in_seq=0 out_seq=0 2023-12-14T14:18:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe103fff700 1 -- 172.21.15.69:0/3667174563 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563052340a00 con 0x563052464fa0 2023-12-14T14:18:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe103fff700 10 client.16515 handle_command_reply: tid=0 2023-12-14T14:18:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 client.16515 shutdown 2023-12-14T14:18:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 -- 172.21.15.69:0/3667174563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 msgr2=0x563052458150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x563052458150 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe11809ee50 tx=0x7fe11809ade0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 -- 172.21.15.69:0/3667174563 shutdown_connections 2023-12-14T14:18:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x563052464fa0 0x563052467380 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563052400b50 0x56305245c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630523f5380 0x563052458150 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe103fff700 0 client.16515 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 --2- 172.21.15.69:0/3667174563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630523f5c90 0x563052458690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 -- 172.21.15.69:0/3667174563 >> 172.21.15.69:0/3667174563 conn(0x5630523ebca0 msgr2=0x5630523faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 -- 172.21.15.69:0/3667174563 shutdown_connections 2023-12-14T14:18:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 1 -- 172.21.15.69:0/3667174563 wait complete. 2023-12-14T14:18:41.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.278+0000 7fe136e9fb80 20 client.16515 trim_cache size 0 max 16384 2023-12-14T14:18:41.289 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:18:41.289 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:18:41.289 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:18:41.289 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:18:41.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 -- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe1140a13c0 msgr2=0x7fe1140a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe1140a13c0 0x7fe1140a3870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe110005950 tx=0x7fe1100058e0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 -- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 msgr2=0x7fe124196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 0x7fe124196300 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe1180098e0 tx=0x7fe11800f720 comp rx=0 tx=0).stop 2023-12-14T14:18:41.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 -- 172.21.15.69:0/3282539435 shutdown_connections 2023-12-14T14:18:41.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fe1140a13c0 0x7fe1140a3870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe12410a880 0x7fe12419aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1240760f0 0x7fe124196300 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 --2- 172.21.15.69:0/3282539435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1240ff9b0 0x7fe124196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 -- 172.21.15.69:0/3282539435 >> 172.21.15.69:0/3282539435 conn(0x7fe124074a60 msgr2=0x7fe124102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 -- 172.21.15.69:0/3282539435 shutdown_connections 2023-12-14T14:18:41.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.279+0000 7fe12ad11700 1 -- 172.21.15.69:0/3282539435 wait complete. 2023-12-14T14:18:41.292 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:18:41.293 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:18:41.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.416+0000 7f04f61dd700 1 -- 172.21.15.69:0/3434898894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 msgr2=0x7f04f010cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.416+0000 7f04f61dd700 1 --2- 172.21.15.69:0/3434898894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 0x7f04f010cc50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f04e800b0a0 tx=0x7f04e800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.416+0000 7f04f61dd700 1 -- 172.21.15.69:0/3434898894 shutdown_connections 2023-12-14T14:18:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.416+0000 7f04f61dd700 1 --2- 172.21.15.69:0/3434898894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 0x7f04f010cc50 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.416+0000 7f04f61dd700 1 --2- 172.21.15.69:0/3434898894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04f0101440 0x7f04f0101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.416+0000 7f04f61dd700 1 --2- 172.21.15.69:0/3434898894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f0101d50 0x7f04f010a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.416+0000 7f04f61dd700 1 -- 172.21.15.69:0/3434898894 >> 172.21.15.69:0/3434898894 conn(0x7f04f00761f0 msgr2=0x7f04f00765f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.416+0000 7f04f61dd700 1 -- 172.21.15.69:0/3434898894 shutdown_connections 2023-12-14T14:18:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.416+0000 7f04f61dd700 1 -- 172.21.15.69:0/3434898894 wait complete. 2023-12-14T14:18:41.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.417+0000 7f04f61dd700 1 Processor -- start 2023-12-14T14:18:41.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.417+0000 7f04f61dd700 1 -- start start 2023-12-14T14:18:41.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.417+0000 7f04f61dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f0101440 0x7f04f0196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.417+0000 7f04f61dd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04f0101d50 0x7f04f01969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.417+0000 7f04f61dd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 0x7f04f019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.417+0000 7f04f61dd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f019b440 con 0x7f04f010a810 2023-12-14T14:18:41.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.417+0000 7f04f61dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f019b5b0 con 0x7f04f0101440 2023-12-14T14:18:41.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.417+0000 7f04f61dd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f019b770 con 0x7f04f0101d50 2023-12-14T14:18:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04effff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 0x7f04f019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04effff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 0x7f04f019ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46820/0 (socket says 172.21.15.69:46820) 2023-12-14T14:18:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04effff700 1 -- 172.21.15.69:0/1043273321 learned_addr learned my addr 172.21.15.69:0/1043273321 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04eeffd700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04f0101d50 0x7f04f01969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04ef7fe700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f0101440 0x7f04f0196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04effff700 1 -- 172.21.15.69:0/1043273321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04f0101d50 msgr2=0x7f04f01969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04effff700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04f0101d50 0x7f04f01969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04effff700 1 -- 172.21.15.69:0/1043273321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f0101440 msgr2=0x7f04f0196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04effff700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f0101440 0x7f04f0196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04effff700 1 -- 172.21.15.69:0/1043273321 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8009d00 con 0x7f04f010a810 2023-12-14T14:18:41.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04effff700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 0x7f04f019ae00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f04e800b830 tx=0x7f04e80079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04ecff9700 1 -- 172.21.15.69:0/1043273321 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800e040 con 0x7f04f010a810 2023-12-14T14:18:41.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04ecff9700 1 -- 172.21.15.69:0/1043273321 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04e8004ce0 con 0x7f04f010a810 2023-12-14T14:18:41.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f0110270 con 0x7f04f010a810 2023-12-14T14:18:41.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04ecff9700 1 -- 172.21.15.69:0/1043273321 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e801d480 con 0x7f04f010a810 2023-12-14T14:18:41.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.418+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f01100e0 con 0x7f04f010a810 2023-12-14T14:18:41.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.419+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f0110400 con 0x7f04f010a810 2023-12-14T14:18:41.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.420+0000 7f04ecff9700 1 -- 172.21.15.69:0/1043273321 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f04e8004000 con 0x7f04f010a810 2023-12-14T14:18:41.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.421+0000 7f04ecff9700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f04d80a12c0 0x7f04d80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.421+0000 7f04ecff9700 1 -- 172.21.15.69:0/1043273321 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f04e80cee60 con 0x7f04f010a810 2023-12-14T14:18:41.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.421+0000 7f04ef7fe700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f04d80a12c0 0x7f04d80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.421+0000 7f04ef7fe700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f04d80a12c0 0x7f04d80a3770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04e0005950 tx=0x7f04e000b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.424+0000 7f04ecff9700 1 -- 172.21.15.69:0/1043273321 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f04e8098310 con 0x7f04f010a810 2023-12-14T14:18:41.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.657+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04f01050a0 con 0x7f04f010a810 2023-12-14T14:18:41.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.658+0000 7f04ecff9700 1 -- 172.21.15.69:0/1043273321 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10810 (secure 0 0 0) 0x7f04e809b930 con 0x7f04f010a810 2023-12-14T14:18:41.657 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:18:41.658 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:14:13.438363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:18:41.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f04d80a12c0 msgr2=0x7f04d80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f04d80a12c0 0x7f04d80a3770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04e0005950 tx=0x7f04e000b410 comp rx=0 tx=0).stop 2023-12-14T14:18:41.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 msgr2=0x7f04f019ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 0x7f04f019ae00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f04e800b830 tx=0x7f04e80079b0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 shutdown_connections 2023-12-14T14:18:41.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f04d80a12c0 0x7f04d80a3770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04f010a810 0x7f04f019ae00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f0101440 0x7f04f0196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 --2- 172.21.15.69:0/1043273321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04f0101d50 0x7f04f01969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 >> 172.21.15.69:0/1043273321 conn(0x7f04f00761f0 msgr2=0x7f04f01021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 shutdown_connections 2023-12-14T14:18:41.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.660+0000 7f04f61dd700 1 -- 172.21.15.69:0/1043273321 wait complete. 2023-12-14T14:18:41.661 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-12-14T14:18:41.672 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:18:41.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:41 smithi119 ceph-mon[43834]: pgmap v248: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:18:41.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 -- 172.21.15.69:0/2215875868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8100540 msgr2=0x7f42c8100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 --2- 172.21.15.69:0/2215875868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8100540 0x7f42c8100910 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009990 tx=0x7f42bc009ca0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 -- 172.21.15.69:0/2215875868 shutdown_connections 2023-12-14T14:18:41.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 --2- 172.21.15.69:0/2215875868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c8109af0 0x7f42c810bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 --2- 172.21.15.69:0/2215875868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8100540 0x7f42c8100910 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 --2- 172.21.15.69:0/2215875868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42c8100e50 0x7f42c81095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 -- 172.21.15.69:0/2215875868 >> 172.21.15.69:0/2215875868 conn(0x7f42c80749c0 msgr2=0x7f42c8074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 -- 172.21.15.69:0/2215875868 shutdown_connections 2023-12-14T14:18:41.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 -- 172.21.15.69:0/2215875868 wait complete. 2023-12-14T14:18:41.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 Processor -- start 2023-12-14T14:18:41.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.797+0000 7f42cf21f700 1 -- start start 2023-12-14T14:18:41.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cf21f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c8100540 0x7f42c81951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cf21f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42c8100e50 0x7f42c8195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cf21f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8109af0 0x7f42c8199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cf21f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c819a1b0 con 0x7f42c8109af0 2023-12-14T14:18:41.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cf21f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c819a320 con 0x7f42c8100e50 2023-12-14T14:18:41.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cf21f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c819a4e0 con 0x7f42c8100540 2023-12-14T14:18:41.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cd7bc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8109af0 0x7f42c8199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cd7bc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8109af0 0x7f42c8199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46842/0 (socket says 172.21.15.69:46842) 2023-12-14T14:18:41.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cd7bc700 1 -- 172.21.15.69:0/4069699843 learned_addr learned my addr 172.21.15.69:0/4069699843 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c8100540 0x7f42c81951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42c7fff700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42c8100e50 0x7f42c8195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cd7bc700 1 -- 172.21.15.69:0/4069699843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c8100540 msgr2=0x7f42c81951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c8100540 0x7f42c81951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cd7bc700 1 -- 172.21.15.69:0/4069699843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42c8100e50 msgr2=0x7f42c8195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42c8100e50 0x7f42c8195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cd7bc700 1 -- 172.21.15.69:0/4069699843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc0095f0 con 0x7f42c8109af0 2023-12-14T14:18:41.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8109af0 0x7f42c8199b70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009fd0 tx=0x7f42c000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42c5ffb700 1 -- 172.21.15.69:0/4069699843 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0018070 con 0x7f42c8109af0 2023-12-14T14:18:41.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42c5ffb700 1 -- 172.21.15.69:0/4069699843 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42c000f040 con 0x7f42c8109af0 2023-12-14T14:18:41.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42cf21f700 1 -- 172.21.15.69:0/4069699843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c810f1a0 con 0x7f42c8109af0 2023-12-14T14:18:41.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.798+0000 7f42c5ffb700 1 -- 172.21.15.69:0/4069699843 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000cdb0 con 0x7f42c8109af0 2023-12-14T14:18:41.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.799+0000 7f42cf21f700 1 -- 172.21.15.69:0/4069699843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c810f010 con 0x7f42c8109af0 2023-12-14T14:18:41.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.801+0000 7f42c5ffb700 1 -- 172.21.15.69:0/4069699843 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f42c0004ad0 con 0x7f42c8109af0 2023-12-14T14:18:41.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.801+0000 7f42c5ffb700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f42b80a12c0 0x7f42b80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.801+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f42b80a12c0 0x7f42b80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.802+0000 7f42c5ffb700 1 -- 172.21.15.69:0/4069699843 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f42c00cc820 con 0x7f42c8109af0 2023-12-14T14:18:41.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.802+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f42b80a12c0 0x7f42b80a3770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00b2e0 tx=0x7f42bc005fd0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.802+0000 7f42db3adb80 1 Processor -- start 2023-12-14T14:18:41.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.802+0000 7f42db3adb80 1 -- start start 2023-12-14T14:18:41.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458380 0x55fa1b458750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b463610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b463b50 0x55fa1b465f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42db3adb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b3425e0 con 0x55fa1b458c90 2023-12-14T14:18:41.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42db3adb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b3b1870 con 0x55fa1b458380 2023-12-14T14:18:41.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42db3adb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b3aad00 con 0x55fa1b463b50 2023-12-14T14:18:41.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42c7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b463610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42c7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b463610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46850/0 (socket says 172.21.15.69:46850) 2023-12-14T14:18:41.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42c7fff700 1 -- 172.21.15.69:0/2357663982 learned_addr learned my addr 172.21.15.69:0/2357663982 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b463b50 0x55fa1b465f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458380 0x55fa1b458750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42c7fff700 1 -- 172.21.15.69:0/2357663982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b463b50 msgr2=0x55fa1b465f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42c7fff700 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b463b50 0x55fa1b465f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42c7fff700 1 -- 172.21.15.69:0/2357663982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458380 msgr2=0x55fa1b458750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42c7fff700 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458380 0x55fa1b458750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42c7fff700 1 -- 172.21.15.69:0/2357663982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa1b22c3b0 con 0x55fa1b458c90 2023-12-14T14:18:41.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458380 0x55fa1b458750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:41.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42c7fff700 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b463610 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f42b4008c30 tx=0x7f42b4008f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c26e307496b37ab server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42b2ffd700 1 -- 172.21.15.69:0/2357663982 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400ee20 con 0x55fa1b458c90 2023-12-14T14:18:41.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42b2ffd700 1 -- 172.21.15.69:0/2357663982 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42b4004cf0 con 0x55fa1b458c90 2023-12-14T14:18:41.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.803+0000 7f42b2ffd700 1 -- 172.21.15.69:0/2357663982 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4010430 con 0x55fa1b458c90 2023-12-14T14:18:41.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 -- 172.21.15.69:0/2357663982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 msgr2=0x55fa1b463610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b463610 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f42b4008c30 tx=0x7f42b4008f40 comp rx=0 tx=0).stop 2023-12-14T14:18:41.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 -- 172.21.15.69:0/2357663982 shutdown_connections 2023-12-14T14:18:41.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b463b50 0x55fa1b465f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458380 0x55fa1b458750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2357663982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b463610 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 -- 172.21.15.69:0/2357663982 >> 172.21.15.69:0/2357663982 conn(0x55fa1b44eca0 msgr2=0x55fa1b4547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 -- 172.21.15.69:0/2357663982 shutdown_connections 2023-12-14T14:18:41.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 -- 172.21.15.69:0/2357663982 wait complete. 2023-12-14T14:18:41.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 -- start start 2023-12-14T14:18:41.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.804+0000 7f42db3adb80 1 Processor -- start 2023-12-14T14:18:41.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b4634e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b460870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b463b50 0x55fa1b460e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42db3adb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b346f90 con 0x55fa1b463b50 2023-12-14T14:18:41.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42db3adb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b346c30 con 0x55fa1b458c90 2023-12-14T14:18:41.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42db3adb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b22e6a0 con 0x55fa1b458380 2023-12-14T14:18:41.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42db3adb80 10 client.0 _ll_register_callbacks cb 0x55fa1b36a910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:41.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42cd7bc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b463b50 0x55fa1b460e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42cd7bc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b463b50 0x55fa1b460e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46864/0 (socket says 172.21.15.69:46864) 2023-12-14T14:18:41.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b460870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42cd7bc700 1 -- 172.21.15.69:0/1030618319 learned_addr learned my addr 172.21.15.69:0/1030618319 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b4634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42cd7bc700 1 -- 172.21.15.69:0/1030618319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 msgr2=0x55fa1b4634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b4634e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42cd7bc700 1 -- 172.21.15.69:0/1030618319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 msgr2=0x55fa1b460870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b460870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42cd7bc700 1 -- 172.21.15.69:0/1030618319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b4008890 con 0x55fa1b463b50 2023-12-14T14:18:41.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.805+0000 7f42c7fff700 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b460870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:18:41.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b463b50 0x55fa1b460e80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f42c00ca030 tx=0x7f42c0099a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136aff495d90bd51 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:41.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42a7fff700 1 -- 172.21.15.69:0/1030618319 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c00a1d50 con 0x55fa1b463b50 2023-12-14T14:18:41.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42a7fff700 1 -- 172.21.15.69:0/1030618319 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f42c0084040 con 0x55fa1b463b50 2023-12-14T14:18:41.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42db3adb80 1 -- 172.21.15.69:0/1030618319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa1b44c2b0 con 0x55fa1b463b50 2023-12-14T14:18:41.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42a7fff700 1 -- 172.21.15.69:0/1030618319 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42c00c5020 con 0x55fa1b463b50 2023-12-14T14:18:41.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42db3adb80 10 client.16533 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:41.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42db3adb80 1 -- 172.21.15.69:0/1030618319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55fa1b371170 con 0x55fa1b463b50 2023-12-14T14:18:41.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42a7fff700 1 -- 172.21.15.69:0/1030618319 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fa1b44c2b0 con 0x55fa1b463b50 2023-12-14T14:18:41.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42a7fff700 1 -- 172.21.15.69:0/1030618319 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f42c00988f0 con 0x55fa1b463b50 2023-12-14T14:18:41.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42db3adb80 10 client.16533 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:41.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42db3adb80 10 client.16533 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:18:41.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42db3adb80 20 client.16533 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:41.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42db3adb80 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55fa1b473550 0x55fa1b475960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42db3adb80 4 client.16533 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:41.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42db3adb80 1 -- 172.21.15.69:0/1030618319 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa1b3a3ce0 con 0x55fa1b473550 2023-12-14T14:18:41.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.806+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55fa1b473550 0x55fa1b475960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.807+0000 7f42a7fff700 10 client.16533 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:18:41.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.807+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55fa1b473550 0x55fa1b475960 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf5134c27b7c6e9 server_cookie=86bda7dd7fbb3448 in_seq=0 out_seq=0 2023-12-14T14:18:41.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.807+0000 7f42a7fff700 1 -- 172.21.15.69:0/1030618319 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fa1b3a3ce0 con 0x55fa1b473550 2023-12-14T14:18:41.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.807+0000 7f42a7fff700 10 client.16533 handle_command_reply: tid=0 2023-12-14T14:18:41.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.807+0000 7f42db3adb80 1 client.16533 shutdown 2023-12-14T14:18:41.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 -- 172.21.15.69:0/1030618319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b463b50 msgr2=0x55fa1b460e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b463b50 0x55fa1b460e80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f42c00ca030 tx=0x7f42c0099a10 comp rx=0 tx=0).stop 2023-12-14T14:18:41.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 -- 172.21.15.69:0/1030618319 shutdown_connections 2023-12-14T14:18:41.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55fa1b473550 0x55fa1b475960 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b463b50 0x55fa1b460e80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42a7fff700 0 client.16533 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:18:41.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b4634e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 --2- 172.21.15.69:0/1030618319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b460870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 -- 172.21.15.69:0/1030618319 >> 172.21.15.69:0/1030618319 conn(0x55fa1b44eca0 msgr2=0x55fa1b4543d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 -- 172.21.15.69:0/1030618319 shutdown_connections 2023-12-14T14:18:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 1 -- 172.21.15.69:0/1030618319 wait complete. 2023-12-14T14:18:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.808+0000 7f42db3adb80 20 client.16533 trim_cache size 0 max 16384 2023-12-14T14:18:41.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42db3adb80 1 Processor -- start 2023-12-14T14:18:41.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42db3adb80 1 -- start start 2023-12-14T14:18:41.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b44eca0 0x55fa1b46a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b45bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b45c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42db3adb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b3a3ce0 con 0x55fa1b458c90 2023-12-14T14:18:41.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42db3adb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b455520 con 0x55fa1b44eca0 2023-12-14T14:18:41.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42db3adb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b470bb0 con 0x55fa1b458380 2023-12-14T14:18:41.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42cd7bc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b45c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42cd7bc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b45c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46880/0 (socket says 172.21.15.69:46880) 2023-12-14T14:18:41.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42cd7bc700 1 -- 172.21.15.69:0/3171592600 learned_addr learned my addr 172.21.15.69:0/3171592600 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/3171592600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b44eca0 0x55fa1b46a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42c7fff700 1 --2- 172.21.15.69:0/3171592600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b45bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42cd7bc700 1 -- 172.21.15.69:0/3171592600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 msgr2=0x55fa1b45bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/3171592600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b45bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42cd7bc700 1 -- 172.21.15.69:0/3171592600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b44eca0 msgr2=0x55fa1b46a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/3171592600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b44eca0 0x55fa1b46a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42cd7bc700 1 -- 172.21.15.69:0/3171592600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa1b370ec0 con 0x55fa1b458c90 2023-12-14T14:18:41.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/3171592600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b45c090 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f42c0097ce0 tx=0x7f42c009db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f8e7d5e698fd1d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.821+0000 7f42b37fe700 1 -- 172.21.15.69:0/3171592600 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c00c5030 con 0x55fa1b458c90 2023-12-14T14:18:41.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42b37fe700 1 -- 172.21.15.69:0/3171592600 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42c00a1d50 con 0x55fa1b458c90 2023-12-14T14:18:41.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42b37fe700 1 -- 172.21.15.69:0/3171592600 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c00a18c0 con 0x55fa1b458c90 2023-12-14T14:18:41.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 -- 172.21.15.69:0/3171592600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 msgr2=0x55fa1b45c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 --2- 172.21.15.69:0/3171592600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b45c090 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f42c0097ce0 tx=0x7f42c009db40 comp rx=0 tx=0).stop 2023-12-14T14:18:41.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 -- 172.21.15.69:0/3171592600 shutdown_connections 2023-12-14T14:18:41.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 --2- 172.21.15.69:0/3171592600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b458c90 0x55fa1b45c090 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 --2- 172.21.15.69:0/3171592600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b44eca0 0x55fa1b46a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 --2- 172.21.15.69:0/3171592600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b45bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 -- 172.21.15.69:0/3171592600 >> 172.21.15.69:0/3171592600 conn(0x55fa1b466200 msgr2=0x55fa1b46f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 -- 172.21.15.69:0/3171592600 shutdown_connections 2023-12-14T14:18:41.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 -- 172.21.15.69:0/3171592600 wait complete. 2023-12-14T14:18:41.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.822+0000 7f42db3adb80 1 -- start start 2023-12-14T14:18:41.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42db3adb80 1 Processor -- start 2023-12-14T14:18:41.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b44eca0 0x55fa1b4bb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b4bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42db3adb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b4c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42db3adb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b4c09a0 con 0x55fa1b44eca0 2023-12-14T14:18:41.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42db3adb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b4c0b10 con 0x55fa1b458c90 2023-12-14T14:18:41.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42db3adb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1b4c0c80 con 0x55fa1b458380 2023-12-14T14:18:41.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42db3adb80 10 client.0 _ll_register_callbacks cb 0x7f42c00994d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:41.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42ccfbb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b44eca0 0x55fa1b4bb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42ccfbb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b44eca0 0x55fa1b4bb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46896/0 (socket says 172.21.15.69:46896) 2023-12-14T14:18:41.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42ccfbb700 1 -- 172.21.15.69:0/2373282721 learned_addr learned my addr 172.21.15.69:0/2373282721 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42c7fff700 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b4bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b4c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42ccfbb700 1 -- 172.21.15.69:0/2373282721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 msgr2=0x55fa1b4bbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b4bbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42ccfbb700 1 -- 172.21.15.69:0/2373282721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 msgr2=0x55fa1b4c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b4c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42ccfbb700 1 -- 172.21.15.69:0/2373282721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa1b371170 con 0x55fa1b44eca0 2023-12-14T14:18:41.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42c7fff700 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b4bbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:41.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.823+0000 7f42cd7bc700 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b4c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:41.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42ccfbb700 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b44eca0 0x55fa1b4bb590 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0098e0 tx=0x7f42bc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c703fc5a914c9e4a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:41.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42a7fff700 1 -- 172.21.15.69:0/2373282721 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc033d30 con 0x55fa1b44eca0 2023-12-14T14:18:41.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42a7fff700 1 -- 172.21.15.69:0/2373282721 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f42bc0052c0 con 0x55fa1b44eca0 2023-12-14T14:18:41.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42db3adb80 1 -- 172.21.15.69:0/2373282721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42b4004cf0 con 0x55fa1b44eca0 2023-12-14T14:18:41.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42a7fff700 1 -- 172.21.15.69:0/2373282721 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42bc033e90 con 0x55fa1b44eca0 2023-12-14T14:18:41.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42db3adb80 10 client.16539 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:41.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42db3adb80 1 -- 172.21.15.69:0/2373282721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55fa1b3579a0 con 0x55fa1b44eca0 2023-12-14T14:18:41.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42a7fff700 1 -- 172.21.15.69:0/2373282721 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42bc048020 con 0x55fa1b44eca0 2023-12-14T14:18:41.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42a7fff700 1 -- 172.21.15.69:0/2373282721 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f42bc00f460 con 0x55fa1b44eca0 2023-12-14T14:18:41.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42db3adb80 10 client.16539 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:41.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42db3adb80 10 client.16539 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:18:41.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42db3adb80 20 client.16539 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:41.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55fa1b463b50 0x55fa1b4ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42db3adb80 4 client.16539 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:18:41.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.824+0000 7f42db3adb80 1 -- 172.21.15.69:0/2373282721 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fa1b3a3a00 con 0x55fa1b463b50 2023-12-14T14:18:41.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42c7fff700 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55fa1b463b50 0x55fa1b4ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42a7fff700 10 client.16539 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:18:41.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42c7fff700 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55fa1b463b50 0x55fa1b4ca4a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e91555e9cb251337 server_cookie=2b3510baa4e6f507 in_seq=0 out_seq=0 2023-12-14T14:18:41.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42a7fff700 1 -- 172.21.15.69:0/2373282721 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fa1b3a3a00 con 0x55fa1b463b50 2023-12-14T14:18:41.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42a7fff700 10 client.16539 handle_command_reply: tid=0 2023-12-14T14:18:41.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 client.16539 shutdown 2023-12-14T14:18:41.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 -- 172.21.15.69:0/2373282721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b44eca0 msgr2=0x55fa1b4bb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b44eca0 0x55fa1b4bb590 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0098e0 tx=0x7f42bc009ca0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 -- 172.21.15.69:0/2373282721 shutdown_connections 2023-12-14T14:18:41.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa1b458c90 0x55fa1b4c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55fa1b463b50 0x55fa1b4ca4a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fa1b44eca0 0x55fa1b4bb590 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 --2- 172.21.15.69:0/2373282721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fa1b458380 0x55fa1b4bbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42a7fff700 0 client.16539 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:18:41.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 -- 172.21.15.69:0/2373282721 >> 172.21.15.69:0/2373282721 conn(0x55fa1b466200 msgr2=0x55fa1b45bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 -- 172.21.15.69:0/2373282721 shutdown_connections 2023-12-14T14:18:41.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 1 -- 172.21.15.69:0/2373282721 wait complete. 2023-12-14T14:18:41.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.825+0000 7f42db3adb80 20 client.16539 trim_cache size 0 max 16384 2023-12-14T14:18:41.839 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:18:41.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 -- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f42b80a12c0 msgr2=0x7f42b80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f42b80a12c0 0x7f42b80a3770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00b2e0 tx=0x7f42bc005fd0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 -- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8109af0 msgr2=0x7f42c8199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8109af0 0x7f42c8199b70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009fd0 tx=0x7f42c000ef90 comp rx=0 tx=0).stop 2023-12-14T14:18:41.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 -- 172.21.15.69:0/4069699843 shutdown_connections 2023-12-14T14:18:41.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f42b80a12c0 0x7f42b80a3770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8109af0 0x7f42c8199b70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c8100540 0x7f42c81951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 --2- 172.21.15.69:0/4069699843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42c8100e50 0x7f42c8195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 -- 172.21.15.69:0/4069699843 >> 172.21.15.69:0/4069699843 conn(0x7f42c80749c0 msgr2=0x7f42c80fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 -- 172.21.15.69:0/4069699843 shutdown_connections 2023-12-14T14:18:41.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.826+0000 7f42cf21f700 1 -- 172.21.15.69:0/4069699843 wait complete. 2023-12-14T14:18:41.842 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:41 smithi069 ceph-mon[42034]: pgmap v248: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:18:41.842 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:18:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:41 smithi081 ceph-mon[43371]: pgmap v248: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:18:41.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 -- 172.21.15.69:0/2044102677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18100c50 msgr2=0x7f6b18101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 --2- 172.21.15.69:0/2044102677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18100c50 0x7f6b18101020 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6b140099c0 tx=0x7f6b14009cd0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 -- 172.21.15.69:0/2044102677 shutdown_connections 2023-12-14T14:18:41.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 --2- 172.21.15.69:0/2044102677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b18105550 0x7f6b1810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 --2- 172.21.15.69:0/2044102677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18100c50 0x7f6b18101020 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 --2- 172.21.15.69:0/2044102677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b181015f0 0x7f6b18104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 -- 172.21.15.69:0/2044102677 >> 172.21.15.69:0/2044102677 conn(0x7f6b18077570 msgr2=0x7f6b18077970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 -- 172.21.15.69:0/2044102677 shutdown_connections 2023-12-14T14:18:41.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 -- 172.21.15.69:0/2044102677 wait complete. 2023-12-14T14:18:41.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.967+0000 7f6b1f808700 1 Processor -- start 2023-12-14T14:18:41.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1f808700 1 -- start start 2023-12-14T14:18:41.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1f808700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b18100c50 0x7f6b18196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1f808700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b181015f0 0x7f6b18196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1f808700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18105550 0x7f6b1819aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1f808700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1819b2e0 con 0x7f6b18105550 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1f808700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1819b450 con 0x7f6b181015f0 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1f808700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1819b610 con 0x7f6b18100c50 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1dda5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18105550 0x7f6b1819aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1dda5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18105550 0x7f6b1819aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46906/0 (socket says 172.21.15.69:46906) 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1dda5700 1 -- 172.21.15.69:0/640512155 learned_addr learned my addr 172.21.15.69:0/640512155 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b18100c50 0x7f6b18196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1cda3700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b181015f0 0x7f6b18196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1dda5700 1 -- 172.21.15.69:0/640512155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b18100c50 msgr2=0x7f6b18196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b18100c50 0x7f6b18196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1dda5700 1 -- 172.21.15.69:0/640512155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b181015f0 msgr2=0x7f6b18196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b181015f0 0x7f6b18196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1dda5700 1 -- 172.21.15.69:0/640512155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140095f0 con 0x7f6b18105550 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1cda3700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b181015f0 0x7f6b18196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18105550 0x7f6b1819aca0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6b10007d70 tx=0x7f6b1000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.968+0000 7f6b0a7fc700 1 -- 172.21.15.69:0/640512155 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000ad40 con 0x7f6b18105550 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.969+0000 7f6b0a7fc700 1 -- 172.21.15.69:0/640512155 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b100128e0 con 0x7f6b18105550 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.969+0000 7f6b1f808700 1 -- 172.21.15.69:0/640512155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b18110310 con 0x7f6b18105550 2023-12-14T14:18:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.969+0000 7f6b0a7fc700 1 -- 172.21.15.69:0/640512155 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100116b0 con 0x7f6b18105550 2023-12-14T14:18:41.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.969+0000 7f6b1f808700 1 -- 172.21.15.69:0/640512155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18110180 con 0x7f6b18105550 2023-12-14T14:18:41.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.971+0000 7f6b0a7fc700 1 -- 172.21.15.69:0/640512155 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6b10012420 con 0x7f6b18105550 2023-12-14T14:18:41.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.971+0000 7f6b0a7fc700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f6b040a1340 0x7f6b040a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.971+0000 7f6b0a7fc700 1 -- 172.21.15.69:0/640512155 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f6b100ccda0 con 0x7f6b18105550 2023-12-14T14:18:41.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.971+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f6b040a1340 0x7f6b040a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.972+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f6b040a1340 0x7f6b040a37f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b14006010 tx=0x7f6b14009f10 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.972+0000 7f6b2b996b80 1 Processor -- start 2023-12-14T14:18:41.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.972+0000 7f6b2b996b80 1 -- start start 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59380 0x56366fe59750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe64610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 0x56366fe66f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fd435e0 con 0x56366fe59380 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fdb2870 con 0x56366fe59c90 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fdabd00 con 0x56366fe64b50 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1d5a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59380 0x56366fe59750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1d5a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59380 0x56366fe59750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46914/0 (socket says 172.21.15.69:46914) 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1d5a4700 1 -- 172.21.15.69:0/734789100 learned_addr learned my addr 172.21.15.69:0/734789100 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 0x56366fe66f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1cda3700 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe64610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1d5a4700 1 -- 172.21.15.69:0/734789100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 msgr2=0x56366fe66f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 0x56366fe66f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1d5a4700 1 -- 172.21.15.69:0/734789100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 msgr2=0x56366fe64610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe64610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1d5a4700 1 -- 172.21.15.69:0/734789100 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56366fc2d3b0 con 0x56366fe59380 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1cda3700 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe64610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59380 0x56366fe59750 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6b140051b0 tx=0x7f6b14020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab92bb1a2e2b20b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b037fe700 1 -- 172.21.15.69:0/734789100 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140038c0 con 0x56366fe59380 2023-12-14T14:18:41.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b037fe700 1 -- 172.21.15.69:0/734789100 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b1401e040 con 0x56366fe59380 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.973+0000 7f6b037fe700 1 -- 172.21.15.69:0/734789100 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140048c0 con 0x56366fe59380 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 -- 172.21.15.69:0/734789100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59380 msgr2=0x56366fe59750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59380 0x56366fe59750 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6b140051b0 tx=0x7f6b14020000 comp rx=0 tx=0).stop 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 -- 172.21.15.69:0/734789100 shutdown_connections 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 0x56366fe66f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59380 0x56366fe59750 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/734789100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe64610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 -- 172.21.15.69:0/734789100 >> 172.21.15.69:0/734789100 conn(0x56366fe4fca0 msgr2=0x56366fe557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 -- 172.21.15.69:0/734789100 shutdown_connections 2023-12-14T14:18:41.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 -- 172.21.15.69:0/734789100 wait complete. 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.974+0000 7f6b2b996b80 1 -- start start 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b2b996b80 1 Processor -- start 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 0x56366fe644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe61760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe61ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fd47f90 con 0x56366fe64b50 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fd47c30 con 0x56366fe59c90 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fc2f6a0 con 0x56366fe59380 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b2b996b80 10 client.0 _ll_register_callbacks cb 0x56366fd6b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:41.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1dda5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe61ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1dda5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe61ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46924/0 (socket says 172.21.15.69:46924) 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1dda5700 1 -- 172.21.15.69:0/4070111095 learned_addr learned my addr 172.21.15.69:0/4070111095 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 0x56366fe644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1cda3700 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe61760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1dda5700 1 -- 172.21.15.69:0/4070111095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 msgr2=0x56366fe644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 0x56366fe644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1dda5700 1 -- 172.21.15.69:0/4070111095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 msgr2=0x56366fe61760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe61760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1dda5700 1 -- 172.21.15.69:0/4070111095 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1810d910 con 0x56366fe64b50 2023-12-14T14:18:41.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe61ce0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6b10096490 tx=0x7f6b10019310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ede707d7fde8728 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.975+0000 7f6b00ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b00ff9700 1 -- 172.21.15.69:0/4070111095 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100a23e0 con 0x56366fe64b50 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b00ff9700 1 -- 172.21.15.69:0/4070111095 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f6b1009a1f0 con 0x56366fe64b50 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b2b996b80 1 -- 172.21.15.69:0/4070111095 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56366fe4d2b0 con 0x56366fe64b50 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b00ff9700 1 -- 172.21.15.69:0/4070111095 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b1009a3b0 con 0x56366fe64b50 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b2b996b80 10 client.16551 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b2b996b80 1 -- 172.21.15.69:0/4070111095 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56366fd72170 con 0x56366fe64b50 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b00ff9700 1 -- 172.21.15.69:0/4070111095 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b100b8030 con 0x56366fe64b50 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b00ff9700 1 -- 172.21.15.69:0/4070111095 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6b10099510 con 0x56366fe64b50 2023-12-14T14:18:41.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b2b996b80 10 client.16551 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:41.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b2b996b80 10 client.16551 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:18:41.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b2b996b80 20 client.16551 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:41.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56366fe744a0 0x56366fe768b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b2b996b80 4 client.16551 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:41.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b2b996b80 1 -- 172.21.15.69:0/4070111095 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56366fda4ce0 con 0x56366fe744a0 2023-12-14T14:18:41.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.976+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56366fe744a0 0x56366fe768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.977+0000 7f6b00ff9700 10 client.16551 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:18:41.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.977+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56366fe744a0 0x56366fe768b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce3f047add85a09a server_cookie=f5dc30213e4adc83 in_seq=0 out_seq=0 2023-12-14T14:18:41.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.977+0000 7f6b00ff9700 1 -- 172.21.15.69:0/4070111095 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56366fda4ce0 con 0x56366fe744a0 2023-12-14T14:18:41.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b00ff9700 10 client.16551 handle_command_reply: tid=0 2023-12-14T14:18:41.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 client.16551 shutdown 2023-12-14T14:18:41.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 -- 172.21.15.69:0/4070111095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 msgr2=0x56366fe61ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe61ce0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6b10096490 tx=0x7f6b10019310 comp rx=0 tx=0).stop 2023-12-14T14:18:41.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 -- 172.21.15.69:0/4070111095 shutdown_connections 2023-12-14T14:18:41.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56366fe744a0 0x56366fe768b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe61ce0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 0x56366fe644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b00ff9700 0 client.16551 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:18:41.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/4070111095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe61760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 -- 172.21.15.69:0/4070111095 >> 172.21.15.69:0/4070111095 conn(0x56366fe4fca0 msgr2=0x56366fe553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 -- 172.21.15.69:0/4070111095 shutdown_connections 2023-12-14T14:18:41.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 1 -- 172.21.15.69:0/4070111095 wait complete. 2023-12-14T14:18:41.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.978+0000 7f6b2b996b80 20 client.16551 trim_cache size 0 max 16384 2023-12-14T14:18:41.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b2b996b80 1 Processor -- start 2023-12-14T14:18:41.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b2b996b80 1 -- start start 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59380 0x56366fe6b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59c90 0x56366fe63f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 0x56366fe644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fe5a5b0 con 0x56366fe59c90 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fe5fce0 con 0x56366fe59380 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fe5d5f0 con 0x56366fe64b50 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b1cda3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59c90 0x56366fe63f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b1cda3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59c90 0x56366fe63f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46930/0 (socket says 172.21.15.69:46930) 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b1cda3700 1 -- 172.21.15.69:0/1397071662 learned_addr learned my addr 172.21.15.69:0/1397071662 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:41.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.991+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/1397071662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59380 0x56366fe6b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/1397071662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 0x56366fe644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:41.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b1cda3700 1 -- 172.21.15.69:0/1397071662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 msgr2=0x56366fe644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b1cda3700 1 --2- 172.21.15.69:0/1397071662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 0x56366fe644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b1cda3700 1 -- 172.21.15.69:0/1397071662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59380 msgr2=0x56366fe6b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:41.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b1cda3700 1 --2- 172.21.15.69:0/1397071662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59380 0x56366fe6b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b1cda3700 1 -- 172.21.15.69:0/1397071662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56366fe514e0 con 0x56366fe59c90 2023-12-14T14:18:41.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b1cda3700 1 --2- 172.21.15.69:0/1397071662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59c90 0x56366fe63f70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6b181019c0 tx=0x7f6b0c00f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c1e06b67e3a6b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:41.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b03fff700 1 -- 172.21.15.69:0/1397071662 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c014070 con 0x56366fe59c90 2023-12-14T14:18:41.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b03fff700 1 -- 172.21.15.69:0/1397071662 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b0c00fd70 con 0x56366fe59c90 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b03fff700 1 -- 172.21.15.69:0/1397071662 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c005790 con 0x56366fe59c90 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b2b996b80 1 -- 172.21.15.69:0/1397071662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59c90 msgr2=0x56366fe63f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/1397071662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59c90 0x56366fe63f70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6b181019c0 tx=0x7f6b0c00f420 comp rx=0 tx=0).stop 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b2b996b80 1 -- 172.21.15.69:0/1397071662 shutdown_connections 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/1397071662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe64b50 0x56366fe644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/1397071662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59380 0x56366fe6b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/1397071662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe59c90 0x56366fe63f70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b2b996b80 1 -- 172.21.15.69:0/1397071662 >> 172.21.15.69:0/1397071662 conn(0x56366fe4fca0 msgr2=0x56366fe70740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b2b996b80 1 -- 172.21.15.69:0/1397071662 shutdown_connections 2023-12-14T14:18:41.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.992+0000 7f6b2b996b80 1 -- 172.21.15.69:0/1397071662 wait complete. 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b2b996b80 1 -- start start 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b2b996b80 1 Processor -- start 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 0x56366fe5f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe5da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b2b996b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe5df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fe5f650 con 0x56366fe64b50 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fe5f7c0 con 0x56366fe59c90 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b2b996b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366fe5e480 con 0x56366fe59380 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b2b996b80 10 client.0 _ll_register_callbacks cb 0x7f6b10099b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b1dda5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe5df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b1dda5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe5df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46942/0 (socket says 172.21.15.69:46942) 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.993+0000 7f6b1dda5700 1 -- 172.21.15.69:0/2111839747 learned_addr learned my addr 172.21.15.69:0/2111839747 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 0x56366fe5f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b1cda3700 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe5da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b1dda5700 1 -- 172.21.15.69:0/2111839747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 msgr2=0x56366fe5f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 0x56366fe5f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b1dda5700 1 -- 172.21.15.69:0/2111839747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 msgr2=0x56366fe5da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe5da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b1dda5700 1 -- 172.21.15.69:0/2111839747 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c00c9e0 con 0x56366fe64b50 2023-12-14T14:18:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b1dda5700 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe5df40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000a740 tx=0x7f6b10098540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb48966c27f882b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:42.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b00ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:42.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b00ff9700 1 -- 172.21.15.69:0/2111839747 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100a20a0 con 0x56366fe64b50 2023-12-14T14:18:42.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b00ff9700 1 -- 172.21.15.69:0/2111839747 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f6b10012a50 con 0x56366fe64b50 2023-12-14T14:18:42.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b2b996b80 1 -- 172.21.15.69:0/2111839747 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b1401e040 con 0x56366fe64b50 2023-12-14T14:18:42.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b00ff9700 1 -- 172.21.15.69:0/2111839747 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b10099d60 con 0x56366fe64b50 2023-12-14T14:18:42.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b2b996b80 10 client.16557 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:42.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b2b996b80 1 -- 172.21.15.69:0/2111839747 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56366fbd9b60 con 0x56366fe64b50 2023-12-14T14:18:42.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b00ff9700 1 -- 172.21.15.69:0/2111839747 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b1401e040 con 0x56366fe64b50 2023-12-14T14:18:42.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b00ff9700 1 -- 172.21.15.69:0/2111839747 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6b10094ba0 con 0x56366fe64b50 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b2b996b80 10 client.16557 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b2b996b80 10 client.16557 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b2b996b80 20 client.16557 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56366fecd550 0x56366fecf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b2b996b80 4 client.16557 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.994+0000 7f6b2b996b80 1 -- 172.21.15.69:0/2111839747 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56366fda4a00 con 0x56366fecd550 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56366fecd550 0x56366fecf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b00ff9700 10 client.16557 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b1d5a4700 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56366fecd550 0x56366fecf960 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7dc808783829e599 server_cookie=dda5f5f47ed8aa05 in_seq=0 out_seq=0 2023-12-14T14:18:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b00ff9700 1 -- 172.21.15.69:0/2111839747 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56366fda4a00 con 0x56366fecd550 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b00ff9700 10 client.16557 handle_command_reply: tid=0 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 client.16557 shutdown 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 -- 172.21.15.69:0/2111839747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 msgr2=0x56366fe5df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe5df40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000a740 tx=0x7f6b10098540 comp rx=0 tx=0).stop 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 -- 172.21.15.69:0/2111839747 shutdown_connections 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x56366fecd550 0x56366fecf960 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56366fe64b50 0x56366fe5df40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b00ff9700 0 client.16557 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56366fe59380 0x56366fe5f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 --2- 172.21.15.69:0/2111839747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56366fe59c90 0x56366fe5da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 -- 172.21.15.69:0/2111839747 >> 172.21.15.69:0/2111839747 conn(0x56366fe4fca0 msgr2=0x56366fe5cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:42.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.995+0000 7f6b2b996b80 1 -- 172.21.15.69:0/2111839747 shutdown_connections 2023-12-14T14:18:42.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b2b996b80 1 -- 172.21.15.69:0/2111839747 wait complete. 2023-12-14T14:18:42.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b2b996b80 20 client.16557 trim_cache size 0 max 16384 2023-12-14T14:18:42.004 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:18:42.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 -- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f6b040a1340 msgr2=0x7f6b040a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f6b040a1340 0x7f6b040a37f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b14006010 tx=0x7f6b14009f10 comp rx=0 tx=0).stop 2023-12-14T14:18:42.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 -- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18105550 msgr2=0x7f6b1819aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18105550 0x7f6b1819aca0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6b10007d70 tx=0x7f6b1000a340 comp rx=0 tx=0).stop 2023-12-14T14:18:42.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 -- 172.21.15.69:0/640512155 shutdown_connections 2023-12-14T14:18:42.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f6b040a1340 0x7f6b040a37f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b18105550 0x7f6b1819aca0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b18100c50 0x7f6b18196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 --2- 172.21.15.69:0/640512155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b181015f0 0x7f6b18196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 -- 172.21.15.69:0/640512155 >> 172.21.15.69:0/640512155 conn(0x7f6b18077570 msgr2=0x7f6b180fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:42.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 -- 172.21.15.69:0/640512155 shutdown_connections 2023-12-14T14:18:42.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:41.996+0000 7f6b1f808700 1 -- 172.21.15.69:0/640512155 wait complete. 2023-12-14T14:18:42.007 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:18:42.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 -- 172.21.15.69:0/82250334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46281043d0 msgr2=0x7f462810bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 --2- 172.21.15.69:0/82250334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46281043d0 0x7f462810bfa0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f462000b0d0 tx=0x7f462000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 -- 172.21.15.69:0/82250334 shutdown_connections 2023-12-14T14:18:42.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 --2- 172.21.15.69:0/82250334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46281043d0 0x7f462810bfa0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 --2- 172.21.15.69:0/82250334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46280ff390 0x7f46280ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 --2- 172.21.15.69:0/82250334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46280ffd30 0x7f4628103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 -- 172.21.15.69:0/82250334 >> 172.21.15.69:0/82250334 conn(0x7f4628075fd0 msgr2=0x7f46280763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:42.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 -- 172.21.15.69:0/82250334 shutdown_connections 2023-12-14T14:18:42.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 -- 172.21.15.69:0/82250334 wait complete. 2023-12-14T14:18:42.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 Processor -- start 2023-12-14T14:18:42.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.131+0000 7f4630395700 1 -- start start 2023-12-14T14:18:42.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f4630395700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46280ff390 0x7f4628196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f4630395700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46280ffd30 0x7f4628196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f4630395700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46281043d0 0x7f462819adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f4630395700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462819b400 con 0x7f46280ff390 2023-12-14T14:18:42.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f4630395700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462819b570 con 0x7f46281043d0 2023-12-14T14:18:42.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f4630395700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462819b730 con 0x7f46280ffd30 2023-12-14T14:18:42.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462e131700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46280ff390 0x7f4628196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462e131700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46280ff390 0x7f4628196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46974/0 (socket says 172.21.15.69:46974) 2023-12-14T14:18:42.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462e131700 1 -- 172.21.15.69:0/1216905708 learned_addr learned my addr 172.21.15.69:0/1216905708 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:42.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462d930700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46280ffd30 0x7f4628196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462e131700 1 -- 172.21.15.69:0/1216905708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46280ffd30 msgr2=0x7f4628196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462e131700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46280ffd30 0x7f4628196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462e131700 1 -- 172.21.15.69:0/1216905708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46281043d0 msgr2=0x7f462819adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462e131700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46281043d0 0x7f462819adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462e131700 1 -- 172.21.15.69:0/1216905708 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620009d00 con 0x7f46280ff390 2023-12-14T14:18:42.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462d930700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46280ffd30 0x7f4628196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:42.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f462e131700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46280ff390 0x7f4628196420 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f461800c9b0 tx=0x7f461800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:42.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f461f7fe700 1 -- 172.21.15.69:0/1216905708 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618007b00 con 0x7f46280ff390 2023-12-14T14:18:42.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f461f7fe700 1 -- 172.21.15.69:0/1216905708 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4618007c60 con 0x7f46280ff390 2023-12-14T14:18:42.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f4630395700 1 -- 172.21.15.69:0/1216905708 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462810f1a0 con 0x7f46280ff390 2023-12-14T14:18:42.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f461f7fe700 1 -- 172.21.15.69:0/1216905708 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618018660 con 0x7f46280ff390 2023-12-14T14:18:42.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.132+0000 7f4630395700 1 -- 172.21.15.69:0/1216905708 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462810f010 con 0x7f46280ff390 2023-12-14T14:18:42.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.135+0000 7f461f7fe700 1 -- 172.21.15.69:0/1216905708 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4618018880 con 0x7f46280ff390 2023-12-14T14:18:42.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.135+0000 7f461f7fe700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f46140a12c0 0x7f46140a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.136+0000 7f462d930700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f46140a12c0 0x7f46140a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.136+0000 7f461f7fe700 1 -- 172.21.15.69:0/1216905708 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f46180cce30 con 0x7f46280ff390 2023-12-14T14:18:42.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.136+0000 7f462d930700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f46140a12c0 0x7f46140a3770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4628197a30 tx=0x7f4624009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:42.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.136+0000 7f463c523b80 1 Processor -- start 2023-12-14T14:18:42.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.136+0000 7f463c523b80 1 -- start start 2023-12-14T14:18:42.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f463c523b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1525750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f463c523b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525c90 0x55edd1534a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f463c523b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 0x55edd1537340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f463c523b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd140f5e0 con 0x55edd1525380 2023-12-14T14:18:42.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f463c523b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd147e870 con 0x55edd1525c90 2023-12-14T14:18:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f463c523b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd1477d00 con 0x55edd1534f60 2023-12-14T14:18:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e131700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1525750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e131700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1525750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46988/0 (socket says 172.21.15.69:46988) 2023-12-14T14:18:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e131700 1 -- 172.21.15.69:0/1543703349 learned_addr learned my addr 172.21.15.69:0/1543703349 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e932700 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 0x55edd1537340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462d930700 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525c90 0x55edd1534a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e131700 1 -- 172.21.15.69:0/1543703349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 msgr2=0x55edd1537340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e131700 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 0x55edd1537340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e131700 1 -- 172.21.15.69:0/1543703349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525c90 msgr2=0x55edd1534a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e131700 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525c90 0x55edd1534a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e131700 1 -- 172.21.15.69:0/1543703349 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edd12f93b0 con 0x55edd1525380 2023-12-14T14:18:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462d930700 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525c90 0x55edd1534a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f462e131700 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1525750 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4618096920 tx=0x7f461801f300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ba15d3a8f62753 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f461cdac700 1 -- 172.21.15.69:0/1543703349 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46180a2300 con 0x55edd1525380 2023-12-14T14:18:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f461cdac700 1 -- 172.21.15.69:0/1543703349 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46180965c0 con 0x55edd1525380 2023-12-14T14:18:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.137+0000 7f461cdac700 1 -- 172.21.15.69:0/1543703349 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618099600 con 0x55edd1525380 2023-12-14T14:18:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 -- 172.21.15.69:0/1543703349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 msgr2=0x55edd1525750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1525750 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4618096920 tx=0x7f461801f300 comp rx=0 tx=0).stop 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 -- 172.21.15.69:0/1543703349 shutdown_connections 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 0x55edd1537340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1525750 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 --2- 172.21.15.69:0/1543703349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525c90 0x55edd1534a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 -- 172.21.15.69:0/1543703349 >> 172.21.15.69:0/1543703349 conn(0x55edd151bca0 msgr2=0x55edd15217e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 -- 172.21.15.69:0/1543703349 shutdown_connections 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 -- 172.21.15.69:0/1543703349 wait complete. 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 -- start start 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.138+0000 7f463c523b80 1 Processor -- start 2023-12-14T14:18:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f463c523b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525380 0x55edd1534990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f463c523b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1531c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f463c523b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 0x55edd1532380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f463c523b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd1413f90 con 0x55edd1525c90 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f463c523b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd1413c30 con 0x55edd1525380 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f463c523b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd12fb6a0 con 0x55edd1534f60 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f463c523b80 10 client.0 _ll_register_callbacks cb 0x55edd1437910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462d930700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1531c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462d930700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1531c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46994/0 (socket says 172.21.15.69:46994) 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462d930700 1 -- 172.21.15.69:0/1849122774 learned_addr learned my addr 172.21.15.69:0/1849122774 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462e131700 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525380 0x55edd1534990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462e932700 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 0x55edd1532380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462d930700 1 -- 172.21.15.69:0/1849122774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 msgr2=0x55edd1532380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462d930700 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 0x55edd1532380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462d930700 1 -- 172.21.15.69:0/1849122774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525380 msgr2=0x55edd1534990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462d930700 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525380 0x55edd1534990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462d930700 1 -- 172.21.15.69:0/1849122774 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462810f010 con 0x55edd1525c90 2023-12-14T14:18:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462e131700 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525380 0x55edd1534990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f462d930700 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1531c40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f462400fda0 tx=0x7f4624004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c235e1dfb8b0f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f4611ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:42.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f4611ffb700 1 -- 172.21.15.69:0/1849122774 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462401e620 con 0x55edd1525c90 2023-12-14T14:18:42.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f4611ffb700 1 -- 172.21.15.69:0/1849122774 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f462400fe80 con 0x55edd1525c90 2023-12-14T14:18:42.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.139+0000 7f463c523b80 1 -- 172.21.15.69:0/1849122774 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edd15192b0 con 0x55edd1525c90 2023-12-14T14:18:42.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f4611ffb700 1 -- 172.21.15.69:0/1849122774 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4624011e70 con 0x55edd1525c90 2023-12-14T14:18:42.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f463c523b80 10 client.16569 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:42.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f463c523b80 1 -- 172.21.15.69:0/1849122774 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55edd143e170 con 0x55edd1525c90 2023-12-14T14:18:42.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f4611ffb700 1 -- 172.21.15.69:0/1849122774 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55edd15192b0 con 0x55edd1525c90 2023-12-14T14:18:42.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f4611ffb700 1 -- 172.21.15.69:0/1849122774 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f462402d070 con 0x55edd1525c90 2023-12-14T14:18:42.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f463c523b80 10 client.16569 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f463c523b80 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f463c523b80 20 client.16569 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f463c523b80 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55edd15448d0 0x55edd1546ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f463c523b80 4 client.16569 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f463c523b80 1 -- 172.21.15.69:0/1849122774 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edd1470ce0 con 0x55edd15448d0 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.140+0000 7f462e131700 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55edd15448d0 0x55edd1546ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f4611ffb700 10 client.16569 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f462e131700 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55edd15448d0 0x55edd1546ce0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3bf424154347798 server_cookie=828927496ac2078a in_seq=0 out_seq=0 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f4611ffb700 1 -- 172.21.15.69:0/1849122774 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55edd1470ce0 con 0x55edd15448d0 2023-12-14T14:18:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f4611ffb700 10 client.16569 handle_command_reply: tid=0 2023-12-14T14:18:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 client.16569 shutdown 2023-12-14T14:18:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 -- 172.21.15.69:0/1849122774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 msgr2=0x55edd1531c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1531c40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f462400fda0 tx=0x7f4624004750 comp rx=0 tx=0).stop 2023-12-14T14:18:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 -- 172.21.15.69:0/1849122774 shutdown_connections 2023-12-14T14:18:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55edd15448d0 0x55edd1546ce0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1534f60 0x55edd1532380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f4611ffb700 0 client.16569 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd1525380 0x55edd1534990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 --2- 172.21.15.69:0/1849122774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1531c40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 -- 172.21.15.69:0/1849122774 >> 172.21.15.69:0/1849122774 conn(0x55edd151bca0 msgr2=0x55edd15213d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 -- 172.21.15.69:0/1849122774 shutdown_connections 2023-12-14T14:18:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 1 -- 172.21.15.69:0/1849122774 wait complete. 2023-12-14T14:18:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.141+0000 7f463c523b80 20 client.16569 trim_cache size 0 max 16384 2023-12-14T14:18:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.154+0000 7f463c523b80 1 Processor -- start 2023-12-14T14:18:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.154+0000 7f463c523b80 1 -- start start 2023-12-14T14:18:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.154+0000 7f463c523b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 0x55edd153baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.154+0000 7f463c523b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1540240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.154+0000 7f463c523b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525c90 0x55edd1534450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.154+0000 7f463c523b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd1532980 con 0x55edd1525380 2023-12-14T14:18:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.154+0000 7f463c523b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd1541fc0 con 0x55edd151bca0 2023-12-14T14:18:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.154+0000 7f463c523b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd1526d30 con 0x55edd1525c90 2023-12-14T14:18:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462d930700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1540240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462d930700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1540240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47004/0 (socket says 172.21.15.69:47004) 2023-12-14T14:18:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462d930700 1 -- 172.21.15.69:0/1965447837 learned_addr learned my addr 172.21.15.69:0/1965447837 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462e131700 1 --2- 172.21.15.69:0/1965447837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 0x55edd153baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462e932700 1 --2- 172.21.15.69:0/1965447837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525c90 0x55edd1534450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462d930700 1 -- 172.21.15.69:0/1965447837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525c90 msgr2=0x55edd1534450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462d930700 1 --2- 172.21.15.69:0/1965447837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525c90 0x55edd1534450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462d930700 1 -- 172.21.15.69:0/1965447837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 msgr2=0x55edd153baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462d930700 1 --2- 172.21.15.69:0/1965447837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 0x55edd153baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462d930700 1 -- 172.21.15.69:0/1965447837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edd143dec0 con 0x55edd1525380 2023-12-14T14:18:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f462d930700 1 --2- 172.21.15.69:0/1965447837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1540240 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4624014040 tx=0x7f4624005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bc01e8a9554c42 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f461d5ad700 1 -- 172.21.15.69:0/1965447837 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400fe80 con 0x55edd1525380 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f461d5ad700 1 -- 172.21.15.69:0/1965447837 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f462402f420 con 0x55edd1525380 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.155+0000 7f461d5ad700 1 -- 172.21.15.69:0/1965447837 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624037680 con 0x55edd1525380 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 -- 172.21.15.69:0/1965447837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 msgr2=0x55edd1540240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 --2- 172.21.15.69:0/1965447837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1540240 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4624014040 tx=0x7f4624005d60 comp rx=0 tx=0).stop 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 -- 172.21.15.69:0/1965447837 shutdown_connections 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 --2- 172.21.15.69:0/1965447837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525c90 0x55edd1534450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 --2- 172.21.15.69:0/1965447837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 0x55edd153baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 --2- 172.21.15.69:0/1965447837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525380 0x55edd1540240 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 -- 172.21.15.69:0/1965447837 >> 172.21.15.69:0/1965447837 conn(0x55edd1537610 msgr2=0x55edd1540cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 -- 172.21.15.69:0/1965447837 shutdown_connections 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 -- 172.21.15.69:0/1965447837 wait complete. 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 -- start start 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 Processor -- start 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 0x55edd153b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525380 0x55edd153bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1539be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd153a2f0 con 0x55edd1525c90 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd153a460 con 0x55edd151bca0 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd153a620 con 0x55edd1525380 2023-12-14T14:18:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f463c523b80 10 client.0 _ll_register_callbacks cb 0x7f462400f950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f462e932700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1539be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f462e932700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1539be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47020/0 (socket says 172.21.15.69:47020) 2023-12-14T14:18:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f462e131700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 0x55edd153b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f462e932700 1 -- 172.21.15.69:0/1240951186 learned_addr learned my addr 172.21.15.69:0/1240951186 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.156+0000 7f462d930700 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525380 0x55edd153bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f462e932700 1 -- 172.21.15.69:0/1240951186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525380 msgr2=0x55edd153bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f462e932700 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525380 0x55edd153bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f462e932700 1 -- 172.21.15.69:0/1240951186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 msgr2=0x55edd153b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f462e932700 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 0x55edd153b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f462e932700 1 -- 172.21.15.69:0/1240951186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edd143e170 con 0x55edd1525c90 2023-12-14T14:18:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f462e131700 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 0x55edd153b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:18:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f462e932700 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1539be0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f462000baa0 tx=0x7f462000bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec16a47dd4bf203 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f4611ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f4611ffb700 1 -- 172.21.15.69:0/1240951186 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000e040 con 0x55edd1525c90 2023-12-14T14:18:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f4611ffb700 1 -- 172.21.15.69:0/1240951186 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f46200076e0 con 0x55edd1525c90 2023-12-14T14:18:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f463c523b80 1 -- 172.21.15.69:0/1240951186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46180965c0 con 0x55edd1525c90 2023-12-14T14:18:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f4611ffb700 1 -- 172.21.15.69:0/1240951186 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4620009b80 con 0x55edd1525c90 2023-12-14T14:18:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f463c523b80 10 client.16575 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f463c523b80 1 -- 172.21.15.69:0/1240951186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55edd14249a0 con 0x55edd1525c90 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.157+0000 7f4611ffb700 1 -- 172.21.15.69:0/1240951186 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46180965c0 con 0x55edd1525c90 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f4611ffb700 1 -- 172.21.15.69:0/1240951186 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f462002c070 con 0x55edd1525c90 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 10 client.16575 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 20 client.16575 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55edd1534f60 0x55edd159bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 4 client.16575 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 1 -- 172.21.15.69:0/1240951186 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55edd1470a00 con 0x55edd1534f60 2023-12-14T14:18:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f462e131700 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55edd1534f60 0x55edd159bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f4611ffb700 10 client.16575 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f462e131700 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55edd1534f60 0x55edd159bb90 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52e5218ab6672ecf server_cookie=f6fb63a708ad12c0 in_seq=0 out_seq=0 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f4611ffb700 1 -- 172.21.15.69:0/1240951186 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55edd1470a00 con 0x55edd1534f60 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f4611ffb700 10 client.16575 handle_command_reply: tid=0 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 1 client.16575 shutdown 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 1 -- 172.21.15.69:0/1240951186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 msgr2=0x55edd1539be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1539be0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f462000baa0 tx=0x7f462000bad0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 1 -- 172.21.15.69:0/1240951186 shutdown_connections 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.158+0000 7f463c523b80 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55edd1534f60 0x55edd159bb90 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f463c523b80 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55edd1525c90 0x55edd1539be0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f463c523b80 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd151bca0 0x55edd153b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4611ffb700 0 client.16575 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:42.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f463c523b80 1 --2- 172.21.15.69:0/1240951186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55edd1525380 0x55edd153bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f463c523b80 1 -- 172.21.15.69:0/1240951186 >> 172.21.15.69:0/1240951186 conn(0x55edd1537610 msgr2=0x55edd1540cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:42.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f463c523b80 1 -- 172.21.15.69:0/1240951186 shutdown_connections 2023-12-14T14:18:42.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f463c523b80 1 -- 172.21.15.69:0/1240951186 wait complete. 2023-12-14T14:18:42.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f463c523b80 20 client.16575 trim_cache size 0 max 16384 2023-12-14T14:18:42.169 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:18:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 -- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f46140a12c0 msgr2=0x7f46140a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f46140a12c0 0x7f46140a3770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4628197a30 tx=0x7f4624009260 comp rx=0 tx=0).stop 2023-12-14T14:18:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 -- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46280ff390 msgr2=0x7f4628196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46280ff390 0x7f4628196420 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f461800c9b0 tx=0x7f461800cd70 comp rx=0 tx=0).stop 2023-12-14T14:18:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 -- 172.21.15.69:0/1216905708 shutdown_connections 2023-12-14T14:18:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f46140a12c0 0x7f46140a3770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46281043d0 0x7f462819adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46280ff390 0x7f4628196420 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 --2- 172.21.15.69:0/1216905708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46280ffd30 0x7f4628196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 -- 172.21.15.69:0/1216905708 >> 172.21.15.69:0/1216905708 conn(0x7f4628075fd0 msgr2=0x7f4628067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 -- 172.21.15.69:0/1216905708 shutdown_connections 2023-12-14T14:18:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:42.159+0000 7f4630395700 1 -- 172.21.15.69:0/1216905708 wait complete. 2023-12-14T14:18:42.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:42 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1043273321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:18:42.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:42 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1043273321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:18:42.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:42 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1043273321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:18:43.172 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:18:43.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:18:43.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.302+0000 7fc9b74e2700 1 -- 172.21.15.69:0/393668105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b010a890 msgr2=0x7fc9b010cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.302+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/393668105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b010a890 0x7fc9b010cc70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800b0a0 tx=0x7fc9a800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 -- 172.21.15.69:0/393668105 shutdown_connections 2023-12-14T14:18:43.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/393668105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b010a890 0x7fc9b010cc70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/393668105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b0067980 0x7fc9b00ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/393668105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9b00ffa40 0x7fc9b00ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 -- 172.21.15.69:0/393668105 >> 172.21.15.69:0/393668105 conn(0x7fc9b0074a60 msgr2=0x7fc9b0074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 -- 172.21.15.69:0/393668105 shutdown_connections 2023-12-14T14:18:43.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 -- 172.21.15.69:0/393668105 wait complete. 2023-12-14T14:18:43.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 Processor -- start 2023-12-14T14:18:43.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 -- start start 2023-12-14T14:18:43.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b0067980 0x7fc9b0196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9b00ffa40 0x7fc9b0196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b010a890 0x7fc9b019aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b019b520 con 0x7fc9b0067980 2023-12-14T14:18:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b019b690 con 0x7fc9b00ffa40 2023-12-14T14:18:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.303+0000 7fc9b74e2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b019b850 con 0x7fc9b010a890 2023-12-14T14:18:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b527e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b0067980 0x7fc9b0196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b527e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b0067980 0x7fc9b0196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47040/0 (socket says 172.21.15.69:47040) 2023-12-14T14:18:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b527e700 1 -- 172.21.15.69:0/3207404243 learned_addr learned my addr 172.21.15.69:0/3207404243 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b5a7f700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b010a890 0x7fc9b019aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b527e700 1 -- 172.21.15.69:0/3207404243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b010a890 msgr2=0x7fc9b019aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b527e700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b010a890 0x7fc9b019aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9b00ffa40 0x7fc9b0196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b527e700 1 -- 172.21.15.69:0/3207404243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9b00ffa40 msgr2=0x7fc9b0196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b527e700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9b00ffa40 0x7fc9b0196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b527e700 1 -- 172.21.15.69:0/3207404243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a8009d00 con 0x7fc9b0067980 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9b00ffa40 0x7fc9b0196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b527e700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b0067980 0x7fc9b0196540 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c920 tx=0x7fc9ac00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9a67fc700 1 -- 172.21.15.69:0/3207404243 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac007b00 con 0x7fc9b0067980 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9a67fc700 1 -- 172.21.15.69:0/3207404243 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9ac00ce70 con 0x7fc9b0067980 2023-12-14T14:18:43.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b74e2700 1 -- 172.21.15.69:0/3207404243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b01102f0 con 0x7fc9b0067980 2023-12-14T14:18:43.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9a67fc700 1 -- 172.21.15.69:0/3207404243 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0054e0 con 0x7fc9b0067980 2023-12-14T14:18:43.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.304+0000 7fc9b74e2700 1 -- 172.21.15.69:0/3207404243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b0110160 con 0x7fc9b0067980 2023-12-14T14:18:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.307+0000 7fc9a67fc700 1 -- 172.21.15.69:0/3207404243 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc9ac004750 con 0x7fc9b0067980 2023-12-14T14:18:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.307+0000 7fc9a67fc700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc99c0a12c0 0x7fc99c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc99c0a12c0 0x7fc99c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9a67fc700 1 -- 172.21.15.69:0/3207404243 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fc9ac0cc8a0 con 0x7fc9b0067980 2023-12-14T14:18:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc99c0a12c0 0x7fc99c0a3770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0197b50 tx=0x7fc9a0008040 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9c3670b80 1 Processor -- start 2023-12-14T14:18:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9c3670b80 1 -- start start 2023-12-14T14:18:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3400 0x556e4c8c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8cebd0 0x556e4c8d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c7ad660 con 0x556e4c8c3d10 2023-12-14T14:18:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c81c8f0 con 0x556e4c8cebd0 2023-12-14T14:18:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.308+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c815d80 con 0x556e4c8c3400 2023-12-14T14:18:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b4a7d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b4a7d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47050/0 (socket says 172.21.15.69:47050) 2023-12-14T14:18:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b4a7d700 1 -- 172.21.15.69:0/2093101564 learned_addr learned my addr 172.21.15.69:0/2093101564 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b527e700 1 --2- 172.21.15.69:0/2093101564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3400 0x556e4c8c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b5a7f700 1 --2- 172.21.15.69:0/2093101564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8cebd0 0x556e4c8d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b4a7d700 1 -- 172.21.15.69:0/2093101564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3400 msgr2=0x556e4c8c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/2093101564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3400 0x556e4c8c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b4a7d700 1 -- 172.21.15.69:0/2093101564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8cebd0 msgr2=0x556e4c8d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/2093101564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8cebd0 0x556e4c8d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b4a7d700 1 -- 172.21.15.69:0/2093101564 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e4c697430 con 0x556e4c8c3d10 2023-12-14T14:18:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/2093101564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8ce690 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000c910 tx=0x7fc9a000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e115542cfadecb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc99b7fe700 1 -- 172.21.15.69:0/2093101564 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0013830 con 0x556e4c8c3d10 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc99b7fe700 1 -- 172.21.15.69:0/2093101564 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9a0013e50 con 0x556e4c8c3d10 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.309+0000 7fc99b7fe700 1 -- 172.21.15.69:0/2093101564 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00113d0 con 0x556e4c8c3d10 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2093101564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 msgr2=0x556e4c8ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/2093101564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8ce690 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000c910 tx=0x7fc9a000f000 comp rx=0 tx=0).stop 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2093101564 shutdown_connections 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/2093101564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8cebd0 0x556e4c8d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/2093101564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3400 0x556e4c8c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/2093101564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8ce690 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2093101564 >> 172.21.15.69:0/2093101564 conn(0x556e4c8b9d20 msgr2=0x556e4c8bf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2093101564 shutdown_connections 2023-12-14T14:18:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2093101564 wait complete. 2023-12-14T14:18:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 -- start start 2023-12-14T14:18:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.310+0000 7fc9c3670b80 1 Processor -- start 2023-12-14T14:18:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3400 0x556e4c8ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 0x556e4c8cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c7b2010 con 0x556e4c8c3d10 2023-12-14T14:18:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c7b1cb0 con 0x556e4c8c3400 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c699720 con 0x556e4c8cebd0 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9c3670b80 10 client.0 _ll_register_callbacks cb 0x556e4c7d5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b4a7d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b4a7d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47064/0 (socket says 172.21.15.69:47064) 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b4a7d700 1 -- 172.21.15.69:0/1739110074 learned_addr learned my addr 172.21.15.69:0/1739110074 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b527e700 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3400 0x556e4c8ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b5a7f700 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 0x556e4c8cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b4a7d700 1 -- 172.21.15.69:0/1739110074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 msgr2=0x556e4c8cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 0x556e4c8cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b4a7d700 1 -- 172.21.15.69:0/1739110074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3400 msgr2=0x556e4c8ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3400 0x556e4c8ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b4a7d700 1 -- 172.21.15.69:0/1739110074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a000c650 con 0x556e4c8c3d10 2023-12-14T14:18:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8cb7e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0006ed0 tx=0x7fc9a001ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d104b683da5a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.311+0000 7fc998ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc998ff9700 1 -- 172.21.15.69:0/1739110074 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0013630 con 0x556e4c8c3d10 2023-12-14T14:18:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc998ff9700 1 -- 172.21.15.69:0/1739110074 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fc9a0013790 con 0x556e4c8c3d10 2023-12-14T14:18:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9c3670b80 1 -- 172.21.15.69:0/1739110074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e4c8b7330 con 0x556e4c8c3d10 2023-12-14T14:18:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc998ff9700 1 -- 172.21.15.69:0/1739110074 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9a0013950 con 0x556e4c8c3d10 2023-12-14T14:18:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9c3670b80 10 client.16587 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:43.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9c3670b80 1 -- 172.21.15.69:0/1739110074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x556e4c7dc1f0 con 0x556e4c8c3d10 2023-12-14T14:18:43.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc998ff9700 1 -- 172.21.15.69:0/1739110074 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556e4c8b7330 con 0x556e4c8c3d10 2023-12-14T14:18:43.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc998ff9700 1 -- 172.21.15.69:0/1739110074 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc9a002e020 con 0x556e4c8c3d10 2023-12-14T14:18:43.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9c3670b80 10 client.16587 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:43.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9c3670b80 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:43.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9c3670b80 20 client.16587 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:43.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x556e4c8de3e0 0x556e4c8e07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9c3670b80 4 client.16587 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:43.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9c3670b80 1 -- 172.21.15.69:0/1739110074 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e4c80ed60 con 0x556e4c8de3e0 2023-12-14T14:18:43.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.312+0000 7fc9b527e700 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x556e4c8de3e0 0x556e4c8e07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc998ff9700 10 client.16587 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:43.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc9b527e700 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x556e4c8de3e0 0x556e4c8e07f0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73cf52b0913ff78e server_cookie=ecfdd6e0e6590545 in_seq=0 out_seq=0 2023-12-14T14:18:43.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc998ff9700 1 -- 172.21.15.69:0/1739110074 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556e4c80ed60 con 0x556e4c8de3e0 2023-12-14T14:18:43.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc998ff9700 10 client.16587 handle_command_reply: tid=0 2023-12-14T14:18:43.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc9c3670b80 1 client.16587 shutdown 2023-12-14T14:18:43.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc9c3670b80 1 -- 172.21.15.69:0/1739110074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 msgr2=0x556e4c8cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8cb7e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0006ed0 tx=0x7fc9a001ee60 comp rx=0 tx=0).stop 2023-12-14T14:18:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc9c3670b80 1 -- 172.21.15.69:0/1739110074 shutdown_connections 2023-12-14T14:18:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x556e4c8de3e0 0x556e4c8e07f0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 0x556e4c8cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3400 0x556e4c8ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/1739110074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3d10 0x556e4c8cb7e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.313+0000 7fc998ff9700 0 client.16587 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.314+0000 7fc9c3670b80 1 -- 172.21.15.69:0/1739110074 >> 172.21.15.69:0/1739110074 conn(0x556e4c8b9d20 msgr2=0x556e4c8bf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.314+0000 7fc9c3670b80 1 -- 172.21.15.69:0/1739110074 shutdown_connections 2023-12-14T14:18:43.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.314+0000 7fc9c3670b80 1 -- 172.21.15.69:0/1739110074 wait complete. 2023-12-14T14:18:43.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.314+0000 7fc9c3670b80 20 client.16587 trim_cache size 0 max 16384 2023-12-14T14:18:43.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.330+0000 7fc9c3670b80 1 Processor -- start 2023-12-14T14:18:43.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.330+0000 7fc9c3670b80 1 -- start start 2023-12-14T14:18:43.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3400 0x556e4c8c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3d10 0x556e4c8d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8cebd0 0x556e4c8cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c8c7730 con 0x556e4c8cebd0 2023-12-14T14:18:43.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c8d5c70 con 0x556e4c8c3400 2023-12-14T14:18:43.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c8c73c0 con 0x556e4c8c3d10 2023-12-14T14:18:43.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b5a7f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8cebd0 0x556e4c8cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b5a7f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8cebd0 0x556e4c8cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47078/0 (socket says 172.21.15.69:47078) 2023-12-14T14:18:43.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b5a7f700 1 -- 172.21.15.69:0/2713917133 learned_addr learned my addr 172.21.15.69:0/2713917133 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/2713917133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3d10 0x556e4c8d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b5a7f700 1 -- 172.21.15.69:0/2713917133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3d10 msgr2=0x556e4c8d5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b5a7f700 1 --2- 172.21.15.69:0/2713917133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3d10 0x556e4c8d5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b5a7f700 1 -- 172.21.15.69:0/2713917133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3400 msgr2=0x556e4c8c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b5a7f700 1 --2- 172.21.15.69:0/2713917133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3400 0x556e4c8c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b5a7f700 1 -- 172.21.15.69:0/2713917133 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e4c8bb560 con 0x556e4c8cebd0 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/2713917133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3d10 0x556e4c8d5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc9b5a7f700 1 --2- 172.21.15.69:0/2713917133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8cebd0 0x556e4c8cdff0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800d000 tx=0x7fc9a80090d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c30a18748b7c8b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc99bfff700 1 -- 172.21.15.69:0/2713917133 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a800e040 con 0x556e4c8cebd0 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc99bfff700 1 -- 172.21.15.69:0/2713917133 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9a80074e0 con 0x556e4c8cebd0 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.331+0000 7fc99bfff700 1 -- 172.21.15.69:0/2713917133 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8005480 con 0x556e4c8cebd0 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2713917133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8cebd0 msgr2=0x556e4c8cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/2713917133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8cebd0 0x556e4c8cdff0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800d000 tx=0x7fc9a80090d0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2713917133 shutdown_connections 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/2713917133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8cebd0 0x556e4c8cdff0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/2713917133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3400 0x556e4c8c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/2713917133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8c3d10 0x556e4c8d5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2713917133 >> 172.21.15.69:0/2713917133 conn(0x556e4c8b9d20 msgr2=0x556e4c8cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2713917133 shutdown_connections 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 -- 172.21.15.69:0/2713917133 wait complete. 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 -- start start 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.332+0000 7fc9c3670b80 1 Processor -- start 2023-12-14T14:18:43.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3400 0x556e4c8d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3d10 0x556e4c8d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 0x556e4c8d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c932260 con 0x556e4c8c3400 2023-12-14T14:18:43.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c9323a0 con 0x556e4c8c3d10 2023-12-14T14:18:43.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4c932530 con 0x556e4c8cebd0 2023-12-14T14:18:43.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 10 client.0 _ll_register_callbacks cb 0x7fc9ac095c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:43.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b527e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3400 0x556e4c8d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b527e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3400 0x556e4c8d1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47082/0 (socket says 172.21.15.69:47082) 2023-12-14T14:18:43.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b527e700 1 -- 172.21.15.69:0/911112626 learned_addr learned my addr 172.21.15.69:0/911112626 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b5a7f700 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 0x556e4c8d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3d10 0x556e4c8d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b527e700 1 -- 172.21.15.69:0/911112626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 msgr2=0x556e4c8d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b527e700 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 0x556e4c8d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b527e700 1 -- 172.21.15.69:0/911112626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3d10 msgr2=0x556e4c8d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b527e700 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3d10 0x556e4c8d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b527e700 1 -- 172.21.15.69:0/911112626 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b010d8e0 con 0x556e4c8c3400 2023-12-14T14:18:43.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9b527e700 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3400 0x556e4c8d1cc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ca000 tx=0x7fc9ac0b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f2979407b34224 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc998ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc998ff9700 1 -- 172.21.15.69:0/911112626 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac097d80 con 0x556e4c8c3400 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc998ff9700 1 -- 172.21.15.69:0/911112626 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fc9ac0ca220 con 0x556e4c8c3400 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 1 -- 172.21.15.69:0/911112626 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9a0013e50 con 0x556e4c8c3400 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc998ff9700 1 -- 172.21.15.69:0/911112626 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9ac0ca3e0 con 0x556e4c8c3400 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 10 client.16593 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.333+0000 7fc9c3670b80 1 -- 172.21.15.69:0/911112626 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x556e4c643be0 con 0x556e4c8c3400 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc998ff9700 1 -- 172.21.15.69:0/911112626 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9a0013e50 con 0x556e4c8c3400 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc998ff9700 1 -- 172.21.15.69:0/911112626 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc9ac098e10 con 0x556e4c8c3400 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc9c3670b80 10 client.16593 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc9c3670b80 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:43.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc9c3670b80 20 client.16593 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:43.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x556e4c933c30 0x556e4c936040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc9c3670b80 4 client.16593 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:18:43.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc9c3670b80 1 -- 172.21.15.69:0/911112626 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556e4c80ea80 con 0x556e4c933c30 2023-12-14T14:18:43.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x556e4c933c30 0x556e4c936040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc998ff9700 10 client.16593 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:43.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.334+0000 7fc9b4a7d700 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x556e4c933c30 0x556e4c936040 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7bffb041af508f3 server_cookie=3165fb7f772da753 in_seq=0 out_seq=0 2023-12-14T14:18:43.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.335+0000 7fc998ff9700 1 -- 172.21.15.69:0/911112626 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556e4c80ea80 con 0x556e4c933c30 2023-12-14T14:18:43.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.335+0000 7fc998ff9700 10 client.16593 handle_command_reply: tid=0 2023-12-14T14:18:43.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.335+0000 7fc9c3670b80 1 client.16593 shutdown 2023-12-14T14:18:43.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.335+0000 7fc9c3670b80 1 -- 172.21.15.69:0/911112626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3400 msgr2=0x556e4c8d1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.335+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3400 0x556e4c8d1cc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ca000 tx=0x7fc9ac0b9040 comp rx=0 tx=0).stop 2023-12-14T14:18:43.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9c3670b80 1 -- 172.21.15.69:0/911112626 shutdown_connections 2023-12-14T14:18:43.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x556e4c933c30 0x556e4c936040 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556e4c8cebd0 0x556e4c8d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556e4c8c3400 0x556e4c8d1cc0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc998ff9700 0 client.16593 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:43.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9c3670b80 1 --2- 172.21.15.69:0/911112626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556e4c8c3d10 0x556e4c8d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9c3670b80 1 -- 172.21.15.69:0/911112626 >> 172.21.15.69:0/911112626 conn(0x556e4c8b9d20 msgr2=0x556e4c8bf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9c3670b80 1 -- 172.21.15.69:0/911112626 shutdown_connections 2023-12-14T14:18:43.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9c3670b80 1 -- 172.21.15.69:0/911112626 wait complete. 2023-12-14T14:18:43.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9c3670b80 20 client.16593 trim_cache size 0 max 16384 2023-12-14T14:18:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:18:43.344 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:18:43.344 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "cc9272a5-0050-4ab4-ac40-962fac360808", 2023-12-14T14:18:43.344 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:18:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:18:43.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 -- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc99c0a12c0 msgr2=0x7fc99c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc99c0a12c0 0x7fc99c0a3770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0197b50 tx=0x7fc9a0008040 comp rx=0 tx=0).stop 2023-12-14T14:18:43.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 -- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b0067980 msgr2=0x7fc9b0196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b0067980 0x7fc9b0196540 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c920 tx=0x7fc9ac00cc30 comp rx=0 tx=0).stop 2023-12-14T14:18:43.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 -- 172.21.15.69:0/3207404243 shutdown_connections 2023-12-14T14:18:43.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc99c0a12c0 0x7fc99c0a3770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b010a890 0x7fc9b019aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9b0067980 0x7fc9b0196540 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 --2- 172.21.15.69:0/3207404243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9b00ffa40 0x7fc9b0196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 -- 172.21.15.69:0/3207404243 >> 172.21.15.69:0/3207404243 conn(0x7fc9b0074a60 msgr2=0x7fc9b0102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 -- 172.21.15.69:0/3207404243 shutdown_connections 2023-12-14T14:18:43.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.336+0000 7fc9b74e2700 1 -- 172.21.15.69:0/3207404243 wait complete. 2023-12-14T14:18:43.347 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:18:43.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.472+0000 7ffbe1af1700 1 -- 172.21.15.69:0/2747497449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc10a880 msgr2=0x7ffbdc10cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.472+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/2747497449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc10a880 0x7ffbdc10cc60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400b0a0 tx=0x7ffbd400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.472+0000 7ffbe1af1700 1 -- 172.21.15.69:0/2747497449 shutdown_connections 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.472+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/2747497449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc10a880 0x7ffbdc10cc60 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.472+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/2747497449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbdc0760f0 0x7ffbdc0ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.472+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/2747497449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc0ff9b0 0x7ffbdc0ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.472+0000 7ffbe1af1700 1 -- 172.21.15.69:0/2747497449 >> 172.21.15.69:0/2747497449 conn(0x7ffbdc074a60 msgr2=0x7ffbdc074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.472+0000 7ffbe1af1700 1 -- 172.21.15.69:0/2747497449 shutdown_connections 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.472+0000 7ffbe1af1700 1 -- 172.21.15.69:0/2747497449 wait complete. 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.473+0000 7ffbe1af1700 1 Processor -- start 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.473+0000 7ffbe1af1700 1 -- start start 2023-12-14T14:18:43.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.473+0000 7ffbe1af1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbdc0760f0 0x7ffbdc1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.473+0000 7ffbe1af1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc0ff9b0 0x7ffbdc196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.473+0000 7ffbe1af1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc10a880 0x7ffbdc19ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.473+0000 7ffbe1af1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc19b3d0 con 0x7ffbdc0ff9b0 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.473+0000 7ffbe1af1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc19b540 con 0x7ffbdc0760f0 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.473+0000 7ffbe1af1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc19b700 con 0x7ffbdc10a880 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc0ff9b0 0x7ffbdc196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc0ff9b0 0x7ffbdc196930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47104/0 (socket says 172.21.15.69:47104) 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdaffd700 1 -- 172.21.15.69:0/4015833794 learned_addr learned my addr 172.21.15.69:0/4015833794 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbdc0760f0 0x7ffbdc1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdbfff700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc10a880 0x7ffbdc19ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdaffd700 1 -- 172.21.15.69:0/4015833794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc10a880 msgr2=0x7ffbdc19ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc10a880 0x7ffbdc19ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdaffd700 1 -- 172.21.15.69:0/4015833794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbdc0760f0 msgr2=0x7ffbdc1963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbdc0760f0 0x7ffbdc1963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdaffd700 1 -- 172.21.15.69:0/4015833794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4009d00 con 0x7ffbdc0ff9b0 2023-12-14T14:18:43.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdbfff700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc10a880 0x7ffbdc19ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:18:43.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc0ff9b0 0x7ffbdc196930 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000d950 tx=0x7ffbd000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbd8ff9700 1 -- 172.21.15.69:0/4015833794 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0009b40 con 0x7ffbdc0ff9b0 2023-12-14T14:18:43.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbd8ff9700 1 -- 172.21.15.69:0/4015833794 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbd0009ca0 con 0x7ffbdc0ff9b0 2023-12-14T14:18:43.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbe1af1700 1 -- 172.21.15.69:0/4015833794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc110240 con 0x7ffbdc0ff9b0 2023-12-14T14:18:43.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbd8ff9700 1 -- 172.21.15.69:0/4015833794 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000f620 con 0x7ffbdc0ff9b0 2023-12-14T14:18:43.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.474+0000 7ffbe1af1700 1 -- 172.21.15.69:0/4015833794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc1100b0 con 0x7ffbdc0ff9b0 2023-12-14T14:18:43.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.477+0000 7ffbd8ff9700 1 -- 172.21.15.69:0/4015833794 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ffbd0010460 con 0x7ffbdc0ff9b0 2023-12-14T14:18:43.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbd8ff9700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ffbc40a12c0 0x7ffbc40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbedc7fb80 1 Processor -- start 2023-12-14T14:18:43.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ffbc40a12c0 0x7ffbc40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbd8ff9700 1 -- 172.21.15.69:0/4015833794 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7ffbd00cd060 con 0x7ffbdc0ff9b0 2023-12-14T14:18:43.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbedc7fb80 1 -- start start 2023-12-14T14:18:43.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 0x55ee96a7f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7fc90 0x55ee96a8a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a8ab50 0x55ee96a8cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee969695e0 con 0x55ee96a8ab50 2023-12-14T14:18:43.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee969d8870 con 0x55ee96a7fc90 2023-12-14T14:18:43.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee969d1d00 con 0x55ee96a7f380 2023-12-14T14:18:43.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a8ab50 0x55ee96a8cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ffbc40a12c0 0x7ffbc40a3770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc005ea0 tx=0x7ffbcc005e30 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a8ab50 0x55ee96a8cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47114/0 (socket says 172.21.15.69:47114) 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbdbfff700 1 -- 172.21.15.69:0/1553014086 learned_addr learned my addr 172.21.15.69:0/1553014086 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7fc90 0x55ee96a8a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 0x55ee96a7f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbdbfff700 1 -- 172.21.15.69:0/1553014086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 msgr2=0x55ee96a7f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.478+0000 7ffbdbfff700 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 0x55ee96a7f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbdbfff700 1 -- 172.21.15.69:0/1553014086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7fc90 msgr2=0x55ee96a8a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbdbfff700 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7fc90 0x55ee96a8a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbdbfff700 1 -- 172.21.15.69:0/1553014086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee968533b0 con 0x55ee96a8ab50 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7fc90 0x55ee96a8a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbdbfff700 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a8ab50 0x55ee96a8cf30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400b070 tx=0x7ffbd4009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaaa1a0580b3f66 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbc1ffb700 1 -- 172.21.15.69:0/1553014086 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd400e050 con 0x55ee96a8ab50 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbc1ffb700 1 -- 172.21.15.69:0/1553014086 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbd4008ec0 con 0x55ee96a8ab50 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbc1ffb700 1 -- 172.21.15.69:0/1553014086 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4005260 con 0x55ee96a8ab50 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/1553014086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a8ab50 msgr2=0x55ee96a8cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a8ab50 0x55ee96a8cf30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400b070 tx=0x7ffbd4009c60 comp rx=0 tx=0).stop 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.479+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/1553014086 shutdown_connections 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a8ab50 0x55ee96a8cf30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 0x55ee96a7f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/1553014086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7fc90 0x55ee96a8a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/1553014086 >> 172.21.15.69:0/1553014086 conn(0x55ee96a75ca0 msgr2=0x55ee96a7b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/1553014086 shutdown_connections 2023-12-14T14:18:43.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/1553014086 wait complete. 2023-12-14T14:18:43.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 -- start start 2023-12-14T14:18:43.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 Processor -- start 2023-12-14T14:18:43.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 0x55ee96a8a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a87780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 0x55ee96a87d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee9696df90 con 0x55ee96a7fc90 2023-12-14T14:18:43.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee9696dc30 con 0x55ee96a7f380 2023-12-14T14:18:43.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee968556a0 con 0x55ee96a8ab50 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbedc7fb80 10 client.0 _ll_register_callbacks cb 0x55ee96991910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a87780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.480+0000 7ffbdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a87780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47130/0 (socket says 172.21.15.69:47130) 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbdaffd700 1 -- 172.21.15.69:0/3299002588 learned_addr learned my addr 172.21.15.69:0/3299002588 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 0x55ee96a8a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbdbfff700 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 0x55ee96a87d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbdaffd700 1 -- 172.21.15.69:0/3299002588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 msgr2=0x55ee96a87d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 0x55ee96a87d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbdaffd700 1 -- 172.21.15.69:0/3299002588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 msgr2=0x55ee96a8a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 0x55ee96a8a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbdaffd700 1 -- 172.21.15.69:0/3299002588 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc10d8d0 con 0x55ee96a7fc90 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a87780 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffbd009a070 tx=0x7ffbd0099b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6857625f609b0161 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbbaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3299002588 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0010910 con 0x55ee96a7fc90 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3299002588 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7ffbd00a2530 con 0x55ee96a7fc90 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3299002588 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee96a732b0 con 0x55ee96a7fc90 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3299002588 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbd009a340 con 0x55ee96a7fc90 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbedc7fb80 10 client.16605 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3299002588 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ee96998170 con 0x55ee96a7fc90 2023-12-14T14:18:43.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.481+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3299002588 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbd00c8080 con 0x55ee96a7fc90 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3299002588 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ffbd00a20a0 con 0x55ee96a7fc90 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbedc7fb80 10 client.16605 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbedc7fb80 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbedc7fb80 20 client.16605 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ee96a9a430 0x55ee96a9c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbedc7fb80 4 client.16605 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3299002588 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee969cace0 con 0x55ee96a9a430 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ee96a9a430 0x55ee96a9c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ee96a9a430 0x55ee96a9c840 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47207f1030964f2 server_cookie=c29b650945a227b5 in_seq=0 out_seq=0 2023-12-14T14:18:43.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.482+0000 7ffbbaffd700 10 client.16605 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3299002588 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ee969cace0 con 0x55ee96a9a430 2023-12-14T14:18:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbbaffd700 10 client.16605 handle_command_reply: tid=0 2023-12-14T14:18:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 client.16605 shutdown 2023-12-14T14:18:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3299002588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 msgr2=0x55ee96a87780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a87780 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffbd009a070 tx=0x7ffbd0099b30 comp rx=0 tx=0).stop 2023-12-14T14:18:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3299002588 shutdown_connections 2023-12-14T14:18:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ee96a9a430 0x55ee96a9c840 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 0x55ee96a87d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 0x55ee96a8a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbbaffd700 0 client.16605 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3299002588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a87780 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3299002588 >> 172.21.15.69:0/3299002588 conn(0x55ee96a75ca0 msgr2=0x55ee96a7b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3299002588 shutdown_connections 2023-12-14T14:18:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3299002588 wait complete. 2023-12-14T14:18:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.483+0000 7ffbedc7fb80 20 client.16605 trim_cache size 0 max 16384 2023-12-14T14:18:43.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbedc7fb80 1 Processor -- start 2023-12-14T14:18:43.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbedc7fb80 1 -- start start 2023-12-14T14:18:43.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 0x55ee96a91630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a89f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a8ab50 0x55ee96a8a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee96a80330 con 0x55ee96a7fc90 2023-12-14T14:18:43.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee96a964e0 con 0x55ee96a8ab50 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee96a9cea0 con 0x55ee96a7f380 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a89f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a89f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47146/0 (socket says 172.21.15.69:47146) 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdaffd700 1 -- 172.21.15.69:0/201667237 learned_addr learned my addr 172.21.15.69:0/201667237 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdbfff700 1 --2- 172.21.15.69:0/201667237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a8ab50 0x55ee96a8a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/201667237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 0x55ee96a91630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdaffd700 1 -- 172.21.15.69:0/201667237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 msgr2=0x55ee96a91630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/201667237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 0x55ee96a91630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdaffd700 1 -- 172.21.15.69:0/201667237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a8ab50 msgr2=0x55ee96a8a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/201667237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a8ab50 0x55ee96a8a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.500+0000 7ffbdaffd700 1 -- 172.21.15.69:0/201667237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee96997ec0 con 0x55ee96a7fc90 2023-12-14T14:18:43.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/201667237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a89f90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000b2f0 tx=0x7ffbd009e250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b310485d17bec38 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbc27fc700 1 -- 172.21.15.69:0/201667237 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0014070 con 0x55ee96a7fc90 2023-12-14T14:18:43.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbc27fc700 1 -- 172.21.15.69:0/201667237 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee96a732b0 con 0x55ee96a7fc90 2023-12-14T14:18:43.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbc27fc700 1 -- 172.21.15.69:0/201667237 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0083c70 con 0x55ee96a7fc90 2023-12-14T14:18:43.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/201667237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 msgr2=0x55ee96a89f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/201667237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a89f90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000b2f0 tx=0x7ffbd009e250 comp rx=0 tx=0).stop 2023-12-14T14:18:43.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/201667237 shutdown_connections 2023-12-14T14:18:43.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/201667237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a8ab50 0x55ee96a8a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/201667237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a7f380 0x55ee96a91630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/201667237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a89f90 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/201667237 >> 172.21.15.69:0/201667237 conn(0x55ee96a75ca0 msgr2=0x55ee96a95dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/201667237 shutdown_connections 2023-12-14T14:18:43.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.501+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/201667237 wait complete. 2023-12-14T14:18:43.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbedc7fb80 1 -- start start 2023-12-14T14:18:43.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbedc7fb80 1 Processor -- start 2023-12-14T14:18:43.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 0x55ee96a91040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a91580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbedc7fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 0x55ee96a8f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee96a8fb70 con 0x55ee96a7fc90 2023-12-14T14:18:43.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee96a8fcb0 con 0x55ee96a7f380 2023-12-14T14:18:43.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbedc7fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee96a8fe70 con 0x55ee96a8ab50 2023-12-14T14:18:43.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbedc7fb80 10 client.0 _ll_register_callbacks cb 0x7ffbd0099fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:18:43.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a91580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a91580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47154/0 (socket says 172.21.15.69:47154) 2023-12-14T14:18:43.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbdaffd700 1 -- 172.21.15.69:0/3580930540 learned_addr learned my addr 172.21.15.69:0/3580930540 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 0x55ee96a91040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.502+0000 7ffbdbfff700 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 0x55ee96a8f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbdaffd700 1 -- 172.21.15.69:0/3580930540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 msgr2=0x55ee96a8f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 0x55ee96a8f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbdaffd700 1 -- 172.21.15.69:0/3580930540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 msgr2=0x55ee96a91040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 0x55ee96a91040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbdaffd700 1 -- 172.21.15.69:0/3580930540 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee96998170 con 0x55ee96a7fc90 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbdbfff700 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 0x55ee96a8f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbdaffd700 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a91580 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00a22d0 tx=0x7ffbd00a2300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab42288a5be15465 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:18:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbbaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:18:43.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3580930540 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0014070 con 0x55ee96a7fc90 2023-12-14T14:18:43.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3580930540 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8498+0+0 (secure 0 0 0) 0x7ffbd00a2530 con 0x55ee96a7fc90 2023-12-14T14:18:43.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3580930540 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbd4008ec0 con 0x55ee96a7fc90 2023-12-14T14:18:43.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3580930540 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbd0099a40 con 0x55ee96a7fc90 2023-12-14T14:18:43.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbedc7fb80 10 client.16611 fetch_fsmap learned FSMap version 28 2023-12-14T14:18:43.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3580930540 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ee9697e9a0 con 0x55ee96a7fc90 2023-12-14T14:18:43.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3580930540 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbd007d020 con 0x55ee96a7fc90 2023-12-14T14:18:43.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3580930540 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ffbd00b8170 con 0x55ee96a7fc90 2023-12-14T14:18:43.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbedc7fb80 10 client.16611 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:18:43.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbedc7fb80 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:18:43.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbedc7fb80 20 client.16611 populate_metadata read hostname 'smithi069' 2023-12-14T14:18:43.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ee96aef080 0x55ee96af1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:18:43.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbedc7fb80 4 client.16611 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:18:43.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.503+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3580930540 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ee969caa00 con 0x55ee96aef080 2023-12-14T14:18:43.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ee96aef080 0x55ee96af1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:18:43.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbdb7fe700 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ee96aef080 0x55ee96af1490 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b71d74e50157c237 server_cookie=adabdd99a6165a34 in_seq=0 out_seq=0 2023-12-14T14:18:43.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbbaffd700 10 client.16611 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:43.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbbaffd700 1 -- 172.21.15.69:0/3580930540 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ee969caa00 con 0x55ee96aef080 2023-12-14T14:18:43.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbbaffd700 10 client.16611 handle_command_reply: tid=0 2023-12-14T14:18:43.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 client.16611 shutdown 2023-12-14T14:18:43.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3580930540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 msgr2=0x55ee96a91580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a91580 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00a22d0 tx=0x7ffbd00a2300 comp rx=0 tx=0).stop 2023-12-14T14:18:43.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3580930540 shutdown_connections 2023-12-14T14:18:43.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55ee96aef080 0x55ee96af1490 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee96a8ab50 0x55ee96a8f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee96a7f380 0x55ee96a91040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 --2- 172.21.15.69:0/3580930540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ee96a7fc90 0x55ee96a91580 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbbaffd700 0 client.16611 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:18:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3580930540 >> 172.21.15.69:0/3580930540 conn(0x55ee96a75ca0 msgr2=0x55ee96a82ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3580930540 shutdown_connections 2023-12-14T14:18:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 1 -- 172.21.15.69:0/3580930540 wait complete. 2023-12-14T14:18:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.504+0000 7ffbedc7fb80 20 client.16611 trim_cache size 0 max 16384 2023-12-14T14:18:43.514 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:18:43.515 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:18:43.515 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:18:43.515 INFO:teuthology.orchestra.run.smithi069.stdout: "cc9272a5-0050-4ab4-ac40-962fac360808": { 2023-12-14T14:18:43.515 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:18:43.515 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "cc9272a5-0050-4ab4-ac40-962fac360808", 2023-12-14T14:18:43.515 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:18:43.515 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:18:43.515 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:18:43.516 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:18:43.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 -- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ffbc40a12c0 msgr2=0x7ffbc40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ffbc40a12c0 0x7ffbc40a3770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc005ea0 tx=0x7ffbcc005e30 comp rx=0 tx=0).stop 2023-12-14T14:18:43.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 -- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc0ff9b0 msgr2=0x7ffbdc196930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:18:43.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc0ff9b0 0x7ffbdc196930 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000d950 tx=0x7ffbd000dd10 comp rx=0 tx=0).stop 2023-12-14T14:18:43.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 -- 172.21.15.69:0/4015833794 shutdown_connections 2023-12-14T14:18:43.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ffbc40a12c0 0x7ffbc40a3770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc10a880 0x7ffbdc19ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbdc0760f0 0x7ffbdc1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 --2- 172.21.15.69:0/4015833794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc0ff9b0 0x7ffbdc196930 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:18:43.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 -- 172.21.15.69:0/4015833794 >> 172.21.15.69:0/4015833794 conn(0x7ffbdc074a60 msgr2=0x7ffbdc102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:18:43.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 -- 172.21.15.69:0/4015833794 shutdown_connections 2023-12-14T14:18:43.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:18:43.505+0000 7ffbe1af1700 1 -- 172.21.15.69:0/4015833794 wait complete. 2023-12-14T14:18:43.518 INFO:tasks.cephfs.filesystem:scrub status for tag:cc9272a5-0050-4ab4-ac40-962fac360808 - {'path': '/', 'tag': 'cc9272a5-0050-4ab4-ac40-962fac360808', 'options': 'recursive,force'} 2023-12-14T14:18:43.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:43 smithi119 ceph-mon[43834]: pgmap v249: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-12-14T14:18:43.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:43 smithi069 ceph-mon[42034]: pgmap v249: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-12-14T14:18:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:43 smithi081 ceph-mon[43371]: pgmap v249: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-12-14T14:18:44.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:44 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:18:44.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:44 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:44.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:44 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:18:44.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:44 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:18:44.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:44 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:44.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:44 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:44.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:44 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:18:44.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:44 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:44.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:44 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:18:44.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:44 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:18:44.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:44 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:44.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:44 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:44 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:18:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:44 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:44 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:18:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:44 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:18:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:44 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:44.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:44 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:18:45.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:45 smithi119 ceph-mon[43834]: pgmap v250: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-12-14T14:18:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:45 smithi069 ceph-mon[42034]: pgmap v250: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-12-14T14:18:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:45 smithi081 ceph-mon[43371]: pgmap v250: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-12-14T14:18:47.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:47 smithi081 ceph-mon[43371]: pgmap v251: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-14T14:18:47.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:47 smithi119 ceph-mon[43834]: pgmap v251: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-14T14:18:47.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:47 smithi069 ceph-mon[42034]: pgmap v251: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-14T14:18:49.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:49 smithi119 ceph-mon[43834]: pgmap v252: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-14T14:18:49.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:49 smithi069 ceph-mon[42034]: pgmap v252: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-14T14:18:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:49 smithi081 ceph-mon[43371]: pgmap v252: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-14T14:18:50.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:50 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:18:50.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:50 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:18:50.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:50 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:18:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:51 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:18:51.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:51 smithi119 ceph-mon[43834]: pgmap v253: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-12-14T14:18:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:51 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:18:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:51 smithi069 ceph-mon[42034]: pgmap v253: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-12-14T14:18:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:51 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:18:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:51 smithi081 ceph-mon[43371]: pgmap v253: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-12-14T14:18:53.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:53 smithi119 ceph-mon[43834]: pgmap v254: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:18:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:53 smithi069 ceph-mon[42034]: pgmap v254: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:18:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:53 smithi081 ceph-mon[43371]: pgmap v254: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:18:54.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:54 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:18:54.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:54 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:18:54.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:54 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:18:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:55 smithi119 ceph-mon[43834]: pgmap v255: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:18:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:55 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:18:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:55 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:18:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:55 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:18:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:55 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:18:55.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:55 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:18:55.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:55 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:18:55.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:55 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:18:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:55 smithi069 ceph-mon[42034]: pgmap v255: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:18:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:55 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:18:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:55 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:18:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:55 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:18:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:55 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:18:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:55 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:18:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:55 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:18:55.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:55 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:18:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:55 smithi081 ceph-mon[43371]: pgmap v255: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:18:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:55 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:18:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:55 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:18:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:55 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:18:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:55 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:18:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:55 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:18:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:55 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:18:55.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:55 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:18:57.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:57 smithi081 ceph-mon[43371]: pgmap v256: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:57.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:57 smithi119 ceph-mon[43834]: pgmap v256: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:57.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:57 smithi069 ceph-mon[42034]: pgmap v256: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:59.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:18:59 smithi119 ceph-mon[43834]: pgmap v257: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:18:59 smithi069 ceph-mon[42034]: pgmap v257: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:18:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:18:59 smithi081 ceph-mon[43371]: pgmap v257: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:01.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:01 smithi119 ceph-mon[43834]: pgmap v258: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:01.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:01 smithi069 ceph-mon[42034]: pgmap v258: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:01 smithi081 ceph-mon[43371]: pgmap v258: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:03.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:03 smithi119 ceph-mon[43834]: pgmap v259: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:03.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:03 smithi069 ceph-mon[42034]: pgmap v259: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:03 smithi081 ceph-mon[43371]: pgmap v259: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:05.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:05 smithi119 ceph-mon[43834]: pgmap v260: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:19:05.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:05 smithi069 ceph-mon[42034]: pgmap v260: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:19:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:05 smithi081 ceph-mon[43371]: pgmap v260: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:19:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:07 smithi081 ceph-mon[43371]: pgmap v261: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:19:07.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:07 smithi119 ceph-mon[43834]: pgmap v261: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:19:07.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:07 smithi069 ceph-mon[42034]: pgmap v261: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:19:09.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:09 smithi119 ceph-mon[43834]: pgmap v262: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:19:09.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:09 smithi069 ceph-mon[42034]: pgmap v262: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:19:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:09 smithi081 ceph-mon[43371]: pgmap v262: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:19:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:11 smithi119 ceph-mon[43834]: pgmap v263: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:19:11.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:11 smithi119 ceph-mon[43834]: osdmap e90: 12 total, 12 up, 12 in 2023-12-14T14:19:11.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:11 smithi069 ceph-mon[42034]: pgmap v263: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:19:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:11 smithi069 ceph-mon[42034]: osdmap e90: 12 total, 12 up, 12 in 2023-12-14T14:19:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:11 smithi081 ceph-mon[43371]: pgmap v263: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:19:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:11 smithi081 ceph-mon[43371]: osdmap e90: 12 total, 12 up, 12 in 2023-12-14T14:19:13.520 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:19:13.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 -- 172.21.15.69:0/3556774227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c0ffd30 msgr2=0x7f7d6c103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 --2- 172.21.15.69:0/3556774227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c0ffd30 0x7f7d6c103cf0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0099c0 tx=0x7f7d5c009cd0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 -- 172.21.15.69:0/3556774227 shutdown_connections 2023-12-14T14:19:13.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 --2- 172.21.15.69:0/3556774227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c1043d0 0x7f7d6c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 --2- 172.21.15.69:0/3556774227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d6c0ff390 0x7f7d6c0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 --2- 172.21.15.69:0/3556774227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c0ffd30 0x7f7d6c103cf0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 -- 172.21.15.69:0/3556774227 >> 172.21.15.69:0/3556774227 conn(0x7f7d6c075fd0 msgr2=0x7f7d6c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:13.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 -- 172.21.15.69:0/3556774227 shutdown_connections 2023-12-14T14:19:13.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 -- 172.21.15.69:0/3556774227 wait complete. 2023-12-14T14:19:13.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 Processor -- start 2023-12-14T14:19:13.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.657+0000 7f7d74756700 1 -- start start 2023-12-14T14:19:13.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d74756700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d6c0ff390 0x7f7d6c100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d74756700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c0ffd30 0x7f7d6c1012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d74756700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c1043d0 0x7f7d6c1a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d74756700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c101b00 con 0x7f7d6c1043d0 2023-12-14T14:19:13.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d74756700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c1a4ac0 con 0x7f7d6c0ffd30 2023-12-14T14:19:13.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d74756700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c1a4c00 con 0x7f7d6c0ff390 2023-12-14T14:19:13.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d72cf3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c1043d0 0x7f7d6c1a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d72cf3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c1043d0 0x7f7d6c1a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36704/0 (socket says 172.21.15.69:36704) 2023-12-14T14:19:13.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d72cf3700 1 -- 172.21.15.69:0/1074835503 learned_addr learned my addr 172.21.15.69:0/1074835503 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:13.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c0ffd30 0x7f7d6c1012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d724f2700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d6c0ff390 0x7f7d6c100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d72cf3700 1 -- 172.21.15.69:0/1074835503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d6c0ff390 msgr2=0x7f7d6c100d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d6c0ff390 0x7f7d6c100d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d72cf3700 1 -- 172.21.15.69:0/1074835503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c0ffd30 msgr2=0x7f7d6c1012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c0ffd30 0x7f7d6c1012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d72cf3700 1 -- 172.21.15.69:0/1074835503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0095f0 con 0x7f7d6c1043d0 2023-12-14T14:19:13.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d724f2700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d6c0ff390 0x7f7d6c100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:13.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c1043d0 0x7f7d6c1a4580 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7d64007ee0 tx=0x7f7d6400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:13.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d637fe700 1 -- 172.21.15.69:0/1074835503 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64017070 con 0x7f7d6c1043d0 2023-12-14T14:19:13.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d637fe700 1 -- 172.21.15.69:0/1074835503 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d6400f040 con 0x7f7d6c1043d0 2023-12-14T14:19:13.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d74756700 1 -- 172.21.15.69:0/1074835503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6c10f150 con 0x7f7d6c1043d0 2023-12-14T14:19:13.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d637fe700 1 -- 172.21.15.69:0/1074835503 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64005740 con 0x7f7d6c1043d0 2023-12-14T14:19:13.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.658+0000 7f7d74756700 1 -- 172.21.15.69:0/1074835503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6c10efc0 con 0x7f7d6c1043d0 2023-12-14T14:19:13.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.661+0000 7f7d637fe700 1 -- 172.21.15.69:0/1074835503 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7d6400dc60 con 0x7f7d6c1043d0 2023-12-14T14:19:13.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.661+0000 7f7d637fe700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7d580a12c0 0x7f7d580a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.662+0000 7f7d724f2700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7d580a12c0 0x7f7d580a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.662+0000 7f7d637fe700 1 -- 172.21.15.69:0/1074835503 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f7d640cc540 con 0x7f7d6c1043d0 2023-12-14T14:19:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.662+0000 7f7d724f2700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7d580a12c0 0x7f7d580a3770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d68005fd0 tx=0x7f7d68005e30 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.662+0000 7f7d808e4b80 1 Processor -- start 2023-12-14T14:19:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d808e4b80 1 -- start start 2023-12-14T14:19:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594380 0x564f56594750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594c90 0x564f5659f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 0x564f565a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5647e5e0 con 0x564f56594380 2023-12-14T14:19:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f564ed870 con 0x564f5659fb50 2023-12-14T14:19:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f564e6d00 con 0x564f56594c90 2023-12-14T14:19:13.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d724f2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594380 0x564f56594750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d724f2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594380 0x564f56594750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36718/0 (socket says 172.21.15.69:36718) 2023-12-14T14:19:13.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d724f2700 1 -- 172.21.15.69:0/3438754878 learned_addr learned my addr 172.21.15.69:0/3438754878 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:13.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 0x564f565a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d724f2700 1 -- 172.21.15.69:0/3438754878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594c90 msgr2=0x564f5659f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:13.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594c90 0x564f5659f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d724f2700 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594c90 0x564f5659f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d724f2700 1 -- 172.21.15.69:0/3438754878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 msgr2=0x564f565a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:13.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d724f2700 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 0x564f565a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d724f2700 1 -- 172.21.15.69:0/3438754878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f563683b0 con 0x564f56594380 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594c90 0x564f5659f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.663+0000 7f7d724f2700 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594380 0x564f56594750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800a5c0 tx=0x7f7d68011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d14742f1f99e30 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d60ff9700 1 -- 172.21.15.69:0/3438754878 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68010e50 con 0x564f56594380 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d60ff9700 1 -- 172.21.15.69:0/3438754878 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d6800eec0 con 0x564f56594380 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d60ff9700 1 -- 172.21.15.69:0/3438754878 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800f840 con 0x564f56594380 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3438754878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594380 msgr2=0x564f56594750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594380 0x564f56594750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800a5c0 tx=0x7f7d68011000 comp rx=0 tx=0).stop 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3438754878 shutdown_connections 2023-12-14T14:19:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 0x564f565a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594380 0x564f56594750 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3438754878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594c90 0x564f5659f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3438754878 >> 172.21.15.69:0/3438754878 conn(0x564f5658aca0 msgr2=0x564f565907e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3438754878 shutdown_connections 2023-12-14T14:19:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.664+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3438754878 wait complete. 2023-12-14T14:19:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d808e4b80 1 -- start start 2023-12-14T14:19:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d808e4b80 1 Processor -- start 2023-12-14T14:19:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594380 0x564f5659f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f5659fb50 0x564f5659cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f56482f90 con 0x564f56594c90 2023-12-14T14:19:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f56482c30 con 0x564f56594380 2023-12-14T14:19:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5636a6a0 con 0x564f5659fb50 2023-12-14T14:19:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d808e4b80 10 client.0 _ll_register_callbacks cb 0x564f564a6910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d71cf1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d71cf1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36724/0 (socket says 172.21.15.69:36724) 2023-12-14T14:19:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.665+0000 7f7d71cf1700 1 -- 172.21.15.69:0/1065344309 learned_addr learned my addr 172.21.15.69:0/1065344309 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d724f2700 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594380 0x564f5659f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f5659fb50 0x564f5659cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d71cf1700 1 -- 172.21.15.69:0/1065344309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f5659fb50 msgr2=0x564f5659cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f5659fb50 0x564f5659cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d71cf1700 1 -- 172.21.15.69:0/1065344309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594380 msgr2=0x564f5659f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594380 0x564f5659f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d71cf1700 1 -- 172.21.15.69:0/1065344309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6800eba0 con 0x564f56594c90 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d724f2700 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594380 0x564f5659f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659c7b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c000c00 tx=0x7f7d5c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ff17d25af167ca server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d55ffb700 1 -- 172.21.15.69:0/1065344309 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c00bc20 con 0x564f56594c90 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d55ffb700 1 -- 172.21.15.69:0/1065344309 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f7d5c00bd80 con 0x564f56594c90 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d808e4b80 1 -- 172.21.15.69:0/1065344309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f564dfce0 con 0x564f56594c90 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d55ffb700 1 -- 172.21.15.69:0/1065344309 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d5c0038c0 con 0x564f56594c90 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d808e4b80 10 client.16623 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d808e4b80 1 -- 172.21.15.69:0/1065344309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564f564ad170 con 0x564f56594c90 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d55ffb700 1 -- 172.21.15.69:0/1065344309 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564f564dfce0 con 0x564f56594c90 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.666+0000 7f7d55ffb700 1 -- 172.21.15.69:0/1065344309 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f7d5c004890 con 0x564f56594c90 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.667+0000 7f7d808e4b80 10 client.16623 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.667+0000 7f7d808e4b80 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.667+0000 7f7d808e4b80 20 client.16623 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.667+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x564f565af4a0 0x564f565b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.667+0000 7f7d808e4b80 4 client.16623 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.667+0000 7f7d808e4b80 1 -- 172.21.15.69:0/1065344309 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f564dfa00 con 0x564f565af4a0 2023-12-14T14:19:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.667+0000 7f7d724f2700 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x564f565af4a0 0x564f565b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.667+0000 7f7d724f2700 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x564f565af4a0 0x564f565b18b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=894180bf31d34c8b server_cookie=ae6548efbd9c63ce in_seq=0 out_seq=0 2023-12-14T14:19:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.667+0000 7f7d55ffb700 10 client.16623 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d55ffb700 1 -- 172.21.15.69:0/1065344309 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564f564dfa00 con 0x564f565af4a0 2023-12-14T14:19:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d55ffb700 10 client.16623 handle_command_reply: tid=0 2023-12-14T14:19:13.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 client.16623 shutdown 2023-12-14T14:19:13.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 -- 172.21.15.69:0/1065344309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 msgr2=0x564f5659c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659c7b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c000c00 tx=0x7f7d5c005800 comp rx=0 tx=0).stop 2023-12-14T14:19:13.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 -- 172.21.15.69:0/1065344309 shutdown_connections 2023-12-14T14:19:13.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x564f565af4a0 0x564f565b18b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f5659fb50 0x564f5659cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d55ffb700 0 client.16623 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:13.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594380 0x564f5659f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/1065344309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659c7b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 -- 172.21.15.69:0/1065344309 >> 172.21.15.69:0/1065344309 conn(0x564f5658aca0 msgr2=0x564f565903d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:13.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 -- 172.21.15.69:0/1065344309 shutdown_connections 2023-12-14T14:19:13.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 1 -- 172.21.15.69:0/1065344309 wait complete. 2023-12-14T14:19:13.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.668+0000 7f7d808e4b80 20 client.16623 trim_cache size 0 max 16384 2023-12-14T14:19:13.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d808e4b80 1 Processor -- start 2023-12-14T14:19:13.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d808e4b80 1 -- start start 2023-12-14T14:19:13.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 0x564f5659efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 0x564f56597ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f564dfce0 con 0x564f56594c90 2023-12-14T14:19:13.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f56595390 con 0x564f5659fb50 2023-12-14T14:19:13.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f565acb00 con 0x564f56594380 2023-12-14T14:19:13.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d71cf1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d71cf1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36740/0 (socket says 172.21.15.69:36740) 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.685+0000 7f7d71cf1700 1 -- 172.21.15.69:0/2828145993 learned_addr learned my addr 172.21.15.69:0/2828145993 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d724f2700 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 0x564f5659efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 0x564f56597ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d71cf1700 1 -- 172.21.15.69:0/2828145993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 msgr2=0x564f5659efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 0x564f5659efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d71cf1700 1 -- 172.21.15.69:0/2828145993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 msgr2=0x564f56597ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 0x564f56597ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d71cf1700 1 -- 172.21.15.69:0/2828145993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f564acec0 con 0x564f56594c90 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 0x564f56597ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:13.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659f500 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c006010 tx=0x7f7d5c009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177a07d63b49613d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:13.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d617fa700 1 -- 172.21.15.69:0/2828145993 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c004e90 con 0x564f56594c90 2023-12-14T14:19:13.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d617fa700 1 -- 172.21.15.69:0/2828145993 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d5c01e050 con 0x564f56594c90 2023-12-14T14:19:13.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d617fa700 1 -- 172.21.15.69:0/2828145993 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c00f530 con 0x564f56594c90 2023-12-14T14:19:13.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d808e4b80 1 -- 172.21.15.69:0/2828145993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 msgr2=0x564f5659f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659f500 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c006010 tx=0x7f7d5c009f10 comp rx=0 tx=0).stop 2023-12-14T14:19:13.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.686+0000 7f7d808e4b80 1 -- 172.21.15.69:0/2828145993 shutdown_connections 2023-12-14T14:19:13.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f5659fb50 0x564f56597ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 0x564f5659efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/2828145993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f56594c90 0x564f5659f500 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 -- 172.21.15.69:0/2828145993 >> 172.21.15.69:0/2828145993 conn(0x564f5658aca0 msgr2=0x564f565ab800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:13.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 -- 172.21.15.69:0/2828145993 shutdown_connections 2023-12-14T14:19:13.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 -- 172.21.15.69:0/2828145993 wait complete. 2023-12-14T14:19:13.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 -- start start 2023-12-14T14:19:13.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 Processor -- start 2023-12-14T14:19:13.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 0x564f565a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594c90 0x564f565a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f5659fb50 0x564f56602360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f565a4e80 con 0x564f5659fb50 2023-12-14T14:19:13.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f566028a0 con 0x564f56594c90 2023-12-14T14:19:13.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f566029e0 con 0x564f56594380 2023-12-14T14:19:13.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d808e4b80 10 client.0 _ll_register_callbacks cb 0x7f7d5c005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:13.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d72cf3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f5659fb50 0x564f56602360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d72cf3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f5659fb50 0x564f56602360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36752/0 (socket says 172.21.15.69:36752) 2023-12-14T14:19:13.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d72cf3700 1 -- 172.21.15.69:0/3745526179 learned_addr learned my addr 172.21.15.69:0/3745526179 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:13.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d71cf1700 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594c90 0x564f565a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.687+0000 7f7d724f2700 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 0x564f565a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d72cf3700 1 -- 172.21.15.69:0/3745526179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 msgr2=0x564f565a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 0x564f565a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d72cf3700 1 -- 172.21.15.69:0/3745526179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594c90 msgr2=0x564f565a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594c90 0x564f565a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d72cf3700 1 -- 172.21.15.69:0/3745526179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f564ad170 con 0x564f5659fb50 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d72cf3700 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f5659fb50 0x564f56602360 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7d64095aa0 tx=0x7f7d6400df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5228b2751316cfb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d55ffb700 1 -- 172.21.15.69:0/3745526179 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d640ca0b0 con 0x564f5659fb50 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d55ffb700 1 -- 172.21.15.69:0/3745526179 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f7d64005aa0 con 0x564f5659fb50 2023-12-14T14:19:13.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3745526179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f565882b0 con 0x564f5659fb50 2023-12-14T14:19:13.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d55ffb700 1 -- 172.21.15.69:0/3745526179 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d64098f00 con 0x564f5659fb50 2023-12-14T14:19:13.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d808e4b80 10 client.16629 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:13.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3745526179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564f564939a0 con 0x564f5659fb50 2023-12-14T14:19:13.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d55ffb700 1 -- 172.21.15.69:0/3745526179 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d640c7080 con 0x564f5659fb50 2023-12-14T14:19:13.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d55ffb700 1 -- 172.21.15.69:0/3745526179 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f7d64099800 con 0x564f5659fb50 2023-12-14T14:19:13.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d808e4b80 10 client.16629 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:13.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d808e4b80 10 client.16629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:13.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d808e4b80 20 client.16629 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:13.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x564f566041c0 0x564f566065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d808e4b80 4 client.16629 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.688+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3745526179 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564f56335cf0 con 0x564f566041c0 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d724f2700 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x564f566041c0 0x564f566065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d55ffb700 10 client.16629 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d724f2700 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x564f566041c0 0x564f566065d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdc86868695f7e29 server_cookie=dab527666b8a47f5 in_seq=0 out_seq=0 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d55ffb700 1 -- 172.21.15.69:0/3745526179 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564f56335cf0 con 0x564f566041c0 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d55ffb700 10 client.16629 handle_command_reply: tid=0 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 client.16629 shutdown 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3745526179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f5659fb50 msgr2=0x564f56602360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f5659fb50 0x564f56602360 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7d64095aa0 tx=0x7f7d6400df60 comp rx=0 tx=0).stop 2023-12-14T14:19:13.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3745526179 shutdown_connections 2023-12-14T14:19:13.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x564f566041c0 0x564f566065d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f5659fb50 0x564f56602360 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d55ffb700 0 client.16629 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:13.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f56594380 0x564f565a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 --2- 172.21.15.69:0/3745526179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f56594c90 0x564f565a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3745526179 >> 172.21.15.69:0/3745526179 conn(0x564f5658aca0 msgr2=0x564f56597ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:13.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3745526179 shutdown_connections 2023-12-14T14:19:13.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 1 -- 172.21.15.69:0/3745526179 wait complete. 2023-12-14T14:19:13.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.689+0000 7f7d808e4b80 20 client.16629 trim_cache size 0 max 16384 2023-12-14T14:19:13.700 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:19:13.700 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:19:13.700 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:19:13.700 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:19:13.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 -- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7d580a12c0 msgr2=0x7f7d580a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7d580a12c0 0x7f7d580a3770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d68005fd0 tx=0x7f7d68005e30 comp rx=0 tx=0).stop 2023-12-14T14:19:13.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 -- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c1043d0 msgr2=0x7f7d6c1a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c1043d0 0x7f7d6c1a4580 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7d64007ee0 tx=0x7f7d6400d3b0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 -- 172.21.15.69:0/1074835503 shutdown_connections 2023-12-14T14:19:13.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7d580a12c0 0x7f7d580a3770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d6c1043d0 0x7f7d6c1a4580 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d6c0ff390 0x7f7d6c100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 --2- 172.21.15.69:0/1074835503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c0ffd30 0x7f7d6c1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 -- 172.21.15.69:0/1074835503 >> 172.21.15.69:0/1074835503 conn(0x7f7d6c075fd0 msgr2=0x7f7d6c067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:13.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 -- 172.21.15.69:0/1074835503 shutdown_connections 2023-12-14T14:19:13.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.690+0000 7f7d74756700 1 -- 172.21.15.69:0/1074835503 wait complete. 2023-12-14T14:19:13.703 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:19:13.703 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:19:13.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:13 smithi119 ceph-mon[43834]: pgmap v265: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-12-14T14:19:13.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 -- 172.21.15.69:0/3638860241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c10a810 msgr2=0x7f0c3c10cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/3638860241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c10a810 0x7f0c3c10cc50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400b0a0 tx=0x7f0c3400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 -- 172.21.15.69:0/3638860241 shutdown_connections 2023-12-14T14:19:13.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/3638860241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c10a810 0x7f0c3c10cc50 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/3638860241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c101440 0x7f0c3c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/3638860241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3c101d50 0x7f0c3c10a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 -- 172.21.15.69:0/3638860241 >> 172.21.15.69:0/3638860241 conn(0x7f0c3c0761f0 msgr2=0x7f0c3c0765f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:13.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 -- 172.21.15.69:0/3638860241 shutdown_connections 2023-12-14T14:19:13.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 -- 172.21.15.69:0/3638860241 wait complete. 2023-12-14T14:19:13.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.825+0000 7f0c41fb1700 1 Processor -- start 2023-12-14T14:19:13.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c41fb1700 1 -- start start 2023-12-14T14:19:13.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c41fb1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c101440 0x7f0c3c0ff090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c41fb1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c101d50 0x7f0c3c0ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c41fb1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3c10a810 0x7f0c3c1a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c41fb1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ffe00 con 0x7f0c3c101440 2023-12-14T14:19:13.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c41fb1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1a4ae0 con 0x7f0c3c101d50 2023-12-14T14:19:13.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c41fb1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1a4c20 con 0x7f0c3c10a810 2023-12-14T14:19:13.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c101440 0x7f0c3c0ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c101440 0x7f0c3c0ff090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36762/0 (socket says 172.21.15.69:36762) 2023-12-14T14:19:13.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3b7fe700 1 -- 172.21.15.69:0/1051024517 learned_addr learned my addr 172.21.15.69:0/1051024517 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:13.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3affd700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c101d50 0x7f0c3c0ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3b7fe700 1 -- 172.21.15.69:0/1051024517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3c10a810 msgr2=0x7f0c3c1a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3b7fe700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3c10a810 0x7f0c3c1a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3b7fe700 1 -- 172.21.15.69:0/1051024517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c101d50 msgr2=0x7f0c3c0ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3b7fe700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c101d50 0x7f0c3c0ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3b7fe700 1 -- 172.21.15.69:0/1051024517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34009d00 con 0x7f0c3c101440 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3affd700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c101d50 0x7f0c3c0ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c3b7fe700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c101440 0x7f0c3c0ff090 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c9b0 tx=0x7f0c3000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.826+0000 7f0c38ff9700 1 -- 172.21.15.69:0/1051024517 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30007b00 con 0x7f0c3c101440 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.827+0000 7f0c38ff9700 1 -- 172.21.15.69:0/1051024517 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c30007c60 con 0x7f0c3c101440 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.827+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c110270 con 0x7f0c3c101440 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.827+0000 7f0c38ff9700 1 -- 172.21.15.69:0/1051024517 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30018660 con 0x7f0c3c101440 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.827+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c1100e0 con 0x7f0c3c101440 2023-12-14T14:19:13.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.827+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c110400 con 0x7f0c3c101440 2023-12-14T14:19:13.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.829+0000 7f0c38ff9700 1 -- 172.21.15.69:0/1051024517 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0c30018880 con 0x7f0c3c101440 2023-12-14T14:19:13.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.829+0000 7f0c38ff9700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0c240a12c0 0x7f0c240a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:13.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.829+0000 7f0c3affd700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0c240a12c0 0x7f0c240a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:13.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.829+0000 7f0c38ff9700 1 -- 172.21.15.69:0/1051024517 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f0c300cd060 con 0x7f0c3c101440 2023-12-14T14:19:13.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.830+0000 7f0c3affd700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0c240a12c0 0x7f0c240a3770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c100880 tx=0x7f0c2c009550 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:13.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:13.833+0000 7f0c38ff9700 1 -- 172.21.15.69:0/1051024517 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0c300964f0 con 0x7f0c3c101440 2023-12-14T14:19:13.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:13 smithi069 ceph-mon[42034]: pgmap v265: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-12-14T14:19:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:13 smithi081 ceph-mon[43371]: pgmap v265: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-12-14T14:19:14.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.063+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c3c1006e0 con 0x7f0c3c101440 2023-12-14T14:19:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.063+0000 7f0c38ff9700 1 -- 172.21.15.69:0/1051024517 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10810 (secure 0 0 0) 0x7f0c3c1006e0 con 0x7f0c3c101440 2023-12-14T14:19:14.064 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:19:14.064 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:14:13.438363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:19:14.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.065+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0c240a12c0 msgr2=0x7f0c240a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.065+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0c240a12c0 0x7f0c240a3770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c100880 tx=0x7f0c2c009550 comp rx=0 tx=0).stop 2023-12-14T14:19:14.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.065+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c101440 msgr2=0x7f0c3c0ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.065+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c101440 0x7f0c3c0ff090 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c9b0 tx=0x7f0c3000cd70 comp rx=0 tx=0).stop 2023-12-14T14:19:14.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.065+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 shutdown_connections 2023-12-14T14:19:14.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.066+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f0c240a12c0 0x7f0c240a3770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.066+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3c10a810 0x7f0c3c1a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.066+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c3c101440 0x7f0c3c0ff090 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.066+0000 7f0c41fb1700 1 --2- 172.21.15.69:0/1051024517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c101d50 0x7f0c3c0ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.066+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 >> 172.21.15.69:0/1051024517 conn(0x7f0c3c0761f0 msgr2=0x7f0c3c104320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.066+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 shutdown_connections 2023-12-14T14:19:14.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.066+0000 7f0c41fb1700 1 -- 172.21.15.69:0/1051024517 wait complete. 2023-12-14T14:19:14.068 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-12-14T14:19:14.078 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:19:14.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 -- 172.21.15.69:0/1699754518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c104410 msgr2=0x7fce9c10bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 --2- 172.21.15.69:0/1699754518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c104410 0x7fce9c10bfe0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fce9400b0d0 tx=0x7fce9400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 -- 172.21.15.69:0/1699754518 shutdown_connections 2023-12-14T14:19:14.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 --2- 172.21.15.69:0/1699754518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c104410 0x7fce9c10bfe0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 --2- 172.21.15.69:0/1699754518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c0ff3d0 0x7fce9c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 --2- 172.21.15.69:0/1699754518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce9c0ffd70 0x7fce9c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 -- 172.21.15.69:0/1699754518 >> 172.21.15.69:0/1699754518 conn(0x7fce9c076000 msgr2=0x7fce9c076400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 -- 172.21.15.69:0/1699754518 shutdown_connections 2023-12-14T14:19:14.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 -- 172.21.15.69:0/1699754518 wait complete. 2023-12-14T14:19:14.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 Processor -- start 2023-12-14T14:19:14.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.202+0000 7fcea22c8700 1 -- start start 2023-12-14T14:19:14.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea22c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c0ff3d0 0x7fce9c1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea22c8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce9c0ffd70 0x7fce9c197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea22c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c104410 0x7fce9c1a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea22c8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c198140 con 0x7fce9c0ff3d0 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea22c8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c1a28b0 con 0x7fce9c104410 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea22c8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c1a2a20 con 0x7fce9c0ffd70 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c0ff3d0 0x7fce9c1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c0ff3d0 0x7fce9c1972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36776/0 (socket says 172.21.15.69:36776) 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9bfff700 1 -- 172.21.15.69:0/4207000874 learned_addr learned my addr 172.21.15.69:0/4207000874 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce9c0ffd70 0x7fce9c197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea0865700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c104410 0x7fce9c1a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9bfff700 1 -- 172.21.15.69:0/4207000874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce9c0ffd70 msgr2=0x7fce9c197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9bfff700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce9c0ffd70 0x7fce9c197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9bfff700 1 -- 172.21.15.69:0/4207000874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c104410 msgr2=0x7fce9c1a2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9bfff700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c104410 0x7fce9c1a2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9bfff700 1 -- 172.21.15.69:0/4207000874 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94009d00 con 0x7fce9c0ff3d0 2023-12-14T14:19:14.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea0865700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c104410 0x7fce9c1a2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:14.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce9bfff700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c0ff3d0 0x7fce9c1972f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fce9000d950 tx=0x7fce9000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce997fa700 1 -- 172.21.15.69:0/4207000874 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90009940 con 0x7fce9c0ff3d0 2023-12-14T14:19:14.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce997fa700 1 -- 172.21.15.69:0/4207000874 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce90010460 con 0x7fce9c0ff3d0 2023-12-14T14:19:14.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea22c8700 1 -- 172.21.15.69:0/4207000874 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c10f1e0 con 0x7fce9c0ff3d0 2023-12-14T14:19:14.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fce997fa700 1 -- 172.21.15.69:0/4207000874 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9000f620 con 0x7fce9c0ff3d0 2023-12-14T14:19:14.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.203+0000 7fcea22c8700 1 -- 172.21.15.69:0/4207000874 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c10f050 con 0x7fce9c0ff3d0 2023-12-14T14:19:14.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.205+0000 7fce997fa700 1 -- 172.21.15.69:0/4207000874 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fce900108d0 con 0x7fce9c0ff3d0 2023-12-14T14:19:14.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.206+0000 7fce997fa700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fce840a12c0 0x7fce840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.206+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fce840a12c0 0x7fce840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.206+0000 7fce997fa700 1 -- 172.21.15.69:0/4207000874 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fce900ccbb0 con 0x7fce9c0ff3d0 2023-12-14T14:19:14.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.206+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fce840a12c0 0x7fce840a3770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce9c069830 tx=0x7fce8c009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fceae456b80 1 Processor -- start 2023-12-14T14:19:14.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fceae456b80 1 -- start start 2023-12-14T14:19:14.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fceae456b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092a380 0x55d53092a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fceae456b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092ac90 0x55d530939a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fceae456b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 0x55d53093c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fceae456b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5308145e0 con 0x55d53092a380 2023-12-14T14:19:14.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fceae456b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d530883870 con 0x55d530939f60 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fceae456b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d53087cd00 con 0x55d53092ac90 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092a380 0x55d53092a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092a380 0x55d53092a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36780/0 (socket says 172.21.15.69:36780) 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9bfff700 1 -- 172.21.15.69:0/3991128803 learned_addr learned my addr 172.21.15.69:0/3991128803 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092ac90 0x55d530939a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fcea0865700 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 0x55d53093c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9bfff700 1 -- 172.21.15.69:0/3991128803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092ac90 msgr2=0x55d530939a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9bfff700 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092ac90 0x55d530939a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9bfff700 1 -- 172.21.15.69:0/3991128803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 msgr2=0x55d53093c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9bfff700 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 0x55d53093c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9bfff700 1 -- 172.21.15.69:0/3991128803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5306fe3b0 con 0x55d53092a380 2023-12-14T14:19:14.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.207+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092ac90 0x55d530939a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:14.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fce9bfff700 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092a380 0x55d53092a750 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fce900a1b90 tx=0x7fce90099c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eac0db5c8c27680 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fce827fc700 1 -- 172.21.15.69:0/3991128803 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90096380 con 0x55d53092a380 2023-12-14T14:19:14.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fce827fc700 1 -- 172.21.15.69:0/3991128803 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce900964e0 con 0x55d53092a380 2023-12-14T14:19:14.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fce827fc700 1 -- 172.21.15.69:0/3991128803 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900a1e90 con 0x55d53092a380 2023-12-14T14:19:14.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fceae456b80 1 -- 172.21.15.69:0/3991128803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092a380 msgr2=0x55d53092a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fceae456b80 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092a380 0x55d53092a750 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fce900a1b90 tx=0x7fce90099c70 comp rx=0 tx=0).stop 2023-12-14T14:19:14.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fceae456b80 1 -- 172.21.15.69:0/3991128803 shutdown_connections 2023-12-14T14:19:14.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fceae456b80 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 0x55d53093c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fceae456b80 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092a380 0x55d53092a750 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fceae456b80 1 --2- 172.21.15.69:0/3991128803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092ac90 0x55d530939a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.208+0000 7fceae456b80 1 -- 172.21.15.69:0/3991128803 >> 172.21.15.69:0/3991128803 conn(0x55d530920ca0 msgr2=0x55d5309267e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 -- 172.21.15.69:0/3991128803 shutdown_connections 2023-12-14T14:19:14.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 -- 172.21.15.69:0/3991128803 wait complete. 2023-12-14T14:19:14.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 -- start start 2023-12-14T14:19:14.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 Processor -- start 2023-12-14T14:19:14.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 0x55d530939a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092ac90 0x55d530936cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d530939f60 0x55d5309373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d530818f90 con 0x55d530939f60 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d530818c30 con 0x55d53092ac90 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5307006a0 con 0x55d53092a380 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fceae456b80 10 client.0 _ll_register_callbacks cb 0x55d53083c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fcea0865700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d530939f60 0x55d5309373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fcea0865700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d530939f60 0x55d5309373f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36790/0 (socket says 172.21.15.69:36790) 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.209+0000 7fcea0865700 1 -- 172.21.15.69:0/145706163 learned_addr learned my addr 172.21.15.69:0/145706163 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fce9bfff700 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 0x55d530939a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092ac90 0x55d530936cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fcea0865700 1 -- 172.21.15.69:0/145706163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 msgr2=0x55d530939a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fcea0865700 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 0x55d530939a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fcea0865700 1 -- 172.21.15.69:0/145706163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092ac90 msgr2=0x55d530936cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fcea0865700 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092ac90 0x55d530936cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fcea0865700 1 -- 172.21.15.69:0/145706163 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c10f050 con 0x55d530939f60 2023-12-14T14:19:14.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092ac90 0x55d530936cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:14.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fcea0865700 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d530939f60 0x55d5309373f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fce94009610 tx=0x7fce9400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94067bc41b6e153 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fce7b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:14.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fce7b7fe700 1 -- 172.21.15.69:0/145706163 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9400e050 con 0x55d530939f60 2023-12-14T14:19:14.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fce7b7fe700 1 -- 172.21.15.69:0/145706163 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fce940074e0 con 0x55d530939f60 2023-12-14T14:19:14.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fceae456b80 1 -- 172.21.15.69:0/145706163 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d53091e2b0 con 0x55d530939f60 2023-12-14T14:19:14.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fce7b7fe700 1 -- 172.21.15.69:0/145706163 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce940076a0 con 0x55d530939f60 2023-12-14T14:19:14.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fceae456b80 10 client.16647 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:14.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fceae456b80 1 -- 172.21.15.69:0/145706163 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d530843170 con 0x55d530939f60 2023-12-14T14:19:14.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.210+0000 7fce7b7fe700 1 -- 172.21.15.69:0/145706163 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d53091e2b0 con 0x55d530939f60 2023-12-14T14:19:14.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fce7b7fe700 1 -- 172.21.15.69:0/145706163 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fce9400b100 con 0x55d530939f60 2023-12-14T14:19:14.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fceae456b80 10 client.16647 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fceae456b80 10 client.16647 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fceae456b80 20 client.16647 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fceae456b80 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55d530949950 0x55d53094bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fceae456b80 4 client.16647 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fceae456b80 1 -- 172.21.15.69:0/145706163 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d530875ce0 con 0x55d530949950 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fce9bfff700 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55d530949950 0x55d53094bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fce7b7fe700 10 client.16647 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.211+0000 7fce9bfff700 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55d530949950 0x55d53094bd60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4788927990a4659 server_cookie=ede775abb6228c3d in_seq=0 out_seq=0 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fce7b7fe700 1 -- 172.21.15.69:0/145706163 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d530875ce0 con 0x55d530949950 2023-12-14T14:19:14.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fce7b7fe700 10 client.16647 handle_command_reply: tid=0 2023-12-14T14:19:14.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 client.16647 shutdown 2023-12-14T14:19:14.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 -- 172.21.15.69:0/145706163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d530939f60 msgr2=0x55d5309373f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d530939f60 0x55d5309373f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fce94009610 tx=0x7fce9400ce00 comp rx=0 tx=0).stop 2023-12-14T14:19:14.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 -- 172.21.15.69:0/145706163 shutdown_connections 2023-12-14T14:19:14.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55d530949950 0x55d53094bd60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d530939f60 0x55d5309373f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 0x55d530939a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fce7b7fe700 0 client.16647 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:19:14.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 --2- 172.21.15.69:0/145706163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092ac90 0x55d530936cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 -- 172.21.15.69:0/145706163 >> 172.21.15.69:0/145706163 conn(0x55d530920ca0 msgr2=0x55d5309263d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 -- 172.21.15.69:0/145706163 shutdown_connections 2023-12-14T14:19:14.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 1 -- 172.21.15.69:0/145706163 wait complete. 2023-12-14T14:19:14.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.212+0000 7fceae456b80 20 client.16647 trim_cache size 0 max 16384 2023-12-14T14:19:14.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.225+0000 7fceae456b80 1 Processor -- start 2023-12-14T14:19:14.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.225+0000 7fceae456b80 1 -- start start 2023-12-14T14:19:14.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.225+0000 7fceae456b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092a380 0x55d530924f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.225+0000 7fceae456b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d5309506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.225+0000 7fceae456b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d530939f60 0x55d530945d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.225+0000 7fceae456b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d530946fb0 con 0x55d53092ac90 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.225+0000 7fceae456b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d530925470 con 0x55d53092a380 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.225+0000 7fceae456b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d530932b40 con 0x55d530939f60 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d5309506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d5309506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36792/0 (socket says 172.21.15.69:36792) 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9b7fe700 1 -- 172.21.15.69:0/3186461391 learned_addr learned my addr 172.21.15.69:0/3186461391 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fcea0865700 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d530939f60 0x55d530945d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9bfff700 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092a380 0x55d530924f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9b7fe700 1 -- 172.21.15.69:0/3186461391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d530939f60 msgr2=0x55d530945d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d530939f60 0x55d530945d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9b7fe700 1 -- 172.21.15.69:0/3186461391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092a380 msgr2=0x55d530924f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092a380 0x55d530924f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9b7fe700 1 -- 172.21.15.69:0/3186461391 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d530842ec0 con 0x55d53092ac90 2023-12-14T14:19:14.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9bfff700 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092a380 0x55d530924f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:14.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d5309506c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fce9c068ec0 tx=0x7fce8c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffe22c02b41b156 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce82ffd700 1 -- 172.21.15.69:0/3186461391 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c01e880 con 0x55d53092ac90 2023-12-14T14:19:14.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce82ffd700 1 -- 172.21.15.69:0/3186461391 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce8c01c480 con 0x55d53092ac90 2023-12-14T14:19:14.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.226+0000 7fce82ffd700 1 -- 172.21.15.69:0/3186461391 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c01eea0 con 0x55d53092ac90 2023-12-14T14:19:14.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 -- 172.21.15.69:0/3186461391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 msgr2=0x55d5309506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d5309506c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fce9c068ec0 tx=0x7fce8c014000 comp rx=0 tx=0).stop 2023-12-14T14:19:14.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 -- 172.21.15.69:0/3186461391 shutdown_connections 2023-12-14T14:19:14.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d530939f60 0x55d530945d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53092a380 0x55d530924f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 --2- 172.21.15.69:0/3186461391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d5309506c0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 -- 172.21.15.69:0/3186461391 >> 172.21.15.69:0/3186461391 conn(0x55d530920ca0 msgr2=0x55d530922210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 -- 172.21.15.69:0/3186461391 shutdown_connections 2023-12-14T14:19:14.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 -- 172.21.15.69:0/3186461391 wait complete. 2023-12-14T14:19:14.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 -- start start 2023-12-14T14:19:14.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 Processor -- start 2023-12-14T14:19:14.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 0x55d53093ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d53093f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.227+0000 7fceae456b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 0x55d530996850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fceae456b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d530996d90 con 0x55d53092ac90 2023-12-14T14:19:14.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fceae456b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d530996ed0 con 0x55d530939f60 2023-12-14T14:19:14.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fceae456b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d530997090 con 0x55d53092a380 2023-12-14T14:19:14.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fceae456b80 10 client.0 _ll_register_callbacks cb 0x7fce8c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:14.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d53093f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d53093f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36798/0 (socket says 172.21.15.69:36798) 2023-12-14T14:19:14.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9b7fe700 1 -- 172.21.15.69:0/1448496880 learned_addr learned my addr 172.21.15.69:0/1448496880 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9bfff700 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 0x55d53093ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fcea0865700 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 0x55d530996850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9b7fe700 1 -- 172.21.15.69:0/1448496880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 msgr2=0x55d53093ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 0x55d53093ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9b7fe700 1 -- 172.21.15.69:0/1448496880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 msgr2=0x55d530996850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 0x55d530996850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9b7fe700 1 -- 172.21.15.69:0/1448496880 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c017070 con 0x55d53092ac90 2023-12-14T14:19:14.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fcea0865700 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 0x55d530996850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:14.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce9b7fe700 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d53093f150 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fce8c01cd60 tx=0x7fce8c01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cb58b91d2ef777 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce7b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:14.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce7b7fe700 1 -- 172.21.15.69:0/1448496880 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c004240 con 0x55d53092ac90 2023-12-14T14:19:14.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce7b7fe700 1 -- 172.21.15.69:0/1448496880 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fce8c0043a0 con 0x55d53092ac90 2023-12-14T14:19:14.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fceae456b80 1 -- 172.21.15.69:0/1448496880 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce900964e0 con 0x55d53092ac90 2023-12-14T14:19:14.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fce7b7fe700 1 -- 172.21.15.69:0/1448496880 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce8c004560 con 0x55d53092ac90 2023-12-14T14:19:14.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fceae456b80 10 client.16653 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:14.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.228+0000 7fceae456b80 1 -- 172.21.15.69:0/1448496880 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d5308299a0 con 0x55d53092ac90 2023-12-14T14:19:14.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fce7b7fe700 1 -- 172.21.15.69:0/1448496880 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce900964e0 con 0x55d53092ac90 2023-12-14T14:19:14.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fce7b7fe700 1 -- 172.21.15.69:0/1448496880 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fce8c004750 con 0x55d53092ac90 2023-12-14T14:19:14.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fceae456b80 10 client.16653 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:14.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fceae456b80 10 client.16653 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:19:14.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fceae456b80 20 client.16653 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:14.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fceae456b80 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55d53099e7b0 0x55d5309a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fceae456b80 4 client.16653 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:19:14.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fceae456b80 1 -- 172.21.15.69:0/1448496880 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d530875a00 con 0x55d53099e7b0 2023-12-14T14:19:14.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fce9bfff700 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55d53099e7b0 0x55d5309a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fce7b7fe700 10 client.16653 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:19:14.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.229+0000 7fce9bfff700 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55d53099e7b0 0x55d5309a0bc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5b0f6d413789cd7 server_cookie=8e4ba911d96572b5 in_seq=0 out_seq=0 2023-12-14T14:19:14.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fce7b7fe700 1 -- 172.21.15.69:0/1448496880 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d530875a00 con 0x55d53099e7b0 2023-12-14T14:19:14.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fce7b7fe700 10 client.16653 handle_command_reply: tid=0 2023-12-14T14:19:14.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 client.16653 shutdown 2023-12-14T14:19:14.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 -- 172.21.15.69:0/1448496880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 msgr2=0x55d53093f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d53093f150 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fce8c01cd60 tx=0x7fce8c01cb80 comp rx=0 tx=0).stop 2023-12-14T14:19:14.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 -- 172.21.15.69:0/1448496880 shutdown_connections 2023-12-14T14:19:14.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d530939f60 0x55d530996850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d53092a380 0x55d53093ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55d53099e7b0 0x55d5309a0bc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 --2- 172.21.15.69:0/1448496880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d53092ac90 0x55d53093f150 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fce7b7fe700 0 client.16653 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:19:14.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 -- 172.21.15.69:0/1448496880 >> 172.21.15.69:0/1448496880 conn(0x55d530920ca0 msgr2=0x55d5309506c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 -- 172.21.15.69:0/1448496880 shutdown_connections 2023-12-14T14:19:14.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 1 -- 172.21.15.69:0/1448496880 wait complete. 2023-12-14T14:19:14.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fceae456b80 20 client.16653 trim_cache size 0 max 16384 2023-12-14T14:19:14.242 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:19:14.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 -- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fce840a12c0 msgr2=0x7fce840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fce840a12c0 0x7fce840a3770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce9c069830 tx=0x7fce8c009260 comp rx=0 tx=0).stop 2023-12-14T14:19:14.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 -- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c0ff3d0 msgr2=0x7fce9c1972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c0ff3d0 0x7fce9c1972f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fce9000d950 tx=0x7fce9000dc60 comp rx=0 tx=0).stop 2023-12-14T14:19:14.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 -- 172.21.15.69:0/4207000874 shutdown_connections 2023-12-14T14:19:14.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fce840a12c0 0x7fce840a3770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c104410 0x7fce9c1a2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce9c0ff3d0 0x7fce9c1972f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 --2- 172.21.15.69:0/4207000874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce9c0ffd70 0x7fce9c197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 -- 172.21.15.69:0/4207000874 >> 172.21.15.69:0/4207000874 conn(0x7fce9c076000 msgr2=0x7fce9c0fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.230+0000 7fcea22c8700 1 -- 172.21.15.69:0/4207000874 shutdown_connections 2023-12-14T14:19:14.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.231+0000 7fcea22c8700 1 -- 172.21.15.69:0/4207000874 wait complete. 2023-12-14T14:19:14.245 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:19:14.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.369+0000 7fc89e96a700 1 -- 172.21.15.69:0/2519259957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc898105510 msgr2=0x7fc89810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.369+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2519259957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc898105510 0x7fc89810d0e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc89000b0d0 tx=0x7fc89000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.369+0000 7fc89e96a700 1 -- 172.21.15.69:0/2519259957 shutdown_connections 2023-12-14T14:19:14.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.369+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2519259957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc898105510 0x7fc89810d0e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.369+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2519259957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8981004d0 0x7fc8981008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.369+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2519259957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc898100e70 0x7fc898104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.369+0000 7fc89e96a700 1 -- 172.21.15.69:0/2519259957 >> 172.21.15.69:0/2519259957 conn(0x7fc898078210 msgr2=0x7fc898078610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.369+0000 7fc89e96a700 1 -- 172.21.15.69:0/2519259957 shutdown_connections 2023-12-14T14:19:14.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.369+0000 7fc89e96a700 1 -- 172.21.15.69:0/2519259957 wait complete. 2023-12-14T14:19:14.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc89e96a700 1 Processor -- start 2023-12-14T14:19:14.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc89e96a700 1 -- start start 2023-12-14T14:19:14.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc89e96a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8981004d0 0x7fc8981964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc89e96a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc898100e70 0x7fc898196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc89e96a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc898105510 0x7fc89819ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc89e96a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89819b4b0 con 0x7fc8981004d0 2023-12-14T14:19:14.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc89e96a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89819b620 con 0x7fc898105510 2023-12-14T14:19:14.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc89e96a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89819b7e0 con 0x7fc898100e70 2023-12-14T14:19:14.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc897fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8981004d0 0x7fc8981964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc897fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8981004d0 0x7fc8981964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36812/0 (socket says 172.21.15.69:36812) 2023-12-14T14:19:14.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc897fff700 1 -- 172.21.15.69:0/2127769562 learned_addr learned my addr 172.21.15.69:0/2127769562 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc89cf07700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc898105510 0x7fc89819ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc8977fe700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc898100e70 0x7fc898196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc897fff700 1 -- 172.21.15.69:0/2127769562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc898100e70 msgr2=0x7fc898196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc897fff700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc898100e70 0x7fc898196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc897fff700 1 -- 172.21.15.69:0/2127769562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc898105510 msgr2=0x7fc89819ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc897fff700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc898105510 0x7fc89819ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.370+0000 7fc897fff700 1 -- 172.21.15.69:0/2127769562 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc890009d00 con 0x7fc8981004d0 2023-12-14T14:19:14.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.371+0000 7fc897fff700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8981004d0 0x7fc8981964d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c920 tx=0x7fc88c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.371+0000 7fc8957fa700 1 -- 172.21.15.69:0/2127769562 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c007b00 con 0x7fc8981004d0 2023-12-14T14:19:14.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.371+0000 7fc89e96a700 1 -- 172.21.15.69:0/2127769562 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc898110330 con 0x7fc8981004d0 2023-12-14T14:19:14.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.371+0000 7fc8957fa700 1 -- 172.21.15.69:0/2127769562 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc88c00ce70 con 0x7fc8981004d0 2023-12-14T14:19:14.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.371+0000 7fc8957fa700 1 -- 172.21.15.69:0/2127769562 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c005460 con 0x7fc8981004d0 2023-12-14T14:19:14.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.371+0000 7fc89e96a700 1 -- 172.21.15.69:0/2127769562 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8981101a0 con 0x7fc8981004d0 2023-12-14T14:19:14.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.373+0000 7fc8957fa700 1 -- 172.21.15.69:0/2127769562 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc88c004750 con 0x7fc8981004d0 2023-12-14T14:19:14.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.374+0000 7fc8957fa700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc8800a12c0 0x7fc8800a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.374+0000 7fc8957fa700 1 -- 172.21.15.69:0/2127769562 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fc88c0cc950 con 0x7fc8981004d0 2023-12-14T14:19:14.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.374+0000 7fc8977fe700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc8800a12c0 0x7fc8800a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.374+0000 7fc8977fe700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc8800a12c0 0x7fc8800a3770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc888005950 tx=0x7fc8880058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc8aaaf8b80 1 Processor -- start 2023-12-14T14:19:14.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc8aaaf8b80 1 -- start start 2023-12-14T14:19:14.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7429750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 0x55b5e7434610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e7436f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e73135e0 con 0x55b5e7429380 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e7382870 con 0x55b5e7429c90 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e737bd00 con 0x55b5e7434b50 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc897fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7429750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc897fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7429750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36824/0 (socket says 172.21.15.69:36824) 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc897fff700 1 -- 172.21.15.69:0/3327423788 learned_addr learned my addr 172.21.15.69:0/3327423788 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc8977fe700 1 --2- 172.21.15.69:0/3327423788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 0x55b5e7434610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc89cf07700 1 --2- 172.21.15.69:0/3327423788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e7436f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc897fff700 1 -- 172.21.15.69:0/3327423788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 msgr2=0x55b5e7436f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc897fff700 1 --2- 172.21.15.69:0/3327423788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e7436f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc897fff700 1 -- 172.21.15.69:0/3327423788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 msgr2=0x55b5e7434610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc897fff700 1 --2- 172.21.15.69:0/3327423788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 0x55b5e7434610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc897fff700 1 -- 172.21.15.69:0/3327423788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5e71fd3b0 con 0x55b5e7429380 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.375+0000 7fc897fff700 1 --2- 172.21.15.69:0/3327423788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7429750 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc88c095f10 tx=0x7fc88c0995d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ff0f432a8b53d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc87e7fc700 1 -- 172.21.15.69:0/3327423788 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c09da40 con 0x55b5e7429380 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc87e7fc700 1 -- 172.21.15.69:0/3327423788 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc88c0a1e60 con 0x55b5e7429380 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc87e7fc700 1 -- 172.21.15.69:0/3327423788 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c099f20 con 0x55b5e7429380 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/3327423788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 msgr2=0x55b5e7429750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/3327423788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7429750 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc88c095f10 tx=0x7fc88c0995d0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/3327423788 shutdown_connections 2023-12-14T14:19:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/3327423788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e7436f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/3327423788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7429750 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/3327423788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 0x55b5e7434610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/3327423788 >> 172.21.15.69:0/3327423788 conn(0x55b5e741fca0 msgr2=0x55b5e74257e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/3327423788 shutdown_connections 2023-12-14T14:19:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.376+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/3327423788 wait complete. 2023-12-14T14:19:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8aaaf8b80 1 -- start start 2023-12-14T14:19:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8aaaf8b80 1 Processor -- start 2023-12-14T14:19:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7434540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7429c90 0x55b5e74317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7434b50 0x55b5e7431e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e7317f90 con 0x55b5e7429380 2023-12-14T14:19:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e7317c30 con 0x55b5e7434b50 2023-12-14T14:19:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e71ff6a0 con 0x55b5e7429c90 2023-12-14T14:19:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8aaaf8b80 10 client.0 _ll_register_callbacks cb 0x55b5e733b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc897fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7434540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc897fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7434540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36838/0 (socket says 172.21.15.69:36838) 2023-12-14T14:19:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc897fff700 1 -- 172.21.15.69:0/165523974 learned_addr learned my addr 172.21.15.69:0/165523974 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc8977fe700 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7429c90 0x55b5e74317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.377+0000 7fc89cf07700 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7434b50 0x55b5e7431e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc897fff700 1 -- 172.21.15.69:0/165523974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7429c90 msgr2=0x55b5e74317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc897fff700 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7429c90 0x55b5e74317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc897fff700 1 -- 172.21.15.69:0/165523974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7434b50 msgr2=0x55b5e7431e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc897fff700 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7434b50 0x55b5e7431e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc897fff700 1 -- 172.21.15.69:0/165523974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8981101a0 con 0x55b5e7429380 2023-12-14T14:19:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc897fff700 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7434540 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0996c0 tx=0x7fc88c00a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f29146da7711ad server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8777fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8777fe700 1 -- 172.21.15.69:0/165523974 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c098f00 con 0x55b5e7429380 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8777fe700 1 -- 172.21.15.69:0/165523974 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fc88c099060 con 0x55b5e7429380 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/165523974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5e741d2b0 con 0x55b5e7429380 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8777fe700 1 -- 172.21.15.69:0/165523974 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc88c099c70 con 0x55b5e7429380 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8aaaf8b80 10 client.16665 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/165523974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b5e7342170 con 0x55b5e7429380 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8777fe700 1 -- 172.21.15.69:0/165523974 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b5e741d2b0 con 0x55b5e7429380 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8777fe700 1 -- 172.21.15.69:0/165523974 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc88c004a90 con 0x55b5e7429380 2023-12-14T14:19:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8aaaf8b80 10 client.16665 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8aaaf8b80 10 client.16665 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:19:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8aaaf8b80 20 client.16665 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55b5e7443f80 0x55b5e7446360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8aaaf8b80 4 client.16665 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.378+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/165523974 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5e7374ce0 con 0x55b5e7443f80 2023-12-14T14:19:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.379+0000 7fc8977fe700 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55b5e7443f80 0x55b5e7446360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.379+0000 7fc8777fe700 10 client.16665 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:19:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.379+0000 7fc8977fe700 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55b5e7443f80 0x55b5e7446360 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cac664fba30943af server_cookie=6fc6298b368bde13 in_seq=0 out_seq=0 2023-12-14T14:19:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8777fe700 1 -- 172.21.15.69:0/165523974 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b5e7374ce0 con 0x55b5e7443f80 2023-12-14T14:19:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8777fe700 10 client.16665 handle_command_reply: tid=0 2023-12-14T14:19:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 client.16665 shutdown 2023-12-14T14:19:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/165523974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 msgr2=0x55b5e7434540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7434540 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0996c0 tx=0x7fc88c00a610 comp rx=0 tx=0).stop 2023-12-14T14:19:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/165523974 shutdown_connections 2023-12-14T14:19:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7434b50 0x55b5e7431e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55b5e7443f80 0x55b5e7446360 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7434540 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8777fe700 0 client.16665 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:19:14.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/165523974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7429c90 0x55b5e74317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/165523974 >> 172.21.15.69:0/165523974 conn(0x55b5e741fca0 msgr2=0x55b5e74253d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/165523974 shutdown_connections 2023-12-14T14:19:14.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/165523974 wait complete. 2023-12-14T14:19:14.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.380+0000 7fc8aaaf8b80 20 client.16665 trim_cache size 0 max 16384 2023-12-14T14:19:14.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc8aaaf8b80 1 Processor -- start 2023-12-14T14:19:14.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc8aaaf8b80 1 -- start start 2023-12-14T14:19:14.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7446360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 0x55b5e7434000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e7434540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e7440450 con 0x55b5e7429380 2023-12-14T14:19:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e742fd70 con 0x55b5e7429c90 2023-12-14T14:19:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e742d680 con 0x55b5e7434b50 2023-12-14T14:19:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc897fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7446360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc897fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7446360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36848/0 (socket says 172.21.15.69:36848) 2023-12-14T14:19:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.393+0000 7fc897fff700 1 -- 172.21.15.69:0/1199495450 learned_addr learned my addr 172.21.15.69:0/1199495450 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc8977fe700 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 0x55b5e7434000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc89cf07700 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e7434540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc897fff700 1 -- 172.21.15.69:0/1199495450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 msgr2=0x55b5e7434540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc897fff700 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e7434540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc897fff700 1 -- 172.21.15.69:0/1199495450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 msgr2=0x55b5e7434000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc897fff700 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 0x55b5e7434000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc897fff700 1 -- 172.21.15.69:0/1199495450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5e7341ec0 con 0x55b5e7429380 2023-12-14T14:19:14.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc89cf07700 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e7434540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:14.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc897fff700 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7446360 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc88c097d60 tx=0x7fc88c0995d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681e50089bb92f00 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc87effd700 1 -- 172.21.15.69:0/1199495450 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c098d50 con 0x55b5e7429380 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc87effd700 1 -- 172.21.15.69:0/1199495450 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc88c098b60 con 0x55b5e7429380 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.394+0000 7fc87effd700 1 -- 172.21.15.69:0/1199495450 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c098f00 con 0x55b5e7429380 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/1199495450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 msgr2=0x55b5e7446360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7446360 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc88c097d60 tx=0x7fc88c0995d0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/1199495450 shutdown_connections 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e7434540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429380 0x55b5e7446360 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/1199495450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429c90 0x55b5e7434000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/1199495450 >> 172.21.15.69:0/1199495450 conn(0x55b5e741fca0 msgr2=0x55b5e743fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/1199495450 shutdown_connections 2023-12-14T14:19:14.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/1199495450 wait complete. 2023-12-14T14:19:14.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 -- start start 2023-12-14T14:19:14.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 Processor -- start 2023-12-14T14:19:14.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429380 0x55b5e7439580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429c90 0x55b5e7439ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e743a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e7496dd0 con 0x55b5e7429c90 2023-12-14T14:19:14.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e7496f10 con 0x55b5e7429380 2023-12-14T14:19:14.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.395+0000 7fc8aaaf8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e7497050 con 0x55b5e7434b50 2023-12-14T14:19:14.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8aaaf8b80 10 client.0 _ll_register_callbacks cb 0x7fc888015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:14.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429c90 0x55b5e7439ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429c90 0x55b5e7439ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36864/0 (socket says 172.21.15.69:36864) 2023-12-14T14:19:14.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8977fe700 1 -- 172.21.15.69:0/2562931957 learned_addr learned my addr 172.21.15.69:0/2562931957 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc897fff700 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429380 0x55b5e7439580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc89cf07700 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e743a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8977fe700 1 -- 172.21.15.69:0/2562931957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 msgr2=0x55b5e743a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8977fe700 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e743a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8977fe700 1 -- 172.21.15.69:0/2562931957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429380 msgr2=0x55b5e7439580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8977fe700 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429380 0x55b5e7439580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8977fe700 1 -- 172.21.15.69:0/2562931957 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5e7342170 con 0x55b5e7429c90 2023-12-14T14:19:14.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8977fe700 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429c90 0x55b5e7439ac0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc898197ae0 tx=0x7fc8880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61302cbfbed7ada server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8777fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:14.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8777fe700 1 -- 172.21.15.69:0/2562931957 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888024040 con 0x55b5e7429c90 2023-12-14T14:19:14.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8777fe700 1 -- 172.21.15.69:0/2562931957 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fc888011640 con 0x55b5e7429c90 2023-12-14T14:19:14.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/2562931957 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc88c0a1e60 con 0x55b5e7429c90 2023-12-14T14:19:14.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8777fe700 1 -- 172.21.15.69:0/2562931957 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc88802a600 con 0x55b5e7429c90 2023-12-14T14:19:14.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8aaaf8b80 10 client.16671 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:14.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.396+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/2562931957 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b5e73289a0 con 0x55b5e7429c90 2023-12-14T14:19:14.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc8777fe700 1 -- 172.21.15.69:0/2562931957 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc88803f020 con 0x55b5e7429c90 2023-12-14T14:19:14.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc8777fe700 1 -- 172.21.15.69:0/2562931957 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc88801f8b0 con 0x55b5e7429c90 2023-12-14T14:19:14.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc8aaaf8b80 10 client.16671 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:14.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc8aaaf8b80 10 client.16671 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:19:14.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc8aaaf8b80 20 client.16671 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:14.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55b5e7498720 0x55b5e749ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc8aaaf8b80 4 client.16671 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:19:14.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/2562931957 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b5e7374a00 con 0x55b5e7498720 2023-12-14T14:19:14.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc897fff700 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55b5e7498720 0x55b5e749ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc8777fe700 10 client.16671 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:19:14.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.397+0000 7fc897fff700 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55b5e7498720 0x55b5e749ab30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=12e61b7bb694bae2 server_cookie=3b7fce59998a7459 in_seq=0 out_seq=0 2023-12-14T14:19:14.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8777fe700 1 -- 172.21.15.69:0/2562931957 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b5e7374a00 con 0x55b5e7498720 2023-12-14T14:19:14.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8777fe700 10 client.16671 handle_command_reply: tid=0 2023-12-14T14:19:14.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 client.16671 shutdown 2023-12-14T14:19:14.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/2562931957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429c90 msgr2=0x55b5e7439ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429c90 0x55b5e7439ac0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc898197ae0 tx=0x7fc8880047c0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/2562931957 shutdown_connections 2023-12-14T14:19:14.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5e7434b50 0x55b5e743a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5e7429380 0x55b5e7439580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55b5e7498720 0x55b5e749ab30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 --2- 172.21.15.69:0/2562931957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b5e7429c90 0x55b5e7439ac0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8777fe700 0 client.16671 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:19:14.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/2562931957 >> 172.21.15.69:0/2562931957 conn(0x55b5e741fca0 msgr2=0x55b5e742cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/2562931957 shutdown_connections 2023-12-14T14:19:14.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 1 -- 172.21.15.69:0/2562931957 wait complete. 2023-12-14T14:19:14.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc8aaaf8b80 20 client.16671 trim_cache size 0 max 16384 2023-12-14T14:19:14.410 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:19:14.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc89e96a700 1 -- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc8800a12c0 msgr2=0x7fc8800a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc8800a12c0 0x7fc8800a3770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc888005950 tx=0x7fc8880058e0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc89e96a700 1 -- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8981004d0 msgr2=0x7fc8981964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.398+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8981004d0 0x7fc8981964d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c920 tx=0x7fc88c00cc30 comp rx=0 tx=0).stop 2023-12-14T14:19:14.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.399+0000 7fc89e96a700 1 -- 172.21.15.69:0/2127769562 shutdown_connections 2023-12-14T14:19:14.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.399+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc8800a12c0 0x7fc8800a3770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.399+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc898105510 0x7fc89819ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.399+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8981004d0 0x7fc8981964d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.399+0000 7fc89e96a700 1 --2- 172.21.15.69:0/2127769562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc898100e70 0x7fc898196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.399+0000 7fc89e96a700 1 -- 172.21.15.69:0/2127769562 >> 172.21.15.69:0/2127769562 conn(0x7fc898078210 msgr2=0x7fc8980fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.399+0000 7fc89e96a700 1 -- 172.21.15.69:0/2127769562 shutdown_connections 2023-12-14T14:19:14.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.399+0000 7fc89e96a700 1 -- 172.21.15.69:0/2127769562 wait complete. 2023-12-14T14:19:14.413 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:19:14.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 -- 172.21.15.69:0/4048113071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 msgr2=0x7f1ca8100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 --2- 172.21.15.69:0/4048113071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 0x7f1ca8100910 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009990 tx=0x7f1c9c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 -- 172.21.15.69:0/4048113071 shutdown_connections 2023-12-14T14:19:14.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 --2- 172.21.15.69:0/4048113071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8109af0 0x7f1ca810bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 --2- 172.21.15.69:0/4048113071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 0x7f1ca8100910 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 --2- 172.21.15.69:0/4048113071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ca8100e50 0x7f1ca81095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 -- 172.21.15.69:0/4048113071 >> 172.21.15.69:0/4048113071 conn(0x7f1ca80749c0 msgr2=0x7f1ca8074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 -- 172.21.15.69:0/4048113071 shutdown_connections 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 -- 172.21.15.69:0/4048113071 wait complete. 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 Processor -- start 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.537+0000 7f1cad751700 1 -- start start 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1cad751700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 0x7f1ca81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1cad751700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8100e50 0x7f1ca8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1cad751700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ca8109af0 0x7f1ca819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1cad751700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca819d5d0 con 0x7f1ca8100540 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1cad751700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca819d740 con 0x7f1ca8100e50 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1cad751700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca819d900 con 0x7f1ca8109af0 2023-12-14T14:19:14.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 0x7f1ca81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 0x7f1ca81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36888/0 (socket says 172.21.15.69:36888) 2023-12-14T14:19:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca6ffd700 1 -- 172.21.15.69:0/2588137134 learned_addr learned my addr 172.21.15.69:0/2588137134 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca67fc700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8100e50 0x7f1ca8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ca8109af0 0x7f1ca819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca6ffd700 1 -- 172.21.15.69:0/2588137134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ca8109af0 msgr2=0x7f1ca819cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ca8109af0 0x7f1ca819cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca6ffd700 1 -- 172.21.15.69:0/2588137134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8100e50 msgr2=0x7f1ca8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8100e50 0x7f1ca8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca6ffd700 1 -- 172.21.15.69:0/2588137134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0095f0 con 0x7f1ca8100540 2023-12-14T14:19:14.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca67fc700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8100e50 0x7f1ca8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:14.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ca8109af0 0x7f1ca819cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:14.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 0x7f1ca81985f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0095c0 tx=0x7f1c9c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1c8ffff700 1 -- 172.21.15.69:0/2588137134 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c01d070 con 0x7f1ca8100540 2023-12-14T14:19:14.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1c8ffff700 1 -- 172.21.15.69:0/2588137134 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c9c0054f0 con 0x7f1ca8100540 2023-12-14T14:19:14.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1c8ffff700 1 -- 172.21.15.69:0/2588137134 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c004bd0 con 0x7f1ca8100540 2023-12-14T14:19:14.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1cad751700 1 -- 172.21.15.69:0/2588137134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca810f1f0 con 0x7f1ca8100540 2023-12-14T14:19:14.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.538+0000 7f1cad751700 1 -- 172.21.15.69:0/2588137134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca810f060 con 0x7f1ca8100540 2023-12-14T14:19:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.540+0000 7f1c8ffff700 1 -- 172.21.15.69:0/2588137134 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1c9c00fc30 con 0x7f1ca8100540 2023-12-14T14:19:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.541+0000 7f1c8ffff700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c900a12c0 0x7f1c900a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.541+0000 7f1ca67fc700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c900a12c0 0x7f1c900a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.541+0000 7f1c8ffff700 1 -- 172.21.15.69:0/2588137134 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f1c9c0cdc80 con 0x7f1ca8100540 2023-12-14T14:19:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.541+0000 7f1ca67fc700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c900a12c0 0x7f1c900a3770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c98005950 tx=0x7f1c980058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1cb98dfb80 1 Processor -- start 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1cb98dfb80 1 -- start start 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a18a380 0x56077a18a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a195610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a195b50 0x56077a197f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a0745e0 con 0x56077a18a380 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a0e3870 con 0x56077a195b50 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a0dcd00 con 0x56077a18ac90 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1ca6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a18a380 0x56077a18a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1ca6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a18a380 0x56077a18a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36896/0 (socket says 172.21.15.69:36896) 2023-12-14T14:19:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1ca6ffd700 1 -- 172.21.15.69:0/4076103961 learned_addr learned my addr 172.21.15.69:0/4076103961 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.542+0000 7f1ca67fc700 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1ca6ffd700 1 -- 172.21.15.69:0/4076103961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 msgr2=0x56077a195610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a195610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a195b50 0x56077a197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1ca6ffd700 1 -- 172.21.15.69:0/4076103961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a195b50 msgr2=0x56077a197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a195b50 0x56077a197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1ca6ffd700 1 -- 172.21.15.69:0/4076103961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560779f5e3b0 con 0x56077a18a380 2023-12-14T14:19:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1ca67fc700 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a195b50 0x56077a197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a18a380 0x56077a18a750 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c097840 tx=0x7f1c9c09a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1e52d111274d0b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1c8d7fa700 1 -- 172.21.15.69:0/4076103961 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c09ee00 con 0x56077a18a380 2023-12-14T14:19:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1c8d7fa700 1 -- 172.21.15.69:0/4076103961 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c9c0a3190 con 0x56077a18a380 2023-12-14T14:19:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1c8d7fa700 1 -- 172.21.15.69:0/4076103961 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0a2f60 con 0x56077a18a380 2023-12-14T14:19:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/4076103961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a18a380 msgr2=0x56077a18a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.543+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a18a380 0x56077a18a750 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c097840 tx=0x7f1c9c09a730 comp rx=0 tx=0).stop 2023-12-14T14:19:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/4076103961 shutdown_connections 2023-12-14T14:19:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a195b50 0x56077a197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a18a380 0x56077a18a750 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/4076103961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/4076103961 >> 172.21.15.69:0/4076103961 conn(0x56077a180ca0 msgr2=0x56077a1867e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/4076103961 shutdown_connections 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/4076103961 wait complete. 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 -- start start 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 Processor -- start 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 0x56077a195f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a196460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a078f90 con 0x56077a195b50 2023-12-14T14:19:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a078c30 con 0x56077a18a380 2023-12-14T14:19:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560779f606a0 con 0x56077a18ac90 2023-12-14T14:19:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1cb98dfb80 10 client.0 _ll_register_callbacks cb 0x56077a09c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1ca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1ca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36908/0 (socket says 172.21.15.69:36908) 2023-12-14T14:19:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1ca77fe700 1 -- 172.21.15.69:0/897167820 learned_addr learned my addr 172.21.15.69:0/897167820 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.544+0000 7f1ca67fc700 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 0x56077a195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1ca77fe700 1 -- 172.21.15.69:0/897167820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 msgr2=0x56077a196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1ca77fe700 1 -- 172.21.15.69:0/897167820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 msgr2=0x56077a195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 0x56077a195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1ca77fe700 1 -- 172.21.15.69:0/897167820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca810f060 con 0x56077a195b50 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1969e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0008bc0 tx=0x7f1ca0008ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c789a04d1ad31a6c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1c8aff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1c8aff5700 1 -- 172.21.15.69:0/897167820 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca000eb10 con 0x56077a195b50 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1c8aff5700 1 -- 172.21.15.69:0/897167820 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f1ca000ec70 con 0x56077a195b50 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/897167820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56077a17e2b0 con 0x56077a195b50 2023-12-14T14:19:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1c8aff5700 1 -- 172.21.15.69:0/897167820 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ca000ee30 con 0x56077a195b50 2023-12-14T14:19:14.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1cb98dfb80 10 client.16683 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:14.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/897167820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56077a0a3170 con 0x56077a195b50 2023-12-14T14:19:14.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.545+0000 7f1c8aff5700 1 -- 172.21.15.69:0/897167820 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56077a17e2b0 con 0x56077a195b50 2023-12-14T14:19:14.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1c8aff5700 1 -- 172.21.15.69:0/897167820 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1ca0004770 con 0x56077a195b50 2023-12-14T14:19:14.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1cb98dfb80 10 client.16683 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:14.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1cb98dfb80 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:14.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1cb98dfb80 20 client.16683 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:14.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56077a1a5200 0x56077a1a7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1cb98dfb80 4 client.16683 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/897167820 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56077a0d5ce0 con 0x56077a1a5200 2023-12-14T14:19:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56077a1a5200 0x56077a1a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56077a1a5200 0x56077a1a7610 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4af38df8cc0e86cf server_cookie=5c41c8c6d4c343c1 in_seq=0 out_seq=0 2023-12-14T14:19:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.546+0000 7f1c8aff5700 10 client.16683 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1c8aff5700 1 -- 172.21.15.69:0/897167820 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56077a0d5ce0 con 0x56077a1a5200 2023-12-14T14:19:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1c8aff5700 10 client.16683 handle_command_reply: tid=0 2023-12-14T14:19:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 client.16683 shutdown 2023-12-14T14:19:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/897167820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 msgr2=0x56077a1969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1969e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0008bc0 tx=0x7f1ca0008ed0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/897167820 shutdown_connections 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56077a1a5200 0x56077a1a7610 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1969e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1c8aff5700 0 client.16683 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 0x56077a195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/897167820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/897167820 >> 172.21.15.69:0/897167820 conn(0x56077a180ca0 msgr2=0x56077a1863d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/897167820 shutdown_connections 2023-12-14T14:19:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/897167820 wait complete. 2023-12-14T14:19:14.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.547+0000 7f1cb98dfb80 20 client.16683 trim_cache size 0 max 16384 2023-12-14T14:19:14.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1cb98dfb80 1 Processor -- start 2023-12-14T14:19:14.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1cb98dfb80 1 -- start start 2023-12-14T14:19:14.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18a380 0x56077a199f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18ac90 0x56077a194450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a18ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a187590 con 0x56077a195b50 2023-12-14T14:19:14.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a18b5b0 con 0x56077a18ac90 2023-12-14T14:19:14.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a18fae0 con 0x56077a18a380 2023-12-14T14:19:14.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1ca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a18ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1ca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a18ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36918/0 (socket says 172.21.15.69:36918) 2023-12-14T14:19:14.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.560+0000 7f1ca77fe700 1 -- 172.21.15.69:0/3016953225 learned_addr learned my addr 172.21.15.69:0/3016953225 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/3016953225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18a380 0x56077a199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1ca77fe700 1 -- 172.21.15.69:0/3016953225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18a380 msgr2=0x56077a199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/3016953225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18a380 0x56077a199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1ca77fe700 1 -- 172.21.15.69:0/3016953225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18ac90 msgr2=0x56077a194450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/3016953225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18ac90 0x56077a194450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1ca77fe700 1 -- 172.21.15.69:0/3016953225 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56077a1824e0 con 0x56077a195b50 2023-12-14T14:19:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/3016953225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a18ffa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0002230 tx=0x7f1ca0007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba7dea0257442fb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1c8dffb700 1 -- 172.21.15.69:0/3016953225 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0007ac0 con 0x56077a195b50 2023-12-14T14:19:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1c8dffb700 1 -- 172.21.15.69:0/3016953225 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ca000e910 con 0x56077a195b50 2023-12-14T14:19:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1c8dffb700 1 -- 172.21.15.69:0/3016953225 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0013c20 con 0x56077a195b50 2023-12-14T14:19:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/3016953225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 msgr2=0x56077a18ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/3016953225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a18ffa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0002230 tx=0x7f1ca0007610 comp rx=0 tx=0).stop 2023-12-14T14:19:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/3016953225 shutdown_connections 2023-12-14T14:19:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/3016953225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a18ffa0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/3016953225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18a380 0x56077a199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/3016953225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18ac90 0x56077a194450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/3016953225 >> 172.21.15.69:0/3016953225 conn(0x56077a180ca0 msgr2=0x56077a1a0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/3016953225 shutdown_connections 2023-12-14T14:19:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.561+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/3016953225 wait complete. 2023-12-14T14:19:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1cb98dfb80 1 -- start start 2023-12-14T14:19:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1cb98dfb80 1 Processor -- start 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 0x56077a1ed200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a1ed740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1cb98dfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1f8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a1ede70 con 0x56077a195b50 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a1f85d0 con 0x56077a18a380 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1cb98dfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56077a1f8760 con 0x56077a18ac90 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1cb98dfb80 10 client.0 _ll_register_callbacks cb 0x7f1ca0008480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36922/0 (socket says 172.21.15.69:36922) 2023-12-14T14:19:14.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca77fe700 1 -- 172.21.15.69:0/2865242088 learned_addr learned my addr 172.21.15.69:0/2865242088 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca67fc700 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a1ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 0x56077a1ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca77fe700 1 -- 172.21.15.69:0/2865242088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 msgr2=0x56077a1ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a1ed740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca77fe700 1 -- 172.21.15.69:0/2865242088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 msgr2=0x56077a1ed200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 0x56077a1ed200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca77fe700 1 -- 172.21.15.69:0/2865242088 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56077a0a3170 con 0x56077a195b50 2023-12-14T14:19:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.562+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 0x56077a1ed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1f8090 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0000f80 tx=0x7f1ca0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9523ae46de811a0c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1c8aff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1c8aff5700 1 -- 172.21.15.69:0/2865242088 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0007ac0 con 0x56077a195b50 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1c8aff5700 1 -- 172.21.15.69:0/2865242088 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f1ca0034030 con 0x56077a195b50 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/2865242088 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c9c0a3190 con 0x56077a195b50 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1c8aff5700 1 -- 172.21.15.69:0/2865242088 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ca00138a0 con 0x56077a195b50 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1cb98dfb80 10 client.16689 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/2865242088 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560779f0ab60 con 0x56077a195b50 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1c8aff5700 1 -- 172.21.15.69:0/2865242088 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c9c0a3190 con 0x56077a195b50 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1c8aff5700 1 -- 172.21.15.69:0/2865242088 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1ca002c070 con 0x56077a195b50 2023-12-14T14:19:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1cb98dfb80 10 client.16689 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:14.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1cb98dfb80 10 client.16689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:14.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1cb98dfb80 20 client.16689 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:14.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56077a1f9a80 0x56077a1fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:14.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1cb98dfb80 4 client.16689 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:19:14.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.563+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/2865242088 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56077a0d5a00 con 0x56077a1f9a80 2023-12-14T14:19:14.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56077a1f9a80 0x56077a1fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:14.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56077a1f9a80 0x56077a1fbe90 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928b5f39ae0654fb server_cookie=a38f6d2aac5502bf in_seq=0 out_seq=0 2023-12-14T14:19:14.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1c8aff5700 10 client.16689 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:14.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1c8aff5700 1 -- 172.21.15.69:0/2865242088 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56077a0d5a00 con 0x56077a1f9a80 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1c8aff5700 10 client.16689 handle_command_reply: tid=0 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 client.16689 shutdown 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/2865242088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 msgr2=0x56077a1f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1f8090 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0000f80 tx=0x7f1ca0003d00 comp rx=0 tx=0).stop 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/2865242088 shutdown_connections 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x56077a1f9a80 0x56077a1fbe90 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56077a195b50 0x56077a1f8090 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56077a18a380 0x56077a1ed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1c8aff5700 0 client.16689 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:14.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 --2- 172.21.15.69:0/2865242088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56077a18ac90 0x56077a1ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/2865242088 >> 172.21.15.69:0/2865242088 conn(0x56077a180ca0 msgr2=0x56077a18ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/2865242088 shutdown_connections 2023-12-14T14:19:14.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 1 -- 172.21.15.69:0/2865242088 wait complete. 2023-12-14T14:19:14.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.564+0000 7f1cb98dfb80 20 client.16689 trim_cache size 0 max 16384 2023-12-14T14:19:14.575 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:19:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 -- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c900a12c0 msgr2=0x7f1c900a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c900a12c0 0x7f1c900a3770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c98005950 tx=0x7f1c980058e0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 -- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 msgr2=0x7f1ca81985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 0x7f1ca81985f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0095c0 tx=0x7f1c9c00f740 comp rx=0 tx=0).stop 2023-12-14T14:19:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 -- 172.21.15.69:0/2588137134 shutdown_connections 2023-12-14T14:19:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1c900a12c0 0x7f1c900a3770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ca8109af0 0x7f1ca819cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca8100540 0x7f1ca81985f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 --2- 172.21.15.69:0/2588137134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8100e50 0x7f1ca8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 -- 172.21.15.69:0/2588137134 >> 172.21.15.69:0/2588137134 conn(0x7f1ca80749c0 msgr2=0x7f1ca81069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 -- 172.21.15.69:0/2588137134 shutdown_connections 2023-12-14T14:19:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:14.565+0000 7f1cad751700 1 -- 172.21.15.69:0/2588137134 wait complete. 2023-12-14T14:19:14.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:14 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1051024517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:19:14.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:14 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1051024517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:19:15.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:14 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1051024517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:19:15.578 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:19:15.579 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:19:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.717+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/2791210301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 msgr2=0x7fb9dc103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.717+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/2791210301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 0x7fb9dc103d10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80099c0 tx=0x7fb9c8009cd0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/2791210301 shutdown_connections 2023-12-14T14:19:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/2791210301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9dc1043f0 0x7fb9dc10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/2791210301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9dc0ff3b0 0x7fb9dc0ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/2791210301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 0x7fb9dc103d10 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/2791210301 >> 172.21.15.69:0/2791210301 conn(0x7fb9dc075fa0 msgr2=0x7fb9dc0763a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/2791210301 shutdown_connections 2023-12-14T14:19:15.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/2791210301 wait complete. 2023-12-14T14:19:15.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 Processor -- start 2023-12-14T14:19:15.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 -- start start 2023-12-14T14:19:15.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9dc0ff3b0 0x7fb9dc100db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 0x7fb9dc1012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9dc1043f0 0x7fb9dc1a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc101b20 con 0x7fb9dc0ffd50 2023-12-14T14:19:15.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1a4ba0 con 0x7fb9dc1043f0 2023-12-14T14:19:15.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.718+0000 7fb9e2fd4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1a4ce0 con 0x7fb9dc0ff3b0 2023-12-14T14:19:15.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 0x7fb9dc1012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 0x7fb9dc1012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36938/0 (socket says 172.21.15.69:36938) 2023-12-14T14:19:15.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9dbfff700 1 -- 172.21.15.69:0/3675451605 learned_addr learned my addr 172.21.15.69:0/3675451605 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9dc0ff3b0 0x7fb9dc100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9e1571700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9dc1043f0 0x7fb9dc1a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9dbfff700 1 -- 172.21.15.69:0/3675451605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9dc0ff3b0 msgr2=0x7fb9dc100db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9dc0ff3b0 0x7fb9dc100db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9dbfff700 1 -- 172.21.15.69:0/3675451605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9dc1043f0 msgr2=0x7fb9dc1a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9dc1043f0 0x7fb9dc1a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9dbfff700 1 -- 172.21.15.69:0/3675451605 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c80095f0 con 0x7fb9dc0ffd50 2023-12-14T14:19:15.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9e1571700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9dc1043f0 0x7fb9dc1a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:15.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 0x7fb9dc1012f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009990 tx=0x7fb9c800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9d9ffb700 1 -- 172.21.15.69:0/3675451605 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c801d070 con 0x7fb9dc0ffd50 2023-12-14T14:19:15.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/3675451605 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc10f1c0 con 0x7fb9dc0ffd50 2023-12-14T14:19:15.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9d9ffb700 1 -- 172.21.15.69:0/3675451605 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9c80054e0 con 0x7fb9dc0ffd50 2023-12-14T14:19:15.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9d9ffb700 1 -- 172.21.15.69:0/3675451605 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8004a70 con 0x7fb9dc0ffd50 2023-12-14T14:19:15.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.719+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/3675451605 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc10f030 con 0x7fb9dc0ffd50 2023-12-14T14:19:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.721+0000 7fb9d9ffb700 1 -- 172.21.15.69:0/3675451605 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb9c800fb80 con 0x7fb9dc0ffd50 2023-12-14T14:19:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.722+0000 7fb9d9ffb700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb9cc0a12c0 0x7fb9cc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.722+0000 7fb9d9ffb700 1 -- 172.21.15.69:0/3675451605 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fb9c80cd8f0 con 0x7fb9dc0ffd50 2023-12-14T14:19:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.722+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb9cc0a12c0 0x7fb9cc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.722+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb9cc0a12c0 0x7fb9cc0a3770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009c60 tx=0x7fb9d0009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9ef162b80 1 Processor -- start 2023-12-14T14:19:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9ef162b80 1 -- start start 2023-12-14T14:19:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651b53690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 0x562651b55fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651a32660 con 0x562651b48400 2023-12-14T14:19:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651aa18f0 con 0x562651b53bd0 2023-12-14T14:19:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651a9ad80 con 0x562651b48d10 2023-12-14T14:19:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9e0d70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9e0d70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36940/0 (socket says 172.21.15.69:36940) 2023-12-14T14:19:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9e0d70700 1 -- 172.21.15.69:0/2411643832 learned_addr learned my addr 172.21.15.69:0/2411643832 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.723+0000 7fb9e1571700 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 0x562651b55fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651b53690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9e0d70700 1 -- 172.21.15.69:0/2411643832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 msgr2=0x562651b53690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651b53690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9e0d70700 1 -- 172.21.15.69:0/2411643832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 msgr2=0x562651b55fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 0x562651b55fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9e0d70700 1 -- 172.21.15.69:0/2411643832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56265191c430 con 0x562651b48400 2023-12-14T14:19:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9e1571700 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 0x562651b55fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651b53690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b487d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000e4e0 tx=0x7fb9d0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9620f476c2a1f4f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9c6ffd700 1 -- 172.21.15.69:0/2411643832 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0026430 con 0x562651b48400 2023-12-14T14:19:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9c6ffd700 1 -- 172.21.15.69:0/2411643832 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9d0021070 con 0x562651b48400 2023-12-14T14:19:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.724+0000 7fb9c6ffd700 1 -- 172.21.15.69:0/2411643832 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d001d740 con 0x562651b48400 2023-12-14T14:19:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2411643832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 msgr2=0x562651b487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b487d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000e4e0 tx=0x7fb9d0014000 comp rx=0 tx=0).stop 2023-12-14T14:19:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2411643832 shutdown_connections 2023-12-14T14:19:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 0x562651b55fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b487d0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2411643832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651b53690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2411643832 >> 172.21.15.69:0/2411643832 conn(0x562651b3ed20 msgr2=0x562651b44860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2411643832 shutdown_connections 2023-12-14T14:19:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2411643832 wait complete. 2023-12-14T14:19:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 -- start start 2023-12-14T14:19:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 Processor -- start 2023-12-14T14:19:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b53580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651b50830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.725+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 0x562651b50df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651a37010 con 0x562651b48400 2023-12-14T14:19:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651a36cb0 con 0x562651b53bd0 2023-12-14T14:19:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265191e720 con 0x562651b48d10 2023-12-14T14:19:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9ef162b80 10 client.0 _ll_register_callbacks cb 0x562651a5a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e0d70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b53580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e0d70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b53580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36956/0 (socket says 172.21.15.69:36956) 2023-12-14T14:19:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e0d70700 1 -- 172.21.15.69:0/3502031984 learned_addr learned my addr 172.21.15.69:0/3502031984 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e1571700 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 0x562651b50df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651b50830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e0d70700 1 -- 172.21.15.69:0/3502031984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 msgr2=0x562651b50830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651b50830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e0d70700 1 -- 172.21.15.69:0/3502031984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 msgr2=0x562651b50df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 0x562651b50df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e0d70700 1 -- 172.21.15.69:0/3502031984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d0017070 con 0x562651b48400 2023-12-14T14:19:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b53580 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009330 tx=0x7fb9d000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbad904e51075404 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9bbfff700 1 -- 172.21.15.69:0/3502031984 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0005250 con 0x562651b48400 2023-12-14T14:19:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9bbfff700 1 -- 172.21.15.69:0/3502031984 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fb9d00053b0 con 0x562651b48400 2023-12-14T14:19:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9ef162b80 1 -- 172.21.15.69:0/3502031984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562651b3c330 con 0x562651b48400 2023-12-14T14:19:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9bbfff700 1 -- 172.21.15.69:0/3502031984 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d0005570 con 0x562651b48400 2023-12-14T14:19:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9ef162b80 10 client.16701 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.726+0000 7fb9ef162b80 1 -- 172.21.15.69:0/3502031984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562651a611f0 con 0x562651b48400 2023-12-14T14:19:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.727+0000 7fb9bbfff700 1 -- 172.21.15.69:0/3502031984 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9d003b020 con 0x562651b48400 2023-12-14T14:19:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.727+0000 7fb9bbfff700 1 -- 172.21.15.69:0/3502031984 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb9d0003a20 con 0x562651b48400 2023-12-14T14:19:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.727+0000 7fb9ef162b80 10 client.16701 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.727+0000 7fb9ef162b80 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.727+0000 7fb9ef162b80 20 client.16701 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.727+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x562651b633e0 0x562651b657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.727+0000 7fb9ef162b80 4 client.16701 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.727+0000 7fb9ef162b80 1 -- 172.21.15.69:0/3502031984 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562651a93d60 con 0x562651b633e0 2023-12-14T14:19:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.727+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x562651b633e0 0x562651b657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9bbfff700 10 client.16701 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x562651b633e0 0x562651b657f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=881eddeea47f899c server_cookie=6cebe880342c6cf8 in_seq=0 out_seq=0 2023-12-14T14:19:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9bbfff700 1 -- 172.21.15.69:0/3502031984 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562651a93d60 con 0x562651b633e0 2023-12-14T14:19:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9bbfff700 10 client.16701 handle_command_reply: tid=0 2023-12-14T14:19:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9ef162b80 1 client.16701 shutdown 2023-12-14T14:19:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9ef162b80 1 -- 172.21.15.69:0/3502031984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 msgr2=0x562651b53580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b53580 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009330 tx=0x7fb9d000ecb0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9ef162b80 1 -- 172.21.15.69:0/3502031984 shutdown_connections 2023-12-14T14:19:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x562651b633e0 0x562651b657f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b53bd0 0x562651b50df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9bbfff700 0 client.16701 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48400 0x562651b53580 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/3502031984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651b50830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.728+0000 7fb9ef162b80 1 -- 172.21.15.69:0/3502031984 >> 172.21.15.69:0/3502031984 conn(0x562651b3ed20 msgr2=0x562651b443f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.729+0000 7fb9ef162b80 1 -- 172.21.15.69:0/3502031984 shutdown_connections 2023-12-14T14:19:15.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.729+0000 7fb9ef162b80 1 -- 172.21.15.69:0/3502031984 wait complete. 2023-12-14T14:19:15.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.729+0000 7fb9ef162b80 20 client.16701 trim_cache size 0 max 16384 2023-12-14T14:19:15.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.745+0000 7fb9ef162b80 1 Processor -- start 2023-12-14T14:19:15.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.745+0000 7fb9ef162b80 1 -- start start 2023-12-14T14:19:15.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.745+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b3ed20 0x562651b507e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.745+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b53040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.745+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48d10 0x562651b53580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.745+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651b4ed90 con 0x562651b48d10 2023-12-14T14:19:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.745+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651b4c6a0 con 0x562651b48400 2023-12-14T14:19:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.745+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651b49db0 con 0x562651b3ed20 2023-12-14T14:19:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e1571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48d10 0x562651b53580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e1571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48d10 0x562651b53580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36964/0 (socket says 172.21.15.69:36964) 2023-12-14T14:19:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e1571700 1 -- 172.21.15.69:0/1160430550 learned_addr learned my addr 172.21.15.69:0/1160430550 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b3ed20 0x562651b507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b53040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e1571700 1 -- 172.21.15.69:0/1160430550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b3ed20 msgr2=0x562651b507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e1571700 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b3ed20 0x562651b507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e1571700 1 -- 172.21.15.69:0/1160430550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 msgr2=0x562651b53040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e1571700 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b53040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e1571700 1 -- 172.21.15.69:0/1160430550 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562651a60f40 con 0x562651b48d10 2023-12-14T14:19:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b53040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9e1571700 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48d10 0x562651b53580 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009d50 tx=0x7fb9d40077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdaf1abe0f852c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9c77fe700 1 -- 172.21.15.69:0/1160430550 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4017440 con 0x562651b48d10 2023-12-14T14:19:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9c77fe700 1 -- 172.21.15.69:0/1160430550 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9d400f070 con 0x562651b48d10 2023-12-14T14:19:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.746+0000 7fb9c77fe700 1 -- 172.21.15.69:0/1160430550 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d401f660 con 0x562651b48d10 2023-12-14T14:19:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 -- 172.21.15.69:0/1160430550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48d10 msgr2=0x562651b53580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48d10 0x562651b53580 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009d50 tx=0x7fb9d40077e0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 -- 172.21.15.69:0/1160430550 shutdown_connections 2023-12-14T14:19:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b48d10 0x562651b53580 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b3ed20 0x562651b507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/1160430550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b53040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 -- 172.21.15.69:0/1160430550 >> 172.21.15.69:0/1160430550 conn(0x562651b56280 msgr2=0x562651b500d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 -- 172.21.15.69:0/1160430550 shutdown_connections 2023-12-14T14:19:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 -- 172.21.15.69:0/1160430550 wait complete. 2023-12-14T14:19:15.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 -- start start 2023-12-14T14:19:15.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 Processor -- start 2023-12-14T14:19:15.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b3ed20 0x562651b59660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.747+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b59ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9ef162b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651bb12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651bb1820 con 0x562651b3ed20 2023-12-14T14:19:15.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651bb1990 con 0x562651b48400 2023-12-14T14:19:15.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9ef162b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562651bb1b50 con 0x562651b48d10 2023-12-14T14:19:15.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9ef162b80 10 client.0 _ll_register_callbacks cb 0x7fb9d000e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:15.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e0d70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b3ed20 0x562651b59660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e0d70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b3ed20 0x562651b59660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36972/0 (socket says 172.21.15.69:36972) 2023-12-14T14:19:15.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e0d70700 1 -- 172.21.15.69:0/2328039101 learned_addr learned my addr 172.21.15.69:0/2328039101 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e1571700 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651bb12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b59ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e0d70700 1 -- 172.21.15.69:0/2328039101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 msgr2=0x562651bb12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651bb12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e0d70700 1 -- 172.21.15.69:0/2328039101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 msgr2=0x562651b59ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b59ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e0d70700 1 -- 172.21.15.69:0/2328039101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d4009a00 con 0x562651b3ed20 2023-12-14T14:19:15.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b59ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:15.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9e0d70700 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b3ed20 0x562651b59660 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb9d001cf50 tx=0x7fb9d001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08e976760b42aa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:15.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9bbfff700 1 -- 172.21.15.69:0/2328039101 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d000ed20 con 0x562651b3ed20 2023-12-14T14:19:15.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9bbfff700 1 -- 172.21.15.69:0/2328039101 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fb9d003c080 con 0x562651b3ed20 2023-12-14T14:19:15.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2328039101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9d0021070 con 0x562651b3ed20 2023-12-14T14:19:15.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9bbfff700 1 -- 172.21.15.69:0/2328039101 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d001c620 con 0x562651b3ed20 2023-12-14T14:19:15.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9ef162b80 10 client.16707 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:15.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.748+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2328039101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562651a47a20 con 0x562651b3ed20 2023-12-14T14:19:15.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9bbfff700 1 -- 172.21.15.69:0/2328039101 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9d004c080 con 0x562651b3ed20 2023-12-14T14:19:15.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9bbfff700 1 -- 172.21.15.69:0/2328039101 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb9d0026430 con 0x562651b3ed20 2023-12-14T14:19:15.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9ef162b80 10 client.16707 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:15.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9ef162b80 10 client.16707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:15.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9ef162b80 20 client.16707 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:15.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x562651b53bd0 0x562651bbb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9ef162b80 4 client.16707 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:19:15.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2328039101 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562651a93a80 con 0x562651b53bd0 2023-12-14T14:19:15.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x562651b53bd0 0x562651bbb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9bbfff700 10 client.16707 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:15.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.749+0000 7fb9dbfff700 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x562651b53bd0 0x562651bbb110 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae213484537bbb9b server_cookie=4bc67f5a7a8d73fc in_seq=0 out_seq=0 2023-12-14T14:19:15.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9bbfff700 1 -- 172.21.15.69:0/2328039101 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562651a93a80 con 0x562651b53bd0 2023-12-14T14:19:15.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9bbfff700 10 client.16707 handle_command_reply: tid=0 2023-12-14T14:19:15.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 client.16707 shutdown 2023-12-14T14:19:15.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2328039101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b3ed20 msgr2=0x562651b59660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b3ed20 0x562651b59660 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb9d001cf50 tx=0x7fb9d001cc10 comp rx=0 tx=0).stop 2023-12-14T14:19:15.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2328039101 shutdown_connections 2023-12-14T14:19:15.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x562651b53bd0 0x562651bbb110 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562651b48d10 0x562651bb12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9bbfff700 0 client.16707 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:15.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562651b3ed20 0x562651b59660 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 --2- 172.21.15.69:0/2328039101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562651b48400 0x562651b59ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2328039101 >> 172.21.15.69:0/2328039101 conn(0x562651b56280 msgr2=0x562651b4a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2328039101 shutdown_connections 2023-12-14T14:19:15.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 1 -- 172.21.15.69:0/2328039101 wait complete. 2023-12-14T14:19:15.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.751+0000 7fb9ef162b80 20 client.16707 trim_cache size 0 max 16384 2023-12-14T14:19:15.767 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:19:15.767 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:19:15.767 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "cdf6b651-1f2e-4b5f-bdab-b23838ebc85c", 2023-12-14T14:19:15.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:19:15.767 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:19:15.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb9cc0a12c0 msgr2=0x7fb9cc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb9cc0a12c0 0x7fb9cc0a3770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009c60 tx=0x7fb9d0009260 comp rx=0 tx=0).stop 2023-12-14T14:19:15.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 msgr2=0x7fb9dc1012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 0x7fb9dc1012f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009990 tx=0x7fb9c800f690 comp rx=0 tx=0).stop 2023-12-14T14:19:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/3675451605 shutdown_connections 2023-12-14T14:19:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb9cc0a12c0 0x7fb9cc0a3770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9dc1043f0 0x7fb9dc1a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9dc0ff3b0 0x7fb9dc100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 --2- 172.21.15.69:0/3675451605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9dc0ffd50 0x7fb9dc1012f0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/3675451605 >> 172.21.15.69:0/3675451605 conn(0x7fb9dc075fa0 msgr2=0x7fb9dc068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/3675451605 shutdown_connections 2023-12-14T14:19:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.752+0000 7fb9e2fd4700 1 -- 172.21.15.69:0/3675451605 wait complete. 2023-12-14T14:19:15.771 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:19:15.795 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:15 smithi069 ceph-mon[42034]: pgmap v266: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:19:15.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.894+0000 7f5a4b65d700 1 -- 172.21.15.69:0/3249820177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 msgr2=0x7f5a441008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.894+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/3249820177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 0x7f5a441008a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5a340099c0 tx=0x7f5a34009cd0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.894+0000 7f5a4b65d700 1 -- 172.21.15.69:0/3249820177 shutdown_connections 2023-12-14T14:19:15.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.894+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/3249820177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a44105510 0x7f5a4410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.894+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/3249820177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 0x7f5a441008a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.894+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/3249820177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a44100e70 0x7f5a44104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.894+0000 7f5a4b65d700 1 -- 172.21.15.69:0/3249820177 >> 172.21.15.69:0/3249820177 conn(0x7f5a440fbd40 msgr2=0x7f5a440fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.894+0000 7f5a4b65d700 1 -- 172.21.15.69:0/3249820177 shutdown_connections 2023-12-14T14:19:15.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.894+0000 7f5a4b65d700 1 -- 172.21.15.69:0/3249820177 wait complete. 2023-12-14T14:19:15.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.895+0000 7f5a4b65d700 1 Processor -- start 2023-12-14T14:19:15.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.895+0000 7f5a4b65d700 1 -- start start 2023-12-14T14:19:15.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.895+0000 7f5a4b65d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 0x7f5a441963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a4b65d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a44100e70 0x7f5a441968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a4b65d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a44105510 0x7f5a4419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a4b65d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4419b380 con 0x7f5a441004d0 2023-12-14T14:19:15.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a4b65d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4419b4f0 con 0x7f5a44105510 2023-12-14T14:19:15.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a4b65d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4419b6b0 con 0x7f5a44100e70 2023-12-14T14:19:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a493f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 0x7f5a441963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a493f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 0x7f5a441963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37000/0 (socket says 172.21.15.69:37000) 2023-12-14T14:19:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a493f9700 1 -- 172.21.15.69:0/2876619639 learned_addr learned my addr 172.21.15.69:0/2876619639 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a44100e70 0x7f5a441968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a49bfa700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a44105510 0x7f5a4419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a493f9700 1 -- 172.21.15.69:0/2876619639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a44100e70 msgr2=0x7f5a441968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a493f9700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a44100e70 0x7f5a441968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a493f9700 1 -- 172.21.15.69:0/2876619639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a44105510 msgr2=0x7f5a4419ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a493f9700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a44105510 0x7f5a4419ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a493f9700 1 -- 172.21.15.69:0/2876619639 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a340095f0 con 0x7f5a441004d0 2023-12-14T14:19:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a49bfa700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a44105510 0x7f5a4419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a493f9700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 0x7f5a441963a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009990 tx=0x7f5a3400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a3a7fc700 1 -- 172.21.15.69:0/2876619639 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3401d070 con 0x7f5a441004d0 2023-12-14T14:19:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a3a7fc700 1 -- 172.21.15.69:0/2876619639 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a340054f0 con 0x7f5a441004d0 2023-12-14T14:19:15.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a3a7fc700 1 -- 172.21.15.69:0/2876619639 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34004b90 con 0x7f5a441004d0 2023-12-14T14:19:15.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a4b65d700 1 -- 172.21.15.69:0/2876619639 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a44110320 con 0x7f5a441004d0 2023-12-14T14:19:15.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.896+0000 7f5a4b65d700 1 -- 172.21.15.69:0/2876619639 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a44110190 con 0x7f5a441004d0 2023-12-14T14:19:15.904 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:15 smithi081 ceph-mon[43371]: pgmap v266: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:19:15.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.898+0000 7f5a3a7fc700 1 -- 172.21.15.69:0/2876619639 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5a3400fc30 con 0x7f5a441004d0 2023-12-14T14:19:15.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.899+0000 7f5a3a7fc700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a300a1340 0x7f5a300a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.899+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a300a1340 0x7f5a300a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.899+0000 7f5a3a7fc700 1 -- 172.21.15.69:0/2876619639 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f5a340cdaf0 con 0x7f5a441004d0 2023-12-14T14:19:15.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.900+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a300a1340 0x7f5a300a37f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a441979b0 tx=0x7f5a40005d50 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.900+0000 7f5a577ebb80 1 Processor -- start 2023-12-14T14:19:15.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.900+0000 7f5a577ebb80 1 -- start start 2023-12-14T14:19:15.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.900+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dc0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.900+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dcfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.900+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dd2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.900+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1caa5e0 con 0x559db1dc0c90 2023-12-14T14:19:15.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.900+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1d19870 con 0x559db1dcff60 2023-12-14T14:19:15.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.900+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1d12d00 con 0x559db1dc0380 2023-12-14T14:19:15.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a48bf8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dcfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a48bf8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dcfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37004/0 (socket says 172.21.15.69:37004) 2023-12-14T14:19:15.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a48bf8700 1 -- 172.21.15.69:0/1788955612 learned_addr learned my addr 172.21.15.69:0/1788955612 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a49bfa700 1 --2- 172.21.15.69:0/1788955612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dd2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a493f9700 1 --2- 172.21.15.69:0/1788955612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dc0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a48bf8700 1 -- 172.21.15.69:0/1788955612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 msgr2=0x559db1dc0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/1788955612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dc0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a48bf8700 1 -- 172.21.15.69:0/1788955612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 msgr2=0x559db1dd2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/1788955612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dd2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a48bf8700 1 -- 172.21.15.69:0/1788955612 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559db1b943b0 con 0x559db1dc0c90 2023-12-14T14:19:15.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/1788955612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dcfa20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a40005fd0 tx=0x7f5a40010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55ca9ddf7b90f1b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a2f7fe700 1 -- 172.21.15.69:0/1788955612 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4001c860 con 0x559db1dc0c90 2023-12-14T14:19:15.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a2f7fe700 1 -- 172.21.15.69:0/1788955612 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a4001ce80 con 0x559db1dc0c90 2023-12-14T14:19:15.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.901+0000 7f5a2f7fe700 1 -- 172.21.15.69:0/1788955612 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4001b3b0 con 0x559db1dc0c90 2023-12-14T14:19:15.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 -- 172.21.15.69:0/1788955612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 msgr2=0x559db1dcfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/1788955612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dcfa20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a40005fd0 tx=0x7f5a40010000 comp rx=0 tx=0).stop 2023-12-14T14:19:15.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 -- 172.21.15.69:0/1788955612 shutdown_connections 2023-12-14T14:19:15.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/1788955612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dd2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/1788955612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dc0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/1788955612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dcfa20 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 -- 172.21.15.69:0/1788955612 >> 172.21.15.69:0/1788955612 conn(0x559db1db6ca0 msgr2=0x559db1dbc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 -- 172.21.15.69:0/1788955612 shutdown_connections 2023-12-14T14:19:15.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 -- 172.21.15.69:0/1788955612 wait complete. 2023-12-14T14:19:15.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 -- start start 2023-12-14T14:19:15.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.902+0000 7f5a577ebb80 1 Processor -- start 2023-12-14T14:19:15.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dcf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dc0c90 0x559db1dccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dcff60 0x559db1dcd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1caef90 con 0x559db1dcff60 2023-12-14T14:19:15.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1caec30 con 0x559db1dc0c90 2023-12-14T14:19:15.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1b966a0 con 0x559db1dc0380 2023-12-14T14:19:15.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a577ebb80 10 client.0 _ll_register_callbacks cb 0x559db1cd2910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:15.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a49bfa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dcff60 0x559db1dcd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a49bfa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dcff60 0x559db1dcd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37018/0 (socket says 172.21.15.69:37018) 2023-12-14T14:19:15.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a49bfa700 1 -- 172.21.15.69:0/662789895 learned_addr learned my addr 172.21.15.69:0/662789895 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dc0c90 0x559db1dccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a493f9700 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dcf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a49bfa700 1 -- 172.21.15.69:0/662789895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 msgr2=0x559db1dcf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a49bfa700 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dcf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a49bfa700 1 -- 172.21.15.69:0/662789895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dc0c90 msgr2=0x559db1dccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a49bfa700 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dc0c90 0x559db1dccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a49bfa700 1 -- 172.21.15.69:0/662789895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4000d8a0 con 0x559db1dcff60 2023-12-14T14:19:15.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a49bfa700 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dcff60 0x559db1dcd0f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009550 tx=0x7f5a3c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f7d91499bda757 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.903+0000 7f5a2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a2cff9700 1 -- 172.21.15.69:0/662789895 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c012b60 con 0x559db1dcff60 2023-12-14T14:19:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a2cff9700 1 -- 172.21.15.69:0/662789895 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f5a3c012cc0 con 0x559db1dcff60 2023-12-14T14:19:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a577ebb80 1 -- 172.21.15.69:0/662789895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559db1d0bce0 con 0x559db1dcff60 2023-12-14T14:19:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a2cff9700 1 -- 172.21.15.69:0/662789895 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a3c012e80 con 0x559db1dcff60 2023-12-14T14:19:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a577ebb80 10 client.16719 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a577ebb80 1 -- 172.21.15.69:0/662789895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x559db1cd9170 con 0x559db1dcff60 2023-12-14T14:19:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a2cff9700 1 -- 172.21.15.69:0/662789895 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559db1d0bce0 con 0x559db1dcff60 2023-12-14T14:19:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a2cff9700 1 -- 172.21.15.69:0/662789895 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5a3c01e060 con 0x559db1dcff60 2023-12-14T14:19:15.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a577ebb80 10 client.16719 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:15.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a577ebb80 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:15.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a577ebb80 20 client.16719 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:15.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559db1ddfa00 0x559db1de1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a577ebb80 4 client.16719 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:15.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a577ebb80 1 -- 172.21.15.69:0/662789895 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559db1d0ba00 con 0x559db1ddfa00 2023-12-14T14:19:15.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.904+0000 7f5a493f9700 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559db1ddfa00 0x559db1de1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.905+0000 7f5a2cff9700 10 client.16719 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:15.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.905+0000 7f5a493f9700 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559db1ddfa00 0x559db1de1e10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a5857c1f2858e8 server_cookie=4d3537090c8cd965 in_seq=0 out_seq=0 2023-12-14T14:19:15.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.905+0000 7f5a2cff9700 1 -- 172.21.15.69:0/662789895 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559db1d0ba00 con 0x559db1ddfa00 2023-12-14T14:19:15.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.905+0000 7f5a2cff9700 10 client.16719 handle_command_reply: tid=0 2023-12-14T14:19:15.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.905+0000 7f5a577ebb80 1 client.16719 shutdown 2023-12-14T14:19:15.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.905+0000 7f5a577ebb80 1 -- 172.21.15.69:0/662789895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dcff60 msgr2=0x559db1dcd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.905+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dcff60 0x559db1dcd0f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009550 tx=0x7f5a3c007ea0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.905+0000 7f5a577ebb80 1 -- 172.21.15.69:0/662789895 shutdown_connections 2023-12-14T14:19:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.905+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559db1ddfa00 0x559db1de1e10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.906+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dcff60 0x559db1dcd0f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.906+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dcf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.906+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/662789895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dc0c90 0x559db1dccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.906+0000 7f5a2cff9700 0 client.16719 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.906+0000 7f5a577ebb80 1 -- 172.21.15.69:0/662789895 >> 172.21.15.69:0/662789895 conn(0x559db1db6ca0 msgr2=0x559db1dbc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.906+0000 7f5a577ebb80 1 -- 172.21.15.69:0/662789895 shutdown_connections 2023-12-14T14:19:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.906+0000 7f5a577ebb80 1 -- 172.21.15.69:0/662789895 wait complete. 2023-12-14T14:19:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.906+0000 7f5a577ebb80 20 client.16719 trim_cache size 0 max 16384 2023-12-14T14:19:15.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.922+0000 7f5a577ebb80 1 Processor -- start 2023-12-14T14:19:15.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.922+0000 7f5a577ebb80 1 -- start start 2023-12-14T14:19:15.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.922+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0380 0x559db1dbb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0c90 0x559db1dd6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dcc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1ddcf60 con 0x559db1dc0380 2023-12-14T14:19:15.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1dcd6d0 con 0x559db1dcff60 2023-12-14T14:19:15.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1dc79c0 con 0x559db1dc0c90 2023-12-14T14:19:15.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a493f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0380 0x559db1dbb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a493f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0380 0x559db1dbb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37022/0 (socket says 172.21.15.69:37022) 2023-12-14T14:19:15.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a493f9700 1 -- 172.21.15.69:0/2745165359 learned_addr learned my addr 172.21.15.69:0/2745165359 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/2745165359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0c90 0x559db1dd6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a493f9700 1 -- 172.21.15.69:0/2745165359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0c90 msgr2=0x559db1dd6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a493f9700 1 --2- 172.21.15.69:0/2745165359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0c90 0x559db1dd6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a493f9700 1 -- 172.21.15.69:0/2745165359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 msgr2=0x559db1dcc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a493f9700 1 --2- 172.21.15.69:0/2745165359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dcc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a493f9700 1 -- 172.21.15.69:0/2745165359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559db1de6a40 con 0x559db1dc0380 2023-12-14T14:19:15.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a493f9700 1 --2- 172.21.15.69:0/2745165359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0380 0x559db1dbb190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c010 tx=0x7f5a340a0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d69942187546331 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a2ffff700 1 -- 172.21.15.69:0/2745165359 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340a3000 con 0x559db1dc0380 2023-12-14T14:19:15.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a2ffff700 1 -- 172.21.15.69:0/2745165359 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a34098fe0 con 0x559db1dc0380 2023-12-14T14:19:15.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.923+0000 7f5a2ffff700 1 -- 172.21.15.69:0/2745165359 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3409a130 con 0x559db1dc0380 2023-12-14T14:19:15.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 -- 172.21.15.69:0/2745165359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0380 msgr2=0x559db1dbb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/2745165359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0380 0x559db1dbb190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c010 tx=0x7f5a340a0040 comp rx=0 tx=0).stop 2023-12-14T14:19:15.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 -- 172.21.15.69:0/2745165359 shutdown_connections 2023-12-14T14:19:15.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/2745165359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dcc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/2745165359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0380 0x559db1dbb190 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/2745165359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0c90 0x559db1dd6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 -- 172.21.15.69:0/2745165359 >> 172.21.15.69:0/2745165359 conn(0x559db1db6ca0 msgr2=0x559db1ddb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 -- 172.21.15.69:0/2745165359 shutdown_connections 2023-12-14T14:19:15.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 -- 172.21.15.69:0/2745165359 wait complete. 2023-12-14T14:19:15.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 -- start start 2023-12-14T14:19:15.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.924+0000 7f5a577ebb80 1 Processor -- start 2023-12-14T14:19:15.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dc8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dc9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a577ebb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dc9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1dd70d0 con 0x559db1dc0c90 2023-12-14T14:19:15.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1dc9dd0 con 0x559db1dcff60 2023-12-14T14:19:15.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a577ebb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db1dc9f90 con 0x559db1dc0380 2023-12-14T14:19:15.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a577ebb80 10 client.0 _ll_register_callbacks cb 0x7f5a3c007590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a48bf8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dc9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a48bf8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dc9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37038/0 (socket says 172.21.15.69:37038) 2023-12-14T14:19:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a48bf8700 1 -- 172.21.15.69:0/117313632 learned_addr learned my addr 172.21.15.69:0/117313632 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a49bfa700 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dc9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a48bf8700 1 -- 172.21.15.69:0/117313632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 msgr2=0x559db1dc8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dc8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a48bf8700 1 -- 172.21.15.69:0/117313632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 msgr2=0x559db1dc9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:15.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dc9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a48bf8700 1 -- 172.21.15.69:0/117313632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a44110190 con 0x559db1dc0c90 2023-12-14T14:19:15.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a49bfa700 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dc9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:15.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a48bf8700 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dc9350 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000dea0 tx=0x7f5a4001ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fb5c54f0e9efcf server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:15.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:15.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a2cff9700 1 -- 172.21.15.69:0/117313632 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40005520 con 0x559db1dc0c90 2023-12-14T14:19:15.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a2cff9700 1 -- 172.21.15.69:0/117313632 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f5a40005680 con 0x559db1dc0c90 2023-12-14T14:19:15.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.925+0000 7f5a577ebb80 1 -- 172.21.15.69:0/117313632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559db1db42b0 con 0x559db1dc0c90 2023-12-14T14:19:15.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a2cff9700 1 -- 172.21.15.69:0/117313632 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a400046f0 con 0x559db1dc0c90 2023-12-14T14:19:15.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a577ebb80 10 client.16725 fetch_fsmap learned FSMap version 28 2023-12-14T14:19:15.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a577ebb80 1 -- 172.21.15.69:0/117313632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x559db1b40b60 con 0x559db1dc0c90 2023-12-14T14:19:15.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a2cff9700 1 -- 172.21.15.69:0/117313632 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a4003e020 con 0x559db1dc0c90 2023-12-14T14:19:15.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a2cff9700 1 -- 172.21.15.69:0/117313632 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5a40025940 con 0x559db1dc0c90 2023-12-14T14:19:15.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a577ebb80 10 client.16725 fetch_fsmap finished waiting for FSMap version 28 2023-12-14T14:19:15.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a577ebb80 10 client.16725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:15.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a577ebb80 20 client.16725 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:15.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559db1e34230 0x559db1e36640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:15.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a577ebb80 4 client.16725 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:19:15.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a577ebb80 1 -- 172.21.15.69:0/117313632 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559db1b61cf0 con 0x559db1e34230 2023-12-14T14:19:15.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a493f9700 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559db1e34230 0x559db1e36640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:15.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a2cff9700 10 client.16725 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:15.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.926+0000 7f5a493f9700 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559db1e34230 0x559db1e36640 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b6b7ff96f910efe server_cookie=c2476413b0dc3fe8 in_seq=0 out_seq=0 2023-12-14T14:19:15.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a2cff9700 1 -- 172.21.15.69:0/117313632 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559db1b61cf0 con 0x559db1e34230 2023-12-14T14:19:15.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a2cff9700 10 client.16725 handle_command_reply: tid=0 2023-12-14T14:19:15.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 client.16725 shutdown 2023-12-14T14:19:15.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 -- 172.21.15.69:0/117313632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 msgr2=0x559db1dc9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dc9350 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000dea0 tx=0x7f5a4001ce20 comp rx=0 tx=0).stop 2023-12-14T14:19:15.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 -- 172.21.15.69:0/117313632 shutdown_connections 2023-12-14T14:19:15.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559db1e34230 0x559db1e36640 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559db1dcff60 0x559db1dc9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a2cff9700 0 client.16725 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:15.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559db1dc0380 0x559db1dc8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 --2- 172.21.15.69:0/117313632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559db1dc0c90 0x559db1dc9350 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 -- 172.21.15.69:0/117313632 >> 172.21.15.69:0/117313632 conn(0x559db1db6ca0 msgr2=0x559db1ddbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 -- 172.21.15.69:0/117313632 shutdown_connections 2023-12-14T14:19:15.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 1 -- 172.21.15.69:0/117313632 wait complete. 2023-12-14T14:19:15.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a577ebb80 20 client.16725 trim_cache size 0 max 16384 2023-12-14T14:19:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:19:15.943 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:19:15.943 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:19:15.943 INFO:teuthology.orchestra.run.smithi069.stdout: "cdf6b651-1f2e-4b5f-bdab-b23838ebc85c": { 2023-12-14T14:19:15.943 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:19:15.943 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "cdf6b651-1f2e-4b5f-bdab-b23838ebc85c", 2023-12-14T14:19:15.943 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:19:15.943 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:19:15.944 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:19:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:19:15.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a4b65d700 1 -- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a300a1340 msgr2=0x7f5a300a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a300a1340 0x7f5a300a37f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a441979b0 tx=0x7f5a40005d50 comp rx=0 tx=0).stop 2023-12-14T14:19:15.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a4b65d700 1 -- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 msgr2=0x7f5a441963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:15.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.927+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 0x7f5a441963a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009990 tx=0x7f5a3400f740 comp rx=0 tx=0).stop 2023-12-14T14:19:15.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.928+0000 7f5a4b65d700 1 -- 172.21.15.69:0/2876619639 shutdown_connections 2023-12-14T14:19:15.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.928+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f5a300a1340 0x7f5a300a37f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.928+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a44105510 0x7f5a4419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.928+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a441004d0 0x7f5a441963a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.928+0000 7f5a4b65d700 1 --2- 172.21.15.69:0/2876619639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a44100e70 0x7f5a441968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:15.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.928+0000 7f5a4b65d700 1 -- 172.21.15.69:0/2876619639 >> 172.21.15.69:0/2876619639 conn(0x7f5a440fbd40 msgr2=0x7f5a440fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:15.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.928+0000 7f5a4b65d700 1 -- 172.21.15.69:0/2876619639 shutdown_connections 2023-12-14T14:19:15.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:15.928+0000 7f5a4b65d700 1 -- 172.21.15.69:0/2876619639 wait complete. 2023-12-14T14:19:15.947 INFO:tasks.cephfs.filesystem:scrub status for tag:cdf6b651-1f2e-4b5f-bdab-b23838ebc85c - {'path': '/', 'tag': 'cdf6b651-1f2e-4b5f-bdab-b23838ebc85c', 'options': 'recursive,force'} 2023-12-14T14:19:16.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:15 smithi119 ceph-mon[43834]: pgmap v266: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:19:16.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:16 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:19:16.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:16 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:16.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:16 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:19:16.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:16 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:16.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:16 smithi069 ceph-mon[42034]: osdmap e91: 12 total, 12 up, 12 in 2023-12-14T14:19:16.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:16 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:19:16.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:16 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:16.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:16 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:19:16.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:16 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:16.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:16 smithi081 ceph-mon[43371]: osdmap e91: 12 total, 12 up, 12 in 2023-12-14T14:19:17.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:16 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:19:17.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:16 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:17.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:16 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:19:17.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:16 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:17.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:16 smithi119 ceph-mon[43834]: osdmap e91: 12 total, 12 up, 12 in 2023-12-14T14:19:17.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:17 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:19:17.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:17 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:17.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:17 smithi069 ceph-mon[42034]: pgmap v268: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-14T14:19:17.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:17 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:19:17.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:17 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:17.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:17 smithi081 ceph-mon[43371]: pgmap v268: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-14T14:19:18.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:17 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:19:18.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:17 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:18.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:17 smithi119 ceph-mon[43834]: pgmap v268: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-14T14:19:19.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:19 smithi069 ceph-mon[42034]: pgmap v269: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2023-12-14T14:19:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:19 smithi081 ceph-mon[43371]: pgmap v269: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2023-12-14T14:19:20.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:19 smithi119 ceph-mon[43834]: pgmap v269: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2023-12-14T14:19:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:21 smithi069 ceph-mon[42034]: pgmap v270: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 205 B/s wr, 6 op/s 2023-12-14T14:19:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:21 smithi081 ceph-mon[43371]: pgmap v270: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 205 B/s wr, 6 op/s 2023-12-14T14:19:22.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:21 smithi119 ceph-mon[43834]: pgmap v270: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 205 B/s wr, 6 op/s 2023-12-14T14:19:23.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:23 smithi069 ceph-mon[42034]: pgmap v271: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:19:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:23 smithi081 ceph-mon[43371]: pgmap v271: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:19:24.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:23 smithi119 ceph-mon[43834]: pgmap v271: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:19:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:25 smithi069 ceph-mon[42034]: pgmap v272: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:19:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:25 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:19:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:25 smithi081 ceph-mon[43371]: pgmap v272: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:19:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:25 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:19:26.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:25 smithi119 ceph-mon[43834]: pgmap v272: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:19:26.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:25 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:19:26.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:26 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:19:26.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:26 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:19:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:26 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:19:27.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:27 smithi069 ceph-mon[42034]: pgmap v273: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 101 B/s wr, 6 op/s 2023-12-14T14:19:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:27 smithi081 ceph-mon[43371]: pgmap v273: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 101 B/s wr, 6 op/s 2023-12-14T14:19:28.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:27 smithi119 ceph-mon[43834]: pgmap v273: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 101 B/s wr, 6 op/s 2023-12-14T14:19:29.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:29 smithi069 ceph-mon[42034]: pgmap v274: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-14T14:19:29.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:29 smithi081 ceph-mon[43371]: pgmap v274: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-14T14:19:30.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:29 smithi119 ceph-mon[43834]: pgmap v274: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-14T14:19:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:31 smithi069 ceph-mon[42034]: pgmap v275: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2023-12-14T14:19:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:31 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:31 smithi081 ceph-mon[43371]: pgmap v275: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2023-12-14T14:19:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:31 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:32.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:31 smithi119 ceph-mon[43834]: pgmap v275: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2023-12-14T14:19:32.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:31 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:33 smithi069 ceph-mon[42034]: pgmap v276: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:33 smithi081 ceph-mon[43371]: pgmap v276: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:34.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:33 smithi119 ceph-mon[43834]: pgmap v276: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:34.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:34 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:34.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:34 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:35.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:34 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:35.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:35 smithi069 ceph-mon[42034]: pgmap v277: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:35 smithi081 ceph-mon[43371]: pgmap v277: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:36.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:35 smithi119 ceph-mon[43834]: pgmap v277: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:37.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:37 smithi119 ceph-mon[43834]: pgmap v278: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:37.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:37 smithi069 ceph-mon[42034]: pgmap v278: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:37 smithi081 ceph-mon[43371]: pgmap v278: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:39.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:39 smithi119 ceph-mon[43834]: pgmap v279: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:39.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:39 smithi069 ceph-mon[42034]: pgmap v279: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:39 smithi081 ceph-mon[43371]: pgmap v279: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:41.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:41 smithi069 ceph-mon[42034]: pgmap v280: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:41 smithi081 ceph-mon[43371]: pgmap v280: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:42.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:41 smithi119 ceph-mon[43834]: pgmap v280: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:43.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:43 smithi069 ceph-mon[42034]: pgmap v281: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:43 smithi081 ceph-mon[43371]: pgmap v281: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:43 smithi119 ceph-mon[43834]: pgmap v281: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:45 smithi069 ceph-mon[42034]: pgmap v282: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:45 smithi081 ceph-mon[43371]: pgmap v282: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:45.948 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:19:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:45 smithi119 ceph-mon[43834]: pgmap v282: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:19:46.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.085+0000 7fca69eae700 1 -- 172.21.15.69:0/2731784333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ffd90 msgr2=0x7fca64103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.085+0000 7fca69eae700 1 --2- 172.21.15.69:0/2731784333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ffd90 0x7fca64103d50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fca540099c0 tx=0x7fca54009cd0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.085+0000 7fca69eae700 1 -- 172.21.15.69:0/2731784333 shutdown_connections 2023-12-14T14:19:46.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.085+0000 7fca69eae700 1 --2- 172.21.15.69:0/2731784333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca64104430 0x7fca6410c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.085+0000 7fca69eae700 1 --2- 172.21.15.69:0/2731784333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca640ff3f0 0x7fca640ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.085+0000 7fca69eae700 1 --2- 172.21.15.69:0/2731784333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ffd90 0x7fca64103d50 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.085+0000 7fca69eae700 1 -- 172.21.15.69:0/2731784333 >> 172.21.15.69:0/2731784333 conn(0x7fca64075fd0 msgr2=0x7fca640763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.085+0000 7fca69eae700 1 -- 172.21.15.69:0/2731784333 shutdown_connections 2023-12-14T14:19:46.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.085+0000 7fca69eae700 1 -- 172.21.15.69:0/2731784333 wait complete. 2023-12-14T14:19:46.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.086+0000 7fca69eae700 1 Processor -- start 2023-12-14T14:19:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.086+0000 7fca69eae700 1 -- start start 2023-12-14T14:19:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.086+0000 7fca69eae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ff3f0 0x7fca64195360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.086+0000 7fca69eae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca640ffd90 0x7fca641958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.086+0000 7fca69eae700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca64104430 0x7fca64199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.086+0000 7fca69eae700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6419a340 con 0x7fca640ff3f0 2023-12-14T14:19:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.086+0000 7fca69eae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6419a4b0 con 0x7fca640ffd90 2023-12-14T14:19:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.086+0000 7fca69eae700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6419a670 con 0x7fca64104430 2023-12-14T14:19:46.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ff3f0 0x7fca64195360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ff3f0 0x7fca64195360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50900/0 (socket says 172.21.15.69:50900) 2023-12-14T14:19:46.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca637fe700 1 -- 172.21.15.69:0/1272595156 learned_addr learned my addr 172.21.15.69:0/1272595156 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca63fff700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca64104430 0x7fca64199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca62ffd700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca640ffd90 0x7fca641958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca637fe700 1 -- 172.21.15.69:0/1272595156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca64104430 msgr2=0x7fca64199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca637fe700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca64104430 0x7fca64199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca637fe700 1 -- 172.21.15.69:0/1272595156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca640ffd90 msgr2=0x7fca641958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca637fe700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca640ffd90 0x7fca641958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca637fe700 1 -- 172.21.15.69:0/1272595156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540095f0 con 0x7fca640ff3f0 2023-12-14T14:19:46.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca637fe700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ff3f0 0x7fca64195360 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b530 tx=0x7fca5800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca60ff9700 1 -- 172.21.15.69:0/1272595156 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58011830 con 0x7fca640ff3f0 2023-12-14T14:19:46.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca60ff9700 1 -- 172.21.15.69:0/1272595156 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca58011e50 con 0x7fca640ff3f0 2023-12-14T14:19:46.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca60ff9700 1 -- 172.21.15.69:0/1272595156 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800f2e0 con 0x7fca640ff3f0 2023-12-14T14:19:46.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca69eae700 1 -- 172.21.15.69:0/1272595156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6410f230 con 0x7fca640ff3f0 2023-12-14T14:19:46.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.087+0000 7fca69eae700 1 -- 172.21.15.69:0/1272595156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6410f0a0 con 0x7fca640ff3f0 2023-12-14T14:19:46.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.089+0000 7fca60ff9700 1 -- 172.21.15.69:0/1272595156 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fca58010380 con 0x7fca640ff3f0 2023-12-14T14:19:46.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.090+0000 7fca60ff9700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fca4c0a1340 0x7fca4c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.090+0000 7fca62ffd700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fca4c0a1340 0x7fca4c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.090+0000 7fca60ff9700 1 -- 172.21.15.69:0/1272595156 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fca580cc710 con 0x7fca640ff3f0 2023-12-14T14:19:46.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.090+0000 7fca62ffd700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fca4c0a1340 0x7fca4c0a37f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fca54006010 tx=0x7fca54000bc0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca7603cb80 1 Processor -- start 2023-12-14T14:19:46.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca7603cb80 1 -- start start 2023-12-14T14:19:46.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45380 0x559281f45750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45c90 0x559281f52820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f55140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca7603cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281e2f5e0 con 0x559281f52d60 2023-12-14T14:19:46.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca7603cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281e9e870 con 0x559281f45380 2023-12-14T14:19:46.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca7603cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281e97d00 con 0x559281f45c90 2023-12-14T14:19:46.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca63fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f55140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca63fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f55140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50914/0 (socket says 172.21.15.69:50914) 2023-12-14T14:19:46.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca63fff700 1 -- 172.21.15.69:0/3388838381 learned_addr learned my addr 172.21.15.69:0/3388838381 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.091+0000 7fca637fe700 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45380 0x559281f45750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca62ffd700 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45c90 0x559281f52820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca63fff700 1 -- 172.21.15.69:0/3388838381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45c90 msgr2=0x559281f52820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca63fff700 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45c90 0x559281f52820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca63fff700 1 -- 172.21.15.69:0/3388838381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45380 msgr2=0x559281f45750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca63fff700 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45380 0x559281f45750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca63fff700 1 -- 172.21.15.69:0/3388838381 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559281d193b0 con 0x559281f52d60 2023-12-14T14:19:46.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca62ffd700 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45c90 0x559281f52820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:46.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca637fe700 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45380 0x559281f45750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:46.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca63fff700 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f55140 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fca5c003f90 tx=0x7fca5c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc828ce10bd74eb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca49ffb700 1 -- 172.21.15.69:0/3388838381 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c009e60 con 0x559281f52d60 2023-12-14T14:19:46.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca49ffb700 1 -- 172.21.15.69:0/3388838381 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca5c00f040 con 0x559281f52d60 2023-12-14T14:19:46.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.092+0000 7fca49ffb700 1 -- 172.21.15.69:0/3388838381 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c015770 con 0x559281f52d60 2023-12-14T14:19:46.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 -- 172.21.15.69:0/3388838381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 msgr2=0x559281f55140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f55140 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fca5c003f90 tx=0x7fca5c009c20 comp rx=0 tx=0).stop 2023-12-14T14:19:46.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 -- 172.21.15.69:0/3388838381 shutdown_connections 2023-12-14T14:19:46.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f55140 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45380 0x559281f45750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 --2- 172.21.15.69:0/3388838381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45c90 0x559281f52820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 -- 172.21.15.69:0/3388838381 >> 172.21.15.69:0/3388838381 conn(0x559281f3bca0 msgr2=0x559281f417e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 -- 172.21.15.69:0/3388838381 shutdown_connections 2023-12-14T14:19:46.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 -- 172.21.15.69:0/3388838381 wait complete. 2023-12-14T14:19:46.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 -- start start 2023-12-14T14:19:46.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 Processor -- start 2023-12-14T14:19:46.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45380 0x559281f526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f4f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f4ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281e33f90 con 0x559281f52d60 2023-12-14T14:19:46.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281e33c30 con 0x559281f45c90 2023-12-14T14:19:46.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.093+0000 7fca7603cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281d1b6a0 con 0x559281f45380 2023-12-14T14:19:46.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca7603cb80 10 client.0 _ll_register_callbacks cb 0x559281e57910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:46.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca63fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f4ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca63fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f4ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50928/0 (socket says 172.21.15.69:50928) 2023-12-14T14:19:46.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca63fff700 1 -- 172.21.15.69:0/1449843323 learned_addr learned my addr 172.21.15.69:0/1449843323 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca62ffd700 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f4f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca637fe700 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45380 0x559281f526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca63fff700 1 -- 172.21.15.69:0/1449843323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45380 msgr2=0x559281f526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca63fff700 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45380 0x559281f526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca63fff700 1 -- 172.21.15.69:0/1449843323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 msgr2=0x559281f4f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca63fff700 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f4f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca63fff700 1 -- 172.21.15.69:0/1449843323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c003bf0 con 0x559281f52d60 2023-12-14T14:19:46.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca637fe700 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45380 0x559281f526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:46.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca63fff700 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f4ff30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fca5c000f80 tx=0x7fca5c007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a64d856fbf1998 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:46.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca42ffd700 1 -- 172.21.15.69:0/1449843323 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c004ad0 con 0x559281f52d60 2023-12-14T14:19:46.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca42ffd700 1 -- 172.21.15.69:0/1449843323 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fca5c022070 con 0x559281f52d60 2023-12-14T14:19:46.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca7603cb80 1 -- 172.21.15.69:0/1449843323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559281f392b0 con 0x559281f52d60 2023-12-14T14:19:46.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca42ffd700 1 -- 172.21.15.69:0/1449843323 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca5c004c30 con 0x559281f52d60 2023-12-14T14:19:46.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca7603cb80 10 client.16737 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:46.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.094+0000 7fca7603cb80 1 -- 172.21.15.69:0/1449843323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x559281e5e170 con 0x559281f52d60 2023-12-14T14:19:46.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca42ffd700 1 -- 172.21.15.69:0/1449843323 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca5c032080 con 0x559281f52d60 2023-12-14T14:19:46.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca42ffd700 1 -- 172.21.15.69:0/1449843323 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fca5c026640 con 0x559281f52d60 2023-12-14T14:19:46.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca7603cb80 10 client.16737 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:46.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca7603cb80 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:46.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca7603cb80 20 client.16737 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:46.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559281f625b0 0x559281f649c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca7603cb80 4 client.16737 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:46.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca7603cb80 1 -- 172.21.15.69:0/1449843323 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559281e90ce0 con 0x559281f625b0 2023-12-14T14:19:46.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca637fe700 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559281f625b0 0x559281f649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca42ffd700 10 client.16737 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:46.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.095+0000 7fca637fe700 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559281f625b0 0x559281f649c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=464b93ccfe7c725 server_cookie=b614223cef59e497 in_seq=0 out_seq=0 2023-12-14T14:19:46.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca42ffd700 1 -- 172.21.15.69:0/1449843323 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559281e90ce0 con 0x559281f625b0 2023-12-14T14:19:46.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca42ffd700 10 client.16737 handle_command_reply: tid=0 2023-12-14T14:19:46.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 client.16737 shutdown 2023-12-14T14:19:46.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 -- 172.21.15.69:0/1449843323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 msgr2=0x559281f4ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f4ff30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fca5c000f80 tx=0x7fca5c007500 comp rx=0 tx=0).stop 2023-12-14T14:19:46.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 -- 172.21.15.69:0/1449843323 shutdown_connections 2023-12-14T14:19:46.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559281f625b0 0x559281f649c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f52d60 0x559281f4ff30 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f45380 0x559281f526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca42ffd700 0 client.16737 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:46.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1449843323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f4f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 -- 172.21.15.69:0/1449843323 >> 172.21.15.69:0/1449843323 conn(0x559281f3bca0 msgr2=0x559281f413d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 -- 172.21.15.69:0/1449843323 shutdown_connections 2023-12-14T14:19:46.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.096+0000 7fca7603cb80 1 -- 172.21.15.69:0/1449843323 wait complete. 2023-12-14T14:19:46.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.097+0000 7fca7603cb80 20 client.16737 trim_cache size 0 max 16384 2023-12-14T14:19:46.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca7603cb80 1 Processor -- start 2023-12-14T14:19:46.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca7603cb80 1 -- start start 2023-12-14T14:19:46.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 0x559281f521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f4ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca7603cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281f465e0 con 0x559281f45380 2023-12-14T14:19:46.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca7603cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281f4df10 con 0x559281f45c90 2023-12-14T14:19:46.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca7603cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281f4b820 con 0x559281f3bca0 2023-12-14T14:19:46.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca62ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca62ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50940/0 (socket says 172.21.15.69:50940) 2023-12-14T14:19:46.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.113+0000 7fca62ffd700 1 -- 172.21.15.69:0/1876155093 learned_addr learned my addr 172.21.15.69:0/1876155093 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca637fe700 1 --2- 172.21.15.69:0/1876155093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 0x559281f521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca62ffd700 1 -- 172.21.15.69:0/1876155093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 msgr2=0x559281f521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca62ffd700 1 --2- 172.21.15.69:0/1876155093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 0x559281f521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca62ffd700 1 -- 172.21.15.69:0/1876155093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 msgr2=0x559281f4ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca62ffd700 1 --2- 172.21.15.69:0/1876155093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f4ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca62ffd700 1 -- 172.21.15.69:0/1876155093 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559281e5dec0 con 0x559281f45380 2023-12-14T14:19:46.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca637fe700 1 --2- 172.21.15.69:0/1876155093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 0x559281f521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:46.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca62ffd700 1 --2- 172.21.15.69:0/1876155093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f526e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fca540099c0 tx=0x7fca5401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7ca1b9cecc0c4f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca4a7fc700 1 -- 172.21.15.69:0/1876155093 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54003ac0 con 0x559281f45380 2023-12-14T14:19:46.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca4a7fc700 1 -- 172.21.15.69:0/1876155093 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca5402b040 con 0x559281f45380 2023-12-14T14:19:46.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca4a7fc700 1 -- 172.21.15.69:0/1876155093 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5400fb20 con 0x559281f45380 2023-12-14T14:19:46.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca7603cb80 1 -- 172.21.15.69:0/1876155093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 msgr2=0x559281f526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1876155093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f526e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fca540099c0 tx=0x7fca5401e000 comp rx=0 tx=0).stop 2023-12-14T14:19:46.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca7603cb80 1 -- 172.21.15.69:0/1876155093 shutdown_connections 2023-12-14T14:19:46.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1876155093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f4ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1876155093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 0x559281f521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.114+0000 7fca7603cb80 1 --2- 172.21.15.69:0/1876155093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f526e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 -- 172.21.15.69:0/1876155093 >> 172.21.15.69:0/1876155093 conn(0x559281f55410 msgr2=0x559281f5ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 -- 172.21.15.69:0/1876155093 shutdown_connections 2023-12-14T14:19:46.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 -- 172.21.15.69:0/1876155093 wait complete. 2023-12-14T14:19:46.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 -- start start 2023-12-14T14:19:46.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 Processor -- start 2023-12-14T14:19:46.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 0x559281f59ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f57ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f58600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281f58cd0 con 0x559281f45380 2023-12-14T14:19:46.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281fb64a0 con 0x559281f45c90 2023-12-14T14:19:46.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281fb65e0 con 0x559281f3bca0 2023-12-14T14:19:46.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca7603cb80 10 client.0 _ll_register_callbacks cb 0x7fca5c003e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:46.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca62ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f57ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca62ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f57ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50954/0 (socket says 172.21.15.69:50954) 2023-12-14T14:19:46.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca62ffd700 1 -- 172.21.15.69:0/2196675808 learned_addr learned my addr 172.21.15.69:0/2196675808 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.115+0000 7fca637fe700 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 0x559281f59ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca62ffd700 1 -- 172.21.15.69:0/2196675808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 msgr2=0x559281f59ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca63fff700 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f58600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca62ffd700 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 0x559281f59ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca62ffd700 1 -- 172.21.15.69:0/2196675808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 msgr2=0x559281f58600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca62ffd700 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f58600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca62ffd700 1 -- 172.21.15.69:0/2196675808 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6410c840 con 0x559281f45380 2023-12-14T14:19:46.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca63fff700 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f58600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:46.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca62ffd700 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f57ec0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fca54005830 tx=0x7fca5400fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe7b121489fc7c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:46.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca42ffd700 1 -- 172.21.15.69:0/2196675808 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54003cd0 con 0x559281f45380 2023-12-14T14:19:46.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca42ffd700 1 -- 172.21.15.69:0/2196675808 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fca54003e30 con 0x559281f45380 2023-12-14T14:19:46.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca7603cb80 1 -- 172.21.15.69:0/2196675808 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca5c00f040 con 0x559281f45380 2023-12-14T14:19:46.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca42ffd700 1 -- 172.21.15.69:0/2196675808 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca54003ff0 con 0x559281f45380 2023-12-14T14:19:46.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca7603cb80 10 client.16743 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:46.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca7603cb80 1 -- 172.21.15.69:0/2196675808 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x559281e449a0 con 0x559281f45380 2023-12-14T14:19:46.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca42ffd700 1 -- 172.21.15.69:0/2196675808 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca54045020 con 0x559281f45380 2023-12-14T14:19:46.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca42ffd700 1 -- 172.21.15.69:0/2196675808 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fca54024440 con 0x559281f45380 2023-12-14T14:19:46.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca7603cb80 10 client.16743 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:46.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca7603cb80 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:46.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.116+0000 7fca7603cb80 20 client.16743 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:46.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca7603cb80 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559281f52d60 0x559281fb9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca7603cb80 4 client.16743 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:19:46.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca7603cb80 1 -- 172.21.15.69:0/2196675808 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559281e90a00 con 0x559281f52d60 2023-12-14T14:19:46.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca637fe700 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559281f52d60 0x559281fb9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca42ffd700 10 client.16743 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:46.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca637fe700 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559281f52d60 0x559281fb9860 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d2ee60dcf85c68 server_cookie=42015731c405220 in_seq=0 out_seq=0 2023-12-14T14:19:46.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca42ffd700 1 -- 172.21.15.69:0/2196675808 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559281e90a00 con 0x559281f52d60 2023-12-14T14:19:46.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca42ffd700 10 client.16743 handle_command_reply: tid=0 2023-12-14T14:19:46.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca7603cb80 1 client.16743 shutdown 2023-12-14T14:19:46.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca7603cb80 1 -- 172.21.15.69:0/2196675808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 msgr2=0x559281f57ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.117+0000 7fca7603cb80 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f57ec0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fca54005830 tx=0x7fca5400fd00 comp rx=0 tx=0).stop 2023-12-14T14:19:46.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca7603cb80 1 -- 172.21.15.69:0/2196675808 shutdown_connections 2023-12-14T14:19:46.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca7603cb80 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559281f52d60 0x559281fb9860 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca7603cb80 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559281f45c90 0x559281f58600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca7603cb80 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559281f3bca0 0x559281f59ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca7603cb80 1 --2- 172.21.15.69:0/2196675808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559281f45380 0x559281f57ec0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca7603cb80 1 -- 172.21.15.69:0/2196675808 >> 172.21.15.69:0/2196675808 conn(0x559281f55410 msgr2=0x559281f4ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca42ffd700 0 client.16743 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:46.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca7603cb80 1 -- 172.21.15.69:0/2196675808 shutdown_connections 2023-12-14T14:19:46.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca7603cb80 1 -- 172.21.15.69:0/2196675808 wait complete. 2023-12-14T14:19:46.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca7603cb80 20 client.16743 trim_cache size 0 max 16384 2023-12-14T14:19:46.133 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:19:46.133 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:19:46.133 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:19:46.133 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:19:46.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 -- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fca4c0a1340 msgr2=0x7fca4c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fca4c0a1340 0x7fca4c0a37f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fca54006010 tx=0x7fca54000bc0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 -- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ff3f0 msgr2=0x7fca64195360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ff3f0 0x7fca64195360 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b530 tx=0x7fca5800b840 comp rx=0 tx=0).stop 2023-12-14T14:19:46.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 -- 172.21.15.69:0/1272595156 shutdown_connections 2023-12-14T14:19:46.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fca4c0a1340 0x7fca4c0a37f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca64104430 0x7fca64199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca640ff3f0 0x7fca64195360 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 --2- 172.21.15.69:0/1272595156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca640ffd90 0x7fca641958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 -- 172.21.15.69:0/1272595156 >> 172.21.15.69:0/1272595156 conn(0x7fca64075fd0 msgr2=0x7fca64102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 -- 172.21.15.69:0/1272595156 shutdown_connections 2023-12-14T14:19:46.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.118+0000 7fca69eae700 1 -- 172.21.15.69:0/1272595156 wait complete. 2023-12-14T14:19:46.136 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:19:46.137 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:19:46.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.258+0000 7f24eb5b5700 1 -- 172.21.15.69:0/2940081226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 msgr2=0x7f24e410bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.258+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/2940081226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 0x7f24e410bfa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00b0d0 tx=0x7f24dc00b3e0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.258+0000 7f24eb5b5700 1 -- 172.21.15.69:0/2940081226 shutdown_connections 2023-12-14T14:19:46.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.258+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/2940081226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 0x7f24e410bfa0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.258+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/2940081226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24e40ff390 0x7f24e40ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.258+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/2940081226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e40ffd30 0x7f24e4103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.258+0000 7f24eb5b5700 1 -- 172.21.15.69:0/2940081226 >> 172.21.15.69:0/2940081226 conn(0x7f24e4076370 msgr2=0x7f24e4076770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 -- 172.21.15.69:0/2940081226 shutdown_connections 2023-12-14T14:19:46.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 -- 172.21.15.69:0/2940081226 wait complete. 2023-12-14T14:19:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 Processor -- start 2023-12-14T14:19:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 -- start start 2023-12-14T14:19:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e40ff390 0x7f24e4197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24e40ffd30 0x7f24e41978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 0x7f24e41a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41981b0 con 0x7f24e41043d0 2023-12-14T14:19:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41a2920 con 0x7f24e40ffd30 2023-12-14T14:19:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.259+0000 7f24eb5b5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41a2a90 con 0x7f24e40ff390 2023-12-14T14:19:46.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9b52700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 0x7f24e41a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9b52700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 0x7f24e41a23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50962/0 (socket says 172.21.15.69:50962) 2023-12-14T14:19:46.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9b52700 1 -- 172.21.15.69:0/13863571 learned_addr learned my addr 172.21.15.69:0/13863571 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9351700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e40ff390 0x7f24e4197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e8b50700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24e40ffd30 0x7f24e41978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9b52700 1 -- 172.21.15.69:0/13863571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e40ff390 msgr2=0x7f24e4197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9b52700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e40ff390 0x7f24e4197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9b52700 1 -- 172.21.15.69:0/13863571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24e40ffd30 msgr2=0x7f24e41978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9b52700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24e40ffd30 0x7f24e41978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9b52700 1 -- 172.21.15.69:0/13863571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc009d00 con 0x7f24e41043d0 2023-12-14T14:19:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e8b50700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24e40ffd30 0x7f24e41978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24e9b52700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 0x7f24e41a23e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f24dc007870 tx=0x7f24dc0078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24da7fc700 1 -- 172.21.15.69:0/13863571 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc00e040 con 0x7f24e41043d0 2023-12-14T14:19:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24da7fc700 1 -- 172.21.15.69:0/13863571 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24dc003e10 con 0x7f24e41043d0 2023-12-14T14:19:46.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e410f1a0 con 0x7f24e41043d0 2023-12-14T14:19:46.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24da7fc700 1 -- 172.21.15.69:0/13863571 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc01b980 con 0x7f24e41043d0 2023-12-14T14:19:46.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.260+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e410f010 con 0x7f24e41043d0 2023-12-14T14:19:46.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.261+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e410f330 con 0x7f24e41043d0 2023-12-14T14:19:46.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.262+0000 7f24da7fc700 1 -- 172.21.15.69:0/13863571 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f24dc0050d0 con 0x7f24e41043d0 2023-12-14T14:19:46.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.263+0000 7f24da7fc700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f24d00a12c0 0x7f24d00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.263+0000 7f24e9351700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f24d00a12c0 0x7f24d00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.263+0000 7f24da7fc700 1 -- 172.21.15.69:0/13863571 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f24dc0ceac0 con 0x7f24e41043d0 2023-12-14T14:19:46.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.263+0000 7f24e9351700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f24d00a12c0 0x7f24d00a3770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f24e0005950 tx=0x7f24e000a300 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.266+0000 7f24da7fc700 1 -- 172.21.15.69:0/13863571 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f24dc097f70 con 0x7f24e41043d0 2023-12-14T14:19:46.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.498+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24e40679f0 con 0x7f24e41043d0 2023-12-14T14:19:46.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.499+0000 7f24da7fc700 1 -- 172.21.15.69:0/13863571 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+10806 (secure 0 0 0) 0x7f24dc09b590 con 0x7f24e41043d0 2023-12-14T14:19:46.500 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:19:46.500 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:19:33.570844+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:19:46.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f24d00a12c0 msgr2=0x7f24d00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f24d00a12c0 0x7f24d00a3770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f24e0005950 tx=0x7f24e000a300 comp rx=0 tx=0).stop 2023-12-14T14:19:46.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 msgr2=0x7f24e41a23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 0x7f24e41a23e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f24dc007870 tx=0x7f24dc0078a0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 shutdown_connections 2023-12-14T14:19:46.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f24d00a12c0 0x7f24d00a3770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e41043d0 0x7f24e41a23e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e40ff390 0x7f24e4197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 --2- 172.21.15.69:0/13863571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24e40ffd30 0x7f24e41978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 >> 172.21.15.69:0/13863571 conn(0x7f24e4076370 msgr2=0x7f24e40fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.501+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 shutdown_connections 2023-12-14T14:19:46.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.502+0000 7f24eb5b5700 1 -- 172.21.15.69:0/13863571 wait complete. 2023-12-14T14:19:46.505 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 30 2023-12-14T14:19:46.515 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:19:46.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.638+0000 7f49f3299700 1 -- 172.21.15.69:0/3209013272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec104410 msgr2=0x7f49ec10bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.638+0000 7f49f3299700 1 --2- 172.21.15.69:0/3209013272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec104410 0x7f49ec10bfe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f49e400b0d0 tx=0x7f49e400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.638+0000 7f49f3299700 1 -- 172.21.15.69:0/3209013272 shutdown_connections 2023-12-14T14:19:46.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.638+0000 7f49f3299700 1 --2- 172.21.15.69:0/3209013272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec104410 0x7f49ec10bfe0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.638+0000 7f49f3299700 1 --2- 172.21.15.69:0/3209013272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49ec0ff3d0 0x7f49ec0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.638+0000 7f49f3299700 1 --2- 172.21.15.69:0/3209013272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49ec0ffd70 0x7f49ec103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.638+0000 7f49f3299700 1 -- 172.21.15.69:0/3209013272 >> 172.21.15.69:0/3209013272 conn(0x7f49ec076000 msgr2=0x7f49ec076400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.638+0000 7f49f3299700 1 -- 172.21.15.69:0/3209013272 shutdown_connections 2023-12-14T14:19:46.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.638+0000 7f49f3299700 1 -- 172.21.15.69:0/3209013272 wait complete. 2023-12-14T14:19:46.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f3299700 1 Processor -- start 2023-12-14T14:19:46.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f3299700 1 -- start start 2023-12-14T14:19:46.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f3299700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec0ff3d0 0x7f49ec195480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f3299700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49ec0ffd70 0x7f49ec1959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f3299700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49ec104410 0x7f49ec199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f3299700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec19a460 con 0x7f49ec0ff3d0 2023-12-14T14:19:46.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f3299700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec19a5d0 con 0x7f49ec104410 2023-12-14T14:19:46.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f3299700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec19a790 con 0x7f49ec0ffd70 2023-12-14T14:19:46.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f1035700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec0ff3d0 0x7f49ec195480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f1035700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec0ff3d0 0x7f49ec195480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41494/0 (socket says 172.21.15.69:41494) 2023-12-14T14:19:46.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f1035700 1 -- 172.21.15.69:0/109267907 learned_addr learned my addr 172.21.15.69:0/109267907 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f0834700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49ec0ffd70 0x7f49ec1959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f1035700 1 -- 172.21.15.69:0/109267907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49ec0ffd70 msgr2=0x7f49ec1959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f1836700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49ec104410 0x7f49ec199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f1035700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49ec0ffd70 0x7f49ec1959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.639+0000 7f49f1035700 1 -- 172.21.15.69:0/109267907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49ec104410 msgr2=0x7f49ec199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49f1035700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49ec104410 0x7f49ec199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49f1035700 1 -- 172.21.15.69:0/109267907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4009d00 con 0x7f49ec0ff3d0 2023-12-14T14:19:46.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49f0834700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49ec0ffd70 0x7f49ec1959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:46.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49f1836700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49ec104410 0x7f49ec199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:46.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49f1035700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec0ff3d0 0x7f49ec195480 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00d950 tx=0x7f49dc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49e27fc700 1 -- 172.21.15.69:0/109267907 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc009b40 con 0x7f49ec0ff3d0 2023-12-14T14:19:46.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49e27fc700 1 -- 172.21.15.69:0/109267907 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49dc009ca0 con 0x7f49ec0ff3d0 2023-12-14T14:19:46.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49f3299700 1 -- 172.21.15.69:0/109267907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec10f1e0 con 0x7f49ec0ff3d0 2023-12-14T14:19:46.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49e27fc700 1 -- 172.21.15.69:0/109267907 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc00f620 con 0x7f49ec0ff3d0 2023-12-14T14:19:46.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.640+0000 7f49f3299700 1 -- 172.21.15.69:0/109267907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec10f050 con 0x7f49ec0ff3d0 2023-12-14T14:19:46.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.643+0000 7f49e27fc700 1 -- 172.21.15.69:0/109267907 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f49dc010460 con 0x7f49ec0ff3d0 2023-12-14T14:19:46.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49ff427b80 1 Processor -- start 2023-12-14T14:19:46.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49ff427b80 1 -- start start 2023-12-14T14:19:46.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c362750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 0x56075c36d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49ff427b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c24c5e0 con 0x56075c36db50 2023-12-14T14:19:46.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49ff427b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c2bb870 con 0x56075c362c90 2023-12-14T14:19:46.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49ff427b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c2b4d00 con 0x56075c362380 2023-12-14T14:19:46.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f0834700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49e27fc700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f49d80a12c0 0x7f49d80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f0834700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41510/0 (socket says 172.21.15.69:41510) 2023-12-14T14:19:46.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f0834700 1 -- 172.21.15.69:0/2298280622 learned_addr learned my addr 172.21.15.69:0/2298280622 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f1035700 1 --2- 172.21.15.69:0/2298280622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 0x56075c36d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f1836700 1 --2- 172.21.15.69:0/2298280622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c362750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f1836700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f49d80a12c0 0x7f49d80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49e27fc700 1 -- 172.21.15.69:0/109267907 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f49dc0cd0f0 con 0x7f49ec0ff3d0 2023-12-14T14:19:46.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f0834700 1 -- 172.21.15.69:0/2298280622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 msgr2=0x56075c362750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f0834700 1 --2- 172.21.15.69:0/2298280622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c362750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f0834700 1 -- 172.21.15.69:0/2298280622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 msgr2=0x56075c36d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f0834700 1 --2- 172.21.15.69:0/2298280622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 0x56075c36d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.644+0000 7f49f0834700 1 -- 172.21.15.69:0/2298280622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56075c1363b0 con 0x56075c36db50 2023-12-14T14:19:46.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.645+0000 7f49f0834700 1 --2- 172.21.15.69:0/2298280622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36ff30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f49e800baf0 tx=0x7f49e800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27a4a3e8b5a256b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.645+0000 7f49f1836700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f49d80a12c0 0x7f49d80a3770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009cd0 tx=0x7f49e400b040 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.645+0000 7f49d77fe700 1 -- 172.21.15.69:0/2298280622 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800dc40 con 0x56075c36db50 2023-12-14T14:19:46.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.645+0000 7f49d77fe700 1 -- 172.21.15.69:0/2298280622 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49e800b5a0 con 0x56075c36db50 2023-12-14T14:19:46.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.645+0000 7f49d77fe700 1 -- 172.21.15.69:0/2298280622 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800f660 con 0x56075c36db50 2023-12-14T14:19:46.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.645+0000 7f49ff427b80 1 -- 172.21.15.69:0/2298280622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 msgr2=0x56075c36ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.645+0000 7f49ff427b80 1 --2- 172.21.15.69:0/2298280622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36ff30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f49e800baf0 tx=0x7f49e800be00 comp rx=0 tx=0).stop 2023-12-14T14:19:46.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 -- 172.21.15.69:0/2298280622 shutdown_connections 2023-12-14T14:19:46.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 --2- 172.21.15.69:0/2298280622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36ff30 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 --2- 172.21.15.69:0/2298280622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c362750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 --2- 172.21.15.69:0/2298280622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 0x56075c36d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 -- 172.21.15.69:0/2298280622 >> 172.21.15.69:0/2298280622 conn(0x56075c358ca0 msgr2=0x56075c35e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 -- 172.21.15.69:0/2298280622 shutdown_connections 2023-12-14T14:19:46.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 -- 172.21.15.69:0/2298280622 wait complete. 2023-12-14T14:19:46.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 -- start start 2023-12-14T14:19:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 Processor -- start 2023-12-14T14:19:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c36d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362c90 0x56075c36a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 0x56075c36ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c250f90 con 0x56075c362c90 2023-12-14T14:19:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c250c30 con 0x56075c36db50 2023-12-14T14:19:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c1386a0 con 0x56075c362380 2023-12-14T14:19:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49ff427b80 10 client.0 _ll_register_callbacks cb 0x56075c274910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.646+0000 7f49f0834700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362c90 0x56075c36a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f0834700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362c90 0x56075c36a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41522/0 (socket says 172.21.15.69:41522) 2023-12-14T14:19:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f0834700 1 -- 172.21.15.69:0/3321795436 learned_addr learned my addr 172.21.15.69:0/3321795436 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f1035700 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c36d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f0834700 1 -- 172.21.15.69:0/3321795436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 msgr2=0x56075c36d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f0834700 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c36d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f1836700 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 0x56075c36ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f0834700 1 -- 172.21.15.69:0/3321795436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 msgr2=0x56075c36ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f0834700 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 0x56075c36ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f0834700 1 -- 172.21.15.69:0/3321795436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e800b720 con 0x56075c362c90 2023-12-14T14:19:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49f0834700 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362c90 0x56075c36a7a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f49e8005950 tx=0x7f49e8017700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9cff66461668e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49d4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49d4ff9700 1 -- 172.21.15.69:0/3321795436 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8005c40 con 0x56075c362c90 2023-12-14T14:19:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49ff427b80 1 -- 172.21.15.69:0/3321795436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56075c2adce0 con 0x56075c362c90 2023-12-14T14:19:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49d4ff9700 1 -- 172.21.15.69:0/3321795436 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f49e8013070 con 0x56075c362c90 2023-12-14T14:19:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49d4ff9700 1 -- 172.21.15.69:0/3321795436 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49e8017be0 con 0x56075c362c90 2023-12-14T14:19:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49ff427b80 10 client.16761 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49ff427b80 1 -- 172.21.15.69:0/3321795436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56075c27b170 con 0x56075c362c90 2023-12-14T14:19:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.647+0000 7f49d4ff9700 1 -- 172.21.15.69:0/3321795436 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56075c2adce0 con 0x56075c362c90 2023-12-14T14:19:46.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49d4ff9700 1 -- 172.21.15.69:0/3321795436 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f49e801e850 con 0x56075c362c90 2023-12-14T14:19:46.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49ff427b80 10 client.16761 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:46.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49ff427b80 10 client.16761 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:19:46.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49ff427b80 20 client.16761 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:46.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56075c37d3b0 0x56075c37f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49ff427b80 4 client.16761 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49ff427b80 1 -- 172.21.15.69:0/3321795436 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56075c2ada00 con 0x56075c37d3b0 2023-12-14T14:19:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49f1035700 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56075c37d3b0 0x56075c37f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49d4ff9700 10 client.16761 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:19:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.648+0000 7f49f1035700 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56075c37d3b0 0x56075c37f7c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a8b17efd9772571 server_cookie=8da034586b1ac7e6 in_seq=0 out_seq=0 2023-12-14T14:19:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49d4ff9700 1 -- 172.21.15.69:0/3321795436 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56075c2ada00 con 0x56075c37d3b0 2023-12-14T14:19:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49d4ff9700 10 client.16761 handle_command_reply: tid=0 2023-12-14T14:19:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 client.16761 shutdown 2023-12-14T14:19:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 -- 172.21.15.69:0/3321795436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362c90 msgr2=0x56075c36a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362c90 0x56075c36a7a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f49e8005950 tx=0x7f49e8017700 comp rx=0 tx=0).stop 2023-12-14T14:19:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 -- 172.21.15.69:0/3321795436 shutdown_connections 2023-12-14T14:19:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 0x56075c36ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c36d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56075c37d3b0 0x56075c37f7c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3321795436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362c90 0x56075c36a7a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49d4ff9700 0 client.16761 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:19:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 -- 172.21.15.69:0/3321795436 >> 172.21.15.69:0/3321795436 conn(0x56075c358ca0 msgr2=0x56075c35e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 -- 172.21.15.69:0/3321795436 shutdown_connections 2023-12-14T14:19:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.649+0000 7f49ff427b80 1 -- 172.21.15.69:0/3321795436 wait complete. 2023-12-14T14:19:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.650+0000 7f49ff427b80 20 client.16761 trim_cache size 0 max 16384 2023-12-14T14:19:46.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.662+0000 7f49ff427b80 1 Processor -- start 2023-12-14T14:19:46.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.662+0000 7f49ff427b80 1 -- start start 2023-12-14T14:19:46.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.662+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c365270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.662+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 0x56075c3797a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.662+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.662+0000 7f49ff427b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c35f590 con 0x56075c36db50 2023-12-14T14:19:46.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.662+0000 7f49ff427b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c3663e0 con 0x56075c362c90 2023-12-14T14:19:46.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.662+0000 7f49ff427b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c366630 con 0x56075c362380 2023-12-14T14:19:46.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1836700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1836700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41532/0 (socket says 172.21.15.69:41532) 2023-12-14T14:19:46.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1836700 1 -- 172.21.15.69:0/3569868569 learned_addr learned my addr 172.21.15.69:0/3569868569 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1035700 1 --2- 172.21.15.69:0/3569868569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c365270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f0834700 1 --2- 172.21.15.69:0/3569868569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 0x56075c3797a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1836700 1 -- 172.21.15.69:0/3569868569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 msgr2=0x56075c365270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1836700 1 --2- 172.21.15.69:0/3569868569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c365270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1836700 1 -- 172.21.15.69:0/3569868569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 msgr2=0x56075c3797a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1836700 1 --2- 172.21.15.69:0/3569868569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 0x56075c3797a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1836700 1 -- 172.21.15.69:0/3569868569 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56075c36a310 con 0x56075c36db50 2023-12-14T14:19:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49f1836700 1 --2- 172.21.15.69:0/3569868569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36cf40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f49e4015000 tx=0x7f49e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9da39ff04c8b41 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49d7fff700 1 -- 172.21.15.69:0/3569868569 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400e040 con 0x56075c36db50 2023-12-14T14:19:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49d7fff700 1 -- 172.21.15.69:0/3569868569 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49e40092c0 con 0x56075c36db50 2023-12-14T14:19:46.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.663+0000 7f49d7fff700 1 -- 172.21.15.69:0/3569868569 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e401e460 con 0x56075c36db50 2023-12-14T14:19:46.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 -- 172.21.15.69:0/3569868569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 msgr2=0x56075c36cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3569868569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36cf40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f49e4015000 tx=0x7f49e4009780 comp rx=0 tx=0).stop 2023-12-14T14:19:46.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 -- 172.21.15.69:0/3569868569 shutdown_connections 2023-12-14T14:19:46.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3569868569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c36db50 0x56075c36cf40 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3569868569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362380 0x56075c365270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 --2- 172.21.15.69:0/3569868569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c362c90 0x56075c3797a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 -- 172.21.15.69:0/3569868569 >> 172.21.15.69:0/3569868569 conn(0x56075c358ca0 msgr2=0x56075c35cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 -- 172.21.15.69:0/3569868569 shutdown_connections 2023-12-14T14:19:46.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 -- 172.21.15.69:0/3569868569 wait complete. 2023-12-14T14:19:46.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 -- start start 2023-12-14T14:19:46.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 Processor -- start 2023-12-14T14:19:46.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.664+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362380 0x56075c370850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362c90 0x56075c370d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49ff427b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 0x56075c3d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49ff427b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c3d07a0 con 0x56075c362380 2023-12-14T14:19:46.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49ff427b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c3d08e0 con 0x56075c36db50 2023-12-14T14:19:46.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49ff427b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c3d0a20 con 0x56075c362c90 2023-12-14T14:19:46.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49ff427b80 10 client.0 _ll_register_callbacks cb 0x7f49dc095d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:46.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1035700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362380 0x56075c370850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1035700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362380 0x56075c370850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41546/0 (socket says 172.21.15.69:41546) 2023-12-14T14:19:46.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1035700 1 -- 172.21.15.69:0/4164158435 learned_addr learned my addr 172.21.15.69:0/4164158435 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f0834700 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362c90 0x56075c370d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1836700 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 0x56075c3d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1035700 1 -- 172.21.15.69:0/4164158435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362c90 msgr2=0x56075c370d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1035700 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362c90 0x56075c370d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1035700 1 -- 172.21.15.69:0/4164158435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 msgr2=0x56075c3d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1035700 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 0x56075c3d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1035700 1 -- 172.21.15.69:0/4164158435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec10c820 con 0x56075c362380 2023-12-14T14:19:46.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1836700 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 0x56075c3d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:46.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49f1035700 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362380 0x56075c370850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00b2f0 tx=0x7f49dc0cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8053e2bc062c07 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49d4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:46.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49d4ff9700 1 -- 172.21.15.69:0/4164158435 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0cac70 con 0x56075c362380 2023-12-14T14:19:46.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49d4ff9700 1 -- 172.21.15.69:0/4164158435 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f49dc010710 con 0x56075c362380 2023-12-14T14:19:46.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49ff427b80 1 -- 172.21.15.69:0/4164158435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56075c3562b0 con 0x56075c362380 2023-12-14T14:19:46.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49d4ff9700 1 -- 172.21.15.69:0/4164158435 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49dc0108d0 con 0x56075c362380 2023-12-14T14:19:46.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49ff427b80 10 client.16767 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:46.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49ff427b80 1 -- 172.21.15.69:0/4164158435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56075c0e2b60 con 0x56075c362380 2023-12-14T14:19:46.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.665+0000 7f49d4ff9700 1 -- 172.21.15.69:0/4164158435 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49dc0c8020 con 0x56075c362380 2023-12-14T14:19:46.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49d4ff9700 1 -- 172.21.15.69:0/4164158435 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f49dc099660 con 0x56075c362380 2023-12-14T14:19:46.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49ff427b80 10 client.16767 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:46.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49ff427b80 10 client.16767 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:19:46.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49ff427b80 20 client.16767 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:46.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49ff427b80 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56075c3d1fa0 0x56075c3d43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49ff427b80 4 client.16767 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:19:46.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49ff427b80 1 -- 172.21.15.69:0/4164158435 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56075c103cf0 con 0x56075c3d1fa0 2023-12-14T14:19:46.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49f0834700 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56075c3d1fa0 0x56075c3d43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49d4ff9700 10 client.16767 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:19:46.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49f0834700 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56075c3d1fa0 0x56075c3d43b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b1b0043eef103aaa server_cookie=b1d878e32e71de3b in_seq=0 out_seq=0 2023-12-14T14:19:46.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49d4ff9700 1 -- 172.21.15.69:0/4164158435 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56075c103cf0 con 0x56075c3d1fa0 2023-12-14T14:19:46.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49d4ff9700 10 client.16767 handle_command_reply: tid=0 2023-12-14T14:19:46.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49ff427b80 1 client.16767 shutdown 2023-12-14T14:19:46.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.666+0000 7f49ff427b80 1 -- 172.21.15.69:0/4164158435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362380 msgr2=0x56075c370850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362380 0x56075c370850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00b2f0 tx=0x7f49dc0cf040 comp rx=0 tx=0).stop 2023-12-14T14:19:46.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 1 -- 172.21.15.69:0/4164158435 shutdown_connections 2023-12-14T14:19:46.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56075c36db50 0x56075c3d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x56075c3d1fa0 0x56075c3d43b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56075c362380 0x56075c370850 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49d4ff9700 0 client.16767 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:19:46.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 1 --2- 172.21.15.69:0/4164158435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075c362c90 0x56075c370d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 1 -- 172.21.15.69:0/4164158435 >> 172.21.15.69:0/4164158435 conn(0x56075c358ca0 msgr2=0x56075c3797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 1 -- 172.21.15.69:0/4164158435 shutdown_connections 2023-12-14T14:19:46.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 1 -- 172.21.15.69:0/4164158435 wait complete. 2023-12-14T14:19:46.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49ff427b80 20 client.16767 trim_cache size 0 max 16384 2023-12-14T14:19:46.689 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:19:46.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 -- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f49d80a12c0 msgr2=0x7f49d80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f49d80a12c0 0x7f49d80a3770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009cd0 tx=0x7f49e400b040 comp rx=0 tx=0).stop 2023-12-14T14:19:46.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 -- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec0ff3d0 msgr2=0x7f49ec195480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec0ff3d0 0x7f49ec195480 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00d950 tx=0x7f49dc00dd10 comp rx=0 tx=0).stop 2023-12-14T14:19:46.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 -- 172.21.15.69:0/109267907 shutdown_connections 2023-12-14T14:19:46.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f49d80a12c0 0x7f49d80a3770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49ec104410 0x7f49ec199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49ec0ff3d0 0x7f49ec195480 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 --2- 172.21.15.69:0/109267907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49ec0ffd70 0x7f49ec1959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 -- 172.21.15.69:0/109267907 >> 172.21.15.69:0/109267907 conn(0x7f49ec076000 msgr2=0x7f49ec102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 -- 172.21.15.69:0/109267907 shutdown_connections 2023-12-14T14:19:46.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.667+0000 7f49f3299700 1 -- 172.21.15.69:0/109267907 wait complete. 2023-12-14T14:19:46.692 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:19:46.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.815+0000 7fb58c7d5700 1 -- 172.21.15.69:0/2227156970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841004b0 msgr2=0x7fb584100880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.815+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/2227156970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841004b0 0x7fb584100880 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb5740099c0 tx=0x7fb574009cd0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.815+0000 7fb58c7d5700 1 -- 172.21.15.69:0/2227156970 shutdown_connections 2023-12-14T14:19:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.815+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/2227156970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5841054f0 0x7fb58410d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.815+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/2227156970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841004b0 0x7fb584100880 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.815+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/2227156970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb584100e50 0x7fb584104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.815+0000 7fb58c7d5700 1 -- 172.21.15.69:0/2227156970 >> 172.21.15.69:0/2227156970 conn(0x7fb5840fbd40 msgr2=0x7fb5840fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.815+0000 7fb58c7d5700 1 -- 172.21.15.69:0/2227156970 shutdown_connections 2023-12-14T14:19:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.815+0000 7fb58c7d5700 1 -- 172.21.15.69:0/2227156970 wait complete. 2023-12-14T14:19:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58c7d5700 1 Processor -- start 2023-12-14T14:19:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58c7d5700 1 -- start start 2023-12-14T14:19:46.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58c7d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5841004b0 0x7fb584196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58c7d5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb584100e50 0x7fb584196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58c7d5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841054f0 0x7fb58419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58c7d5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58419b3e0 con 0x7fb5841054f0 2023-12-14T14:19:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58c7d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58419b550 con 0x7fb5841004b0 2023-12-14T14:19:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58c7d5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58419b710 con 0x7fb584100e50 2023-12-14T14:19:46.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58ad72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841054f0 0x7fb58419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58ad72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841054f0 0x7fb58419ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41568/0 (socket says 172.21.15.69:41568) 2023-12-14T14:19:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58ad72700 1 -- 172.21.15.69:0/1302506167 learned_addr learned my addr 172.21.15.69:0/1302506167 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58a571700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5841004b0 0x7fb584196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb589d70700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb584100e50 0x7fb584196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58ad72700 1 -- 172.21.15.69:0/1302506167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb584100e50 msgr2=0x7fb584196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58ad72700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb584100e50 0x7fb584196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58ad72700 1 -- 172.21.15.69:0/1302506167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5841004b0 msgr2=0x7fb584196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.816+0000 7fb58ad72700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5841004b0 0x7fb584196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.817+0000 7fb58ad72700 1 -- 172.21.15.69:0/1302506167 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740095f0 con 0x7fb5841054f0 2023-12-14T14:19:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.817+0000 7fb589d70700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb584100e50 0x7fb584196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.817+0000 7fb58ad72700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841054f0 0x7fb58419ada0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00ef30 tx=0x7fb57c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.817+0000 7fb57b7fe700 1 -- 172.21.15.69:0/1302506167 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c018070 con 0x7fb5841054f0 2023-12-14T14:19:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.817+0000 7fb57b7fe700 1 -- 172.21.15.69:0/1302506167 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb57c00f040 con 0x7fb5841054f0 2023-12-14T14:19:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.817+0000 7fb58c7d5700 1 -- 172.21.15.69:0/1302506167 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5841102b0 con 0x7fb5841054f0 2023-12-14T14:19:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.817+0000 7fb57b7fe700 1 -- 172.21.15.69:0/1302506167 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c003dc0 con 0x7fb5841054f0 2023-12-14T14:19:46.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.817+0000 7fb58c7d5700 1 -- 172.21.15.69:0/1302506167 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb584110120 con 0x7fb5841054f0 2023-12-14T14:19:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.819+0000 7fb57b7fe700 1 -- 172.21.15.69:0/1302506167 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb57c00caa0 con 0x7fb5841054f0 2023-12-14T14:19:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.819+0000 7fb57b7fe700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb5700a12c0 0x7fb5700a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb58a571700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb5700a12c0 0x7fb5700a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb57b7fe700 1 -- 172.21.15.69:0/1302506167 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fb57c0cc940 con 0x7fb5841054f0 2023-12-14T14:19:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb58a571700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb5700a12c0 0x7fb5700a3770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb574009990 tx=0x7fb57401a040 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb598963b80 1 Processor -- start 2023-12-14T14:19:46.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb598963b80 1 -- start start 2023-12-14T14:19:46.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb598963b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae737750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb598963b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae742610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb598963b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae742b50 0x55f6ae744f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb598963b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae6215e0 con 0x55f6ae737c90 2023-12-14T14:19:46.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb598963b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae690870 con 0x55f6ae742b50 2023-12-14T14:19:46.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.820+0000 7fb598963b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae689d00 con 0x55f6ae737380 2023-12-14T14:19:46.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb589d70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae742610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb589d70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae742610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41584/0 (socket says 172.21.15.69:41584) 2023-12-14T14:19:46.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb589d70700 1 -- 172.21.15.69:0/2876022728 learned_addr learned my addr 172.21.15.69:0/2876022728 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb58a571700 1 --2- 172.21.15.69:0/2876022728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae737750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb58ad72700 1 --2- 172.21.15.69:0/2876022728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae742b50 0x55f6ae744f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb589d70700 1 -- 172.21.15.69:0/2876022728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 msgr2=0x55f6ae737750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb589d70700 1 --2- 172.21.15.69:0/2876022728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae737750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb589d70700 1 -- 172.21.15.69:0/2876022728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae742b50 msgr2=0x55f6ae744f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb589d70700 1 --2- 172.21.15.69:0/2876022728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae742b50 0x55f6ae744f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb589d70700 1 -- 172.21.15.69:0/2876022728 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6ae50b3b0 con 0x55f6ae737c90 2023-12-14T14:19:46.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb589d70700 1 --2- 172.21.15.69:0/2876022728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae742610 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb580009c40 tx=0x7fb580009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6236b152e08e2655 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb578ff9700 1 -- 172.21.15.69:0/2876022728 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58000ebb0 con 0x55f6ae737c90 2023-12-14T14:19:46.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb578ff9700 1 -- 172.21.15.69:0/2876022728 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb580004cf0 con 0x55f6ae737c90 2023-12-14T14:19:46.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.821+0000 7fb578ff9700 1 -- 172.21.15.69:0/2876022728 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580005700 con 0x55f6ae737c90 2023-12-14T14:19:46.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 -- 172.21.15.69:0/2876022728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 msgr2=0x55f6ae742610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 --2- 172.21.15.69:0/2876022728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae742610 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb580009c40 tx=0x7fb580009f50 comp rx=0 tx=0).stop 2023-12-14T14:19:46.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 -- 172.21.15.69:0/2876022728 shutdown_connections 2023-12-14T14:19:46.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 --2- 172.21.15.69:0/2876022728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae742b50 0x55f6ae744f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 --2- 172.21.15.69:0/2876022728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae737750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 --2- 172.21.15.69:0/2876022728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae742610 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 -- 172.21.15.69:0/2876022728 >> 172.21.15.69:0/2876022728 conn(0x55f6ae72dca0 msgr2=0x55f6ae7337e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 -- 172.21.15.69:0/2876022728 shutdown_connections 2023-12-14T14:19:46.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 -- 172.21.15.69:0/2876022728 wait complete. 2023-12-14T14:19:46.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 -- start start 2023-12-14T14:19:46.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.822+0000 7fb598963b80 1 Processor -- start 2023-12-14T14:19:46.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb598963b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae7424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb598963b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737c90 0x55f6ae73f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb598963b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae742b50 0x55f6ae73fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb598963b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae625f90 con 0x55f6ae742b50 2023-12-14T14:19:46.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb598963b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae625c30 con 0x55f6ae737c90 2023-12-14T14:19:46.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb598963b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae50d6a0 con 0x55f6ae737380 2023-12-14T14:19:46.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb598963b80 10 client.0 _ll_register_callbacks cb 0x55f6ae649910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:46.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58ad72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae742b50 0x55f6ae73fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58ad72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae742b50 0x55f6ae73fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41588/0 (socket says 172.21.15.69:41588) 2023-12-14T14:19:46.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58ad72700 1 -- 172.21.15.69:0/1495934063 learned_addr learned my addr 172.21.15.69:0/1495934063 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb589d70700 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737c90 0x55f6ae73f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58a571700 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae7424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58ad72700 1 -- 172.21.15.69:0/1495934063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 msgr2=0x55f6ae7424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58ad72700 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae7424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58ad72700 1 -- 172.21.15.69:0/1495934063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737c90 msgr2=0x55f6ae73f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58ad72700 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737c90 0x55f6ae73f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58ad72700 1 -- 172.21.15.69:0/1495934063 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5800098a0 con 0x55f6ae742b50 2023-12-14T14:19:46.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58a571700 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae7424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:46.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb58ad72700 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae742b50 0x55f6ae73fd60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb57c099a40 tx=0x7fb57c099ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d35a5db6562aa28 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb56dffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:46.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb56dffb700 1 -- 172.21.15.69:0/1495934063 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0a1e70 con 0x55f6ae742b50 2023-12-14T14:19:46.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb56dffb700 1 -- 172.21.15.69:0/1495934063 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fb57c099d10 con 0x55f6ae742b50 2023-12-14T14:19:46.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb598963b80 1 -- 172.21.15.69:0/1495934063 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6ae72b2b0 con 0x55f6ae742b50 2023-12-14T14:19:46.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.823+0000 7fb56dffb700 1 -- 172.21.15.69:0/1495934063 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb57c099ed0 con 0x55f6ae742b50 2023-12-14T14:19:46.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb598963b80 10 client.16779 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:46.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb598963b80 1 -- 172.21.15.69:0/1495934063 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f6ae650170 con 0x55f6ae742b50 2023-12-14T14:19:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb56dffb700 1 -- 172.21.15.69:0/1495934063 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f6ae72b2b0 con 0x55f6ae742b50 2023-12-14T14:19:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb56dffb700 1 -- 172.21.15.69:0/1495934063 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb57c0a19e0 con 0x55f6ae742b50 2023-12-14T14:19:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb598963b80 10 client.16779 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb598963b80 10 client.16779 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:19:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb598963b80 20 client.16779 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb598963b80 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55f6ae7523b0 0x55f6ae7547c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb598963b80 4 client.16779 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb598963b80 1 -- 172.21.15.69:0/1495934063 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6ae682ce0 con 0x55f6ae7523b0 2023-12-14T14:19:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.824+0000 7fb58a571700 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55f6ae7523b0 0x55f6ae7547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb56dffb700 10 client.16779 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:19:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb58a571700 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55f6ae7523b0 0x55f6ae7547c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3c3222950e6e8ac server_cookie=ddfd4af2489535cb in_seq=0 out_seq=0 2023-12-14T14:19:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb56dffb700 1 -- 172.21.15.69:0/1495934063 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f6ae682ce0 con 0x55f6ae7523b0 2023-12-14T14:19:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb56dffb700 10 client.16779 handle_command_reply: tid=0 2023-12-14T14:19:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb598963b80 1 client.16779 shutdown 2023-12-14T14:19:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb598963b80 1 -- 172.21.15.69:0/1495934063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae742b50 msgr2=0x55f6ae73fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb598963b80 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae742b50 0x55f6ae73fd60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb57c099a40 tx=0x7fb57c099ab0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb598963b80 1 -- 172.21.15.69:0/1495934063 shutdown_connections 2023-12-14T14:19:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb598963b80 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55f6ae7523b0 0x55f6ae7547c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb598963b80 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae742b50 0x55f6ae73fd60 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb598963b80 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae7424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb598963b80 1 --2- 172.21.15.69:0/1495934063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737c90 0x55f6ae73f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb56dffb700 0 client.16779 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:19:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.825+0000 7fb598963b80 1 -- 172.21.15.69:0/1495934063 >> 172.21.15.69:0/1495934063 conn(0x55f6ae72dca0 msgr2=0x55f6ae733370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.826+0000 7fb598963b80 1 -- 172.21.15.69:0/1495934063 shutdown_connections 2023-12-14T14:19:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.826+0000 7fb598963b80 1 -- 172.21.15.69:0/1495934063 wait complete. 2023-12-14T14:19:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.826+0000 7fb598963b80 20 client.16779 trim_cache size 0 max 16384 2023-12-14T14:19:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.838+0000 7fb598963b80 1 Processor -- start 2023-12-14T14:19:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.838+0000 7fb598963b80 1 -- start start 2023-12-14T14:19:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb598963b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae72dca0 0x55f6ae741fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb598963b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737380 0x55f6ae7424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb598963b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737c90 0x55f6ae73aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb598963b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae7385b0 con 0x55f6ae72dca0 2023-12-14T14:19:46.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb598963b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae734490 con 0x55f6ae737380 2023-12-14T14:19:46.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb598963b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae74e540 con 0x55f6ae737c90 2023-12-14T14:19:46.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58a571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae72dca0 0x55f6ae741fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58a571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae72dca0 0x55f6ae741fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41590/0 (socket says 172.21.15.69:41590) 2023-12-14T14:19:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58a571700 1 -- 172.21.15.69:0/2361344922 learned_addr learned my addr 172.21.15.69:0/2361344922 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58ad72700 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737c90 0x55f6ae73aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58a571700 1 -- 172.21.15.69:0/2361344922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737c90 msgr2=0x55f6ae73aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58a571700 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737c90 0x55f6ae73aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58a571700 1 -- 172.21.15.69:0/2361344922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737380 msgr2=0x55f6ae7424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb589d70700 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737380 0x55f6ae7424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58a571700 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737380 0x55f6ae7424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58a571700 1 -- 172.21.15.69:0/2361344922 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6ae64fec0 con 0x55f6ae72dca0 2023-12-14T14:19:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58ad72700 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737c90 0x55f6ae73aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb58a571700 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae72dca0 0x55f6ae741fb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb574005850 tx=0x7fb574022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420877fb6bd969e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb5797fa700 1 -- 172.21.15.69:0/2361344922 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57402a030 con 0x55f6ae72dca0 2023-12-14T14:19:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb5797fa700 1 -- 172.21.15.69:0/2361344922 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb57402b040 con 0x55f6ae72dca0 2023-12-14T14:19:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.839+0000 7fb5797fa700 1 -- 172.21.15.69:0/2361344922 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57401d040 con 0x55f6ae72dca0 2023-12-14T14:19:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 -- 172.21.15.69:0/2361344922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae72dca0 msgr2=0x55f6ae741fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae72dca0 0x55f6ae741fb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb574005850 tx=0x7fb574022000 comp rx=0 tx=0).stop 2023-12-14T14:19:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 -- 172.21.15.69:0/2361344922 shutdown_connections 2023-12-14T14:19:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737c90 0x55f6ae73aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae72dca0 0x55f6ae741fb0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 --2- 172.21.15.69:0/2361344922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae737380 0x55f6ae7424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 -- 172.21.15.69:0/2361344922 >> 172.21.15.69:0/2361344922 conn(0x55f6ae745200 msgr2=0x55f6ae74de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 -- 172.21.15.69:0/2361344922 shutdown_connections 2023-12-14T14:19:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 -- 172.21.15.69:0/2361344922 wait complete. 2023-12-14T14:19:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 -- start start 2023-12-14T14:19:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.840+0000 7fb598963b80 1 Processor -- start 2023-12-14T14:19:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb598963b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae72dca0 0x55f6ae747860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb598963b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae747da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb598963b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae748e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb598963b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae7493e0 con 0x55f6ae737c90 2023-12-14T14:19:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb598963b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae749550 con 0x55f6ae72dca0 2023-12-14T14:19:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb598963b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ae749710 con 0x55f6ae737380 2023-12-14T14:19:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb598963b80 10 client.0 _ll_register_callbacks cb 0x7fb57c0995f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58ad72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae748e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58ad72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae748e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41596/0 (socket says 172.21.15.69:41596) 2023-12-14T14:19:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58ad72700 1 -- 172.21.15.69:0/2244898633 learned_addr learned my addr 172.21.15.69:0/2244898633 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb589d70700 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae747da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58a571700 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae72dca0 0x55f6ae747860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58ad72700 1 -- 172.21.15.69:0/2244898633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 msgr2=0x55f6ae747da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58ad72700 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae747da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58ad72700 1 -- 172.21.15.69:0/2244898633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae72dca0 msgr2=0x55f6ae747860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:46.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58ad72700 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae72dca0 0x55f6ae747860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58ad72700 1 -- 172.21.15.69:0/2244898633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58410d900 con 0x55f6ae737c90 2023-12-14T14:19:46.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58a571700 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae72dca0 0x55f6ae747860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:46.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb58ad72700 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae748e00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00c850 tx=0x7fb57c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a579aff29a38aa86 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb56dffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:46.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb56dffb700 1 -- 172.21.15.69:0/2244898633 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c098a60 con 0x55f6ae737c90 2023-12-14T14:19:46.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb56dffb700 1 -- 172.21.15.69:0/2244898633 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fb57c0a1e70 con 0x55f6ae737c90 2023-12-14T14:19:46.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.841+0000 7fb598963b80 1 -- 172.21.15.69:0/2244898633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb580004cf0 con 0x55f6ae737c90 2023-12-14T14:19:46.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb56dffb700 1 -- 172.21.15.69:0/2244898633 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb57c099d10 con 0x55f6ae737c90 2023-12-14T14:19:46.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb598963b80 10 client.16785 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:46.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb598963b80 1 -- 172.21.15.69:0/2244898633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f6ae6369a0 con 0x55f6ae737c90 2023-12-14T14:19:46.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb56dffb700 1 -- 172.21.15.69:0/2244898633 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb580004cf0 con 0x55f6ae737c90 2023-12-14T14:19:46.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb56dffb700 1 -- 172.21.15.69:0/2244898633 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb57c0b9150 con 0x55f6ae737c90 2023-12-14T14:19:46.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb598963b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb598963b80 10 client.16785 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:19:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb598963b80 20 client.16785 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb598963b80 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55f6ae742b50 0x55f6ae7a9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb598963b80 4 client.16785 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:19:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb598963b80 1 -- 172.21.15.69:0/2244898633 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f6ae682a00 con 0x55f6ae742b50 2023-12-14T14:19:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.842+0000 7fb58a571700 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55f6ae742b50 0x55f6ae7a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb56dffb700 10 client.16785 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:19:46.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb58a571700 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55f6ae742b50 0x55f6ae7a9060 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24adef209ba569d1 server_cookie=a8bbd9e6e6d0ec0b in_seq=0 out_seq=0 2023-12-14T14:19:46.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb56dffb700 1 -- 172.21.15.69:0/2244898633 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f6ae682a00 con 0x55f6ae742b50 2023-12-14T14:19:46.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb56dffb700 10 client.16785 handle_command_reply: tid=0 2023-12-14T14:19:46.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 client.16785 shutdown 2023-12-14T14:19:46.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 -- 172.21.15.69:0/2244898633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 msgr2=0x55f6ae748e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae748e00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00c850 tx=0x7fb57c00cf80 comp rx=0 tx=0).stop 2023-12-14T14:19:46.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 -- 172.21.15.69:0/2244898633 shutdown_connections 2023-12-14T14:19:46.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55f6ae742b50 0x55f6ae7a9060 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f6ae737c90 0x55f6ae748e00 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6ae72dca0 0x55f6ae747860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 --2- 172.21.15.69:0/2244898633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f6ae737380 0x55f6ae747da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb56dffb700 0 client.16785 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:19:46.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 -- 172.21.15.69:0/2244898633 >> 172.21.15.69:0/2244898633 conn(0x55f6ae745200 msgr2=0x55f6ae73aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 -- 172.21.15.69:0/2244898633 shutdown_connections 2023-12-14T14:19:46.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 1 -- 172.21.15.69:0/2244898633 wait complete. 2023-12-14T14:19:46.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.843+0000 7fb598963b80 20 client.16785 trim_cache size 0 max 16384 2023-12-14T14:19:46.864 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:19:46.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 -- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb5700a12c0 msgr2=0x7fb5700a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb5700a12c0 0x7fb5700a3770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb574009990 tx=0x7fb57401a040 comp rx=0 tx=0).stop 2023-12-14T14:19:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 -- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841054f0 msgr2=0x7fb58419ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841054f0 0x7fb58419ada0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00ef30 tx=0x7fb57c00c450 comp rx=0 tx=0).stop 2023-12-14T14:19:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 -- 172.21.15.69:0/1302506167 shutdown_connections 2023-12-14T14:19:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fb5700a12c0 0x7fb5700a3770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5841054f0 0x7fb58419ada0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5841004b0 0x7fb584196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 --2- 172.21.15.69:0/1302506167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb584100e50 0x7fb584196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 -- 172.21.15.69:0/1302506167 >> 172.21.15.69:0/1302506167 conn(0x7fb5840fbd40 msgr2=0x7fb5840fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 -- 172.21.15.69:0/1302506167 shutdown_connections 2023-12-14T14:19:46.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.844+0000 7fb58c7d5700 1 -- 172.21.15.69:0/1302506167 wait complete. 2023-12-14T14:19:46.867 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:19:46.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.990+0000 7f4a7aec0700 1 -- 172.21.15.69:0/3545952331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a740690f0 msgr2=0x7f4a740694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.990+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/3545952331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a740690f0 0x7f4a740694c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4a680099c0 tx=0x7f4a68009cd0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.990+0000 7f4a7aec0700 1 -- 172.21.15.69:0/3545952331 shutdown_connections 2023-12-14T14:19:46.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.990+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/3545952331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741054f0 0x7f4a7410d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.990+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/3545952331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a740690f0 0x7f4a740694c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.990+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/3545952331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a74069a90 0x7f4a74104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.990+0000 7f4a7aec0700 1 -- 172.21.15.69:0/3545952331 >> 172.21.15.69:0/3545952331 conn(0x7f4a74075fa0 msgr2=0x7f4a740763a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.990+0000 7f4a7aec0700 1 -- 172.21.15.69:0/3545952331 shutdown_connections 2023-12-14T14:19:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.990+0000 7f4a7aec0700 1 -- 172.21.15.69:0/3545952331 wait complete. 2023-12-14T14:19:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7aec0700 1 Processor -- start 2023-12-14T14:19:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7aec0700 1 -- start start 2023-12-14T14:19:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7aec0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a740690f0 0x7f4a740ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7aec0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a74069a90 0x7f4a740ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7aec0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a741054f0 0x7f4a741a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7aec0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740fff00 con 0x7f4a741054f0 2023-12-14T14:19:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7aec0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a741a4a60 con 0x7f4a74069a90 2023-12-14T14:19:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7aec0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a741a4ba0 con 0x7f4a740690f0 2023-12-14T14:19:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7945d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a741054f0 0x7f4a741a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7945d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a741054f0 0x7f4a741a4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41624/0 (socket says 172.21.15.69:41624) 2023-12-14T14:19:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a7945d700 1 -- 172.21.15.69:0/1092299372 learned_addr learned my addr 172.21.15.69:0/1092299372 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.991+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a740690f0 0x7f4a740ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a73fff700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a74069a90 0x7f4a740ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a7945d700 1 -- 172.21.15.69:0/1092299372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a740690f0 msgr2=0x7f4a740ff190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a7945d700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a740690f0 0x7f4a740ff190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a7945d700 1 -- 172.21.15.69:0/1092299372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a74069a90 msgr2=0x7f4a740ff6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:46.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a7945d700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a74069a90 0x7f4a740ff6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:46.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a7945d700 1 -- 172.21.15.69:0/1092299372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680095f0 con 0x7f4a741054f0 2023-12-14T14:19:46.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a73fff700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a74069a90 0x7f4a740ff6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:46.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a7945d700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a741054f0 0x7f4a741a4520 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c007f10 tx=0x7f4a6c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:46.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a71ffb700 1 -- 172.21.15.69:0/1092299372 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00ddd0 con 0x7f4a741054f0 2023-12-14T14:19:46.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a7aec0700 1 -- 172.21.15.69:0/1092299372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a74110300 con 0x7f4a741054f0 2023-12-14T14:19:46.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a71ffb700 1 -- 172.21.15.69:0/1092299372 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a6c00f040 con 0x7f4a741054f0 2023-12-14T14:19:46.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a71ffb700 1 -- 172.21.15.69:0/1092299372 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0048e0 con 0x7f4a741054f0 2023-12-14T14:19:46.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.992+0000 7f4a7aec0700 1 -- 172.21.15.69:0/1092299372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a74110170 con 0x7f4a741054f0 2023-12-14T14:19:47.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.994+0000 7f4a71ffb700 1 -- 172.21.15.69:0/1092299372 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4a6c003a00 con 0x7f4a741054f0 2023-12-14T14:19:47.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.995+0000 7f4a71ffb700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4a640a12c0 0x7f4a640a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.995+0000 7f4a71ffb700 1 -- 172.21.15.69:0/1092299372 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f4a6c0cc680 con 0x7f4a741054f0 2023-12-14T14:19:47.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.995+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4a640a12c0 0x7f4a640a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.995+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4a640a12c0 0x7f4a640a3770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009fd0 tx=0x7f4a68005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:47.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a8704eb80 1 Processor -- start 2023-12-14T14:19:47.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a8704eb80 1 -- start start 2023-12-14T14:19:47.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2380 0x5615fd5a2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5ad610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5aff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd48c5e0 con 0x5615fd5a2c90 2023-12-14T14:19:47.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd4fb870 con 0x5615fd5a2380 2023-12-14T14:19:47.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd4f4d00 con 0x5615fd5adb50 2023-12-14T14:19:47.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5ad610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41626/0 (socket says 172.21.15.69:41626) 2023-12-14T14:19:47.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a73fff700 1 -- 172.21.15.69:0/2668310370 learned_addr learned my addr 172.21.15.69:0/2668310370 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:47.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/2668310370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2380 0x5615fd5a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a7945d700 1 --2- 172.21.15.69:0/2668310370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a73fff700 1 -- 172.21.15.69:0/2668310370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 msgr2=0x5615fd5aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:47.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.996+0000 7f4a73fff700 1 --2- 172.21.15.69:0/2668310370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.997+0000 7f4a73fff700 1 -- 172.21.15.69:0/2668310370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2380 msgr2=0x5615fd5a2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:47.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.997+0000 7f4a73fff700 1 --2- 172.21.15.69:0/2668310370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2380 0x5615fd5a2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.997+0000 7f4a73fff700 1 -- 172.21.15.69:0/2668310370 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615fd3763b0 con 0x5615fd5a2c90 2023-12-14T14:19:47.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.997+0000 7f4a73fff700 1 --2- 172.21.15.69:0/2668310370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5ad610 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000bc20 tx=0x7f4a6000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bc658fb07070c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:47.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.997+0000 7f4a5effd700 1 -- 172.21.15.69:0/2668310370 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000ddb0 con 0x5615fd5a2c90 2023-12-14T14:19:47.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.997+0000 7f4a5effd700 1 -- 172.21.15.69:0/2668310370 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a600178e0 con 0x5615fd5a2c90 2023-12-14T14:19:47.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.997+0000 7f4a5effd700 1 -- 172.21.15.69:0/2668310370 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000f9d0 con 0x5615fd5a2c90 2023-12-14T14:19:47.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.997+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2668310370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 msgr2=0x5615fd5ad610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:47.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.997+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2668310370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5ad610 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000bc20 tx=0x7f4a6000bf30 comp rx=0 tx=0).stop 2023-12-14T14:19:47.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2668310370 shutdown_connections 2023-12-14T14:19:47.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2668310370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2668310370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2380 0x5615fd5a2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2668310370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5ad610 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2668310370 >> 172.21.15.69:0/2668310370 conn(0x5615fd598ca0 msgr2=0x5615fd59e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:47.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2668310370 shutdown_connections 2023-12-14T14:19:47.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2668310370 wait complete. 2023-12-14T14:19:47.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 -- start start 2023-12-14T14:19:47.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 Processor -- start 2023-12-14T14:19:47.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5a2380 0x5615fd5ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5adb50 0x5615fd5aad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd490f90 con 0x5615fd5a2c90 2023-12-14T14:19:47.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd490c30 con 0x5615fd5adb50 2023-12-14T14:19:47.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd3786a0 con 0x5615fd5a2380 2023-12-14T14:19:47.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a8704eb80 10 client.0 _ll_register_callbacks cb 0x5615fd4b4910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:47.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.998+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5aa7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41634/0 (socket says 172.21.15.69:41634) 2023-12-14T14:19:47.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a73fff700 1 -- 172.21.15.69:0/3903646466 learned_addr learned my addr 172.21.15.69:0/3903646466 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:47.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5a2380 0x5615fd5ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a7945d700 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5adb50 0x5615fd5aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a73fff700 1 -- 172.21.15.69:0/3903646466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5a2380 msgr2=0x5615fd5ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:47.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a73fff700 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5a2380 0x5615fd5ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a73fff700 1 -- 172.21.15.69:0/3903646466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5adb50 msgr2=0x5615fd5aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:47.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a73fff700 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5adb50 0x5615fd5aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a73fff700 1 -- 172.21.15.69:0/3903646466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6000b850 con 0x5615fd5a2c90 2023-12-14T14:19:47.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a73fff700 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5aa7b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000b390 tx=0x7f4a600176b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ded313366bff083 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:47.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a53fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:47.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a53fff700 1 -- 172.21.15.69:0/3903646466 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a60017c60 con 0x5615fd5a2c90 2023-12-14T14:19:47.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a53fff700 1 -- 172.21.15.69:0/3903646466 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f4a60013070 con 0x5615fd5a2c90 2023-12-14T14:19:47.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a8704eb80 1 -- 172.21.15.69:0/3903646466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615fd5962b0 con 0x5615fd5a2c90 2023-12-14T14:19:47.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a53fff700 1 -- 172.21.15.69:0/3903646466 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a60017dc0 con 0x5615fd5a2c90 2023-12-14T14:19:47.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a8704eb80 10 client.16797 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:47.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a8704eb80 1 -- 172.21.15.69:0/3903646466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5615fd4bb170 con 0x5615fd5a2c90 2023-12-14T14:19:47.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:46.999+0000 7f4a53fff700 1 -- 172.21.15.69:0/3903646466 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5615fd5962b0 con 0x5615fd5a2c90 2023-12-14T14:19:47.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a53fff700 1 -- 172.21.15.69:0/3903646466 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4a6001f070 con 0x5615fd5a2c90 2023-12-14T14:19:47.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a8704eb80 10 client.16797 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:47.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a8704eb80 10 client.16797 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:47.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a8704eb80 20 client.16797 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:47.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5615fd5bd580 0x5615fd5bf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a8704eb80 4 client.16797 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:47.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a8704eb80 1 -- 172.21.15.69:0/3903646466 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5615fd4edce0 con 0x5615fd5bd580 2023-12-14T14:19:47.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5615fd5bd580 0x5615fd5bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a53fff700 10 client.16797 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:47.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.000+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5615fd5bd580 0x5615fd5bf990 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e733175579b93e81 server_cookie=764a446b327c8b28 in_seq=0 out_seq=0 2023-12-14T14:19:47.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a53fff700 1 -- 172.21.15.69:0/3903646466 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5615fd4edce0 con 0x5615fd5bd580 2023-12-14T14:19:47.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a53fff700 10 client.16797 handle_command_reply: tid=0 2023-12-14T14:19:47.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 client.16797 shutdown 2023-12-14T14:19:47.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 -- 172.21.15.69:0/3903646466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 msgr2=0x5615fd5aa7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:47.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5aa7b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000b390 tx=0x7f4a600176b0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 -- 172.21.15.69:0/3903646466 shutdown_connections 2023-12-14T14:19:47.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5615fd5bd580 0x5615fd5bf990 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5adb50 0x5615fd5aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a53fff700 0 client.16797 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:47.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5a2380 0x5615fd5ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/3903646466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2c90 0x5615fd5aa7b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 -- 172.21.15.69:0/3903646466 >> 172.21.15.69:0/3903646466 conn(0x5615fd598ca0 msgr2=0x5615fd59e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:47.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 -- 172.21.15.69:0/3903646466 shutdown_connections 2023-12-14T14:19:47.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 1 -- 172.21.15.69:0/3903646466 wait complete. 2023-12-14T14:19:47.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.001+0000 7f4a8704eb80 20 client.16797 trim_cache size 0 max 16384 2023-12-14T14:19:47.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a8704eb80 1 Processor -- start 2023-12-14T14:19:47.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a8704eb80 1 -- start start 2023-12-14T14:19:47.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd59cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2c90 0x5615fd5b9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd5a6340 con 0x5615fd5a2380 2023-12-14T14:19:47.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd5bf960 con 0x5615fd5a2c90 2023-12-14T14:19:47.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd59d470 con 0x5615fd5adb50 2023-12-14T14:19:47.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a78c5c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd59cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a78c5c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd59cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41642/0 (socket says 172.21.15.69:41642) 2023-12-14T14:19:47.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.014+0000 7f4a78c5c700 1 -- 172.21.15.69:0/1310327852 learned_addr learned my addr 172.21.15.69:0/1310327852 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:47.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a7945d700 1 --2- 172.21.15.69:0/1310327852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a78c5c700 1 -- 172.21.15.69:0/1310327852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 msgr2=0x5615fd5acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:47.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/1310327852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a78c5c700 1 -- 172.21.15.69:0/1310327852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2c90 msgr2=0x5615fd5b9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:47.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/1310327852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2c90 0x5615fd5b9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a78c5c700 1 -- 172.21.15.69:0/1310327852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615fd4baec0 con 0x5615fd5a2380 2023-12-14T14:19:47.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/1310327852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd59cf30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4a68005930 tx=0x7f4a6801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548f4bc2c5320cb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:47.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a5f7fe700 1 -- 172.21.15.69:0/1310327852 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68033a60 con 0x5615fd5a2380 2023-12-14T14:19:47.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a5f7fe700 1 -- 172.21.15.69:0/1310327852 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a6801e040 con 0x5615fd5a2380 2023-12-14T14:19:47.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a5f7fe700 1 -- 172.21.15.69:0/1310327852 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6800bb00 con 0x5615fd5a2380 2023-12-14T14:19:47.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a8704eb80 1 -- 172.21.15.69:0/1310327852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 msgr2=0x5615fd59cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:47.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/1310327852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd59cf30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4a68005930 tx=0x7f4a6801f000 comp rx=0 tx=0).stop 2023-12-14T14:19:47.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a8704eb80 1 -- 172.21.15.69:0/1310327852 shutdown_connections 2023-12-14T14:19:47.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/1310327852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/1310327852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd59cf30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.015+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/1310327852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2c90 0x5615fd5b9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 -- 172.21.15.69:0/1310327852 >> 172.21.15.69:0/1310327852 conn(0x5615fd598ca0 msgr2=0x5615fd5c42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:47.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 -- 172.21.15.69:0/1310327852 shutdown_connections 2023-12-14T14:19:47.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 -- 172.21.15.69:0/1310327852 wait complete. 2023-12-14T14:19:47.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 -- start start 2023-12-14T14:19:47.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 Processor -- start 2023-12-14T14:19:47.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd5b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2c90 0x5615fd5b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd5b3590 con 0x5615fd5a2380 2023-12-14T14:19:47.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd5b3700 con 0x5615fd5a2c90 2023-12-14T14:19:47.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fd5b38c0 con 0x5615fd5adb50 2023-12-14T14:19:47.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a8704eb80 10 client.0 _ll_register_callbacks cb 0x7f4a6000ba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:47.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a78c5c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd5b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a78c5c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd5b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41654/0 (socket says 172.21.15.69:41654) 2023-12-14T14:19:47.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.016+0000 7f4a78c5c700 1 -- 172.21.15.69:0/2749584745 learned_addr learned my addr 172.21.15.69:0/2749584745 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:47.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a7945d700 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a73fff700 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2c90 0x5615fd5b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a78c5c700 1 -- 172.21.15.69:0/2749584745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 msgr2=0x5615fd5b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:47.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a78c5c700 1 -- 172.21.15.69:0/2749584745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2c90 msgr2=0x5615fd5b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:47.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2c90 0x5615fd5b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a78c5c700 1 -- 172.21.15.69:0/2749584745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7410d900 con 0x5615fd5a2380 2023-12-14T14:19:47.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a78c5c700 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd5b4600 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800b600 tx=0x7f4a6800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9ad3b57519e097 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:47.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a53fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:47.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a53fff700 1 -- 172.21.15.69:0/2749584745 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68033450 con 0x5615fd5a2380 2023-12-14T14:19:47.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a53fff700 1 -- 172.21.15.69:0/2749584745 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f4a680335b0 con 0x5615fd5a2380 2023-12-14T14:19:47.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2749584745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a600178e0 con 0x5615fd5a2380 2023-12-14T14:19:47.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a53fff700 1 -- 172.21.15.69:0/2749584745 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a68033c60 con 0x5615fd5a2380 2023-12-14T14:19:47.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a8704eb80 10 client.16803 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:47.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2749584745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5615fd4a19a0 con 0x5615fd5a2380 2023-12-14T14:19:47.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a53fff700 1 -- 172.21.15.69:0/2749584745 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a600178e0 con 0x5615fd5a2380 2023-12-14T14:19:47.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a53fff700 1 -- 172.21.15.69:0/2749584745 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4a68021070 con 0x5615fd5a2380 2023-12-14T14:19:47.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a8704eb80 10 client.16803 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:47.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a8704eb80 10 client.16803 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:47.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.017+0000 7f4a8704eb80 20 client.16803 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:47.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5615fd6124f0 0x5615fd614900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:47.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 4 client.16803 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:19:47.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2749584745 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5615fd4eda00 con 0x5615fd6124f0 2023-12-14T14:19:47.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a73fff700 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5615fd6124f0 0x5615fd614900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:47.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a53fff700 10 client.16803 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:47.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a73fff700 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5615fd6124f0 0x5615fd614900 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=489e160f62fda011 server_cookie=6ef15a78131148bb in_seq=0 out_seq=0 2023-12-14T14:19:47.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a53fff700 1 -- 172.21.15.69:0/2749584745 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5615fd4eda00 con 0x5615fd6124f0 2023-12-14T14:19:47.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a53fff700 10 client.16803 handle_command_reply: tid=0 2023-12-14T14:19:47.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 client.16803 shutdown 2023-12-14T14:19:47.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2749584745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 msgr2=0x5615fd5b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:47.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd5b4600 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800b600 tx=0x7f4a6800b630 comp rx=0 tx=0).stop 2023-12-14T14:19:47.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2749584745 shutdown_connections 2023-12-14T14:19:47.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5615fd6124f0 0x5615fd614900 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615fd5adb50 0x5615fd5b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5615fd5a2380 0x5615fd5b4600 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a53fff700 0 client.16803 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:47.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 --2- 172.21.15.69:0/2749584745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615fd5a2c90 0x5615fd5b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.018+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2749584745 >> 172.21.15.69:0/2749584745 conn(0x5615fd598ca0 msgr2=0x5615fd5a5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:47.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2749584745 shutdown_connections 2023-12-14T14:19:47.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a8704eb80 1 -- 172.21.15.69:0/2749584745 wait complete. 2023-12-14T14:19:47.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a8704eb80 20 client.16803 trim_cache size 0 max 16384 2023-12-14T14:19:47.033 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:19:47.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 -- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4a640a12c0 msgr2=0x7f4a640a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:47.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4a640a12c0 0x7f4a640a3770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009fd0 tx=0x7f4a68005fb0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 -- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a741054f0 msgr2=0x7f4a741a4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:47.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a741054f0 0x7f4a741a4520 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c007f10 tx=0x7f4a6c00d3b0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 -- 172.21.15.69:0/1092299372 shutdown_connections 2023-12-14T14:19:47.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f4a640a12c0 0x7f4a640a3770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a741054f0 0x7f4a741a4520 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a740690f0 0x7f4a740ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 --2- 172.21.15.69:0/1092299372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a74069a90 0x7f4a740ff6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:47.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 -- 172.21.15.69:0/1092299372 >> 172.21.15.69:0/1092299372 conn(0x7f4a74075fa0 msgr2=0x7f4a740fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:47.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 -- 172.21.15.69:0/1092299372 shutdown_connections 2023-12-14T14:19:47.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:47.019+0000 7f4a7aec0700 1 -- 172.21.15.69:0/1092299372 wait complete. 2023-12-14T14:19:47.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:47 smithi119 ceph-mon[43834]: pgmap v283: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:47.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:47 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/13863571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:19:47.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:47 smithi069 ceph-mon[42034]: pgmap v283: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:47.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:47 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/13863571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:19:47.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:47 smithi081 ceph-mon[43371]: pgmap v283: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:47.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:47 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/13863571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:19:48.037 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:19:48.037 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:19:48.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.176+0000 7fdf78e6a700 1 -- 172.21.15.69:0/1719947755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 msgr2=0x7fdf74104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.176+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/1719947755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 0x7fdf74104ea0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fdf640099c0 tx=0x7fdf64009cd0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.176+0000 7fdf78e6a700 1 -- 172.21.15.69:0/1719947755 shutdown_connections 2023-12-14T14:19:48.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.176+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/1719947755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf74105580 0x7fdf7410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.176+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/1719947755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf740692d0 0x7fdf740696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.176+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/1719947755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 0x7fdf74104ea0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.176+0000 7fdf78e6a700 1 -- 172.21.15.69:0/1719947755 >> 172.21.15.69:0/1719947755 conn(0x7fdf74075ff0 msgr2=0x7fdf740763f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.176+0000 7fdf78e6a700 1 -- 172.21.15.69:0/1719947755 shutdown_connections 2023-12-14T14:19:48.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.176+0000 7fdf78e6a700 1 -- 172.21.15.69:0/1719947755 wait complete. 2023-12-14T14:19:48.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf78e6a700 1 Processor -- start 2023-12-14T14:19:48.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf78e6a700 1 -- start start 2023-12-14T14:19:48.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf78e6a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf740692d0 0x7fdf74196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf78e6a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 0x7fdf74196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf78e6a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf74105580 0x7fdf7419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf78e6a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7419b400 con 0x7fdf74069c70 2023-12-14T14:19:48.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf78e6a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7419b570 con 0x7fdf740692d0 2023-12-14T14:19:48.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf78e6a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7419b730 con 0x7fdf74105580 2023-12-14T14:19:48.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf71d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 0x7fdf74196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf71d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 0x7fdf74196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41672/0 (socket says 172.21.15.69:41672) 2023-12-14T14:19:48.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf71d9b700 1 -- 172.21.15.69:0/2665712775 learned_addr learned my addr 172.21.15.69:0/2665712775 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.177+0000 7fdf72d9d700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf74105580 0x7fdf7419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf740692d0 0x7fdf74196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf71d9b700 1 -- 172.21.15.69:0/2665712775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf74105580 msgr2=0x7fdf7419adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf74105580 0x7fdf7419adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf71d9b700 1 -- 172.21.15.69:0/2665712775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf740692d0 msgr2=0x7fdf74196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf740692d0 0x7fdf74196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf71d9b700 1 -- 172.21.15.69:0/2665712775 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf640095f0 con 0x7fdf74069c70 2023-12-14T14:19:48.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf740692d0 0x7fdf74196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:48.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 0x7fdf74196960 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009990 tx=0x7fdf6400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf6b7fe700 1 -- 172.21.15.69:0/2665712775 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6401d070 con 0x7fdf74069c70 2023-12-14T14:19:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf78e6a700 1 -- 172.21.15.69:0/2665712775 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf741102c0 con 0x7fdf74069c70 2023-12-14T14:19:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf6b7fe700 1 -- 172.21.15.69:0/2665712775 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf640054e0 con 0x7fdf74069c70 2023-12-14T14:19:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf6b7fe700 1 -- 172.21.15.69:0/2665712775 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64004a70 con 0x7fdf74069c70 2023-12-14T14:19:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.178+0000 7fdf78e6a700 1 -- 172.21.15.69:0/2665712775 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf74110130 con 0x7fdf74069c70 2023-12-14T14:19:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.180+0000 7fdf6b7fe700 1 -- 172.21.15.69:0/2665712775 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fdf6400fb80 con 0x7fdf74069c70 2023-12-14T14:19:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.180+0000 7fdf6b7fe700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdf600a12c0 0x7fdf600a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.181+0000 7fdf6b7fe700 1 -- 172.21.15.69:0/2665712775 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fdf640cd810 con 0x7fdf74069c70 2023-12-14T14:19:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.181+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdf600a12c0 0x7fdf600a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.181+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdf600a12c0 0x7fdf600a3770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009be0 tx=0x7fdf5c009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.181+0000 7fdf84ff8b80 1 Processor -- start 2023-12-14T14:19:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf84ff8b80 1 -- start start 2023-12-14T14:19:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 0x5640887c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1d10 0x5640887cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x5640887cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640886ab660 con 0x5640887c1d10 2023-12-14T14:19:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56408871a8f0 con 0x5640887c1400 2023-12-14T14:19:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564088713d80 con 0x5640887ccbd0 2023-12-14T14:19:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf71d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1d10 0x5640887cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf71d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1d10 0x5640887cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41684/0 (socket says 172.21.15.69:41684) 2023-12-14T14:19:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf71d9b700 1 -- 172.21.15.69:0/1737014547 learned_addr learned my addr 172.21.15.69:0/1737014547 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf7259c700 1 --2- 172.21.15.69:0/1737014547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 0x5640887c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf72d9d700 1 --2- 172.21.15.69:0/1737014547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x5640887cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf71d9b700 1 -- 172.21.15.69:0/1737014547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 msgr2=0x5640887cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/1737014547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x5640887cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf71d9b700 1 -- 172.21.15.69:0/1737014547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 msgr2=0x5640887c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/1737014547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 0x5640887c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf71d9b700 1 -- 172.21.15.69:0/1737014547 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564088595430 con 0x5640887c1d10 2023-12-14T14:19:48.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.182+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/1737014547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1d10 0x5640887cc690 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fdf64096e80 tx=0x7fdf64005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6558f385505523a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf68ff9700 1 -- 172.21.15.69:0/1737014547 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6409e9b0 con 0x5640887c1d10 2023-12-14T14:19:48.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf68ff9700 1 -- 172.21.15.69:0/1737014547 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf640a2d40 con 0x5640887c1d10 2023-12-14T14:19:48.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf68ff9700 1 -- 172.21.15.69:0/1737014547 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6409a0d0 con 0x5640887c1d10 2023-12-14T14:19:48.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/1737014547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1d10 msgr2=0x5640887cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/1737014547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1d10 0x5640887cc690 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fdf64096e80 tx=0x7fdf64005e80 comp rx=0 tx=0).stop 2023-12-14T14:19:48.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/1737014547 shutdown_connections 2023-12-14T14:19:48.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/1737014547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x5640887cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/1737014547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 0x5640887c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/1737014547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1d10 0x5640887cc690 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/1737014547 >> 172.21.15.69:0/1737014547 conn(0x5640887b7d20 msgr2=0x5640887bd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/1737014547 shutdown_connections 2023-12-14T14:19:48.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.183+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/1737014547 wait complete. 2023-12-14T14:19:48.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf84ff8b80 1 -- start start 2023-12-14T14:19:48.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf84ff8b80 1 Processor -- start 2023-12-14T14:19:48.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 0x5640887ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887c1d10 0x5640887cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887ccbd0 0x5640887cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640886b0010 con 0x5640887ccbd0 2023-12-14T14:19:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640886afcb0 con 0x5640887c1400 2023-12-14T14:19:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564088597720 con 0x5640887c1d10 2023-12-14T14:19:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf84ff8b80 10 client.0 _ll_register_callbacks cb 0x5640886d3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf72d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887ccbd0 0x5640887cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf72d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887ccbd0 0x5640887cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41686/0 (socket says 172.21.15.69:41686) 2023-12-14T14:19:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf72d9d700 1 -- 172.21.15.69:0/2343332550 learned_addr learned my addr 172.21.15.69:0/2343332550 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887c1d10 0x5640887cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 0x5640887ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.184+0000 7fdf72d9d700 1 -- 172.21.15.69:0/2343332550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887c1d10 msgr2=0x5640887cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf72d9d700 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887c1d10 0x5640887cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf72d9d700 1 -- 172.21.15.69:0/2343332550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 msgr2=0x5640887ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf72d9d700 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 0x5640887ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf72d9d700 1 -- 172.21.15.69:0/2343332550 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf74110130 con 0x5640887ccbd0 2023-12-14T14:19:48.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 0x5640887ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:48.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf72d9d700 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887ccbd0 0x5640887cda20 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009790 tx=0x7fdf6c004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb657a53b91830b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:48.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2343332550 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c004900 con 0x5640887ccbd0 2023-12-14T14:19:48.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2343332550 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fdf6c007710 con 0x5640887ccbd0 2023-12-14T14:19:48.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2343332550 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640887b5330 con 0x5640887ccbd0 2023-12-14T14:19:48.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2343332550 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf6c0078f0 con 0x5640887ccbd0 2023-12-14T14:19:48.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf84ff8b80 10 client.16815 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:48.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2343332550 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5640886da1f0 con 0x5640887ccbd0 2023-12-14T14:19:48.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2343332550 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5640887b5330 con 0x5640887ccbd0 2023-12-14T14:19:48.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2343332550 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdf6c014070 con 0x5640887ccbd0 2023-12-14T14:19:48.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf84ff8b80 10 client.16815 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:48.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf84ff8b80 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:48.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf84ff8b80 20 client.16815 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:48.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5640887dc330 0x5640887de740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf84ff8b80 4 client.16815 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.185+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2343332550 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56408870cd60 con 0x5640887dc330 2023-12-14T14:19:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.186+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5640887dc330 0x5640887de740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.186+0000 7fdf59ffb700 10 client.16815 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.186+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5640887dc330 0x5640887de740 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89519d6b7527dbf9 server_cookie=f4cb53314e5c2e0b in_seq=0 out_seq=0 2023-12-14T14:19:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2343332550 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56408870cd60 con 0x5640887dc330 2023-12-14T14:19:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf59ffb700 10 client.16815 handle_command_reply: tid=0 2023-12-14T14:19:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 client.16815 shutdown 2023-12-14T14:19:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2343332550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887ccbd0 msgr2=0x5640887cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887ccbd0 0x5640887cda20 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009790 tx=0x7fdf6c004320 comp rx=0 tx=0).stop 2023-12-14T14:19:48.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2343332550 shutdown_connections 2023-12-14T14:19:48.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5640887dc330 0x5640887de740 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887ccbd0 0x5640887cda20 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1400 0x5640887ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf59ffb700 0 client.16815 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:48.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2343332550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887c1d10 0x5640887cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2343332550 >> 172.21.15.69:0/2343332550 conn(0x5640887b7d20 msgr2=0x5640887bd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2343332550 shutdown_connections 2023-12-14T14:19:48.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2343332550 wait complete. 2023-12-14T14:19:48.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.187+0000 7fdf84ff8b80 20 client.16815 trim_cache size 0 max 16384 2023-12-14T14:19:48.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf84ff8b80 1 Processor -- start 2023-12-14T14:19:48.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf84ff8b80 1 -- start start 2023-12-14T14:19:48.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 0x5640887cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x5640887c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640887be5d0 con 0x5640887c1400 2023-12-14T14:19:48.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640887deda0 con 0x5640887c1d10 2023-12-14T14:19:48.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640887be350 con 0x5640887ccbd0 2023-12-14T14:19:48.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf7259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf7259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41694/0 (socket says 172.21.15.69:41694) 2023-12-14T14:19:48.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf7259c700 1 -- 172.21.15.69:0/2450708920 learned_addr learned my addr 172.21.15.69:0/2450708920 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/2450708920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 0x5640887cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf7259c700 1 -- 172.21.15.69:0/2450708920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 msgr2=0x5640887c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2450708920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x5640887c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf7259c700 1 -- 172.21.15.69:0/2450708920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 msgr2=0x5640887cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2450708920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 0x5640887cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf7259c700 1 -- 172.21.15.69:0/2450708920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640886d9f40 con 0x5640887c1400 2023-12-14T14:19:48.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.204+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2450708920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887d0fd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c011010 tx=0x7fdf5c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5906a7a223b5fe64 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf697fa700 1 -- 172.21.15.69:0/2450708920 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c026040 con 0x5640887c1400 2023-12-14T14:19:48.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf697fa700 1 -- 172.21.15.69:0/2450708920 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf5c012d40 con 0x5640887c1400 2023-12-14T14:19:48.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf697fa700 1 -- 172.21.15.69:0/2450708920 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c028aa0 con 0x5640887c1400 2023-12-14T14:19:48.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2450708920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 msgr2=0x5640887d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2450708920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887d0fd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c011010 tx=0x7fdf5c016000 comp rx=0 tx=0).stop 2023-12-14T14:19:48.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2450708920 shutdown_connections 2023-12-14T14:19:48.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2450708920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x5640887c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2450708920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887d0fd0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2450708920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 0x5640887cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2450708920 >> 172.21.15.69:0/2450708920 conn(0x5640887b7d20 msgr2=0x5640887ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2450708920 shutdown_connections 2023-12-14T14:19:48.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.205+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2450708920 wait complete. 2023-12-14T14:19:48.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf84ff8b80 1 -- start start 2023-12-14T14:19:48.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf84ff8b80 1 Processor -- start 2023-12-14T14:19:48.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 0x5640887d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf84ff8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x56408882a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56408882a740 con 0x5640887c1400 2023-12-14T14:19:48.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56408882a8b0 con 0x5640887c1d10 2023-12-14T14:19:48.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf84ff8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56408882aa70 con 0x5640887ccbd0 2023-12-14T14:19:48.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf84ff8b80 10 client.0 _ll_register_callbacks cb 0x7fdf6c003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:48.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf7259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf7259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41698/0 (socket says 172.21.15.69:41698) 2023-12-14T14:19:48.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf7259c700 1 -- 172.21.15.69:0/2223886920 learned_addr learned my addr 172.21.15.69:0/2223886920 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 0x5640887d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf7259c700 1 -- 172.21.15.69:0/2223886920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 msgr2=0x56408882a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf72d9d700 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x56408882a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x56408882a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf7259c700 1 -- 172.21.15.69:0/2223886920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 msgr2=0x5640887d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 0x5640887d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf7259c700 1 -- 172.21.15.69:0/2223886920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c010ab0 con 0x5640887c1400 2023-12-14T14:19:48.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 0x5640887d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:48.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.206+0000 7fdf72d9d700 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x56408882a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:48.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf7259c700 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887cff80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c004510 tx=0x7fdf5c020570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74e46a30ac9a3ed server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:48.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2223886920 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c020a20 con 0x5640887c1400 2023-12-14T14:19:48.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2223886920 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fdf5c020b80 con 0x5640887c1400 2023-12-14T14:19:48.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2223886920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf640a2d40 con 0x5640887c1400 2023-12-14T14:19:48.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2223886920 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf5c020d40 con 0x5640887c1400 2023-12-14T14:19:48.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf84ff8b80 10 client.16821 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:48.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2223886920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5640886c0a20 con 0x5640887c1400 2023-12-14T14:19:48.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2223886920 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf640a2d40 con 0x5640887c1400 2023-12-14T14:19:48.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2223886920 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdf5c041070 con 0x5640887c1400 2023-12-14T14:19:48.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf84ff8b80 10 client.16821 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:48.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf84ff8b80 10 client.16821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:48.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf84ff8b80 20 client.16821 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:48.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5640888322b0 0x5640888346c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf84ff8b80 4 client.16821 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:19:48.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.207+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2223886920 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56408870ca80 con 0x5640888322b0 2023-12-14T14:19:48.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.208+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5640888322b0 0x5640888346c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.208+0000 7fdf59ffb700 10 client.16821 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:48.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.208+0000 7fdf71d9b700 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5640888322b0 0x5640888346c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a3d878272234c91 server_cookie=b18b414594aa31e5 in_seq=0 out_seq=0 2023-12-14T14:19:48.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.209+0000 7fdf59ffb700 1 -- 172.21.15.69:0/2223886920 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56408870ca80 con 0x5640888322b0 2023-12-14T14:19:48.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.209+0000 7fdf59ffb700 10 client.16821 handle_command_reply: tid=0 2023-12-14T14:19:48.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.209+0000 7fdf84ff8b80 1 client.16821 shutdown 2023-12-14T14:19:48.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2223886920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 msgr2=0x5640887cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887cff80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c004510 tx=0x7fdf5c020570 comp rx=0 tx=0).stop 2023-12-14T14:19:48.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2223886920 shutdown_connections 2023-12-14T14:19:48.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5640888322b0 0x5640888346c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640887ccbd0 0x56408882a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640887c1400 0x5640887cff80 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf59ffb700 0 client.16821 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:48.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 --2- 172.21.15.69:0/2223886920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640887c1d10 0x5640887d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2223886920 >> 172.21.15.69:0/2223886920 conn(0x5640887b7d20 msgr2=0x5640887cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2223886920 shutdown_connections 2023-12-14T14:19:48.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 1 -- 172.21.15.69:0/2223886920 wait complete. 2023-12-14T14:19:48.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf84ff8b80 20 client.16821 trim_cache size 0 max 16384 2023-12-14T14:19:48.223 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:19:48.224 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:19:48.224 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "c176bbf3-ad75-4c89-8612-1ba1cb03884a", 2023-12-14T14:19:48.224 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:19:48.224 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:19:48.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 -- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdf600a12c0 msgr2=0x7fdf600a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdf600a12c0 0x7fdf600a3770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009be0 tx=0x7fdf5c009260 comp rx=0 tx=0).stop 2023-12-14T14:19:48.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 -- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 msgr2=0x7fdf74196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 0x7fdf74196960 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009990 tx=0x7fdf6400f690 comp rx=0 tx=0).stop 2023-12-14T14:19:48.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 -- 172.21.15.69:0/2665712775 shutdown_connections 2023-12-14T14:19:48.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fdf600a12c0 0x7fdf600a3770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf74105580 0x7fdf7419adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf740692d0 0x7fdf74196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 --2- 172.21.15.69:0/2665712775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf74069c70 0x7fdf74196960 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 -- 172.21.15.69:0/2665712775 >> 172.21.15.69:0/2665712775 conn(0x7fdf74075ff0 msgr2=0x7fdf74103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 -- 172.21.15.69:0/2665712775 shutdown_connections 2023-12-14T14:19:48.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.210+0000 7fdf78e6a700 1 -- 172.21.15.69:0/2665712775 wait complete. 2023-12-14T14:19:48.227 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:19:48.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.351+0000 7ff91721e700 1 -- 172.21.15.69:0/2689096057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 msgr2=0x7ff910103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.351+0000 7ff91721e700 1 --2- 172.21.15.69:0/2689096057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 0x7ff910103cf0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0099c0 tx=0x7ff8fc009cd0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 -- 172.21.15.69:0/2689096057 shutdown_connections 2023-12-14T14:19:48.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 --2- 172.21.15.69:0/2689096057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9101043d0 0x7ff91010bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 --2- 172.21.15.69:0/2689096057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9100ff390 0x7ff9100ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 --2- 172.21.15.69:0/2689096057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 0x7ff910103cf0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 -- 172.21.15.69:0/2689096057 >> 172.21.15.69:0/2689096057 conn(0x7ff910075fd0 msgr2=0x7ff9100763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 -- 172.21.15.69:0/2689096057 shutdown_connections 2023-12-14T14:19:48.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 -- 172.21.15.69:0/2689096057 wait complete. 2023-12-14T14:19:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 Processor -- start 2023-12-14T14:19:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 -- start start 2023-12-14T14:19:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9100ff390 0x7ff910197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 0x7ff910197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9101043d0 0x7ff9101a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9101980a0 con 0x7ff9100ffd30 2023-12-14T14:19:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9101a27e0 con 0x7ff9100ff390 2023-12-14T14:19:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff91721e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9101a29a0 con 0x7ff9101043d0 2023-12-14T14:19:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.352+0000 7ff90ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 0x7ff910197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 0x7ff910197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41718/0 (socket says 172.21.15.69:41718) 2023-12-14T14:19:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90ffff700 1 -- 172.21.15.69:0/1491376871 learned_addr learned my addr 172.21.15.69:0/1491376871 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff9157bb700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9101043d0 0x7ff9101a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff914fba700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9100ff390 0x7ff910197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90ffff700 1 -- 172.21.15.69:0/1491376871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9101043d0 msgr2=0x7ff9101a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90ffff700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9101043d0 0x7ff9101a22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90ffff700 1 -- 172.21.15.69:0/1491376871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9100ff390 msgr2=0x7ff910197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90ffff700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9100ff390 0x7ff910197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90ffff700 1 -- 172.21.15.69:0/1491376871 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc0095f0 con 0x7ff9100ffd30 2023-12-14T14:19:48.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90ffff700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 0x7ff910197760 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009f50 tx=0x7ff8fc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90dffb700 1 -- 172.21.15.69:0/1491376871 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc01d070 con 0x7ff9100ffd30 2023-12-14T14:19:48.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90dffb700 1 -- 172.21.15.69:0/1491376871 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8fc003f90 con 0x7ff9100ffd30 2023-12-14T14:19:48.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff91721e700 1 -- 172.21.15.69:0/1491376871 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91010f1a0 con 0x7ff9100ffd30 2023-12-14T14:19:48.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff90dffb700 1 -- 172.21.15.69:0/1491376871 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00fcf0 con 0x7ff9100ffd30 2023-12-14T14:19:48.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.353+0000 7ff91721e700 1 -- 172.21.15.69:0/1491376871 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91010f010 con 0x7ff9100ffd30 2023-12-14T14:19:48.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.356+0000 7ff90dffb700 1 -- 172.21.15.69:0/1491376871 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff8fc00f460 con 0x7ff9100ffd30 2023-12-14T14:19:48.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff90dffb700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff9000a1340 0x7ff9000a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff914fba700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff9000a1340 0x7ff9000a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff9233acb80 1 Processor -- start 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff90dffb700 1 -- 172.21.15.69:0/1491376871 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7ff8fc0cdaf0 con 0x7ff9100ffd30 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff9233acb80 1 -- start start 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97f380 0x55869f97f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97fc90 0x55869f98a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 0x55869f98cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff9233acb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f8695e0 con 0x55869f97fc90 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff9233acb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f8d8870 con 0x55869f98ab50 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff9233acb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f8d1d00 con 0x55869f97f380 2023-12-14T14:19:48.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff914fba700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff9000a1340 0x7ff9000a37f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff904005950 tx=0x7ff9040058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff90ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97fc90 0x55869f98a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff90ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97fc90 0x55869f98a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41734/0 (socket says 172.21.15.69:41734) 2023-12-14T14:19:48.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff90ffff700 1 -- 172.21.15.69:0/3305263820 learned_addr learned my addr 172.21.15.69:0/3305263820 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff914fba700 1 --2- 172.21.15.69:0/3305263820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97f380 0x55869f97f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff9157bb700 1 --2- 172.21.15.69:0/3305263820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 0x55869f98cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff90ffff700 1 -- 172.21.15.69:0/3305263820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97f380 msgr2=0x55869f97f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff90ffff700 1 --2- 172.21.15.69:0/3305263820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97f380 0x55869f97f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff90ffff700 1 -- 172.21.15.69:0/3305263820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 msgr2=0x55869f98cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.357+0000 7ff90ffff700 1 --2- 172.21.15.69:0/3305263820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 0x55869f98cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.358+0000 7ff90ffff700 1 -- 172.21.15.69:0/3305263820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55869f7533b0 con 0x55869f97fc90 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.358+0000 7ff90ffff700 1 --2- 172.21.15.69:0/3305263820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97fc90 0x55869f98a610 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a2a90 tx=0x7ff8fc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71f2d910357bba7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.358+0000 7ff8faffd700 1 -- 172.21.15.69:0/3305263820 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0a2fc0 con 0x55869f97fc90 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.358+0000 7ff8faffd700 1 -- 172.21.15.69:0/3305263820 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8fc09ee90 con 0x55869f97fc90 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.358+0000 7ff8faffd700 1 -- 172.21.15.69:0/3305263820 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc09a350 con 0x55869f97fc90 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.358+0000 7ff9233acb80 1 -- 172.21.15.69:0/3305263820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97fc90 msgr2=0x55869f98a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.358+0000 7ff9233acb80 1 --2- 172.21.15.69:0/3305263820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97fc90 0x55869f98a610 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a2a90 tx=0x7ff8fc00f790 comp rx=0 tx=0).stop 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.358+0000 7ff9233acb80 1 -- 172.21.15.69:0/3305263820 shutdown_connections 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.359+0000 7ff9233acb80 1 --2- 172.21.15.69:0/3305263820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 0x55869f98cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.359+0000 7ff9233acb80 1 --2- 172.21.15.69:0/3305263820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97f380 0x55869f97f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.359+0000 7ff9233acb80 1 --2- 172.21.15.69:0/3305263820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97fc90 0x55869f98a610 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.359+0000 7ff9233acb80 1 -- 172.21.15.69:0/3305263820 >> 172.21.15.69:0/3305263820 conn(0x55869f975ca0 msgr2=0x55869f97b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.359+0000 7ff9233acb80 1 -- 172.21.15.69:0/3305263820 shutdown_connections 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.359+0000 7ff9233acb80 1 -- 172.21.15.69:0/3305263820 wait complete. 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.359+0000 7ff9233acb80 1 -- start start 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.359+0000 7ff9233acb80 1 Processor -- start 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f98af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97fc90 0x55869f98b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f98ab50 0x55869f98b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9233acb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f86df90 con 0x55869f97f380 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9233acb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f86dc30 con 0x55869f97fc90 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9233acb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f7556a0 con 0x55869f98ab50 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9233acb80 10 client.0 _ll_register_callbacks cb 0x55869f891910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff914fba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f98af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff914fba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f98af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41740/0 (socket says 172.21.15.69:41740) 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff914fba700 1 -- 172.21.15.69:0/2398856009 learned_addr learned my addr 172.21.15.69:0/2398856009 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff90ffff700 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97fc90 0x55869f98b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9157bb700 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f98ab50 0x55869f98b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff914fba700 1 -- 172.21.15.69:0/2398856009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f98ab50 msgr2=0x55869f98b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff914fba700 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f98ab50 0x55869f98b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff914fba700 1 -- 172.21.15.69:0/2398856009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97fc90 msgr2=0x55869f98b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff914fba700 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97fc90 0x55869f98b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff914fba700 1 -- 172.21.15.69:0/2398856009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91010f010 con 0x55869f97f380 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9157bb700 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f98ab50 0x55869f98b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff914fba700 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f98af20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff90400feb0 tx=0x7ff904004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0715faf84bf3968 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff8effff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff8effff700 1 -- 172.21.15.69:0/2398856009 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90401f630 con 0x55869f97f380 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff8effff700 1 -- 172.21.15.69:0/2398856009 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7ff90401f790 con 0x55869f97f380 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9233acb80 1 -- 172.21.15.69:0/2398856009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55869f9732b0 con 0x55869f97f380 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff8effff700 1 -- 172.21.15.69:0/2398856009 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff904011e70 con 0x55869f97f380 2023-12-14T14:19:48.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.360+0000 7ff9233acb80 10 client.16833 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff9233acb80 1 -- 172.21.15.69:0/2398856009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55869f898170 con 0x55869f97f380 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff8effff700 1 -- 172.21.15.69:0/2398856009 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55869f9732b0 con 0x55869f97f380 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff8effff700 1 -- 172.21.15.69:0/2398856009 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff904025020 con 0x55869f97f380 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff9233acb80 10 client.16833 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff9233acb80 10 client.16833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff9233acb80 20 client.16833 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55869f99e510 0x55869f9a0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff9233acb80 4 client.16833 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff9233acb80 1 -- 172.21.15.69:0/2398856009 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55869f8cace0 con 0x55869f99e510 2023-12-14T14:19:48.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.361+0000 7ff90ffff700 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55869f99e510 0x55869f9a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff8effff700 10 client.16833 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff90ffff700 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55869f99e510 0x55869f9a0920 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=824ad4f3749c386e server_cookie=180b225a25cc97fa in_seq=0 out_seq=0 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff8effff700 1 -- 172.21.15.69:0/2398856009 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55869f8cace0 con 0x55869f99e510 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff8effff700 10 client.16833 handle_command_reply: tid=0 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 client.16833 shutdown 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 -- 172.21.15.69:0/2398856009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 msgr2=0x55869f98af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f98af20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff90400feb0 tx=0x7ff904004750 comp rx=0 tx=0).stop 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 -- 172.21.15.69:0/2398856009 shutdown_connections 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55869f99e510 0x55869f9a0920 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f98ab50 0x55869f98b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f98af20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff8effff700 0 client.16833 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:48.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2398856009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97fc90 0x55869f98b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 -- 172.21.15.69:0/2398856009 >> 172.21.15.69:0/2398856009 conn(0x55869f975ca0 msgr2=0x55869f97b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 -- 172.21.15.69:0/2398856009 shutdown_connections 2023-12-14T14:19:48.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.362+0000 7ff9233acb80 1 -- 172.21.15.69:0/2398856009 wait complete. 2023-12-14T14:19:48.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.363+0000 7ff9233acb80 20 client.16833 trim_cache size 0 max 16384 2023-12-14T14:19:48.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9233acb80 1 Processor -- start 2023-12-14T14:19:48.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9233acb80 1 -- start start 2023-12-14T14:19:48.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97f380 0x55869f98ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 0x55869f995700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f98ab50 0x55869f986e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9233acb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f980600 con 0x55869f98ab50 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9233acb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f99bcc0 con 0x55869f97f380 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9233acb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f985850 con 0x55869f97fc90 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9157bb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f98ab50 0x55869f986e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9157bb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f98ab50 0x55869f986e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41752/0 (socket says 172.21.15.69:41752) 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff9157bb700 1 -- 172.21.15.69:0/2819904937 learned_addr learned my addr 172.21.15.69:0/2819904937 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff90ffff700 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 0x55869f995700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.379+0000 7ff914fba700 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97f380 0x55869f98ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9157bb700 1 -- 172.21.15.69:0/2819904937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 msgr2=0x55869f995700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9157bb700 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 0x55869f995700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9157bb700 1 -- 172.21.15.69:0/2819904937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97f380 msgr2=0x55869f98ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9157bb700 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97f380 0x55869f98ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9157bb700 1 -- 172.21.15.69:0/2819904937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55869f9774e0 con 0x55869f98ab50 2023-12-14T14:19:48.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff914fba700 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97f380 0x55869f98ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:19:48.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9157bb700 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f98ab50 0x55869f986e10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff908009910 tx=0x7ff908009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4661bea45d08c0e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff8fb7fe700 1 -- 172.21.15.69:0/2819904937 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080046b0 con 0x55869f98ab50 2023-12-14T14:19:48.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff8fb7fe700 1 -- 172.21.15.69:0/2819904937 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff90800f040 con 0x55869f98ab50 2023-12-14T14:19:48.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff8fb7fe700 1 -- 172.21.15.69:0/2819904937 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080167c0 con 0x55869f98ab50 2023-12-14T14:19:48.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9233acb80 1 -- 172.21.15.69:0/2819904937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f98ab50 msgr2=0x55869f986e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f98ab50 0x55869f986e10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff908009910 tx=0x7ff908009c20 comp rx=0 tx=0).stop 2023-12-14T14:19:48.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9233acb80 1 -- 172.21.15.69:0/2819904937 shutdown_connections 2023-12-14T14:19:48.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f98ab50 0x55869f986e10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f97f380 0x55869f98ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2819904937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 0x55869f995700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.380+0000 7ff9233acb80 1 -- 172.21.15.69:0/2819904937 >> 172.21.15.69:0/2819904937 conn(0x55869f975ca0 msgr2=0x55869f989440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 -- 172.21.15.69:0/2819904937 shutdown_connections 2023-12-14T14:19:48.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 -- 172.21.15.69:0/2819904937 wait complete. 2023-12-14T14:19:48.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 -- start start 2023-12-14T14:19:48.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 Processor -- start 2023-12-14T14:19:48.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f9ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 0x55869f9ec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 0x55869f9e6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f9e6900 con 0x55869f97f380 2023-12-14T14:19:48.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f9e6a70 con 0x55869f98ab50 2023-12-14T14:19:48.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869f9e6c30 con 0x55869f97fc90 2023-12-14T14:19:48.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff9233acb80 10 client.0 _ll_register_callbacks cb 0x7ff90400fa90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:19:48.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff914fba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f9ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff914fba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f9ebbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41756/0 (socket says 172.21.15.69:41756) 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff914fba700 1 -- 172.21.15.69:0/2559827616 learned_addr learned my addr 172.21.15.69:0/2559827616 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.381+0000 7ff90ffff700 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 0x55869f9ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff9157bb700 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 0x55869f9e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff914fba700 1 -- 172.21.15.69:0/2559827616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 msgr2=0x55869f9ec120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff914fba700 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 0x55869f9ec120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff914fba700 1 -- 172.21.15.69:0/2559827616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 msgr2=0x55869f9e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff914fba700 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 0x55869f9e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff914fba700 1 -- 172.21.15.69:0/2559827616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff908003d20 con 0x55869f97f380 2023-12-14T14:19:48.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff9157bb700 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 0x55869f9e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff914fba700 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f9ebbe0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff90400feb0 tx=0x7ff9040306a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae8df0f9176184b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff8effff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff8effff700 1 -- 172.21.15.69:0/2559827616 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904036070 con 0x55869f97f380 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff8effff700 1 -- 172.21.15.69:0/2559827616 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8498+0+0 (secure 0 0 0) 0x7ff904005250 con 0x55869f97f380 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff9233acb80 1 -- 172.21.15.69:0/2559827616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8fc09ee90 con 0x55869f97f380 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff8effff700 1 -- 172.21.15.69:0/2559827616 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff904011e70 con 0x55869f97f380 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff9233acb80 10 client.16839 fetch_fsmap learned FSMap version 30 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff9233acb80 1 -- 172.21.15.69:0/2559827616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55869f6ffb60 con 0x55869f97f380 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff8effff700 1 -- 172.21.15.69:0/2559827616 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8fc09ee90 con 0x55869f97f380 2023-12-14T14:19:48.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff8effff700 1 -- 172.21.15.69:0/2559827616 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff904011440 con 0x55869f97f380 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff9233acb80 10 client.16839 fetch_fsmap finished waiting for FSMap version 30 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff9233acb80 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff9233acb80 20 client.16839 populate_metadata read hostname 'smithi069' 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.382+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55869f9f3a40 0x55869f9f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 4 client.16839 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 1 -- 172.21.15.69:0/2559827616 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55869f8caa00 con 0x55869f9f3a40 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff90ffff700 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55869f9f3a40 0x55869f9f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff8effff700 10 client.16839 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff90ffff700 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55869f9f3a40 0x55869f9f5e50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=642c4f42a15f9fb8 server_cookie=5dbd1d475ea773eb in_seq=0 out_seq=0 2023-12-14T14:19:48.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff8effff700 1 -- 172.21.15.69:0/2559827616 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55869f8caa00 con 0x55869f9f3a40 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff8effff700 10 client.16839 handle_command_reply: tid=0 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 1 client.16839 shutdown 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 1 -- 172.21.15.69:0/2559827616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 msgr2=0x55869f9ebbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f9ebbe0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff90400feb0 tx=0x7ff9040306a0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 1 -- 172.21.15.69:0/2559827616 shutdown_connections 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55869f9f3a40 0x55869f9f5e50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55869f98ab50 0x55869f9e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55869f97f380 0x55869f9ebbe0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff8effff700 0 client.16839 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:19:48.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.383+0000 7ff9233acb80 1 --2- 172.21.15.69:0/2559827616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869f97fc90 0x55869f9ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff9233acb80 1 -- 172.21.15.69:0/2559827616 >> 172.21.15.69:0/2559827616 conn(0x55869f975ca0 msgr2=0x55869f995700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff9233acb80 1 -- 172.21.15.69:0/2559827616 shutdown_connections 2023-12-14T14:19:48.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff9233acb80 1 -- 172.21.15.69:0/2559827616 wait complete. 2023-12-14T14:19:48.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff9233acb80 20 client.16839 trim_cache size 0 max 16384 2023-12-14T14:19:48.393 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:19:48.393 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:19:48.393 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:19:48.394 INFO:teuthology.orchestra.run.smithi069.stdout: "c176bbf3-ad75-4c89-8612-1ba1cb03884a": { 2023-12-14T14:19:48.394 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:19:48.394 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "c176bbf3-ad75-4c89-8612-1ba1cb03884a", 2023-12-14T14:19:48.394 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:19:48.394 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:19:48.394 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:19:48.394 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:19:48.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 -- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff9000a1340 msgr2=0x7ff9000a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff9000a1340 0x7ff9000a37f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff904005950 tx=0x7ff9040058e0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 -- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 msgr2=0x7ff910197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:19:48.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 0x7ff910197760 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009f50 tx=0x7ff8fc005740 comp rx=0 tx=0).stop 2023-12-14T14:19:48.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 -- 172.21.15.69:0/1491376871 shutdown_connections 2023-12-14T14:19:48.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff9000a1340 0x7ff9000a37f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9101043d0 0x7ff9101a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9100ff390 0x7ff910197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 --2- 172.21.15.69:0/1491376871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9100ffd30 0x7ff910197760 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:19:48.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 -- 172.21.15.69:0/1491376871 >> 172.21.15.69:0/1491376871 conn(0x7ff910075fd0 msgr2=0x7ff9100fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:19:48.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 -- 172.21.15.69:0/1491376871 shutdown_connections 2023-12-14T14:19:48.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:19:48.384+0000 7ff91721e700 1 -- 172.21.15.69:0/1491376871 wait complete. 2023-12-14T14:19:48.397 INFO:tasks.cephfs.filesystem:scrub status for tag:c176bbf3-ad75-4c89-8612-1ba1cb03884a - {'path': '/', 'tag': 'c176bbf3-ad75-4c89-8612-1ba1cb03884a', 'options': 'recursive,force'} 2023-12-14T14:19:49.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:49 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:19:49.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:49 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:49.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:49 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:19:49.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:49 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:19:49.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:49 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:49.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:49 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:49.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:49 smithi069 ceph-mon[42034]: pgmap v284: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:49 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:19:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:49 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:49 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:19:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:49 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:19:49.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:49 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:49.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:49 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:49.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:49 smithi081 ceph-mon[43371]: pgmap v284: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:50.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:49 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:19:50.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:49 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:50.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:49 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:19:50.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:49 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:19:50.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:49 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:50.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:49 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:19:50.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:49 smithi119 ceph-mon[43834]: pgmap v284: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:19:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:51 smithi069 ceph-mon[42034]: pgmap v285: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:19:51.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:51 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:51 smithi081 ceph-mon[43371]: pgmap v285: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:19:51.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:51 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:52.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:51 smithi119 ceph-mon[43834]: pgmap v285: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:19:52.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:51 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:53.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:53 smithi069 ceph-mon[42034]: pgmap v286: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:19:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:53 smithi081 ceph-mon[43371]: pgmap v286: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:19:54.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:53 smithi119 ceph-mon[43834]: pgmap v286: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:19:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:55 smithi069 ceph-mon[42034]: pgmap v287: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:19:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:55 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:19:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:55 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:19:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:55 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:19:55.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:55 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:19:55.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:55 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:19:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:55 smithi081 ceph-mon[43371]: pgmap v287: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:19:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:55 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:19:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:55 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:19:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:55 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:19:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:55 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:19:55.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:55 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:19:56.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:55 smithi119 ceph-mon[43834]: pgmap v287: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:19:56.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:55 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:19:56.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:55 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:19:56.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:55 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:19:56.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:55 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:19:56.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:55 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:19:56.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:56 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:19:56.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:56 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:19:56.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:56 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:19:56.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:56 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:19:56.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:56 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:19:56.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:56 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:56.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:56 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:19:56.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:56 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:19:56.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:56 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:19:56.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:56 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:19:56.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:56 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:19:56.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:56 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:57.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:56 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:19:57.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:56 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:19:57.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:56 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:19:57.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:56 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:19:57.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:56 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:19:57.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:56 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:57.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:57 smithi069 ceph-mon[42034]: pgmap v288: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:19:57.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:57 smithi081 ceph-mon[43371]: pgmap v288: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:19:58.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:57 smithi119 ceph-mon[43834]: pgmap v288: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:19:59.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:59 smithi069 ceph-mon[42034]: pgmap v289: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:19:59.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:19:59 smithi069 ceph-mon[42034]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:19:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:59 smithi081 ceph-mon[43371]: pgmap v289: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:19:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:19:59 smithi081 ceph-mon[43371]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:20:00.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:59 smithi119 ceph-mon[43834]: pgmap v289: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T14:20:00.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:19:59 smithi119 ceph-mon[43834]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T14:20:00.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:00 smithi069 ceph-mon[42034]: overall HEALTH_OK 2023-12-14T14:20:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:00 smithi081 ceph-mon[43371]: overall HEALTH_OK 2023-12-14T14:20:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:00 smithi119 ceph-mon[43834]: overall HEALTH_OK 2023-12-14T14:20:01.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:01 smithi069 ceph-mon[42034]: pgmap v290: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:20:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:01 smithi081 ceph-mon[43371]: pgmap v290: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:20:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:01 smithi119 ceph-mon[43834]: pgmap v290: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:20:03.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:03 smithi069 ceph-mon[42034]: pgmap v291: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:03 smithi081 ceph-mon[43371]: pgmap v291: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:04.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:03 smithi119 ceph-mon[43834]: pgmap v291: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:05.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:05 smithi069 ceph-mon[42034]: pgmap v292: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:20:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:05 smithi081 ceph-mon[43371]: pgmap v292: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:20:06.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:05 smithi119 ceph-mon[43834]: pgmap v292: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:20:07.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:07 smithi119 ceph-mon[43834]: pgmap v293: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:20:07.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:07 smithi069 ceph-mon[42034]: pgmap v293: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:20:07.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:07 smithi081 ceph-mon[43371]: pgmap v293: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:20:09.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:09 smithi069 ceph-mon[42034]: pgmap v294: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:20:09.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:09 smithi081 ceph-mon[43371]: pgmap v294: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:20:10.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:09 smithi119 ceph-mon[43834]: pgmap v294: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:20:11.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:11 smithi069 ceph-mon[42034]: pgmap v295: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:20:11.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:11 smithi069 ceph-mon[42034]: osdmap e92: 12 total, 12 up, 12 in 2023-12-14T14:20:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:11 smithi081 ceph-mon[43371]: pgmap v295: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:20:11.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:11 smithi081 ceph-mon[43371]: osdmap e92: 12 total, 12 up, 12 in 2023-12-14T14:20:12.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:11 smithi119 ceph-mon[43834]: pgmap v295: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:20:12.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:11 smithi119 ceph-mon[43834]: osdmap e92: 12 total, 12 up, 12 in 2023-12-14T14:20:13.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:13 smithi069 ceph-mon[42034]: pgmap v297: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-12-14T14:20:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:13 smithi081 ceph-mon[43371]: pgmap v297: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-12-14T14:20:14.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:13 smithi119 ceph-mon[43834]: pgmap v297: 97 pgs: 97 active+clean; 688 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-12-14T14:20:15.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:15 smithi069 ceph-mon[42034]: pgmap v298: 97 pgs: 5 active+clean+snaptrim_wait, 89 active+clean, 3 active+clean+snaptrim; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:15.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:15 smithi081 ceph-mon[43371]: pgmap v298: 97 pgs: 5 active+clean+snaptrim_wait, 89 active+clean, 3 active+clean+snaptrim; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:16.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:15 smithi119 ceph-mon[43834]: pgmap v298: 97 pgs: 5 active+clean+snaptrim_wait, 89 active+clean, 3 active+clean+snaptrim; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:17.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:17 smithi119 ceph-mon[43834]: pgmap v299: 97 pgs: 5 active+clean+snaptrim_wait, 89 active+clean, 3 active+clean+snaptrim; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:17.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:17 smithi069 ceph-mon[42034]: pgmap v299: 97 pgs: 5 active+clean+snaptrim_wait, 89 active+clean, 3 active+clean+snaptrim; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:17.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:17 smithi081 ceph-mon[43371]: pgmap v299: 97 pgs: 5 active+clean+snaptrim_wait, 89 active+clean, 3 active+clean+snaptrim; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:18.398 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:20:18.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 -- 172.21.15.69:0/4271912794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9600692d0 msgr2=0x7fc9600696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 --2- 172.21.15.69:0/4271912794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9600692d0 0x7fc9600696a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc9480099c0 tx=0x7fc948009cd0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 -- 172.21.15.69:0/4271912794 shutdown_connections 2023-12-14T14:20:18.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 --2- 172.21.15.69:0/4271912794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9601054f0 0x7fc96010d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 --2- 172.21.15.69:0/4271912794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9600692d0 0x7fc9600696a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 --2- 172.21.15.69:0/4271912794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc960069c70 0x7fc960104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 -- 172.21.15.69:0/4271912794 >> 172.21.15.69:0/4271912794 conn(0x7fc960075f70 msgr2=0x7fc960076370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:18.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 -- 172.21.15.69:0/4271912794 shutdown_connections 2023-12-14T14:20:18.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 -- 172.21.15.69:0/4271912794 wait complete. 2023-12-14T14:20:18.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.540+0000 7fc9659cb700 1 Processor -- start 2023-12-14T14:20:18.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9659cb700 1 -- start start 2023-12-14T14:20:18.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9659cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9600692d0 0x7fc9600ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9659cb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc960069c70 0x7fc9600ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9659cb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9601054f0 0x7fc9601a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9659cb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600fff00 con 0x7fc960069c70 2023-12-14T14:20:18.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9659cb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9601a4ba0 con 0x7fc9600692d0 2023-12-14T14:20:18.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9659cb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9601a4ce0 con 0x7fc9601054f0 2023-12-14T14:20:18.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc960069c70 0x7fc9600ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc960069c70 0x7fc9600ff6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53318/0 (socket says 172.21.15.69:53318) 2023-12-14T14:20:18.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95e7fc700 1 -- 172.21.15.69:0/1575335133 learned_addr learned my addr 172.21.15.69:0/1575335133 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:18.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95effd700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9600692d0 0x7fc9600ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95f7fe700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9601054f0 0x7fc9601a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95e7fc700 1 -- 172.21.15.69:0/1575335133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9601054f0 msgr2=0x7fc9601a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9601054f0 0x7fc9601a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95e7fc700 1 -- 172.21.15.69:0/1575335133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9600692d0 msgr2=0x7fc9600ff190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9600692d0 0x7fc9600ff190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95e7fc700 1 -- 172.21.15.69:0/1575335133 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480095f0 con 0x7fc960069c70 2023-12-14T14:20:18.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95effd700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9600692d0 0x7fc9600ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:18.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc960069c70 0x7fc9600ff6d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc95000d950 tx=0x7fc95000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:18.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9649c9700 1 -- 172.21.15.69:0/1575335133 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950009b40 con 0x7fc960069c70 2023-12-14T14:20:18.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9649c9700 1 -- 172.21.15.69:0/1575335133 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc95000de30 con 0x7fc960069c70 2023-12-14T14:20:18.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.541+0000 7fc9659cb700 1 -- 172.21.15.69:0/1575335133 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc960110300 con 0x7fc960069c70 2023-12-14T14:20:18.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.542+0000 7fc9649c9700 1 -- 172.21.15.69:0/1575335133 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95000f620 con 0x7fc960069c70 2023-12-14T14:20:18.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.542+0000 7fc9659cb700 1 -- 172.21.15.69:0/1575335133 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc960110170 con 0x7fc960069c70 2023-12-14T14:20:18.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.543+0000 7fc9649c9700 1 -- 172.21.15.69:0/1575335133 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc950010460 con 0x7fc960069c70 2023-12-14T14:20:18.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.544+0000 7fc9649c9700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc94c0a12c0 0x7fc94c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.544+0000 7fc95effd700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc94c0a12c0 0x7fc94c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.544+0000 7fc9649c9700 1 -- 172.21.15.69:0/1575335133 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fc9500cc970 con 0x7fc960069c70 2023-12-14T14:20:18.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.545+0000 7fc95effd700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc94c0a12c0 0x7fc94c0a3770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc948009fd0 tx=0x7fc948005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:18.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.545+0000 7fc971b59b80 1 Processor -- start 2023-12-14T14:20:18.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.545+0000 7fc971b59b80 1 -- start start 2023-12-14T14:20:18.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb80491750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb8049c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc971b59b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb8037b5e0 con 0x55bb80491380 2023-12-14T14:20:18.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc971b59b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb803ea870 con 0x55bb8049cb50 2023-12-14T14:20:18.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc971b59b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb803e3d00 con 0x55bb80491c90 2023-12-14T14:20:18.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb80491750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb80491750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53328/0 (socket says 172.21.15.69:53328) 2023-12-14T14:20:18.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95effd700 1 -- 172.21.15.69:0/1410373862 learned_addr learned my addr 172.21.15.69:0/1410373862 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:18.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb8049c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95f7fe700 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95effd700 1 -- 172.21.15.69:0/1410373862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 msgr2=0x55bb8049c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:18.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95effd700 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb8049c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95effd700 1 -- 172.21.15.69:0/1410373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 msgr2=0x55bb8049ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:18.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95effd700 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95effd700 1 -- 172.21.15.69:0/1410373862 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb802653b0 con 0x55bb80491380 2023-12-14T14:20:18.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95f7fe700 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:18.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc95effd700 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb80491750 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc9480099c0 tx=0x7fc94801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd41a9c0cedcaab4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:18.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc955ffb700 1 -- 172.21.15.69:0/1410373862 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94802b070 con 0x55bb80491380 2023-12-14T14:20:18.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc955ffb700 1 -- 172.21.15.69:0/1410373862 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc94801e040 con 0x55bb80491380 2023-12-14T14:20:18.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.546+0000 7fc955ffb700 1 -- 172.21.15.69:0/1410373862 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948004b50 con 0x55bb80491380 2023-12-14T14:20:18.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 -- 172.21.15.69:0/1410373862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 msgr2=0x55bb80491750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb80491750 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc9480099c0 tx=0x7fc94801f000 comp rx=0 tx=0).stop 2023-12-14T14:20:18.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 -- 172.21.15.69:0/1410373862 shutdown_connections 2023-12-14T14:20:18.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb80491750 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 --2- 172.21.15.69:0/1410373862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb8049c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 -- 172.21.15.69:0/1410373862 >> 172.21.15.69:0/1410373862 conn(0x55bb80487ca0 msgr2=0x55bb8048d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:18.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 -- 172.21.15.69:0/1410373862 shutdown_connections 2023-12-14T14:20:18.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 -- 172.21.15.69:0/1410373862 wait complete. 2023-12-14T14:20:18.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.547+0000 7fc971b59b80 1 -- start start 2023-12-14T14:20:18.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc971b59b80 1 Processor -- start 2023-12-14T14:20:18.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491380 0x55bb8049c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb80491c90 0x55bb80499760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb8049cb50 0x55bb80499ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc971b59b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb8037ff90 con 0x55bb8049cb50 2023-12-14T14:20:18.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc971b59b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb8037fc30 con 0x55bb80491c90 2023-12-14T14:20:18.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc971b59b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb802676a0 con 0x55bb80491380 2023-12-14T14:20:18.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc971b59b80 10 client.0 _ll_register_callbacks cb 0x55bb803a3910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:18.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb8049cb50 0x55bb80499ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb8049cb50 0x55bb80499ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53330/0 (socket says 172.21.15.69:53330) 2023-12-14T14:20:18.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95f7fe700 1 -- 172.21.15.69:0/2459185247 learned_addr learned my addr 172.21.15.69:0/2459185247 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:18.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb80491c90 0x55bb80499760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95effd700 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491380 0x55bb8049c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95f7fe700 1 -- 172.21.15.69:0/2459185247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491380 msgr2=0x55bb8049c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:18.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95f7fe700 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491380 0x55bb8049c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95f7fe700 1 -- 172.21.15.69:0/2459185247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb80491c90 msgr2=0x55bb80499760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:18.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95f7fe700 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb80491c90 0x55bb80499760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95f7fe700 1 -- 172.21.15.69:0/2459185247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96010d900 con 0x55bb8049cb50 2023-12-14T14:20:18.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95effd700 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491380 0x55bb8049c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:18.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.548+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb80491c90 0x55bb80499760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:20:18.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc95f7fe700 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb8049cb50 0x55bb80499ce0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc958008bf0 tx=0x7fc958008f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e8ab1202cc66e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:18.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc93effd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:18.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc93effd700 1 -- 172.21.15.69:0/2459185247 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958004db0 con 0x55bb8049cb50 2023-12-14T14:20:18.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc93effd700 1 -- 172.21.15.69:0/2459185247 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fc958010940 con 0x55bb8049cb50 2023-12-14T14:20:18.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc971b59b80 1 -- 172.21.15.69:0/2459185247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb804852b0 con 0x55bb8049cb50 2023-12-14T14:20:18.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc93effd700 1 -- 172.21.15.69:0/2459185247 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc958007b20 con 0x55bb8049cb50 2023-12-14T14:20:18.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc971b59b80 10 client.16851 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:18.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc971b59b80 1 -- 172.21.15.69:0/2459185247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55bb803aa170 con 0x55bb8049cb50 2023-12-14T14:20:18.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc93effd700 1 -- 172.21.15.69:0/2459185247 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc958023020 con 0x55bb8049cb50 2023-12-14T14:20:18.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc93effd700 1 -- 172.21.15.69:0/2459185247 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc958015070 con 0x55bb8049cb50 2023-12-14T14:20:18.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc971b59b80 10 client.16851 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:18.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc971b59b80 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:18.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc971b59b80 20 client.16851 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:18.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bb804ac530 0x55bb804ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc971b59b80 4 client.16851 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:18.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.549+0000 7fc971b59b80 1 -- 172.21.15.69:0/2459185247 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb803dcce0 con 0x55bb804ac530 2023-12-14T14:20:18.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.550+0000 7fc95effd700 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bb804ac530 0x55bb804ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.550+0000 7fc93effd700 10 client.16851 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:18.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.550+0000 7fc95effd700 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bb804ac530 0x55bb804ae940 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16fc707652857efc server_cookie=1cfaca2a35f28f2a in_seq=0 out_seq=0 2023-12-14T14:20:18.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc93effd700 1 -- 172.21.15.69:0/2459185247 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bb803dcce0 con 0x55bb804ac530 2023-12-14T14:20:18.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc93effd700 10 client.16851 handle_command_reply: tid=0 2023-12-14T14:20:18.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 client.16851 shutdown 2023-12-14T14:20:18.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 -- 172.21.15.69:0/2459185247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb8049cb50 msgr2=0x55bb80499ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb8049cb50 0x55bb80499ce0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc958008bf0 tx=0x7fc958008f00 comp rx=0 tx=0).stop 2023-12-14T14:20:18.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 -- 172.21.15.69:0/2459185247 shutdown_connections 2023-12-14T14:20:18.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bb804ac530 0x55bb804ae940 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb8049cb50 0x55bb80499ce0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491380 0x55bb8049c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2459185247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb80491c90 0x55bb80499760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 -- 172.21.15.69:0/2459185247 >> 172.21.15.69:0/2459185247 conn(0x55bb80487ca0 msgr2=0x55bb8048d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:18.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc93effd700 0 client.16851 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:18.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 -- 172.21.15.69:0/2459185247 shutdown_connections 2023-12-14T14:20:18.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 1 -- 172.21.15.69:0/2459185247 wait complete. 2023-12-14T14:20:18.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.551+0000 7fc971b59b80 20 client.16851 trim_cache size 0 max 16384 2023-12-14T14:20:18.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.568+0000 7fc971b59b80 1 Processor -- start 2023-12-14T14:20:18.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.568+0000 7fc971b59b80 1 -- start start 2023-12-14T14:20:18.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb80498f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc971b59b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb8048c5b0 con 0x55bb80491380 2023-12-14T14:20:18.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc971b59b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb804955f0 con 0x55bb8049cb50 2023-12-14T14:20:18.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc971b59b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb80492d30 con 0x55bb80491c90 2023-12-14T14:20:18.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53334/0 (socket says 172.21.15.69:53334) 2023-12-14T14:20:18.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95effd700 1 -- 172.21.15.69:0/1006124866 learned_addr learned my addr 172.21.15.69:0/1006124866 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:18.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/1006124866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb80498f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95f7fe700 1 --2- 172.21.15.69:0/1006124866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95effd700 1 -- 172.21.15.69:0/1006124866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 msgr2=0x55bb80498f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:18.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95effd700 1 --2- 172.21.15.69:0/1006124866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb80498f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95effd700 1 -- 172.21.15.69:0/1006124866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 msgr2=0x55bb8049bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:18.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95effd700 1 --2- 172.21.15.69:0/1006124866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95effd700 1 -- 172.21.15.69:0/1006124866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb803a9ec0 con 0x55bb80491380 2023-12-14T14:20:18.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc95effd700 1 --2- 172.21.15.69:0/1006124866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3620 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc948009350 tx=0x7fc948019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cfa6ae6e52dba3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:18.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc9567fc700 1 -- 172.21.15.69:0/1006124866 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94802b040 con 0x55bb80491380 2023-12-14T14:20:18.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc9567fc700 1 -- 172.21.15.69:0/1006124866 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc94800bc40 con 0x55bb80491380 2023-12-14T14:20:18.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.569+0000 7fc9567fc700 1 -- 172.21.15.69:0/1006124866 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9480038c0 con 0x55bb80491380 2023-12-14T14:20:18.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 -- 172.21.15.69:0/1006124866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 msgr2=0x55bb804a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 --2- 172.21.15.69:0/1006124866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3620 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc948009350 tx=0x7fc948019040 comp rx=0 tx=0).stop 2023-12-14T14:20:18.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 -- 172.21.15.69:0/1006124866 shutdown_connections 2023-12-14T14:20:18.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 --2- 172.21.15.69:0/1006124866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 --2- 172.21.15.69:0/1006124866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3620 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 --2- 172.21.15.69:0/1006124866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb80498f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 -- 172.21.15.69:0/1006124866 >> 172.21.15.69:0/1006124866 conn(0x55bb80487ca0 msgr2=0x55bb804ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:18.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 -- 172.21.15.69:0/1006124866 shutdown_connections 2023-12-14T14:20:18.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 -- 172.21.15.69:0/1006124866 wait complete. 2023-12-14T14:20:18.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 -- start start 2023-12-14T14:20:18.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.570+0000 7fc971b59b80 1 Processor -- start 2023-12-14T14:20:18.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb8049f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc971b59b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc971b59b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb804a0080 con 0x55bb80491380 2023-12-14T14:20:18.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc971b59b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb804a01f0 con 0x55bb8049cb50 2023-12-14T14:20:18.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc971b59b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb804a03b0 con 0x55bb80491c90 2023-12-14T14:20:18.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc971b59b80 10 client.0 _ll_register_callbacks cb 0x7fc958008480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:18.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53348/0 (socket says 172.21.15.69:53348) 2023-12-14T14:20:18.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95effd700 1 -- 172.21.15.69:0/2069938278 learned_addr learned my addr 172.21.15.69:0/2069938278 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:18.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb8049f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95f7fe700 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95effd700 1 -- 172.21.15.69:0/2069938278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 msgr2=0x55bb8049f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:18.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95effd700 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb8049f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95effd700 1 -- 172.21.15.69:0/2069938278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 msgr2=0x55bb8049fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:18.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95effd700 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95effd700 1 -- 172.21.15.69:0/2069938278 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb802653b0 con 0x55bb80491380 2023-12-14T14:20:18.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95f7fe700 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:18.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc95effd700 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3640 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc948009990 tx=0x7fc948005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc1b4e10d8e7262 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:18.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc93effd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:18.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc93effd700 1 -- 172.21.15.69:0/2069938278 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948005410 con 0x55bb80491380 2023-12-14T14:20:18.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc93effd700 1 -- 172.21.15.69:0/2069938278 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fc948035070 con 0x55bb80491380 2023-12-14T14:20:18.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.571+0000 7fc971b59b80 1 -- 172.21.15.69:0/2069938278 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc94801e040 con 0x55bb80491380 2023-12-14T14:20:18.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc93effd700 1 -- 172.21.15.69:0/2069938278 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc948005570 con 0x55bb80491380 2023-12-14T14:20:18.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc971b59b80 10 client.16857 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:18.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc971b59b80 1 -- 172.21.15.69:0/2069938278 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55bb803909a0 con 0x55bb80491380 2023-12-14T14:20:18.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc93effd700 1 -- 172.21.15.69:0/2069938278 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc94801e040 con 0x55bb80491380 2023-12-14T14:20:18.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc93effd700 1 -- 172.21.15.69:0/2069938278 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc948003ea0 con 0x55bb80491380 2023-12-14T14:20:18.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc971b59b80 10 client.16857 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:18.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc971b59b80 10 client.16857 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:18.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc971b59b80 20 client.16857 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:18.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bb80500430 0x55bb80502810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc971b59b80 4 client.16857 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:20:18.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc971b59b80 1 -- 172.21.15.69:0/2069938278 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bb803dca00 con 0x55bb80500430 2023-12-14T14:20:18.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bb80500430 0x55bb80502810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc93effd700 10 client.16857 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:18.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.572+0000 7fc95e7fc700 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bb80500430 0x55bb80502810 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c621a88c7f1e07f server_cookie=4b0cefc0506de114 in_seq=0 out_seq=0 2023-12-14T14:20:18.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc93effd700 1 -- 172.21.15.69:0/2069938278 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55bb803dca00 con 0x55bb80500430 2023-12-14T14:20:18.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc93effd700 10 client.16857 handle_command_reply: tid=0 2023-12-14T14:20:18.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 client.16857 shutdown 2023-12-14T14:20:18.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 -- 172.21.15.69:0/2069938278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 msgr2=0x55bb804a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3640 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc948009990 tx=0x7fc948005c50 comp rx=0 tx=0).stop 2023-12-14T14:20:18.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 -- 172.21.15.69:0/2069938278 shutdown_connections 2023-12-14T14:20:18.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55bb80500430 0x55bb80502810 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb8049cb50 0x55bb8049fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb80491380 0x55bb804a3640 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc93effd700 0 client.16857 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:18.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 --2- 172.21.15.69:0/2069938278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb80491c90 0x55bb8049f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 -- 172.21.15.69:0/2069938278 >> 172.21.15.69:0/2069938278 conn(0x55bb80487ca0 msgr2=0x55bb80494ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:18.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 -- 172.21.15.69:0/2069938278 shutdown_connections 2023-12-14T14:20:18.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 1 -- 172.21.15.69:0/2069938278 wait complete. 2023-12-14T14:20:18.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc971b59b80 20 client.16857 trim_cache size 0 max 16384 2023-12-14T14:20:18.590 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:20:18.590 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:20:18.590 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:20:18.591 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:20:18.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 -- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc94c0a12c0 msgr2=0x7fc94c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc94c0a12c0 0x7fc94c0a3770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc948009fd0 tx=0x7fc948005fb0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 -- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc960069c70 msgr2=0x7fc9600ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc960069c70 0x7fc9600ff6d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc95000d950 tx=0x7fc95000dd10 comp rx=0 tx=0).stop 2023-12-14T14:20:18.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 -- 172.21.15.69:0/1575335133 shutdown_connections 2023-12-14T14:20:18.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc94c0a12c0 0x7fc94c0a3770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9601054f0 0x7fc9601a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9600692d0 0x7fc9600ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 --2- 172.21.15.69:0/1575335133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc960069c70 0x7fc9600ff6d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.573+0000 7fc9659cb700 1 -- 172.21.15.69:0/1575335133 >> 172.21.15.69:0/1575335133 conn(0x7fc960075f70 msgr2=0x7fc960103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:18.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.574+0000 7fc9659cb700 1 -- 172.21.15.69:0/1575335133 shutdown_connections 2023-12-14T14:20:18.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.574+0000 7fc9659cb700 1 -- 172.21.15.69:0/1575335133 wait complete. 2023-12-14T14:20:18.594 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:20:18.594 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:20:18.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 -- 172.21.15.69:0/3239951141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 msgr2=0x7ff13810c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 --2- 172.21.15.69:0/3239951141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 0x7ff13810c000 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff13000b0d0 tx=0x7ff13000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 -- 172.21.15.69:0/3239951141 shutdown_connections 2023-12-14T14:20:18.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 --2- 172.21.15.69:0/3239951141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 0x7ff13810c000 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 --2- 172.21.15.69:0/3239951141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1380ff3f0 0x7ff1380ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 --2- 172.21.15.69:0/3239951141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1380ffd90 0x7ff138103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 -- 172.21.15.69:0/3239951141 >> 172.21.15.69:0/3239951141 conn(0x7ff138075fd0 msgr2=0x7ff1380763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:18.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 -- 172.21.15.69:0/3239951141 shutdown_connections 2023-12-14T14:20:18.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 -- 172.21.15.69:0/3239951141 wait complete. 2023-12-14T14:20:18.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.719+0000 7ff13db40700 1 Processor -- start 2023-12-14T14:20:18.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff13db40700 1 -- start start 2023-12-14T14:20:18.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff13db40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1380ff3f0 0x7ff138197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff13db40700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1380ffd90 0x7ff1381977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff13db40700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 0x7ff1381a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff13db40700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381a2820 con 0x7ff138104430 2023-12-14T14:20:18.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff13db40700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381a2960 con 0x7ff1380ff3f0 2023-12-14T14:20:18.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff13db40700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381a2aa0 con 0x7ff1380ffd90 2023-12-14T14:20:18.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff137fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 0x7ff1381a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff137fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 0x7ff1381a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53374/0 (socket says 172.21.15.69:53374) 2023-12-14T14:20:18.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff137fff700 1 -- 172.21.15.69:0/457405479 learned_addr learned my addr 172.21.15.69:0/457405479 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:18.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff1377fe700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1380ff3f0 0x7ff138197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff136ffd700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1380ffd90 0x7ff1381977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff137fff700 1 -- 172.21.15.69:0/457405479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1380ffd90 msgr2=0x7ff1381977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff137fff700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1380ffd90 0x7ff1381977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff137fff700 1 -- 172.21.15.69:0/457405479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1380ff3f0 msgr2=0x7ff138197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff137fff700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1380ff3f0 0x7ff138197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff137fff700 1 -- 172.21.15.69:0/457405479 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130009d00 con 0x7ff138104430 2023-12-14T14:20:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff137fff700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 0x7ff1381a22e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff130007870 tx=0x7ff1300078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff134ff9700 1 -- 172.21.15.69:0/457405479 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13000e040 con 0x7ff138104430 2023-12-14T14:20:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13810f200 con 0x7ff138104430 2023-12-14T14:20:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff134ff9700 1 -- 172.21.15.69:0/457405479 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff130005070 con 0x7ff138104430 2023-12-14T14:20:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.720+0000 7ff134ff9700 1 -- 172.21.15.69:0/457405479 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13001b6a0 con 0x7ff138104430 2023-12-14T14:20:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.721+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13810f070 con 0x7ff138104430 2023-12-14T14:20:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.721+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13810f390 con 0x7ff138104430 2023-12-14T14:20:18.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.723+0000 7ff134ff9700 1 -- 172.21.15.69:0/457405479 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff1300051e0 con 0x7ff138104430 2023-12-14T14:20:18.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.723+0000 7ff134ff9700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff1200a12c0 0x7ff1200a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:18.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.724+0000 7ff1377fe700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff1200a12c0 0x7ff1200a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:18.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.724+0000 7ff134ff9700 1 -- 172.21.15.69:0/457405479 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7ff1300ce420 con 0x7ff138104430 2023-12-14T14:20:18.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.724+0000 7ff1377fe700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff1200a12c0 0x7ff1200a3770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff128009c60 tx=0x7ff128009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:18.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.727+0000 7ff134ff9700 1 -- 172.21.15.69:0/457405479 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff1300978b0 con 0x7ff138104430 2023-12-14T14:20:18.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.962+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1380671e0 con 0x7ff138104430 2023-12-14T14:20:18.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.963+0000 7ff134ff9700 1 -- 172.21.15.69:0/457405479 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+10801 (secure 0 0 0) 0x7ff13009aed0 con 0x7ff138104430 2023-12-14T14:20:18.963 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:20:18.963 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:19:58.550404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:20:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff1200a12c0 msgr2=0x7ff1200a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff1200a12c0 0x7ff1200a3770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff128009c60 tx=0x7ff128009260 comp rx=0 tx=0).stop 2023-12-14T14:20:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 msgr2=0x7ff1381a22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 0x7ff1381a22e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff130007870 tx=0x7ff1300078a0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 shutdown_connections 2023-12-14T14:20:18.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff1200a12c0 0x7ff1200a3770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff138104430 0x7ff1381a22e0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1380ff3f0 0x7ff138197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 --2- 172.21.15.69:0/457405479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1380ffd90 0x7ff1381977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:18.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 >> 172.21.15.69:0/457405479 conn(0x7ff138075fd0 msgr2=0x7ff138102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:18.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 shutdown_connections 2023-12-14T14:20:18.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:18.965+0000 7ff13db40700 1 -- 172.21.15.69:0/457405479 wait complete. 2023-12-14T14:20:18.967 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 33 2023-12-14T14:20:18.978 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:20:19.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.104+0000 7f60a0a3f700 1 -- 172.21.15.69:0/2547468690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c1043f0 msgr2=0x7f609c10bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.104+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/2547468690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c1043f0 0x7f609c10bfc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f609400b0d0 tx=0x7f609400b3e0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.104+0000 7f60a0a3f700 1 -- 172.21.15.69:0/2547468690 shutdown_connections 2023-12-14T14:20:19.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.104+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/2547468690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c1043f0 0x7f609c10bfc0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.104+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/2547468690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f609c0ff3b0 0x7f609c0ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.104+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/2547468690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f609c0ffd50 0x7f609c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.104+0000 7f60a0a3f700 1 -- 172.21.15.69:0/2547468690 >> 172.21.15.69:0/2547468690 conn(0x7f609c0763a0 msgr2=0x7f609c0767a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.104+0000 7f60a0a3f700 1 -- 172.21.15.69:0/2547468690 shutdown_connections 2023-12-14T14:20:19.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.104+0000 7f60a0a3f700 1 -- 172.21.15.69:0/2547468690 wait complete. 2023-12-14T14:20:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f60a0a3f700 1 Processor -- start 2023-12-14T14:20:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f60a0a3f700 1 -- start start 2023-12-14T14:20:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f60a0a3f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f609c0ff3b0 0x7f609c195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f60a0a3f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c0ffd50 0x7f609c1959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f60a0a3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f609c1043f0 0x7f609c199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f60a0a3f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c19a470 con 0x7f609c0ffd50 2023-12-14T14:20:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f60a0a3f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c19a5e0 con 0x7f609c1043f0 2023-12-14T14:20:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f60a0a3f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c19a7a0 con 0x7f609c0ff3b0 2023-12-14T14:20:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f6099d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c0ffd50 0x7f609c1959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f6099d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c0ffd50 0x7f609c1959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53390/0 (socket says 172.21.15.69:53390) 2023-12-14T14:20:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f6099d9b700 1 -- 172.21.15.69:0/3818222869 learned_addr learned my addr 172.21.15.69:0/3818222869 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f609a59c700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f609c0ff3b0 0x7f609c195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f609ad9d700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f609c1043f0 0x7f609c199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f6099d9b700 1 -- 172.21.15.69:0/3818222869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f609c0ff3b0 msgr2=0x7f609c195490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f6099d9b700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f609c0ff3b0 0x7f609c195490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f6099d9b700 1 -- 172.21.15.69:0/3818222869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f609c1043f0 msgr2=0x7f609c199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f6099d9b700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f609c1043f0 0x7f609c199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f6099d9b700 1 -- 172.21.15.69:0/3818222869 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6094009d00 con 0x7f609c0ffd50 2023-12-14T14:20:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f609ad9d700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f609c1043f0 0x7f609c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:19.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f6099d9b700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c0ffd50 0x7f609c1959d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f608c00c8c0 tx=0x7f608c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.105+0000 7f608b7fe700 1 -- 172.21.15.69:0/3818222869 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c004220 con 0x7f609c0ffd50 2023-12-14T14:20:19.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.106+0000 7f60a0a3f700 1 -- 172.21.15.69:0/3818222869 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c10f210 con 0x7f609c0ffd50 2023-12-14T14:20:19.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.106+0000 7f608b7fe700 1 -- 172.21.15.69:0/3818222869 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f608c004cf0 con 0x7f609c0ffd50 2023-12-14T14:20:19.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.106+0000 7f608b7fe700 1 -- 172.21.15.69:0/3818222869 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c005700 con 0x7f609c0ffd50 2023-12-14T14:20:19.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.106+0000 7f60a0a3f700 1 -- 172.21.15.69:0/3818222869 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c10f080 con 0x7f609c0ffd50 2023-12-14T14:20:19.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.108+0000 7f608b7fe700 1 -- 172.21.15.69:0/3818222869 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f608c004380 con 0x7f609c0ffd50 2023-12-14T14:20:19.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.108+0000 7f608b7fe700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f60840a12c0 0x7f60840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.108+0000 7f609a59c700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f60840a12c0 0x7f60840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.108+0000 7f608b7fe700 1 -- 172.21.15.69:0/3818222869 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f608c0cc840 con 0x7f609c0ffd50 2023-12-14T14:20:19.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.109+0000 7f609a59c700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f60840a12c0 0x7f60840a3770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6090005950 tx=0x7f609000b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f60acbcdb80 1 Processor -- start 2023-12-14T14:20:19.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f60acbcdb80 1 -- start start 2023-12-14T14:20:19.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499b9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 0x564b499bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b498985e0 con 0x564b499ae380 2023-12-14T14:20:19.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b49907870 con 0x564b499b9b50 2023-12-14T14:20:19.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b49900d00 con 0x564b499aec90 2023-12-14T14:20:19.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f609a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f609a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53402/0 (socket says 172.21.15.69:53402) 2023-12-14T14:20:19.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f609a59c700 1 -- 172.21.15.69:0/546501981 learned_addr learned my addr 172.21.15.69:0/546501981 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.110+0000 7f6099d9b700 1 --2- 172.21.15.69:0/546501981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f609ad9d700 1 --2- 172.21.15.69:0/546501981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 0x564b499bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f609a59c700 1 -- 172.21.15.69:0/546501981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 msgr2=0x564b499b9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f609a59c700 1 --2- 172.21.15.69:0/546501981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499b9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f609a59c700 1 -- 172.21.15.69:0/546501981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 msgr2=0x564b499bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f609a59c700 1 --2- 172.21.15.69:0/546501981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 0x564b499bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f609a59c700 1 -- 172.21.15.69:0/546501981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b497823b0 con 0x564b499ae380 2023-12-14T14:20:19.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f609a59c700 1 --2- 172.21.15.69:0/546501981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499ae750 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6090010fa0 tx=0x7f6090013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2905ae7743ec00c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f6088ff9700 1 -- 172.21.15.69:0/546501981 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090011db0 con 0x564b499ae380 2023-12-14T14:20:19.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f6088ff9700 1 -- 172.21.15.69:0/546501981 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6090015070 con 0x564b499ae380 2023-12-14T14:20:19.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.111+0000 7f6088ff9700 1 -- 172.21.15.69:0/546501981 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609001c5b0 con 0x564b499ae380 2023-12-14T14:20:19.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 -- 172.21.15.69:0/546501981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 msgr2=0x564b499ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/546501981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499ae750 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6090010fa0 tx=0x7f6090013000 comp rx=0 tx=0).stop 2023-12-14T14:20:19.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 -- 172.21.15.69:0/546501981 shutdown_connections 2023-12-14T14:20:19.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/546501981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 0x564b499bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/546501981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499ae750 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/546501981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 -- 172.21.15.69:0/546501981 >> 172.21.15.69:0/546501981 conn(0x564b499a4ca0 msgr2=0x564b499aa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 -- 172.21.15.69:0/546501981 shutdown_connections 2023-12-14T14:20:19.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 -- 172.21.15.69:0/546501981 wait complete. 2023-12-14T14:20:19.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 -- start start 2023-12-14T14:20:19.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 Processor -- start 2023-12-14T14:20:19.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499ae380 0x564b499b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499aec90 0x564b499b9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b499bfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4989cf90 con 0x564b499b9b50 2023-12-14T14:20:19.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4989cc30 con 0x564b499aec90 2023-12-14T14:20:19.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.112+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b497846a0 con 0x564b499ae380 2023-12-14T14:20:19.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f60acbcdb80 10 client.0 _ll_register_callbacks cb 0x564b498c0910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:19.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b499bfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b499bfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53416/0 (socket says 172.21.15.69:53416) 2023-12-14T14:20:19.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609ad9d700 1 -- 172.21.15.69:0/1836644887 learned_addr learned my addr 172.21.15.69:0/1836644887 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499ae380 0x564b499b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f6099d9b700 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499aec90 0x564b499b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609ad9d700 1 -- 172.21.15.69:0/1836644887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499ae380 msgr2=0x564b499b8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609ad9d700 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499ae380 0x564b499b8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609ad9d700 1 -- 172.21.15.69:0/1836644887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499aec90 msgr2=0x564b499b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609ad9d700 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499aec90 0x564b499b9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609ad9d700 1 -- 172.21.15.69:0/1836644887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6090010c50 con 0x564b499b9b50 2023-12-14T14:20:19.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f6099d9b700 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499aec90 0x564b499b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:19.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f609ad9d700 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b499bfe10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6094004cf0 tx=0x7f6094004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb12ecbd42b53b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f6081ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:19.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f6081ffb700 1 -- 172.21.15.69:0/1836644887 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400e070 con 0x564b499b9b50 2023-12-14T14:20:19.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f60acbcdb80 1 -- 172.21.15.69:0/1836644887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b499a22b0 con 0x564b499b9b50 2023-12-14T14:20:19.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f6081ffb700 1 -- 172.21.15.69:0/1836644887 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f60940078f0 con 0x564b499b9b50 2023-12-14T14:20:19.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f6081ffb700 1 -- 172.21.15.69:0/1836644887 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6094005040 con 0x564b499b9b50 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f60acbcdb80 10 client.16875 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.113+0000 7f60acbcdb80 1 -- 172.21.15.69:0/1836644887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564b498c7170 con 0x564b499b9b50 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f6081ffb700 1 -- 172.21.15.69:0/1836644887 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564b499a22b0 con 0x564b499b9b50 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f6081ffb700 1 -- 172.21.15.69:0/1836644887 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6094022020 con 0x564b499b9b50 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f60acbcdb80 10 client.16875 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f60acbcdb80 10 client.16875 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f60acbcdb80 20 client.16875 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564b499cb6f0 0x564b499cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f60acbcdb80 4 client.16875 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:19.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f60acbcdb80 1 -- 172.21.15.69:0/1836644887 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b498f9ce0 con 0x564b499cb6f0 2023-12-14T14:20:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f609a59c700 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564b499cb6f0 0x564b499cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f6081ffb700 10 client.16875 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:20:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.114+0000 7f609a59c700 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564b499cb6f0 0x564b499cdb00 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=60a732f0ff67b80d server_cookie=453c3e205735a2dd in_seq=0 out_seq=0 2023-12-14T14:20:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f6081ffb700 1 -- 172.21.15.69:0/1836644887 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564b498f9ce0 con 0x564b499cb6f0 2023-12-14T14:20:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f6081ffb700 10 client.16875 handle_command_reply: tid=0 2023-12-14T14:20:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 client.16875 shutdown 2023-12-14T14:20:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 -- 172.21.15.69:0/1836644887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 msgr2=0x564b499bfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b499bfe10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6094004cf0 tx=0x7f6094004d20 comp rx=0 tx=0).stop 2023-12-14T14:20:19.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 -- 172.21.15.69:0/1836644887 shutdown_connections 2023-12-14T14:20:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564b499cb6f0 0x564b499cdb00 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b499bfe10 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f6081ffb700 0 client.16875 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:20:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499ae380 0x564b499b8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/1836644887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499aec90 0x564b499b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 -- 172.21.15.69:0/1836644887 >> 172.21.15.69:0/1836644887 conn(0x564b499a4ca0 msgr2=0x564b499aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 -- 172.21.15.69:0/1836644887 shutdown_connections 2023-12-14T14:20:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.115+0000 7f60acbcdb80 1 -- 172.21.15.69:0/1836644887 wait complete. 2023-12-14T14:20:19.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.116+0000 7f60acbcdb80 20 client.16875 trim_cache size 0 max 16384 2023-12-14T14:20:19.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f60acbcdb80 1 Processor -- start 2023-12-14T14:20:19.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f60acbcdb80 1 -- start start 2023-12-14T14:20:19.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499c1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 0x564b499b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b499af390 con 0x564b499ae380 2023-12-14T14:20:19.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b499af5b0 con 0x564b499b9b50 2023-12-14T14:20:19.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b499bcb50 con 0x564b499aec90 2023-12-14T14:20:19.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f609a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.128+0000 7f609a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499bfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53426/0 (socket says 172.21.15.69:53426) 2023-12-14T14:20:19.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f609a59c700 1 -- 172.21.15.69:0/2192625656 learned_addr learned my addr 172.21.15.69:0/2192625656 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f6099d9b700 1 --2- 172.21.15.69:0/2192625656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f609ad9d700 1 --2- 172.21.15.69:0/2192625656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 0x564b499b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f609a59c700 1 -- 172.21.15.69:0/2192625656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 msgr2=0x564b499c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f609a59c700 1 --2- 172.21.15.69:0/2192625656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499c1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f609a59c700 1 -- 172.21.15.69:0/2192625656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 msgr2=0x564b499b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f609a59c700 1 --2- 172.21.15.69:0/2192625656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 0x564b499b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f609a59c700 1 -- 172.21.15.69:0/2192625656 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b499a64e0 con 0x564b499ae380 2023-12-14T14:20:19.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f609a59c700 1 --2- 172.21.15.69:0/2192625656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499bfd90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6090010f40 tx=0x7f6090016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291de600af576b1e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f60897fa700 1 -- 172.21.15.69:0/2192625656 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609002c070 con 0x564b499ae380 2023-12-14T14:20:19.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f60897fa700 1 -- 172.21.15.69:0/2192625656 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f609002d040 con 0x564b499ae380 2023-12-14T14:20:19.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.129+0000 7f60897fa700 1 -- 172.21.15.69:0/2192625656 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609001e420 con 0x564b499ae380 2023-12-14T14:20:19.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 -- 172.21.15.69:0/2192625656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 msgr2=0x564b499bfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/2192625656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499bfd90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6090010f40 tx=0x7f6090016000 comp rx=0 tx=0).stop 2023-12-14T14:20:19.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 -- 172.21.15.69:0/2192625656 shutdown_connections 2023-12-14T14:20:19.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/2192625656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499b9b50 0x564b499b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/2192625656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499ae380 0x564b499bfd90 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/2192625656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 -- 172.21.15.69:0/2192625656 >> 172.21.15.69:0/2192625656 conn(0x564b499a4ca0 msgr2=0x564b499b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 -- 172.21.15.69:0/2192625656 shutdown_connections 2023-12-14T14:20:19.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 -- 172.21.15.69:0/2192625656 wait complete. 2023-12-14T14:20:19.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 -- start start 2023-12-14T14:20:19.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 Processor -- start 2023-12-14T14:20:19.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499ae380 0x564b499c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b49a1e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b499c45b0 con 0x564b499b9b50 2023-12-14T14:20:19.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b49a1eb10 con 0x564b499ae380 2023-12-14T14:20:19.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b49a1ecd0 con 0x564b499aec90 2023-12-14T14:20:19.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f60acbcdb80 10 client.0 _ll_register_callbacks cb 0x7f609400b450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:19.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f609ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b49a1e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f609ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b49a1e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53436/0 (socket says 172.21.15.69:53436) 2023-12-14T14:20:19.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.130+0000 7f609ad9d700 1 -- 172.21.15.69:0/4221392004 learned_addr learned my addr 172.21.15.69:0/4221392004 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f6099d9b700 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f609a59c700 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499ae380 0x564b499c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f609ad9d700 1 -- 172.21.15.69:0/4221392004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 msgr2=0x564b499c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f609ad9d700 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f609ad9d700 1 -- 172.21.15.69:0/4221392004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499ae380 msgr2=0x564b499c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f609ad9d700 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499ae380 0x564b499c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f609ad9d700 1 -- 172.21.15.69:0/4221392004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b497823b0 con 0x564b499b9b50 2023-12-14T14:20:19.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f609ad9d700 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b49a1e5a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f609400b820 tx=0x7f609401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0fdf05a7b8f34f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f6081ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:19.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f6081ffb700 1 -- 172.21.15.69:0/4221392004 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400e040 con 0x564b499b9b50 2023-12-14T14:20:19.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f6081ffb700 1 -- 172.21.15.69:0/4221392004 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f6094007900 con 0x564b499b9b50 2023-12-14T14:20:19.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f60acbcdb80 1 -- 172.21.15.69:0/4221392004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6090015070 con 0x564b499b9b50 2023-12-14T14:20:19.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f6081ffb700 1 -- 172.21.15.69:0/4221392004 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6094034400 con 0x564b499b9b50 2023-12-14T14:20:19.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f60acbcdb80 10 client.16881 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:19.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f60acbcdb80 1 -- 172.21.15.69:0/4221392004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564b4972eb60 con 0x564b499b9b50 2023-12-14T14:20:19.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f6081ffb700 1 -- 172.21.15.69:0/4221392004 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6090015070 con 0x564b499b9b50 2023-12-14T14:20:19.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f6081ffb700 1 -- 172.21.15.69:0/4221392004 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6094032020 con 0x564b499b9b50 2023-12-14T14:20:19.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f60acbcdb80 10 client.16881 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:19.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f60acbcdb80 10 client.16881 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:20:19.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f60acbcdb80 20 client.16881 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:19.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564b499cb6f0 0x564b49a220c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f60acbcdb80 4 client.16881 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:20:19.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.131+0000 7f60acbcdb80 1 -- 172.21.15.69:0/4221392004 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564b498f9a00 con 0x564b499cb6f0 2023-12-14T14:20:19.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f609a59c700 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564b499cb6f0 0x564b49a220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f6081ffb700 10 client.16881 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:20:19.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f609a59c700 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564b499cb6f0 0x564b49a220c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b04e60731226d2a server_cookie=c86e0b04bf75dae1 in_seq=0 out_seq=0 2023-12-14T14:20:19.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f6081ffb700 1 -- 172.21.15.69:0/4221392004 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564b498f9a00 con 0x564b499cb6f0 2023-12-14T14:20:19.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f6081ffb700 10 client.16881 handle_command_reply: tid=0 2023-12-14T14:20:19.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 client.16881 shutdown 2023-12-14T14:20:19.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 -- 172.21.15.69:0/4221392004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 msgr2=0x564b49a1e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b49a1e5a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f609400b820 tx=0x7f609401ca70 comp rx=0 tx=0).stop 2023-12-14T14:20:19.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 -- 172.21.15.69:0/4221392004 shutdown_connections 2023-12-14T14:20:19.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x564b499cb6f0 0x564b49a220c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564b499b9b50 0x564b49a1e5a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b499ae380 0x564b499c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f6081ffb700 0 client.16881 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:20:19.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 --2- 172.21.15.69:0/4221392004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b499aec90 0x564b499c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 -- 172.21.15.69:0/4221392004 >> 172.21.15.69:0/4221392004 conn(0x564b499a4ca0 msgr2=0x564b499b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 -- 172.21.15.69:0/4221392004 shutdown_connections 2023-12-14T14:20:19.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.132+0000 7f60acbcdb80 1 -- 172.21.15.69:0/4221392004 wait complete. 2023-12-14T14:20:19.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60acbcdb80 20 client.16881 trim_cache size 0 max 16384 2023-12-14T14:20:19.144 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:20:19.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 -- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f60840a12c0 msgr2=0x7f60840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f60840a12c0 0x7f60840a3770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6090005950 tx=0x7f609000b410 comp rx=0 tx=0).stop 2023-12-14T14:20:19.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 -- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c0ffd50 msgr2=0x7f609c1959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c0ffd50 0x7f609c1959d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f608c00c8c0 tx=0x7f608c00cbd0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 -- 172.21.15.69:0/3818222869 shutdown_connections 2023-12-14T14:20:19.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f60840a12c0 0x7f60840a3770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f609c1043f0 0x7f609c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f609c0ff3b0 0x7f609c195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 --2- 172.21.15.69:0/3818222869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f609c0ffd50 0x7f609c1959d0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 -- 172.21.15.69:0/3818222869 >> 172.21.15.69:0/3818222869 conn(0x7f609c0763a0 msgr2=0x7f609c0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 -- 172.21.15.69:0/3818222869 shutdown_connections 2023-12-14T14:20:19.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.133+0000 7f60a0a3f700 1 -- 172.21.15.69:0/3818222869 wait complete. 2023-12-14T14:20:19.147 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:20:19.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 -- 172.21.15.69:0/3631660644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c0ffd90 msgr2=0x7f872c103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 --2- 172.21.15.69:0/3631660644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c0ffd90 0x7f872c103d50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f87180099c0 tx=0x7f8718009cd0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 -- 172.21.15.69:0/3631660644 shutdown_connections 2023-12-14T14:20:19.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 --2- 172.21.15.69:0/3631660644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872c104430 0x7f872c10c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 --2- 172.21.15.69:0/3631660644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ff3f0 0x7f872c0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 --2- 172.21.15.69:0/3631660644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c0ffd90 0x7f872c103d50 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 -- 172.21.15.69:0/3631660644 >> 172.21.15.69:0/3631660644 conn(0x7f872c075fd0 msgr2=0x7f872c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 -- 172.21.15.69:0/3631660644 shutdown_connections 2023-12-14T14:20:19.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 -- 172.21.15.69:0/3631660644 wait complete. 2023-12-14T14:20:19.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 Processor -- start 2023-12-14T14:20:19.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.272+0000 7f8732e73700 1 -- start start 2023-12-14T14:20:19.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8732e73700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872c0ff3f0 0x7f872c195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8732e73700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ffd90 0x7f872c195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8732e73700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c104430 0x7f872c199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8732e73700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c19a230 con 0x7f872c104430 2023-12-14T14:20:19.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8732e73700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c19a3a0 con 0x7f872c0ffd90 2023-12-14T14:20:19.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8732e73700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c19a560 con 0x7f872c0ff3f0 2023-12-14T14:20:19.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8731410700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c104430 0x7f872c199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8731410700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c104430 0x7f872c199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53448/0 (socket says 172.21.15.69:53448) 2023-12-14T14:20:19.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8731410700 1 -- 172.21.15.69:0/3749132567 learned_addr learned my addr 172.21.15.69:0/3749132567 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8730c0f700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872c0ff3f0 0x7f872c195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f872bfff700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ffd90 0x7f872c195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8731410700 1 -- 172.21.15.69:0/3749132567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872c0ff3f0 msgr2=0x7f872c195250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8731410700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872c0ff3f0 0x7f872c195250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8731410700 1 -- 172.21.15.69:0/3749132567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ffd90 msgr2=0x7f872c195790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8731410700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ffd90 0x7f872c195790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8731410700 1 -- 172.21.15.69:0/3749132567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180095f0 con 0x7f872c104430 2023-12-14T14:20:19.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f872bfff700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ffd90 0x7f872c195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:19.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8731410700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c104430 0x7f872c199bf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f872400ef30 tx=0x7f872400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8729ffb700 1 -- 172.21.15.69:0/3749132567 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724018070 con 0x7f872c104430 2023-12-14T14:20:19.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8732e73700 1 -- 172.21.15.69:0/3749132567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c10f1b0 con 0x7f872c104430 2023-12-14T14:20:19.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8729ffb700 1 -- 172.21.15.69:0/3749132567 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f872400f040 con 0x7f872c104430 2023-12-14T14:20:19.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.273+0000 7f8729ffb700 1 -- 172.21.15.69:0/3749132567 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400cdb0 con 0x7f872c104430 2023-12-14T14:20:19.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.274+0000 7f8732e73700 1 -- 172.21.15.69:0/3749132567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c10f020 con 0x7f872c104430 2023-12-14T14:20:19.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.275+0000 7f8729ffb700 1 -- 172.21.15.69:0/3749132567 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8724003a00 con 0x7f872c104430 2023-12-14T14:20:19.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.276+0000 7f8729ffb700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f871c0a12c0 0x7f871c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.276+0000 7f8729ffb700 1 -- 172.21.15.69:0/3749132567 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f87240cc8c0 con 0x7f872c104430 2023-12-14T14:20:19.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.276+0000 7f8730c0f700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f871c0a12c0 0x7f871c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.276+0000 7f8730c0f700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f871c0a12c0 0x7f871c0a3770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8720009c60 tx=0x7f8720009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f873f001b80 1 Processor -- start 2023-12-14T14:20:19.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f873f001b80 1 -- start start 2023-12-14T14:20:19.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f873f001b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 0x55c2898f1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f873f001b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898fec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f873f001b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898ff150 0x55c289901530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f873f001b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2897d95e0 con 0x55c2898f1ea0 2023-12-14T14:20:19.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f873f001b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c289848870 con 0x55c2898ff150 2023-12-14T14:20:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f873f001b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c289841d00 con 0x55c2898f1590 2023-12-14T14:20:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f872bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898fec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f872bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898fec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53450/0 (socket says 172.21.15.69:53450) 2023-12-14T14:20:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f872bfff700 1 -- 172.21.15.69:0/2890456049 learned_addr learned my addr 172.21.15.69:0/2890456049 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f8730c0f700 1 --2- 172.21.15.69:0/2890456049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 0x55c2898f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.277+0000 7f8731410700 1 --2- 172.21.15.69:0/2890456049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898ff150 0x55c289901530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.278+0000 7f872bfff700 1 -- 172.21.15.69:0/2890456049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 msgr2=0x55c2898f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.278+0000 7f872bfff700 1 --2- 172.21.15.69:0/2890456049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 0x55c2898f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.278+0000 7f872bfff700 1 -- 172.21.15.69:0/2890456049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898ff150 msgr2=0x55c289901530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.278+0000 7f872bfff700 1 --2- 172.21.15.69:0/2890456049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898ff150 0x55c289901530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.278+0000 7f872bfff700 1 -- 172.21.15.69:0/2890456049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2896c33b0 con 0x55c2898f1ea0 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.278+0000 7f872bfff700 1 --2- 172.21.15.69:0/2890456049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898fec10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8718000c00 tx=0x7f8718005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ff349ebfb4a441 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.278+0000 7f8716ffd700 1 -- 172.21.15.69:0/2890456049 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871801c040 con 0x55c2898f1ea0 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.278+0000 7f8716ffd700 1 -- 172.21.15.69:0/2890456049 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8718005020 con 0x55c2898f1ea0 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.278+0000 7f8716ffd700 1 -- 172.21.15.69:0/2890456049 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800b9f0 con 0x55c2898f1ea0 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 -- 172.21.15.69:0/2890456049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 msgr2=0x55c2898fec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 --2- 172.21.15.69:0/2890456049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898fec10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8718000c00 tx=0x7f8718005e80 comp rx=0 tx=0).stop 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 -- 172.21.15.69:0/2890456049 shutdown_connections 2023-12-14T14:20:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 --2- 172.21.15.69:0/2890456049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898ff150 0x55c289901530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 --2- 172.21.15.69:0/2890456049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 0x55c2898f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 --2- 172.21.15.69:0/2890456049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898fec10 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 -- 172.21.15.69:0/2890456049 >> 172.21.15.69:0/2890456049 conn(0x55c2898e5ca0 msgr2=0x55c2898eb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 -- 172.21.15.69:0/2890456049 shutdown_connections 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 -- 172.21.15.69:0/2890456049 wait complete. 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 -- start start 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 Processor -- start 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 0x55c2898ff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898ff150 0x55c2898fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2897ddf90 con 0x55c2898f1ea0 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2897ddc30 con 0x55c2898f1590 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.279+0000 7f873f001b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2896c56a0 con 0x55c2898ff150 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f873f001b80 10 client.0 _ll_register_callbacks cb 0x55c289801910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f872bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f8731410700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898ff150 0x55c2898fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f872bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898ffa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53454/0 (socket says 172.21.15.69:53454) 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f872bfff700 1 -- 172.21.15.69:0/2422283997 learned_addr learned my addr 172.21.15.69:0/2422283997 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f8730c0f700 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 0x55c2898ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f8731410700 1 -- 172.21.15.69:0/2422283997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 msgr2=0x55c2898ff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f8731410700 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 0x55c2898ff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f8731410700 1 -- 172.21.15.69:0/2422283997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 msgr2=0x55c2898ffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f8731410700 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898ffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f8731410700 1 -- 172.21.15.69:0/2422283997 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c10c840 con 0x55c2898ff150 2023-12-14T14:20:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f8731410700 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898ff150 0x55c2898fffa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f87240ca000 tx=0x7f8724099550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=534361c10c8160cb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f870bfff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T14:20:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f870bfff700 1 -- 172.21.15.69:0/2422283997 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724099a10 con 0x55c2898ff150 2023-12-14T14:20:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f870bfff700 1 -- 172.21.15.69:0/2422283997 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f872409da40 con 0x55c2898ff150 2023-12-14T14:20:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f873f001b80 1 -- 172.21.15.69:0/2422283997 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2898e32b0 con 0x55c2898ff150 2023-12-14T14:20:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f870bfff700 1 -- 172.21.15.69:0/2422283997 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87240a1dd0 con 0x55c2898ff150 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f873f001b80 10 client.26203 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.280+0000 7f873f001b80 1 -- 172.21.15.69:0/2422283997 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55c289808170 con 0x55c2898ff150 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f870bfff700 1 -- 172.21.15.69:0/2422283997 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c2898e32b0 con 0x55c2898ff150 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f870bfff700 1 -- 172.21.15.69:0/2422283997 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f87240b90c0 con 0x55c2898ff150 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f873f001b80 10 client.26203 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f873f001b80 10 client.26203 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f873f001b80 20 client.26203 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f873f001b80 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c28990e6b0 0x55c289910ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f873f001b80 4 client.26203 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f873f001b80 1 -- 172.21.15.69:0/2422283997 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c28983ace0 con 0x55c28990e6b0 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f8730c0f700 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c28990e6b0 0x55c289910ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f8730c0f700 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c28990e6b0 0x55c289910ac0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ede1dc3cd700a6c7 server_cookie=6421a00d26a099b6 in_seq=0 out_seq=0 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.281+0000 7f870bfff700 10 client.26203 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f870bfff700 1 -- 172.21.15.69:0/2422283997 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c28983ace0 con 0x55c28990e6b0 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f870bfff700 10 client.26203 handle_command_reply: tid=0 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f873f001b80 1 client.26203 shutdown 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f873f001b80 1 -- 172.21.15.69:0/2422283997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898ff150 msgr2=0x55c2898fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f873f001b80 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898ff150 0x55c2898fffa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f87240ca000 tx=0x7f8724099550 comp rx=0 tx=0).stop 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f873f001b80 1 -- 172.21.15.69:0/2422283997 shutdown_connections 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f873f001b80 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898ff150 0x55c2898fffa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f873f001b80 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 0x55c2898ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f873f001b80 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c28990e6b0 0x55c289910ac0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f873f001b80 1 --2- 172.21.15.69:0/2422283997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898f1ea0 0x55c2898ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f870bfff700 0 client.26203 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:20:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.282+0000 7f873f001b80 1 -- 172.21.15.69:0/2422283997 >> 172.21.15.69:0/2422283997 conn(0x55c2898e5ca0 msgr2=0x55c2898eb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.283+0000 7f873f001b80 1 -- 172.21.15.69:0/2422283997 shutdown_connections 2023-12-14T14:20:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.283+0000 7f873f001b80 1 -- 172.21.15.69:0/2422283997 wait complete. 2023-12-14T14:20:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.283+0000 7f873f001b80 20 client.26203 trim_cache size 0 max 16384 2023-12-14T14:20:19.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.295+0000 7f873f001b80 1 Processor -- start 2023-12-14T14:20:19.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.295+0000 7f873f001b80 1 -- start start 2023-12-14T14:20:19.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.295+0000 7f873f001b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 0x55c289904530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.295+0000 7f873f001b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1ea0 0x55c2898ea9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.295+0000 7f873f001b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c289909ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.295+0000 7f873f001b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2898eaf10 con 0x55c2898ff150 2023-12-14T14:20:19.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.295+0000 7f873f001b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2898f1960 con 0x55c2898f1590 2023-12-14T14:20:19.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f873f001b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2898fde70 con 0x55c2898f1ea0 2023-12-14T14:20:19.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8731410700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c289909ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8731410700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c289909ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53464/0 (socket says 172.21.15.69:53464) 2023-12-14T14:20:19.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8731410700 1 -- 172.21.15.69:0/2530440654 learned_addr learned my addr 172.21.15.69:0/2530440654 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8730c0f700 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 0x55c289904530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f872bfff700 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1ea0 0x55c2898ea9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8731410700 1 -- 172.21.15.69:0/2530440654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1ea0 msgr2=0x55c2898ea9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8731410700 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1ea0 0x55c2898ea9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8731410700 1 -- 172.21.15.69:0/2530440654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 msgr2=0x55c289904530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8731410700 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 0x55c289904530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8731410700 1 -- 172.21.15.69:0/2530440654 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2898ec580 con 0x55c2898ff150 2023-12-14T14:20:19.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f872bfff700 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1ea0 0x55c2898ea9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:19.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f8731410700 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c289909ce0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f8724098000 tx=0x7f87240092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb1a12f44d6548e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f87177fe700 1 -- 172.21.15.69:0/2530440654 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240a1940 con 0x55c2898ff150 2023-12-14T14:20:19.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f87177fe700 1 -- 172.21.15.69:0/2530440654 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f872409da40 con 0x55c2898ff150 2023-12-14T14:20:19.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.296+0000 7f87177fe700 1 -- 172.21.15.69:0/2530440654 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724098f00 con 0x55c2898ff150 2023-12-14T14:20:19.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 -- 172.21.15.69:0/2530440654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 msgr2=0x55c289909ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c289909ce0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f8724098000 tx=0x7f87240092e0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 -- 172.21.15.69:0/2530440654 shutdown_connections 2023-12-14T14:20:19.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c289909ce0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1590 0x55c289904530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 --2- 172.21.15.69:0/2530440654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1ea0 0x55c2898ea9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 -- 172.21.15.69:0/2530440654 >> 172.21.15.69:0/2530440654 conn(0x55c2898e5ca0 msgr2=0x55c289915420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 -- 172.21.15.69:0/2530440654 shutdown_connections 2023-12-14T14:20:19.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 -- 172.21.15.69:0/2530440654 wait complete. 2023-12-14T14:20:19.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 -- start start 2023-12-14T14:20:19.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.297+0000 7f873f001b80 1 Processor -- start 2023-12-14T14:20:19.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 0x55c289903fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1ea0 0x55c2899044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c2899023d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c289902aa0 con 0x55c2898ff150 2023-12-14T14:20:19.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c289902c10 con 0x55c2898f1ea0 2023-12-14T14:20:19.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c289902dd0 con 0x55c2898f1590 2023-12-14T14:20:19.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 10 client.0 _ll_register_callbacks cb 0x7f87240997e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:19.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8731410700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c2899023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8731410700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c2899023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53478/0 (socket says 172.21.15.69:53478) 2023-12-14T14:20:19.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8731410700 1 -- 172.21.15.69:0/177395216 learned_addr learned my addr 172.21.15.69:0/177395216 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f872bfff700 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1ea0 0x55c2899044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8730c0f700 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 0x55c289903fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8731410700 1 -- 172.21.15.69:0/177395216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 msgr2=0x55c289903fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8731410700 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 0x55c289903fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8731410700 1 -- 172.21.15.69:0/177395216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1ea0 msgr2=0x55c2899044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8731410700 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1ea0 0x55c2899044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8731410700 1 -- 172.21.15.69:0/177395216 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c289808170 con 0x55c2898ff150 2023-12-14T14:20:19.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f872bfff700 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1ea0 0x55c2899044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:19.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f8731410700 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c2899023d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8724009c10 tx=0x7f87240b93f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfcb8aba98e268d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f870bfff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f870bfff700 1 -- 172.21.15.69:0/177395216 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724099100 con 0x55c2898ff150 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f870bfff700 1 -- 172.21.15.69:0/177395216 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f8724099a10 con 0x55c2898ff150 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 1 -- 172.21.15.69:0/177395216 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8718005020 con 0x55c2898ff150 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f870bfff700 1 -- 172.21.15.69:0/177395216 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8724099550 con 0x55c2898ff150 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 10 client.16899 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.298+0000 7f873f001b80 1 -- 172.21.15.69:0/177395216 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55c28966fb60 con 0x55c2898ff150 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.299+0000 7f870bfff700 1 -- 172.21.15.69:0/177395216 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8718005020 con 0x55c2898ff150 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.299+0000 7f870bfff700 1 -- 172.21.15.69:0/177395216 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f87240c7020 con 0x55c2898ff150 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.299+0000 7f873f001b80 10 client.16899 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:19.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.299+0000 7f873f001b80 10 client.16899 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:20:19.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.299+0000 7f873f001b80 20 client.16899 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:19.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.299+0000 7f873f001b80 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c2899632f0 0x55c2899656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.299+0000 7f873f001b80 4 client.16899 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:20:19.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.299+0000 7f873f001b80 1 -- 172.21.15.69:0/177395216 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c28983aa00 con 0x55c2899632f0 2023-12-14T14:20:19.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.299+0000 7f8730c0f700 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c2899632f0 0x55c2899656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f870bfff700 10 client.16899 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:20:19.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f8730c0f700 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c2899632f0 0x55c2899656d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51a9da4f05d0e233 server_cookie=98ce9dcfe67d7669 in_seq=0 out_seq=0 2023-12-14T14:20:19.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f870bfff700 1 -- 172.21.15.69:0/177395216 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c28983aa00 con 0x55c2899632f0 2023-12-14T14:20:19.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f870bfff700 10 client.16899 handle_command_reply: tid=0 2023-12-14T14:20:19.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 client.16899 shutdown 2023-12-14T14:20:19.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 -- 172.21.15.69:0/177395216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 msgr2=0x55c2899023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c2899023d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8724009c10 tx=0x7f87240b93f0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 -- 172.21.15.69:0/177395216 shutdown_connections 2023-12-14T14:20:19.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x55c2899632f0 0x55c2899656d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2898ff150 0x55c2899023d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f870bfff700 0 client.16899 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:20:19.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2898f1590 0x55c289903fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 --2- 172.21.15.69:0/177395216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2898f1ea0 0x55c2899044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 -- 172.21.15.69:0/177395216 >> 172.21.15.69:0/177395216 conn(0x55c2898e5ca0 msgr2=0x55c2898eb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 -- 172.21.15.69:0/177395216 shutdown_connections 2023-12-14T14:20:19.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 1 -- 172.21.15.69:0/177395216 wait complete. 2023-12-14T14:20:19.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.300+0000 7f873f001b80 20 client.16899 trim_cache size 0 max 16384 2023-12-14T14:20:19.309 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:20:19.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 -- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f871c0a12c0 msgr2=0x7f871c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f871c0a12c0 0x7f871c0a3770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8720009c60 tx=0x7f8720009260 comp rx=0 tx=0).stop 2023-12-14T14:20:19.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 -- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c104430 msgr2=0x7f872c199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c104430 0x7f872c199bf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f872400ef30 tx=0x7f872400c3a0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 -- 172.21.15.69:0/3749132567 shutdown_connections 2023-12-14T14:20:19.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f871c0a12c0 0x7f871c0a3770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f872c104430 0x7f872c199bf0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872c0ff3f0 0x7f872c195250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 --2- 172.21.15.69:0/3749132567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ffd90 0x7f872c195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 -- 172.21.15.69:0/3749132567 >> 172.21.15.69:0/3749132567 conn(0x7f872c075fd0 msgr2=0x7f872c0fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 -- 172.21.15.69:0/3749132567 shutdown_connections 2023-12-14T14:20:19.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.301+0000 7f8732e73700 1 -- 172.21.15.69:0/3749132567 wait complete. 2023-12-14T14:20:19.312 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:20:19.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 -- 172.21.15.69:0/384412142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 msgr2=0x7f14b010a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 --2- 172.21.15.69:0/384412142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 0x7f14b010a7b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009990 tx=0x7f14a0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 -- 172.21.15.69:0/384412142 shutdown_connections 2023-12-14T14:20:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 --2- 172.21.15.69:0/384412142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b010acf0 0x7f14b010d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 --2- 172.21.15.69:0/384412142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b00ff430 0x7f14b00ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 --2- 172.21.15.69:0/384412142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 0x7f14b010a7b0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 -- 172.21.15.69:0/384412142 >> 172.21.15.69:0/384412142 conn(0x7f14b00749c0 msgr2=0x7f14b0074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 -- 172.21.15.69:0/384412142 shutdown_connections 2023-12-14T14:20:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 -- 172.21.15.69:0/384412142 wait complete. 2023-12-14T14:20:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 Processor -- start 2023-12-14T14:20:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.438+0000 7f14b82eb700 1 -- start start 2023-12-14T14:20:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b82eb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b00ff430 0x7f14b01962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b82eb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 0x7f14b0196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b82eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b010acf0 0x7f14b019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b82eb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b019b2d0 con 0x7f14b00ffd40 2023-12-14T14:20:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b82eb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b019b440 con 0x7f14b010acf0 2023-12-14T14:20:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b82eb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b019b600 con 0x7f14b00ff430 2023-12-14T14:20:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b5886700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 0x7f14b0196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b5886700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 0x7f14b0196830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53498/0 (socket says 172.21.15.69:53498) 2023-12-14T14:20:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b5886700 1 -- 172.21.15.69:0/3140250714 learned_addr learned my addr 172.21.15.69:0/3140250714 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b6888700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b010acf0 0x7f14b019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b6087700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b00ff430 0x7f14b01962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b5886700 1 -- 172.21.15.69:0/3140250714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b00ff430 msgr2=0x7f14b01962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b5886700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b00ff430 0x7f14b01962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b5886700 1 -- 172.21.15.69:0/3140250714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b010acf0 msgr2=0x7f14b019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b5886700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b010acf0 0x7f14b019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b5886700 1 -- 172.21.15.69:0/3140250714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00095f0 con 0x7f14b00ffd40 2023-12-14T14:20:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b6888700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b010acf0 0x7f14b019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b5886700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 0x7f14b0196830 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f14a0000c00 tx=0x7f14a000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14a77fe700 1 -- 172.21.15.69:0/3140250714 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a001d070 con 0x7f14b00ffd40 2023-12-14T14:20:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14a77fe700 1 -- 172.21.15.69:0/3140250714 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14a000fc20 con 0x7f14b00ffd40 2023-12-14T14:20:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b82eb700 1 -- 172.21.15.69:0/3140250714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b0110300 con 0x7f14b00ffd40 2023-12-14T14:20:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14a77fe700 1 -- 172.21.15.69:0/3140250714 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0017650 con 0x7f14b00ffd40 2023-12-14T14:20:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.439+0000 7f14b82eb700 1 -- 172.21.15.69:0/3140250714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b0110170 con 0x7f14b00ffd40 2023-12-14T14:20:19.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.441+0000 7f14a77fe700 1 -- 172.21.15.69:0/3140250714 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f14a0021410 con 0x7f14b00ffd40 2023-12-14T14:20:19.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.442+0000 7f14a77fe700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f149c0a1340 0x7f149c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.442+0000 7f14b6087700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f149c0a1340 0x7f149c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.442+0000 7f14a77fe700 1 -- 172.21.15.69:0/3140250714 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f14a00ce1f0 con 0x7f14b00ffd40 2023-12-14T14:20:19.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14b6087700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f149c0a1340 0x7f149c0a37f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005950 tx=0x7f14ac0058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14c4479b80 1 Processor -- start 2023-12-14T14:20:19.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14c4479b80 1 -- start start 2023-12-14T14:20:19.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62380 0x559f10c62750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c6d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c6db50 0x559f10c6ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14c4479b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10b4c5e0 con 0x559f10c62380 2023-12-14T14:20:19.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14c4479b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10bbb870 con 0x559f10c6db50 2023-12-14T14:20:19.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14c4479b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10bb4d00 con 0x559f10c62c90 2023-12-14T14:20:19.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.443+0000 7f14b6087700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62380 0x559f10c62750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6087700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62380 0x559f10c62750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53502/0 (socket says 172.21.15.69:53502) 2023-12-14T14:20:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6087700 1 -- 172.21.15.69:0/4037987183 learned_addr learned my addr 172.21.15.69:0/4037987183 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b5886700 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c6d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6888700 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c6db50 0x559f10c6ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6087700 1 -- 172.21.15.69:0/4037987183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 msgr2=0x559f10c6d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6087700 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c6d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6087700 1 -- 172.21.15.69:0/4037987183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c6db50 msgr2=0x559f10c6ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6087700 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c6db50 0x559f10c6ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6087700 1 -- 172.21.15.69:0/4037987183 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f10a363b0 con 0x559f10c62380 2023-12-14T14:20:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6888700 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c6db50 0x559f10c6ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14b6087700 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62380 0x559f10c62750 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00fd70 tx=0x7f14ac012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37deb45e9cad3b6c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14a4dac700 1 -- 172.21.15.69:0/4037987183 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac011bb0 con 0x559f10c62380 2023-12-14T14:20:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14a4dac700 1 -- 172.21.15.69:0/4037987183 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14ac011d10 con 0x559f10c62380 2023-12-14T14:20:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.444+0000 7f14a4dac700 1 -- 172.21.15.69:0/4037987183 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac01d610 con 0x559f10c62380 2023-12-14T14:20:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 -- 172.21.15.69:0/4037987183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62380 msgr2=0x559f10c62750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62380 0x559f10c62750 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00fd70 tx=0x7f14ac012000 comp rx=0 tx=0).stop 2023-12-14T14:20:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 -- 172.21.15.69:0/4037987183 shutdown_connections 2023-12-14T14:20:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c6db50 0x559f10c6ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62380 0x559f10c62750 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 --2- 172.21.15.69:0/4037987183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c6d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 -- 172.21.15.69:0/4037987183 >> 172.21.15.69:0/4037987183 conn(0x559f10c58ca0 msgr2=0x559f10c5e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 -- 172.21.15.69:0/4037987183 shutdown_connections 2023-12-14T14:20:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 -- 172.21.15.69:0/4037987183 wait complete. 2023-12-14T14:20:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 -- start start 2023-12-14T14:20:19.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.445+0000 7f14c4479b80 1 Processor -- start 2023-12-14T14:20:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c6d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62c90 0x559f10c6a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c6db50 0x559f10c6ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10b50f90 con 0x559f10c62c90 2023-12-14T14:20:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10b50c30 con 0x559f10c62380 2023-12-14T14:20:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10a386a0 con 0x559f10c6db50 2023-12-14T14:20:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 10 client.0 _ll_register_callbacks cb 0x559f10b74910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:19.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b5886700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62c90 0x559f10c6a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b5886700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62c90 0x559f10c6a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53518/0 (socket says 172.21.15.69:53518) 2023-12-14T14:20:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b5886700 1 -- 172.21.15.69:0/3733858942 learned_addr learned my addr 172.21.15.69:0/3733858942 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b6888700 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c6db50 0x559f10c6ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b6087700 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c6d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b5886700 1 -- 172.21.15.69:0/3733858942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c6db50 msgr2=0x559f10c6ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b5886700 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c6db50 0x559f10c6ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b5886700 1 -- 172.21.15.69:0/3733858942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 msgr2=0x559f10c6d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b5886700 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c6d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b5886700 1 -- 172.21.15.69:0/3733858942 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac00fa20 con 0x559f10c62c90 2023-12-14T14:20:19.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b6888700 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c6db50 0x559f10c6ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:19.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14b5886700 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62c90 0x559f10c6a7b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f14a009b2d0 tx=0x7f14a0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6544665148a61f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f1499ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:19.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f1499ffb700 1 -- 172.21.15.69:0/3733858942 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a009f370 con 0x559f10c62c90 2023-12-14T14:20:19.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f1499ffb700 1 -- 172.21.15.69:0/3733858942 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f14a00a3700 con 0x559f10c62c90 2023-12-14T14:20:19.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 1 -- 172.21.15.69:0/3733858942 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f10c562b0 con 0x559f10c62c90 2023-12-14T14:20:19.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f1499ffb700 1 -- 172.21.15.69:0/3733858942 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14a009a830 con 0x559f10c62c90 2023-12-14T14:20:19.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 10 client.16911 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:19.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.446+0000 7f14c4479b80 1 -- 172.21.15.69:0/3733858942 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x559f10b7b170 con 0x559f10c62c90 2023-12-14T14:20:19.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.447+0000 7f1499ffb700 1 -- 172.21.15.69:0/3733858942 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559f10c562b0 con 0x559f10c62c90 2023-12-14T14:20:19.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.447+0000 7f1499ffb700 1 -- 172.21.15.69:0/3733858942 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f14a00216c0 con 0x559f10c62c90 2023-12-14T14:20:19.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.447+0000 7f14c4479b80 10 client.16911 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:19.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.447+0000 7f14c4479b80 10 client.16911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:19.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.447+0000 7f14c4479b80 20 client.16911 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:19.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.447+0000 7f14c4479b80 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559f10c7d020 0x559f10c7f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.447+0000 7f14c4479b80 4 client.16911 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:19.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.447+0000 7f14c4479b80 1 -- 172.21.15.69:0/3733858942 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f10badce0 con 0x559f10c7d020 2023-12-14T14:20:19.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.447+0000 7f14b6087700 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559f10c7d020 0x559f10c7f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f1499ffb700 10 client.16911 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:19.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14b6087700 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559f10c7d020 0x559f10c7f430 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6772c210207bfafb server_cookie=eb70f913de20ff6c in_seq=0 out_seq=0 2023-12-14T14:20:19.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f1499ffb700 1 -- 172.21.15.69:0/3733858942 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559f10badce0 con 0x559f10c7d020 2023-12-14T14:20:19.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f1499ffb700 10 client.16911 handle_command_reply: tid=0 2023-12-14T14:20:19.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14c4479b80 1 client.16911 shutdown 2023-12-14T14:20:19.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14c4479b80 1 -- 172.21.15.69:0/3733858942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62c90 msgr2=0x559f10c6a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14c4479b80 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62c90 0x559f10c6a7b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f14a009b2d0 tx=0x7f14a0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14c4479b80 1 -- 172.21.15.69:0/3733858942 shutdown_connections 2023-12-14T14:20:19.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14c4479b80 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559f10c7d020 0x559f10c7f430 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14c4479b80 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c6db50 0x559f10c6ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f1499ffb700 0 client.16911 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:19.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14c4479b80 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c6d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14c4479b80 1 --2- 172.21.15.69:0/3733858942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c62c90 0x559f10c6a7b0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.448+0000 7f14c4479b80 1 -- 172.21.15.69:0/3733858942 >> 172.21.15.69:0/3733858942 conn(0x559f10c58ca0 msgr2=0x559f10c5e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.449+0000 7f14c4479b80 1 -- 172.21.15.69:0/3733858942 shutdown_connections 2023-12-14T14:20:19.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.449+0000 7f14c4479b80 1 -- 172.21.15.69:0/3733858942 wait complete. 2023-12-14T14:20:19.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.449+0000 7f14c4479b80 20 client.16911 trim_cache size 0 max 16384 2023-12-14T14:20:19.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.461+0000 7f14c4479b80 1 Processor -- start 2023-12-14T14:20:19.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.461+0000 7f14c4479b80 1 -- start start 2023-12-14T14:20:19.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.461+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c6cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.461+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c6d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c65ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14c4479b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10c635e0 con 0x559f10c58ca0 2023-12-14T14:20:19.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14c4479b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10c68d10 con 0x559f10c62380 2023-12-14T14:20:19.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14c4479b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10c66600 con 0x559f10c62c90 2023-12-14T14:20:19.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6087700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c6cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6087700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c6cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53520/0 (socket says 172.21.15.69:53520) 2023-12-14T14:20:19.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6087700 1 -- 172.21.15.69:0/1361289719 learned_addr learned my addr 172.21.15.69:0/1361289719 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6888700 1 --2- 172.21.15.69:0/1361289719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c65ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6087700 1 -- 172.21.15.69:0/1361289719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 msgr2=0x559f10c65ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6087700 1 --2- 172.21.15.69:0/1361289719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c65ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6087700 1 -- 172.21.15.69:0/1361289719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 msgr2=0x559f10c6d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6087700 1 --2- 172.21.15.69:0/1361289719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c6d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6087700 1 -- 172.21.15.69:0/1361289719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f10b7aec0 con 0x559f10c58ca0 2023-12-14T14:20:19.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6888700 1 --2- 172.21.15.69:0/1361289719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c65ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:19.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14b6087700 1 --2- 172.21.15.69:0/1361289719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c6cfc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00fd70 tx=0x7f14ac011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740104170d64b2e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14a55ad700 1 -- 172.21.15.69:0/1361289719 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac005ee0 con 0x559f10c58ca0 2023-12-14T14:20:19.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14a55ad700 1 -- 172.21.15.69:0/1361289719 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14ac02e040 con 0x559f10c58ca0 2023-12-14T14:20:19.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.462+0000 7f14a55ad700 1 -- 172.21.15.69:0/1361289719 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0053c0 con 0x559f10c58ca0 2023-12-14T14:20:19.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 -- 172.21.15.69:0/1361289719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 msgr2=0x559f10c6cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 --2- 172.21.15.69:0/1361289719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c6cfc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00fd70 tx=0x7f14ac011f60 comp rx=0 tx=0).stop 2023-12-14T14:20:19.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 -- 172.21.15.69:0/1361289719 shutdown_connections 2023-12-14T14:20:19.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 --2- 172.21.15.69:0/1361289719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c65ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 --2- 172.21.15.69:0/1361289719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c6cfc0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 --2- 172.21.15.69:0/1361289719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c6d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 -- 172.21.15.69:0/1361289719 >> 172.21.15.69:0/1361289719 conn(0x559f10c70200 msgr2=0x559f10c79860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 -- 172.21.15.69:0/1361289719 shutdown_connections 2023-12-14T14:20:19.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 -- 172.21.15.69:0/1361289719 wait complete. 2023-12-14T14:20:19.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 -- start start 2023-12-14T14:20:19.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 Processor -- start 2023-12-14T14:20:19.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c72c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10c74cb0 con 0x559f10c58ca0 2023-12-14T14:20:19.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10c73150 con 0x559f10c62380 2023-12-14T14:20:19.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f10c732c0 con 0x559f10c62c90 2023-12-14T14:20:19.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14c4479b80 10 client.0 _ll_register_callbacks cb 0x7f14a009b1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:19.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.463+0000 7f14b6087700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b6087700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c743a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53524/0 (socket says 172.21.15.69:53524) 2023-12-14T14:20:19.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b6087700 1 -- 172.21.15.69:0/2463822453 learned_addr learned my addr 172.21.15.69:0/2463822453 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:19.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b6888700 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c72c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b5886700 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b6087700 1 -- 172.21.15.69:0/2463822453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 msgr2=0x559f10c72c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b6087700 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c72c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b6087700 1 -- 172.21.15.69:0/2463822453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 msgr2=0x559f10c726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:19.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b6087700 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b6087700 1 -- 172.21.15.69:0/2463822453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f10a363b0 con 0x559f10c58ca0 2023-12-14T14:20:19.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b5886700 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:19.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14b6087700 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c743a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f14ac011ce0 tx=0x7f14ac005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa485a1d5f0af7e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:19.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f1499ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:19.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f1499ffb700 1 -- 172.21.15.69:0/2463822453 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0335c0 con 0x559f10c58ca0 2023-12-14T14:20:19.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14c4479b80 1 -- 172.21.15.69:0/2463822453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14ac011d10 con 0x559f10c58ca0 2023-12-14T14:20:19.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f1499ffb700 1 -- 172.21.15.69:0/2463822453 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f14ac033960 con 0x559f10c58ca0 2023-12-14T14:20:19.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f1499ffb700 1 -- 172.21.15.69:0/2463822453 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14ac033b20 con 0x559f10c58ca0 2023-12-14T14:20:19.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14c4479b80 10 client.16917 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:19.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f14c4479b80 1 -- 172.21.15.69:0/2463822453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x559f10b619a0 con 0x559f10c58ca0 2023-12-14T14:20:19.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.464+0000 7f1499ffb700 1 -- 172.21.15.69:0/2463822453 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14ac011d10 con 0x559f10c58ca0 2023-12-14T14:20:19.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f1499ffb700 1 -- 172.21.15.69:0/2463822453 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f14ac027450 con 0x559f10c58ca0 2023-12-14T14:20:19.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f14c4479b80 10 client.16917 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:19.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f14c4479b80 10 client.16917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:19.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f14c4479b80 20 client.16917 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:19.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f14c4479b80 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559f10c6db50 0x559f10cd3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:19.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f14c4479b80 4 client.16917 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:20:19.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f14c4479b80 1 -- 172.21.15.69:0/2463822453 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559f10bada00 con 0x559f10c6db50 2023-12-14T14:20:19.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f14b5886700 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559f10c6db50 0x559f10cd3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:19.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f14b5886700 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559f10c6db50 0x559f10cd3dd0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1382047cabe15726 server_cookie=cd415cdec76e16d8 in_seq=0 out_seq=0 2023-12-14T14:20:19.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f1499ffb700 10 client.16917 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:19.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f1499ffb700 1 -- 172.21.15.69:0/2463822453 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559f10bada00 con 0x559f10c6db50 2023-12-14T14:20:19.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f1499ffb700 10 client.16917 handle_command_reply: tid=0 2023-12-14T14:20:19.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.465+0000 7f14c4479b80 1 client.16917 shutdown 2023-12-14T14:20:19.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 -- 172.21.15.69:0/2463822453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 msgr2=0x559f10c743a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c743a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f14ac011ce0 tx=0x7f14ac005ee0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 -- 172.21.15.69:0/2463822453 shutdown_connections 2023-12-14T14:20:19.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x559f10c6db50 0x559f10cd3dd0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f10c62c90 0x559f10c72c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f10c58ca0 0x559f10c743a0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 --2- 172.21.15.69:0/2463822453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f10c62380 0x559f10c726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f1499ffb700 0 client.16917 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:19.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 -- 172.21.15.69:0/2463822453 >> 172.21.15.69:0/2463822453 conn(0x559f10c70200 msgr2=0x559f10c65ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 -- 172.21.15.69:0/2463822453 shutdown_connections 2023-12-14T14:20:19.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 1 -- 172.21.15.69:0/2463822453 wait complete. 2023-12-14T14:20:19.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14c4479b80 20 client.16917 trim_cache size 0 max 16384 2023-12-14T14:20:19.479 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:20:19.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 -- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f149c0a1340 msgr2=0x7f149c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f149c0a1340 0x7f149c0a37f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005950 tx=0x7f14ac0058e0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 -- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 msgr2=0x7f14b0196830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:19.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 0x7f14b0196830 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f14a0000c00 tx=0x7f14a000f510 comp rx=0 tx=0).stop 2023-12-14T14:20:19.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 -- 172.21.15.69:0/3140250714 shutdown_connections 2023-12-14T14:20:19.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f149c0a1340 0x7f149c0a37f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b010acf0 0x7f14b019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b00ff430 0x7f14b01962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 --2- 172.21.15.69:0/3140250714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b00ffd40 0x7f14b0196830 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:19.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 -- 172.21.15.69:0/3140250714 >> 172.21.15.69:0/3140250714 conn(0x7f14b00749c0 msgr2=0x7f14b00fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:19.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 -- 172.21.15.69:0/3140250714 shutdown_connections 2023-12-14T14:20:19.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:19.466+0000 7f14b82eb700 1 -- 172.21.15.69:0/3140250714 wait complete. 2023-12-14T14:20:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:19 smithi069 ceph-mon[42034]: pgmap v300: 97 pgs: 5 active+clean+snaptrim_wait, 89 active+clean, 3 active+clean+snaptrim; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:19.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:19 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/457405479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:20:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:19 smithi081 ceph-mon[43371]: pgmap v300: 97 pgs: 5 active+clean+snaptrim_wait, 89 active+clean, 3 active+clean+snaptrim; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:19 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/457405479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:20:20.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:19 smithi119 ceph-mon[43834]: pgmap v300: 97 pgs: 5 active+clean+snaptrim_wait, 89 active+clean, 3 active+clean+snaptrim; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:20.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:19 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/457405479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:20:20.483 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T14:20:20.484 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T14:20:20.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.625+0000 7f89b5516700 1 -- 172.21.15.69:0/2741620342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 msgr2=0x7f89b010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.625+0000 7f89b5516700 1 --2- 172.21.15.69:0/2741620342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 0x7f89b010d0a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f89a800b0a0 tx=0x7f89a800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.625+0000 7f89b5516700 1 -- 172.21.15.69:0/2741620342 shutdown_connections 2023-12-14T14:20:20.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.625+0000 7f89b5516700 1 --2- 172.21.15.69:0/2741620342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 0x7f89b010d0a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.625+0000 7f89b5516700 1 --2- 172.21.15.69:0/2741620342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b00ff400 0x7f89b00ff7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.625+0000 7f89b5516700 1 --2- 172.21.15.69:0/2741620342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89b00ffd10 0x7f89b010a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.625+0000 7f89b5516700 1 -- 172.21.15.69:0/2741620342 >> 172.21.15.69:0/2741620342 conn(0x7f89b00749f0 msgr2=0x7f89b0074df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.625+0000 7f89b5516700 1 -- 172.21.15.69:0/2741620342 shutdown_connections 2023-12-14T14:20:20.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.625+0000 7f89b5516700 1 -- 172.21.15.69:0/2741620342 wait complete. 2023-12-14T14:20:20.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.626+0000 7f89b5516700 1 Processor -- start 2023-12-14T14:20:20.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.626+0000 7f89b5516700 1 -- start start 2023-12-14T14:20:20.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.626+0000 7f89b5516700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89b00ff400 0x7f89b0196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.626+0000 7f89b5516700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b00ffd10 0x7f89b01969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.626+0000 7f89b5516700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 0x7f89b019adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.626+0000 7f89b5516700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b019b3f0 con 0x7f89b010acc0 2023-12-14T14:20:20.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.626+0000 7f89b5516700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b019b560 con 0x7f89b00ffd10 2023-12-14T14:20:20.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.626+0000 7f89b5516700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b019b720 con 0x7f89b00ff400 2023-12-14T14:20:20.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 0x7f89b019adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 0x7f89b019adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53538/0 (socket says 172.21.15.69:53538) 2023-12-14T14:20:20.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89af7fe700 1 -- 172.21.15.69:0/1393369032 learned_addr learned my addr 172.21.15.69:0/1393369032 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89aeffd700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89b00ff400 0x7f89b0196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b00ffd10 0x7f89b01969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89af7fe700 1 -- 172.21.15.69:0/1393369032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89b00ff400 msgr2=0x7f89b0196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89af7fe700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89b00ff400 0x7f89b0196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89af7fe700 1 -- 172.21.15.69:0/1393369032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b00ffd10 msgr2=0x7f89b01969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89af7fe700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b00ffd10 0x7f89b01969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89af7fe700 1 -- 172.21.15.69:0/1393369032 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8009d00 con 0x7f89b010acc0 2023-12-14T14:20:20.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89af7fe700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 0x7f89b019adb0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f89a80062a0 tx=0x7f89a80079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f8997fff700 1 -- 172.21.15.69:0/1393369032 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a800e040 con 0x7f89b010acc0 2023-12-14T14:20:20.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89b5516700 1 -- 172.21.15.69:0/1393369032 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b0110320 con 0x7f89b010acc0 2023-12-14T14:20:20.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f8997fff700 1 -- 172.21.15.69:0/1393369032 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89a8004ce0 con 0x7f89b010acc0 2023-12-14T14:20:20.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f8997fff700 1 -- 172.21.15.69:0/1393369032 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a801d480 con 0x7f89b010acc0 2023-12-14T14:20:20.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.627+0000 7f89b5516700 1 -- 172.21.15.69:0/1393369032 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b0110190 con 0x7f89b010acc0 2023-12-14T14:20:20.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.629+0000 7f8997fff700 1 -- 172.21.15.69:0/1393369032 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f89a8004020 con 0x7f89b010acc0 2023-12-14T14:20:20.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.630+0000 7f8997fff700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89980a12c0 0x7f89980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.630+0000 7f8997fff700 1 -- 172.21.15.69:0/1393369032 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f89a80ce330 con 0x7f89b010acc0 2023-12-14T14:20:20.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.630+0000 7f89aeffd700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89980a12c0 0x7f89980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.630+0000 7f89aeffd700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89980a12c0 0x7f89980a3770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f89a0005950 tx=0x7f89a000b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89c16a4b80 1 Processor -- start 2023-12-14T14:20:20.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89c16a4b80 1 -- start start 2023-12-14T14:20:20.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 0x55c07a9f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1d10 0x55c07aa00aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07aa00fe0 0x55c07aa033c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a8db660 con 0x55c07aa00fe0 2023-12-14T14:20:20.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a94a8f0 con 0x55c07a9f1d10 2023-12-14T14:20:20.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a943d80 con 0x55c07a9f1400 2023-12-14T14:20:20.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07aa00fe0 0x55c07aa033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07aa00fe0 0x55c07aa033c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53554/0 (socket says 172.21.15.69:53554) 2023-12-14T14:20:20.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89af7fe700 1 -- 172.21.15.69:0/903279945 learned_addr learned my addr 172.21.15.69:0/903279945 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89aeffd700 1 --2- 172.21.15.69:0/903279945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 0x55c07a9f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/903279945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1d10 0x55c07aa00aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89af7fe700 1 -- 172.21.15.69:0/903279945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 msgr2=0x55c07a9f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89af7fe700 1 --2- 172.21.15.69:0/903279945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 0x55c07a9f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89af7fe700 1 -- 172.21.15.69:0/903279945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1d10 msgr2=0x55c07aa00aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89af7fe700 1 --2- 172.21.15.69:0/903279945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1d10 0x55c07aa00aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89af7fe700 1 -- 172.21.15.69:0/903279945 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c07a7c5430 con 0x55c07aa00fe0 2023-12-14T14:20:20.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.631+0000 7f89af7fe700 1 --2- 172.21.15.69:0/903279945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07aa00fe0 0x55c07aa033c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f89a80cc070 tx=0x7f89a80977c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d152213a08c1aff7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89957fa700 1 -- 172.21.15.69:0/903279945 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a809ade0 con 0x55c07aa00fe0 2023-12-14T14:20:20.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89957fa700 1 -- 172.21.15.69:0/903279945 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89a80b1070 con 0x55c07aa00fe0 2023-12-14T14:20:20.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89957fa700 1 -- 172.21.15.69:0/903279945 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a809f120 con 0x55c07aa00fe0 2023-12-14T14:20:20.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89c16a4b80 1 -- 172.21.15.69:0/903279945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07aa00fe0 msgr2=0x55c07aa033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/903279945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07aa00fe0 0x55c07aa033c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f89a80cc070 tx=0x7f89a80977c0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89c16a4b80 1 -- 172.21.15.69:0/903279945 shutdown_connections 2023-12-14T14:20:20.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/903279945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07aa00fe0 0x55c07aa033c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/903279945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 0x55c07a9f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/903279945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1d10 0x55c07aa00aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89c16a4b80 1 -- 172.21.15.69:0/903279945 >> 172.21.15.69:0/903279945 conn(0x55c07a9e7d20 msgr2=0x55c07a9ed860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89c16a4b80 1 -- 172.21.15.69:0/903279945 shutdown_connections 2023-12-14T14:20:20.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.632+0000 7f89c16a4b80 1 -- 172.21.15.69:0/903279945 wait complete. 2023-12-14T14:20:20.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89c16a4b80 1 -- start start 2023-12-14T14:20:20.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89c16a4b80 1 Processor -- start 2023-12-14T14:20:20.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1400 0x55c07aa00a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07a9fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07aa00fe0 0x55c07a9fe430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a8e0010 con 0x55c07a9f1d10 2023-12-14T14:20:20.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a8dfcb0 con 0x55c07a9f1400 2023-12-14T14:20:20.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a7c7720 con 0x55c07aa00fe0 2023-12-14T14:20:20.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89c16a4b80 10 client.0 _ll_register_callbacks cb 0x55c07a903990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:20.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89ae7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07a9fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89ae7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07a9fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53562/0 (socket says 172.21.15.69:53562) 2023-12-14T14:20:20.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89ae7fc700 1 -- 172.21.15.69:0/2878497746 learned_addr learned my addr 172.21.15.69:0/2878497746 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89aeffd700 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1400 0x55c07aa00a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89af7fe700 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07aa00fe0 0x55c07a9fe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89ae7fc700 1 -- 172.21.15.69:0/2878497746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07aa00fe0 msgr2=0x55c07a9fe430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07aa00fe0 0x55c07a9fe430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89ae7fc700 1 -- 172.21.15.69:0/2878497746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1400 msgr2=0x55c07aa00a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1400 0x55c07aa00a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89ae7fc700 1 -- 172.21.15.69:0/2878497746 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b0110190 con 0x55c07a9f1d10 2023-12-14T14:20:20.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07a9fdcf0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f89a400b8b0 tx=0x7f89a400bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9a3aea2ebb79c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.633+0000 7f8992ff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:20.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f8992ff5700 1 -- 172.21.15.69:0/2878497746 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4003d10 con 0x55c07a9f1d10 2023-12-14T14:20:20.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f8992ff5700 1 -- 172.21.15.69:0/2878497746 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f89a401b440 con 0x55c07a9f1d10 2023-12-14T14:20:20.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89c16a4b80 1 -- 172.21.15.69:0/2878497746 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c07a9e5330 con 0x55c07a9f1d10 2023-12-14T14:20:20.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f8992ff5700 1 -- 172.21.15.69:0/2878497746 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89a4003e70 con 0x55c07a9f1d10 2023-12-14T14:20:20.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89c16a4b80 10 client.16929 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:20.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89c16a4b80 1 -- 172.21.15.69:0/2878497746 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55c07a90a1f0 con 0x55c07a9f1d10 2023-12-14T14:20:20.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f8992ff5700 1 -- 172.21.15.69:0/2878497746 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c07a9e5330 con 0x55c07a9f1d10 2023-12-14T14:20:20.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f8992ff5700 1 -- 172.21.15.69:0/2878497746 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f89a40117a0 con 0x55c07a9f1d10 2023-12-14T14:20:20.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89c16a4b80 10 client.16929 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:20.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89c16a4b80 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:20.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89c16a4b80 20 client.16929 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:20.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c07aa10810 0x55c07aa12c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89c16a4b80 4 client.16929 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:20.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89c16a4b80 1 -- 172.21.15.69:0/2878497746 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c07a93cd60 con 0x55c07aa10810 2023-12-14T14:20:20.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.634+0000 7f89aeffd700 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c07aa10810 0x55c07aa12c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.635+0000 7f8992ff5700 10 client.16929 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.635+0000 7f89aeffd700 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c07aa10810 0x55c07aa12c20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82de666422b116b0 server_cookie=3888a52044001a2f in_seq=0 out_seq=0 2023-12-14T14:20:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.635+0000 7f8992ff5700 1 -- 172.21.15.69:0/2878497746 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c07a93cd60 con 0x55c07aa10810 2023-12-14T14:20:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.635+0000 7f8992ff5700 10 client.16929 handle_command_reply: tid=0 2023-12-14T14:20:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.635+0000 7f89c16a4b80 1 client.16929 shutdown 2023-12-14T14:20:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 -- 172.21.15.69:0/2878497746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 msgr2=0x55c07a9fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07a9fdcf0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f89a400b8b0 tx=0x7f89a400bbc0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 -- 172.21.15.69:0/2878497746 shutdown_connections 2023-12-14T14:20:20.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c07aa10810 0x55c07aa12c20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07aa00fe0 0x55c07a9fe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07a9f1400 0x55c07aa00a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/2878497746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07a9fdcf0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f8992ff5700 0 client.16929 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:20.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 -- 172.21.15.69:0/2878497746 >> 172.21.15.69:0/2878497746 conn(0x55c07a9e7d20 msgr2=0x55c07a9ed450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 -- 172.21.15.69:0/2878497746 shutdown_connections 2023-12-14T14:20:20.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 1 -- 172.21.15.69:0/2878497746 wait complete. 2023-12-14T14:20:20.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.636+0000 7f89c16a4b80 20 client.16929 trim_cache size 0 max 16384 2023-12-14T14:20:20.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.652+0000 7f89c16a4b80 1 Processor -- start 2023-12-14T14:20:20.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.652+0000 7f89c16a4b80 1 -- start start 2023-12-14T14:20:20.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 0x55c07aa0c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07aa00500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 0x55c07aa00a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07aa0c7e0 con 0x55c07a9f1d10 2023-12-14T14:20:20.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a9ec630 con 0x55c07aa00fe0 2023-12-14T14:20:20.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a9f9b80 con 0x55c07a9f1400 2023-12-14T14:20:20.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89ae7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07aa00500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89ae7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07aa00500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53570/0 (socket says 172.21.15.69:53570) 2023-12-14T14:20:20.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89ae7fc700 1 -- 172.21.15.69:0/90339088 learned_addr learned my addr 172.21.15.69:0/90339088 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89aeffd700 1 --2- 172.21.15.69:0/90339088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 0x55c07aa0c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89ae7fc700 1 -- 172.21.15.69:0/90339088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 msgr2=0x55c07aa0c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/90339088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 0x55c07aa0c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89ae7fc700 1 -- 172.21.15.69:0/90339088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 msgr2=0x55c07aa00a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/90339088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 0x55c07aa00a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89ae7fc700 1 -- 172.21.15.69:0/90339088 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c07a909f40 con 0x55c07a9f1d10 2023-12-14T14:20:20.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/90339088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07aa00500 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f89a4001eb0 tx=0x7f89a400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada0855f54a92b65 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f8995ffb700 1 -- 172.21.15.69:0/90339088 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4003b10 con 0x55c07a9f1d10 2023-12-14T14:20:20.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f8995ffb700 1 -- 172.21.15.69:0/90339088 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89a4011900 con 0x55c07a9f1d10 2023-12-14T14:20:20.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.653+0000 7f8995ffb700 1 -- 172.21.15.69:0/90339088 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4004710 con 0x55c07a9f1d10 2023-12-14T14:20:20.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 -- 172.21.15.69:0/90339088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 msgr2=0x55c07aa00500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/90339088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07aa00500 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f89a4001eb0 tx=0x7f89a400bfd0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 -- 172.21.15.69:0/90339088 shutdown_connections 2023-12-14T14:20:20.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/90339088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 0x55c07aa00a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/90339088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1400 0x55c07aa0c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/90339088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1d10 0x55c07aa00500 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 -- 172.21.15.69:0/90339088 >> 172.21.15.69:0/90339088 conn(0x55c07a9e7d20 msgr2=0x55c07aa0bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 -- 172.21.15.69:0/90339088 shutdown_connections 2023-12-14T14:20:20.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 -- 172.21.15.69:0/90339088 wait complete. 2023-12-14T14:20:20.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 -- start start 2023-12-14T14:20:20.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 Processor -- start 2023-12-14T14:20:20.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1400 0x55c07aa03a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1d10 0x55c07aa03fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 0x55c07aa044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07aa646e0 con 0x55c07a9f1400 2023-12-14T14:20:20.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07aa64820 con 0x55c07aa00fe0 2023-12-14T14:20:20.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.654+0000 7f89c16a4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07aa64960 con 0x55c07a9f1d10 2023-12-14T14:20:20.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89c16a4b80 10 client.0 _ll_register_callbacks cb 0x7f89a4004280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:20.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89aeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1400 0x55c07aa03a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89aeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1400 0x55c07aa03a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53586/0 (socket says 172.21.15.69:53586) 2023-12-14T14:20:20.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89aeffd700 1 -- 172.21.15.69:0/316735432 learned_addr learned my addr 172.21.15.69:0/316735432 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1d10 0x55c07aa03fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89af7fe700 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 0x55c07aa044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89aeffd700 1 -- 172.21.15.69:0/316735432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1d10 msgr2=0x55c07aa03fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89aeffd700 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1d10 0x55c07aa03fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89aeffd700 1 -- 172.21.15.69:0/316735432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 msgr2=0x55c07aa044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89aeffd700 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 0x55c07aa044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89aeffd700 1 -- 172.21.15.69:0/316735432 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c07a90a1f0 con 0x55c07a9f1400 2023-12-14T14:20:20.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89af7fe700 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 0x55c07aa044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:20.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89aeffd700 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1400 0x55c07aa03a60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x55c07aa13530 tx=0x7f89a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f3f44adc8868ba server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f8992ff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:20.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f8992ff5700 1 -- 172.21.15.69:0/316735432 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0024040 con 0x55c07a9f1400 2023-12-14T14:20:20.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f8992ff5700 1 -- 172.21.15.69:0/316735432 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f89a0017070 con 0x55c07a9f1400 2023-12-14T14:20:20.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89c16a4b80 1 -- 172.21.15.69:0/316735432 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f89a80b1070 con 0x55c07a9f1400 2023-12-14T14:20:20.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f8992ff5700 1 -- 172.21.15.69:0/316735432 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89a0011ba0 con 0x55c07a9f1400 2023-12-14T14:20:20.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89c16a4b80 10 client.16935 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:20.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f89c16a4b80 1 -- 172.21.15.69:0/316735432 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55c07a8f0a20 con 0x55c07a9f1400 2023-12-14T14:20:20.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.655+0000 7f8992ff5700 1 -- 172.21.15.69:0/316735432 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89a80b1070 con 0x55c07a9f1400 2023-12-14T14:20:20.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f8992ff5700 1 -- 172.21.15.69:0/316735432 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f89a001f6a0 con 0x55c07a9f1400 2023-12-14T14:20:20.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f89c16a4b80 10 client.16935 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:20.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f89c16a4b80 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:20.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f89c16a4b80 20 client.16935 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:20.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c07aa66080 0x55c07aa68490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f89c16a4b80 4 client.16935 mds_command: new command op to 24500 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T14:20:20.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f89c16a4b80 1 -- 172.21.15.69:0/316735432 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c07a93ca80 con 0x55c07aa66080 2023-12-14T14:20:20.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c07aa66080 0x55c07aa68490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f8992ff5700 10 client.16935 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:20.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.656+0000 7f89ae7fc700 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c07aa66080 0x55c07aa68490 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ed4e094587549b4 server_cookie=407096f03dc9ba12 in_seq=0 out_seq=0 2023-12-14T14:20:20.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.657+0000 7f8992ff5700 1 -- 172.21.15.69:0/316735432 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c07a93ca80 con 0x55c07aa66080 2023-12-14T14:20:20.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.657+0000 7f8992ff5700 10 client.16935 handle_command_reply: tid=0 2023-12-14T14:20:20.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.657+0000 7f89c16a4b80 1 client.16935 shutdown 2023-12-14T14:20:20.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.657+0000 7f89c16a4b80 1 -- 172.21.15.69:0/316735432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1400 msgr2=0x55c07aa03a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.657+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1400 0x55c07aa03a60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x55c07aa13530 tx=0x7f89a00047c0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89c16a4b80 1 -- 172.21.15.69:0/316735432 shutdown_connections 2023-12-14T14:20:20.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55c07aa66080 0x55c07aa68490 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c07aa00fe0 0x55c07aa044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c07a9f1400 0x55c07aa03a60 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89c16a4b80 1 --2- 172.21.15.69:0/316735432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c07a9f1d10 0x55c07aa03fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89c16a4b80 1 -- 172.21.15.69:0/316735432 >> 172.21.15.69:0/316735432 conn(0x55c07a9e7d20 msgr2=0x55c07a9f3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f8992ff5700 0 client.16935 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:20.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89c16a4b80 1 -- 172.21.15.69:0/316735432 shutdown_connections 2023-12-14T14:20:20.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89c16a4b80 1 -- 172.21.15.69:0/316735432 wait complete. 2023-12-14T14:20:20.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89c16a4b80 20 client.16935 trim_cache size 0 max 16384 2023-12-14T14:20:20.673 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:20:20.673 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T14:20:20.673 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "68c0471a-41dc-4c6e-91a4-56a1a54b00ab", 2023-12-14T14:20:20.673 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T14:20:20.674 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:20:20.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 -- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89980a12c0 msgr2=0x7f89980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89980a12c0 0x7f89980a3770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f89a0005950 tx=0x7f89a000b410 comp rx=0 tx=0).stop 2023-12-14T14:20:20.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 -- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 msgr2=0x7f89b019adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 0x7f89b019adb0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f89a80062a0 tx=0x7f89a80079b0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 -- 172.21.15.69:0/1393369032 shutdown_connections 2023-12-14T14:20:20.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89980a12c0 0x7f89980a3770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89b010acc0 0x7f89b019adb0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89b00ff400 0x7f89b0196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 --2- 172.21.15.69:0/1393369032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b00ffd10 0x7f89b01969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 -- 172.21.15.69:0/1393369032 >> 172.21.15.69:0/1393369032 conn(0x7f89b00749f0 msgr2=0x7f89b0102720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 -- 172.21.15.69:0/1393369032 shutdown_connections 2023-12-14T14:20:20.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.658+0000 7f89b5516700 1 -- 172.21.15.69:0/1393369032 wait complete. 2023-12-14T14:20:20.677 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:20:20.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 -- 172.21.15.69:0/614803127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc998104d70 msgr2=0x7fc99810b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 --2- 172.21.15.69:0/614803127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc998104d70 0x7fc99810b750 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c240 tx=0x7fc99000c550 comp rx=0 tx=0).stop 2023-12-14T14:20:20.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 -- 172.21.15.69:0/614803127 shutdown_connections 2023-12-14T14:20:20.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 --2- 172.21.15.69:0/614803127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc998104d70 0x7fc99810b750 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 --2- 172.21.15.69:0/614803127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980ff6e0 0x7fc9980ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 --2- 172.21.15.69:0/614803127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc998100080 0x7fc998104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 -- 172.21.15.69:0/614803127 >> 172.21.15.69:0/614803127 conn(0x7fc998074a60 msgr2=0x7fc998074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 -- 172.21.15.69:0/614803127 shutdown_connections 2023-12-14T14:20:20.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 -- 172.21.15.69:0/614803127 wait complete. 2023-12-14T14:20:20.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.801+0000 7fc99e283700 1 Processor -- start 2023-12-14T14:20:20.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc99e283700 1 -- start start 2023-12-14T14:20:20.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc99e283700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9980ff6e0 0x7fc9981942a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc99e283700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc998100080 0x7fc9981947e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc99e283700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc998104d70 0x7fc998198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc99e283700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc998199280 con 0x7fc9980ff6e0 2023-12-14T14:20:20.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc99e283700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9981993f0 con 0x7fc998100080 2023-12-14T14:20:20.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc99e283700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9981995b0 con 0x7fc998104d70 2023-12-14T14:20:20.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc997fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9980ff6e0 0x7fc9981942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc997fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9980ff6e0 0x7fc9981942a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53598/0 (socket says 172.21.15.69:53598) 2023-12-14T14:20:20.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc997fff700 1 -- 172.21.15.69:0/86929597 learned_addr learned my addr 172.21.15.69:0/86929597 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc9977fe700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc998100080 0x7fc9981947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc99c820700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc998104d70 0x7fc998198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc997fff700 1 -- 172.21.15.69:0/86929597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc998104d70 msgr2=0x7fc998198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc997fff700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc998104d70 0x7fc998198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc997fff700 1 -- 172.21.15.69:0/86929597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc998100080 msgr2=0x7fc9981947e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc997fff700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc998100080 0x7fc9981947e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc997fff700 1 -- 172.21.15.69:0/86929597 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99000ae10 con 0x7fc9980ff6e0 2023-12-14T14:20:20.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.802+0000 7fc997fff700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9980ff6e0 0x7fc9981942a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc988009970 tx=0x7fc988009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.803+0000 7fc9957fa700 1 -- 172.21.15.69:0/86929597 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988012070 con 0x7fc9980ff6e0 2023-12-14T14:20:20.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.803+0000 7fc9957fa700 1 -- 172.21.15.69:0/86929597 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc98800d260 con 0x7fc9980ff6e0 2023-12-14T14:20:20.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.803+0000 7fc99e283700 1 -- 172.21.15.69:0/86929597 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99810e170 con 0x7fc9980ff6e0 2023-12-14T14:20:20.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.803+0000 7fc9957fa700 1 -- 172.21.15.69:0/86929597 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9880179d0 con 0x7fc9980ff6e0 2023-12-14T14:20:20.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.803+0000 7fc99e283700 1 -- 172.21.15.69:0/86929597 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99810dfe0 con 0x7fc9980ff6e0 2023-12-14T14:20:20.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.805+0000 7fc9957fa700 1 -- 172.21.15.69:0/86929597 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc988007c00 con 0x7fc9980ff6e0 2023-12-14T14:20:20.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.806+0000 7fc9957fa700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc9840a12c0 0x7fc9840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.806+0000 7fc9977fe700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc9840a12c0 0x7fc9840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.806+0000 7fc9957fa700 1 -- 172.21.15.69:0/86929597 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fc9880ce090 con 0x7fc9980ff6e0 2023-12-14T14:20:20.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.806+0000 7fc9977fe700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc9840a12c0 0x7fc9840a3770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc9981958b0 tx=0x7fc98000b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc9aa411b80 1 Processor -- start 2023-12-14T14:20:20.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc9aa411b80 1 -- start start 2023-12-14T14:20:20.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 0x55aa030fc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03107610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03109f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa02fe65e0 con 0x55aa030fcc90 2023-12-14T14:20:20.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa03055870 con 0x55aa03107b50 2023-12-14T14:20:20.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa0304ed00 con 0x55aa030fc380 2023-12-14T14:20:20.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc99c820700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03109f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc99c820700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03109f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.69:49522/0 (socket says 172.21.15.69:49522) 2023-12-14T14:20:20.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc99c820700 1 -- 172.21.15.69:0/3817020985 learned_addr learned my addr 172.21.15.69:0/3817020985 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.807+0000 7fc9977fe700 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03107610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc997fff700 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 0x55aa030fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc99c820700 1 -- 172.21.15.69:0/3817020985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 msgr2=0x55aa030fc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc99c820700 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 0x55aa030fc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc99c820700 1 -- 172.21.15.69:0/3817020985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 msgr2=0x55aa03107610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc99c820700 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03107610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc99c820700 1 -- 172.21.15.69:0/3817020985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa02ed03b0 con 0x55aa03107b50 2023-12-14T14:20:20.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc9977fe700 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03107610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T14:20:20.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc99c820700 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03109f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc99000ad30 tx=0x7fc99000ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf02af1cd690ff9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc98e7fc700 1 -- 172.21.15.69:0/3817020985 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99000f040 con 0x55aa03107b50 2023-12-14T14:20:20.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc98e7fc700 1 -- 172.21.15.69:0/3817020985 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc99000a0d0 con 0x55aa03107b50 2023-12-14T14:20:20.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.808+0000 7fc98e7fc700 1 -- 172.21.15.69:0/3817020985 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990007aa0 con 0x55aa03107b50 2023-12-14T14:20:20.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 -- 172.21.15.69:0/3817020985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 msgr2=0x55aa03109f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03109f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc99000ad30 tx=0x7fc99000ad60 comp rx=0 tx=0).stop 2023-12-14T14:20:20.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 -- 172.21.15.69:0/3817020985 shutdown_connections 2023-12-14T14:20:20.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03109f30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 0x55aa030fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/3817020985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03107610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 -- 172.21.15.69:0/3817020985 >> 172.21.15.69:0/3817020985 conn(0x55aa030f2ca0 msgr2=0x55aa030f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 -- 172.21.15.69:0/3817020985 shutdown_connections 2023-12-14T14:20:20.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 -- 172.21.15.69:0/3817020985 wait complete. 2023-12-14T14:20:20.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 -- start start 2023-12-14T14:20:20.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.809+0000 7fc9aa411b80 1 Processor -- start 2023-12-14T14:20:20.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 0x55aa031074c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03104770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa02feaf90 con 0x55aa030fcc90 2023-12-14T14:20:20.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa02feac30 con 0x55aa03107b50 2023-12-14T14:20:20.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa02ed26a0 con 0x55aa030fc380 2023-12-14T14:20:20.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 10 client.0 _ll_register_callbacks cb 0x55aa0300e910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:20.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03104770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03104770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53620/0 (socket says 172.21.15.69:53620) 2023-12-14T14:20:20.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9977fe700 1 -- 172.21.15.69:0/324883169 learned_addr learned my addr 172.21.15.69:0/324883169 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc99c820700 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc997fff700 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 0x55aa031074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9977fe700 1 -- 172.21.15.69:0/324883169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 msgr2=0x55aa031074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9977fe700 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 0x55aa031074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9977fe700 1 -- 172.21.15.69:0/324883169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 msgr2=0x55aa03104cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9977fe700 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03104cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9977fe700 1 -- 172.21.15.69:0/324883169 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99810bf90 con 0x55aa030fcc90 2023-12-14T14:20:20.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9977fe700 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03104770 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc998100450 tx=0x7fc9800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e8467d5f38862 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9777fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:20.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9777fe700 1 -- 172.21.15.69:0/324883169 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980028470 con 0x55aa030fcc90 2023-12-14T14:20:20.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9777fe700 1 -- 172.21.15.69:0/324883169 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fc980017070 con 0x55aa030fcc90 2023-12-14T14:20:20.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 1 -- 172.21.15.69:0/324883169 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa030f02b0 con 0x55aa030fcc90 2023-12-14T14:20:20.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9777fe700 1 -- 172.21.15.69:0/324883169 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc980004830 con 0x55aa030fcc90 2023-12-14T14:20:20.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 10 client.16947 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:20.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.810+0000 7fc9aa411b80 1 -- 172.21.15.69:0/324883169 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55aa03015170 con 0x55aa030fcc90 2023-12-14T14:20:20.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc9777fe700 1 -- 172.21.15.69:0/324883169 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55aa030f02b0 con 0x55aa030fcc90 2023-12-14T14:20:20.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc9777fe700 1 -- 172.21.15.69:0/324883169 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc9800285d0 con 0x55aa030fcc90 2023-12-14T14:20:20.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc9aa411b80 10 client.16947 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:20.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc9aa411b80 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:20.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc9aa411b80 20 client.16947 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:20.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55aa0311b850 0x55aa0311dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc9aa411b80 4 client.16947 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:20.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc9aa411b80 1 -- 172.21.15.69:0/324883169 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa03047ce0 con 0x55aa0311b850 2023-12-14T14:20:20.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc997fff700 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55aa0311b850 0x55aa0311dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc9777fe700 10 client.16947 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:20.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.811+0000 7fc997fff700 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55aa0311b850 0x55aa0311dc60 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7979ab97dffc26c9 server_cookie=1c8974531642b990 in_seq=0 out_seq=0 2023-12-14T14:20:20.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9777fe700 1 -- 172.21.15.69:0/324883169 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55aa03047ce0 con 0x55aa0311b850 2023-12-14T14:20:20.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9777fe700 10 client.16947 handle_command_reply: tid=0 2023-12-14T14:20:20.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 client.16947 shutdown 2023-12-14T14:20:20.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 -- 172.21.15.69:0/324883169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 msgr2=0x55aa03104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03104770 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc998100450 tx=0x7fc9800047c0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 -- 172.21.15.69:0/324883169 shutdown_connections 2023-12-14T14:20:20.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55aa0311b850 0x55aa0311dc60 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa03107b50 0x55aa03104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa030fc380 0x55aa031074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9777fe700 0 client.16947 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:20.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/324883169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fcc90 0x55aa03104770 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 -- 172.21.15.69:0/324883169 >> 172.21.15.69:0/324883169 conn(0x55aa030f2ca0 msgr2=0x55aa030f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 -- 172.21.15.69:0/324883169 shutdown_connections 2023-12-14T14:20:20.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 1 -- 172.21.15.69:0/324883169 wait complete. 2023-12-14T14:20:20.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.812+0000 7fc9aa411b80 20 client.16947 trim_cache size 0 max 16384 2023-12-14T14:20:20.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc9aa411b80 1 Processor -- start 2023-12-14T14:20:20.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc9aa411b80 1 -- start start 2023-12-14T14:20:20.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03106f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 0x55aa031074c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 0x55aa03104730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa03118f80 con 0x55aa030fc380 2023-12-14T14:20:20.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa030ff590 con 0x55aa030fcc90 2023-12-14T14:20:20.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa030fd5e0 con 0x55aa03107b50 2023-12-14T14:20:20.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc997fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc997fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53622/0 (socket says 172.21.15.69:53622) 2023-12-14T14:20:20.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.829+0000 7fc997fff700 1 -- 172.21.15.69:0/689712629 learned_addr learned my addr 172.21.15.69:0/689712629 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc99c820700 1 --2- 172.21.15.69:0/689712629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 0x55aa03104730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc9977fe700 1 --2- 172.21.15.69:0/689712629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 0x55aa031074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc997fff700 1 -- 172.21.15.69:0/689712629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 msgr2=0x55aa03104730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc997fff700 1 --2- 172.21.15.69:0/689712629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 0x55aa03104730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc997fff700 1 -- 172.21.15.69:0/689712629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 msgr2=0x55aa031074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc997fff700 1 --2- 172.21.15.69:0/689712629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 0x55aa031074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc997fff700 1 -- 172.21.15.69:0/689712629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa031042e0 con 0x55aa030fc380 2023-12-14T14:20:20.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc997fff700 1 --2- 172.21.15.69:0/689712629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03106f80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc988097b60 tx=0x7fc988017470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967c092cf88ed25 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc98effd700 1 -- 172.21.15.69:0/689712629 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988099490 con 0x55aa030fc380 2023-12-14T14:20:20.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc98effd700 1 -- 172.21.15.69:0/689712629 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc98809b350 con 0x55aa030fc380 2023-12-14T14:20:20.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.830+0000 7fc98effd700 1 -- 172.21.15.69:0/689712629 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9880a3310 con 0x55aa030fc380 2023-12-14T14:20:20.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 -- 172.21.15.69:0/689712629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 msgr2=0x55aa03106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/689712629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03106f80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc988097b60 tx=0x7fc988017470 comp rx=0 tx=0).stop 2023-12-14T14:20:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 -- 172.21.15.69:0/689712629 shutdown_connections 2023-12-14T14:20:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/689712629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 0x55aa03104730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/689712629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03106f80 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/689712629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 0x55aa031074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 -- 172.21.15.69:0/689712629 >> 172.21.15.69:0/689712629 conn(0x55aa030f2ca0 msgr2=0x55aa030f6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 -- 172.21.15.69:0/689712629 shutdown_connections 2023-12-14T14:20:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 -- 172.21.15.69:0/689712629 wait complete. 2023-12-14T14:20:20.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 -- start start 2023-12-14T14:20:20.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 Processor -- start 2023-12-14T14:20:20.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03112770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 0x55aa03110a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 0x55aa03110fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa03113040 con 0x55aa030fc380 2023-12-14T14:20:20.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa031114e0 con 0x55aa030fcc90 2023-12-14T14:20:20.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa031116a0 con 0x55aa03107b50 2023-12-14T14:20:20.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc9aa411b80 10 client.0 _ll_register_callbacks cb 0x7fc98000bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:20.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc997fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.831+0000 7fc997fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03112770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53638/0 (socket says 172.21.15.69:53638) 2023-12-14T14:20:20.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc997fff700 1 -- 172.21.15.69:0/1458257175 learned_addr learned my addr 172.21.15.69:0/1458257175 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:20.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc99c820700 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 0x55aa03110fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc997fff700 1 -- 172.21.15.69:0/1458257175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 msgr2=0x55aa03110fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc997fff700 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 0x55aa03110fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9977fe700 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 0x55aa03110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc997fff700 1 -- 172.21.15.69:0/1458257175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 msgr2=0x55aa03110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc997fff700 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 0x55aa03110a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc997fff700 1 -- 172.21.15.69:0/1458257175 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99810dfe0 con 0x55aa030fc380 2023-12-14T14:20:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc99c820700 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 0x55aa03110fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc997fff700 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03112770 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc98809b2b0 tx=0x7fc9880992e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8cd3e43125479e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9777fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9777fe700 1 -- 172.21.15.69:0/1458257175 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9880b94c0 con 0x55aa030fc380 2023-12-14T14:20:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9777fe700 1 -- 172.21.15.69:0/1458257175 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8542+0+0 (secure 0 0 0) 0x7fc98809a5e0 con 0x55aa030fc380 2023-12-14T14:20:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9aa411b80 1 -- 172.21.15.69:0/1458257175 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc99000a0d0 con 0x55aa030fc380 2023-12-14T14:20:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9777fe700 1 -- 172.21.15.69:0/1458257175 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc98809a7a0 con 0x55aa030fc380 2023-12-14T14:20:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9aa411b80 10 client.16953 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9aa411b80 1 -- 172.21.15.69:0/1458257175 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55aa02e7cb60 con 0x55aa030fc380 2023-12-14T14:20:20.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9777fe700 1 -- 172.21.15.69:0/1458257175 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc99000a0d0 con 0x55aa030fc380 2023-12-14T14:20:20.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9777fe700 1 -- 172.21.15.69:0/1458257175 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc988096ee0 con 0x55aa030fc380 2023-12-14T14:20:20.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9aa411b80 10 client.16953 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:20.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9aa411b80 10 client.16953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:20.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9aa411b80 20 client.16953 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:20.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55aa031706d0 0x55aa03172ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:20.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9aa411b80 4 client.16953 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:20:20.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.832+0000 7fc9aa411b80 1 -- 172.21.15.69:0/1458257175 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aa03047a00 con 0x55aa031706d0 2023-12-14T14:20:20.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.833+0000 7fc9977fe700 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55aa031706d0 0x55aa03172ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:20.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.833+0000 7fc9777fe700 10 client.16953 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:20.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.833+0000 7fc9977fe700 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55aa031706d0 0x55aa03172ae0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5356dc438a115f6 server_cookie=848158047d70125 in_seq=0 out_seq=0 2023-12-14T14:20:20.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.833+0000 7fc9777fe700 1 -- 172.21.15.69:0/1458257175 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55aa03047a00 con 0x55aa031706d0 2023-12-14T14:20:20.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.833+0000 7fc9777fe700 10 client.16953 handle_command_reply: tid=0 2023-12-14T14:20:20.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 client.16953 shutdown 2023-12-14T14:20:20.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 -- 172.21.15.69:0/1458257175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 msgr2=0x55aa03112770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03112770 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc98809b2b0 tx=0x7fc9880992e0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 -- 172.21.15.69:0/1458257175 shutdown_connections 2023-12-14T14:20:20.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55aa031706d0 0x55aa03172ae0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aa03107b50 0x55aa03110fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa030fc380 0x55aa03112770 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9777fe700 0 client.16953 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 --2- 172.21.15.69:0/1458257175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa030fcc90 0x55aa03110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 -- 172.21.15.69:0/1458257175 >> 172.21.15.69:0/1458257175 conn(0x55aa030f2ca0 msgr2=0x55aa030ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 -- 172.21.15.69:0/1458257175 shutdown_connections 2023-12-14T14:20:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 1 -- 172.21.15.69:0/1458257175 wait complete. 2023-12-14T14:20:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc9aa411b80 20 client.16953 trim_cache size 0 max 16384 2023-12-14T14:20:20.850 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:20:20.851 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T14:20:20.851 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T14:20:20.851 INFO:teuthology.orchestra.run.smithi069.stdout: "68c0471a-41dc-4c6e-91a4-56a1a54b00ab": { 2023-12-14T14:20:20.851 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T14:20:20.851 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "68c0471a-41dc-4c6e-91a4-56a1a54b00ab", 2023-12-14T14:20:20.851 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T14:20:20.851 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:20.852 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:20.852 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:20:20.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 -- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc9840a12c0 msgr2=0x7fc9840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc9840a12c0 0x7fc9840a3770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc9981958b0 tx=0x7fc98000b410 comp rx=0 tx=0).stop 2023-12-14T14:20:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 -- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9980ff6e0 msgr2=0x7fc9981942a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9980ff6e0 0x7fc9981942a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc988009970 tx=0x7fc988009c80 comp rx=0 tx=0).stop 2023-12-14T14:20:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 -- 172.21.15.69:0/86929597 shutdown_connections 2023-12-14T14:20:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc9840a12c0 0x7fc9840a3770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc998104d70 0x7fc998198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc9980ff6e0 0x7fc9981942a0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 --2- 172.21.15.69:0/86929597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc998100080 0x7fc9981947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:20.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 -- 172.21.15.69:0/86929597 >> 172.21.15.69:0/86929597 conn(0x7fc998074a60 msgr2=0x7fc9980fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:20.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 -- 172.21.15.69:0/86929597 shutdown_connections 2023-12-14T14:20:20.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:20.834+0000 7fc99e283700 1 -- 172.21.15.69:0/86929597 wait complete. 2023-12-14T14:20:20.855 INFO:tasks.cephfs.filesystem:scrub status for tag:68c0471a-41dc-4c6e-91a4-56a1a54b00ab - {'path': '/', 'tag': '68c0471a-41dc-4c6e-91a4-56a1a54b00ab', 'options': 'recursive,force'} 2023-12-14T14:20:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:21 smithi069 ceph-mon[42034]: pgmap v301: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:21 smithi069 ceph-mon[42034]: scrub queued for path: / 2023-12-14T14:20:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:21 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:20:21.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:21 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:20:21.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:21 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:20:21.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:21 smithi069 ceph-mon[42034]: osdmap e93: 12 total, 12 up, 12 in 2023-12-14T14:20:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:21 smithi081 ceph-mon[43371]: pgmap v301: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:21 smithi081 ceph-mon[43371]: scrub queued for path: / 2023-12-14T14:20:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:21 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:20:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:21 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:20:21.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:21 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:20:21.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:21 smithi081 ceph-mon[43371]: osdmap e93: 12 total, 12 up, 12 in 2023-12-14T14:20:22.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:21 smithi119 ceph-mon[43834]: pgmap v301: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:22.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:21 smithi119 ceph-mon[43834]: scrub queued for path: / 2023-12-14T14:20:22.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:21 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:20:22.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:21 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:20:22.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:21 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:20:22.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:21 smithi119 ceph-mon[43834]: osdmap e93: 12 total, 12 up, 12 in 2023-12-14T14:20:22.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:22 smithi069 ceph-mon[42034]: scrub summary: active paths [/] 2023-12-14T14:20:22.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:22 smithi069 ceph-mon[42034]: scrub summary: idle+waiting paths [/] 2023-12-14T14:20:22.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:22 smithi081 ceph-mon[43371]: scrub summary: active paths [/] 2023-12-14T14:20:22.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:22 smithi081 ceph-mon[43371]: scrub summary: idle+waiting paths [/] 2023-12-14T14:20:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:22 smithi119 ceph-mon[43834]: scrub summary: active paths [/] 2023-12-14T14:20:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:22 smithi119 ceph-mon[43834]: scrub summary: idle+waiting paths [/] 2023-12-14T14:20:23.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:23 smithi069 ceph-mon[42034]: pgmap v303: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:23 smithi081 ceph-mon[43371]: pgmap v303: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:24.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:23 smithi119 ceph-mon[43834]: pgmap v303: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:20:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:25 smithi069 ceph-mon[42034]: pgmap v304: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:20:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:25 smithi081 ceph-mon[43371]: pgmap v304: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:20:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:25 smithi119 ceph-mon[43834]: pgmap v304: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:20:27.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:27 smithi119 ceph-mon[43834]: pgmap v305: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:20:27.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:27 smithi069 ceph-mon[42034]: pgmap v305: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:20:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:27 smithi081 ceph-mon[43371]: pgmap v305: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:20:29.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:29 smithi069 ceph-mon[42034]: pgmap v306: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:20:29.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:29 smithi081 ceph-mon[43371]: pgmap v306: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:20:30.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:29 smithi119 ceph-mon[43834]: pgmap v306: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-14T14:20:30.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:30 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:20:30.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:30 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:20:31.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:30 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:20:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:31 smithi069 ceph-mon[42034]: scrub summary: idle 2023-12-14T14:20:31.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:31 smithi069 ceph-mon[42034]: pgmap v307: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-12-14T14:20:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:31 smithi081 ceph-mon[43371]: scrub summary: idle 2023-12-14T14:20:31.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:31 smithi081 ceph-mon[43371]: pgmap v307: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-12-14T14:20:32.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:31 smithi119 ceph-mon[43834]: scrub summary: idle 2023-12-14T14:20:32.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:31 smithi119 ceph-mon[43834]: pgmap v307: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-12-14T14:20:33.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:33 smithi069 ceph-mon[42034]: pgmap v308: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:20:33.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:33 smithi081 ceph-mon[43371]: pgmap v308: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:20:34.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:33 smithi119 ceph-mon[43834]: pgmap v308: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T14:20:35.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:35 smithi069 ceph-mon[42034]: pgmap v309: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:20:35.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:35 smithi081 ceph-mon[43371]: pgmap v309: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:20:36.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:35 smithi119 ceph-mon[43834]: pgmap v309: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T14:20:37.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:37 smithi119 ceph-mon[43834]: pgmap v310: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:37.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:37 smithi069 ceph-mon[42034]: pgmap v310: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:37.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:37 smithi081 ceph-mon[43371]: pgmap v310: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:39.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:39 smithi069 ceph-mon[42034]: pgmap v311: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:39.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:39 smithi081 ceph-mon[43371]: pgmap v311: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:40.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:39 smithi119 ceph-mon[43834]: pgmap v311: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:40.284 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-12-14T14:20:40.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.418+0000 7fc52980d700 1 -- 172.21.15.69:0/2828693736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5240ffd60 msgr2=0x7fc524103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:40.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.418+0000 7fc52980d700 1 --2- 172.21.15.69:0/2828693736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5240ffd60 0x7fc524103d20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc5140099c0 tx=0x7fc514009cd0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.418+0000 7fc52980d700 1 -- 172.21.15.69:0/2828693736 shutdown_connections 2023-12-14T14:20:40.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.418+0000 7fc52980d700 1 --2- 172.21.15.69:0/2828693736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc524104400 0x7fc52410bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.418+0000 7fc52980d700 1 --2- 172.21.15.69:0/2828693736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5240ff3c0 0x7fc5240ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.418+0000 7fc52980d700 1 --2- 172.21.15.69:0/2828693736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5240ffd60 0x7fc524103d20 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.418+0000 7fc52980d700 1 -- 172.21.15.69:0/2828693736 >> 172.21.15.69:0/2828693736 conn(0x7fc5240763a0 msgr2=0x7fc5240767a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:40.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.418+0000 7fc52980d700 1 -- 172.21.15.69:0/2828693736 shutdown_connections 2023-12-14T14:20:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.418+0000 7fc52980d700 1 -- 172.21.15.69:0/2828693736 wait complete. 2023-12-14T14:20:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc52980d700 1 Processor -- start 2023-12-14T14:20:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc52980d700 1 -- start start 2023-12-14T14:20:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc52980d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5240ff3c0 0x7fc5241963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc52980d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5240ffd60 0x7fc524196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc52980d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc524104400 0x7fc52419ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc52980d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52419b3c0 con 0x7fc524104400 2023-12-14T14:20:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc52980d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52419b530 con 0x7fc5240ffd60 2023-12-14T14:20:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc52980d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52419b6f0 con 0x7fc5240ff3c0 2023-12-14T14:20:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc5237fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc524104400 0x7fc52419ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc5237fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc524104400 0x7fc52419ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32948/0 (socket says 172.21.15.69:32948) 2023-12-14T14:20:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc5237fe700 1 -- 172.21.15.69:0/1056808935 learned_addr learned my addr 172.21.15.69:0/1056808935 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc5227fc700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5240ffd60 0x7fc524196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc522ffd700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5240ff3c0 0x7fc5241963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc5237fe700 1 -- 172.21.15.69:0/1056808935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5240ff3c0 msgr2=0x7fc5241963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc5237fe700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5240ff3c0 0x7fc5241963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc5237fe700 1 -- 172.21.15.69:0/1056808935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5240ffd60 msgr2=0x7fc524196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc5237fe700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5240ffd60 0x7fc524196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.419+0000 7fc5237fe700 1 -- 172.21.15.69:0/1056808935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140095f0 con 0x7fc524104400 2023-12-14T14:20:40.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.420+0000 7fc5237fe700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc524104400 0x7fc52419ad80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc51c007ee0 tx=0x7fc51c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:40.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.420+0000 7fc52880b700 1 -- 172.21.15.69:0/1056808935 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00ddd0 con 0x7fc524104400 2023-12-14T14:20:40.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.420+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52410f1a0 con 0x7fc524104400 2023-12-14T14:20:40.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.420+0000 7fc52880b700 1 -- 172.21.15.69:0/1056808935 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc51c00f040 con 0x7fc524104400 2023-12-14T14:20:40.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.420+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52410f010 con 0x7fc524104400 2023-12-14T14:20:40.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.420+0000 7fc52880b700 1 -- 172.21.15.69:0/1056808935 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c015400 con 0x7fc524104400 2023-12-14T14:20:40.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.421+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52410f330 con 0x7fc524104400 2023-12-14T14:20:40.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.422+0000 7fc52880b700 1 -- 172.21.15.69:0/1056808935 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc51c004000 con 0x7fc524104400 2023-12-14T14:20:40.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.422+0000 7fc52880b700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc50c0a12c0 0x7fc50c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:40.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.422+0000 7fc522ffd700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc50c0a12c0 0x7fc50c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:40.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.423+0000 7fc52880b700 1 -- 172.21.15.69:0/1056808935 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fc51c0cce50 con 0x7fc524104400 2023-12-14T14:20:40.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.423+0000 7fc522ffd700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc50c0a12c0 0x7fc50c0a3770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc518005950 tx=0x7fc518005eb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:40.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.426+0000 7fc52880b700 1 -- 172.21.15.69:0/1056808935 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc51c096270 con 0x7fc524104400 2023-12-14T14:20:40.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.643+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 --> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5241978a0 con 0x7fc50c0a12c0 2023-12-14T14:20:40.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.651+0000 7fc52880b700 1 -- 172.21.15.69:0/1056808935 <== mgr.15411 v2:172.21.15.69:6800/4150820502 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+335 (secure 0 0 0) 0x7fc51800e8a0 con 0x7fc50c0a12c0 2023-12-14T14:20:40.652 INFO:teuthology.orchestra.run.smithi069.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-12-14T00:00:00", "created": "2023-12-14T14:10:39", "first": "2023-12-14T14:11:00", "last": "2023-12-14T14:20:00", "last_pruned": "2023-12-14T14:20:00", "created_count": 10, "pruned_count": 4, "active": true} 2023-12-14T14:20:40.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc50c0a12c0 msgr2=0x7fc50c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:40.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc50c0a12c0 0x7fc50c0a3770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc518005950 tx=0x7fc518005eb0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc524104400 msgr2=0x7fc52419ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:40.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc524104400 0x7fc52419ad80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc51c007ee0 tx=0x7fc51c00d3b0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 shutdown_connections 2023-12-14T14:20:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fc50c0a12c0 0x7fc50c0a3770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc524104400 0x7fc52419ad80 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5240ff3c0 0x7fc5241963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 --2- 172.21.15.69:0/1056808935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5240ffd60 0x7fc524196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.653+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 >> 172.21.15.69:0/1056808935 conn(0x7fc5240763a0 msgr2=0x7fc5240680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:40.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.654+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 shutdown_connections 2023-12-14T14:20:40.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.654+0000 7fc52980d700 1 -- 172.21.15.69:0/1056808935 wait complete. 2023-12-14T14:20:40.666 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-12-14T14:20:40.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.789+0000 7facf7441700 1 -- 172.21.15.69:0/3582996977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 msgr2=0x7facf010b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:40.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.789+0000 7facf7441700 1 --2- 172.21.15.69:0/3582996977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 0x7facf010b700 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7face800b0a0 tx=0x7face800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.789+0000 7facf7441700 1 -- 172.21.15.69:0/3582996977 shutdown_connections 2023-12-14T14:20:40.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.789+0000 7facf7441700 1 --2- 172.21.15.69:0/3582996977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 0x7facf010b700 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.789+0000 7facf7441700 1 --2- 172.21.15.69:0/3582996977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf01048d0 0x7facf0104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.789+0000 7facf7441700 1 --2- 172.21.15.69:0/3582996977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf00fe8c0 0x7facf00fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.789+0000 7facf7441700 1 -- 172.21.15.69:0/3582996977 >> 172.21.15.69:0/3582996977 conn(0x7facf0075810 msgr2=0x7facf0075c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:40.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.789+0000 7facf7441700 1 -- 172.21.15.69:0/3582996977 shutdown_connections 2023-12-14T14:20:40.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.789+0000 7facf7441700 1 -- 172.21.15.69:0/3582996977 wait complete. 2023-12-14T14:20:40.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf7441700 1 Processor -- start 2023-12-14T14:20:40.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf7441700 1 -- start start 2023-12-14T14:20:40.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf7441700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf00fe8c0 0x7facf01971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:40.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf7441700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 0x7facf0197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:40.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf7441700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf01048d0 0x7facf01a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:40.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf7441700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf0198060 con 0x7facf00ff270 2023-12-14T14:20:40.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf7441700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf01a27a0 con 0x7facf00fe8c0 2023-12-14T14:20:40.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf7441700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf01a2960 con 0x7facf01048d0 2023-12-14T14:20:40.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf49dc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 0x7facf0197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:40.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf49dc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 0x7facf0197720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32972/0 (socket says 172.21.15.69:32972) 2023-12-14T14:20:40.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.790+0000 7facf49dc700 1 -- 172.21.15.69:0/1923791502 learned_addr learned my addr 172.21.15.69:0/1923791502 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:40.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf59de700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf01048d0 0x7facf01a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:40.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf51dd700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf00fe8c0 0x7facf01971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:40.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf49dc700 1 -- 172.21.15.69:0/1923791502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf01048d0 msgr2=0x7facf01a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:40.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf49dc700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf01048d0 0x7facf01a2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf49dc700 1 -- 172.21.15.69:0/1923791502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf00fe8c0 msgr2=0x7facf01971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:40.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf49dc700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf00fe8c0 0x7facf01971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:40.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf49dc700 1 -- 172.21.15.69:0/1923791502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8009d00 con 0x7facf00ff270 2023-12-14T14:20:40.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf59de700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf01048d0 0x7facf01a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:40.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf49dc700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 0x7facf0197720 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7facec00c920 tx=0x7facec00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:40.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7face67fc700 1 -- 172.21.15.69:0/1923791502 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec007b00 con 0x7facf00ff270 2023-12-14T14:20:40.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7face67fc700 1 -- 172.21.15.69:0/1923791502 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facec004cf0 con 0x7facf00ff270 2023-12-14T14:20:40.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf010e960 con 0x7facf00ff270 2023-12-14T14:20:40.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7face67fc700 1 -- 172.21.15.69:0/1923791502 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec005610 con 0x7facf00ff270 2023-12-14T14:20:40.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.791+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf010e7d0 con 0x7facf00ff270 2023-12-14T14:20:40.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.792+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf010eaf0 con 0x7facf00ff270 2023-12-14T14:20:40.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.793+0000 7face67fc700 1 -- 172.21.15.69:0/1923791502 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7facec004750 con 0x7facf00ff270 2023-12-14T14:20:40.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.793+0000 7face67fc700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7facdc0a12c0 0x7facdc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:40.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.794+0000 7facf51dd700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7facdc0a12c0 0x7facdc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:40.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.794+0000 7face67fc700 1 -- 172.21.15.69:0/1923791502 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7facec0ccd00 con 0x7facf00ff270 2023-12-14T14:20:40.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.794+0000 7facf51dd700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7facdc0a12c0 0x7facdc0a3770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7facf00ffa00 tx=0x7face0009eb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:40.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:40.798+0000 7face67fc700 1 -- 172.21.15.69:0/1923791502 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7facec096120 con 0x7facf00ff270 2023-12-14T14:20:41.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.009+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 --> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7facf00fd270 con 0x7facdc0a12c0 2023-12-14T14:20:41.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.016+0000 7face67fc700 1 -- 172.21.15.69:0/1923791502 <== mgr.15411 v2:172.21.15.69:6800/4150820502 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7facf00fd270 con 0x7facdc0a12c0 2023-12-14T14:20:41.017 INFO:teuthology.orchestra.run.smithi069.stdout:/ 1M 6M3h 2023-12-14T14:20:41.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7facdc0a12c0 msgr2=0x7facdc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:41.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7facdc0a12c0 0x7facdc0a3770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7facf00ffa00 tx=0x7face0009eb0 comp rx=0 tx=0).stop 2023-12-14T14:20:41.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 msgr2=0x7facf0197720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:41.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 0x7facf0197720 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7facec00c920 tx=0x7facec00cce0 comp rx=0 tx=0).stop 2023-12-14T14:20:41.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 shutdown_connections 2023-12-14T14:20:41.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7facdc0a12c0 0x7facdc0a3770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:41.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf01048d0 0x7facf01a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:41.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf00fe8c0 0x7facf01971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:41.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 --2- 172.21.15.69:0/1923791502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf00ff270 0x7facf0197720 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:41.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 >> 172.21.15.69:0/1923791502 conn(0x7facf0075810 msgr2=0x7facf0102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:41.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 shutdown_connections 2023-12-14T14:20:41.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:41.018+0000 7facf7441700 1 -- 172.21.15.69:0/1923791502 wait complete. 2023-12-14T14:20:41.031 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-12-14T14:20:41.044 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-12-14T14:20:41.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:41 smithi069 ceph-mon[42034]: pgmap v312: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:20:41.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:41 smithi069 ceph-mon[42034]: from='client.16959 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:20:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:41 smithi081 ceph-mon[43371]: pgmap v312: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:20:41.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:41 smithi081 ceph-mon[43371]: from='client.16959 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:20:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:41 smithi119 ceph-mon[43834]: pgmap v312: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:20:42.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:41 smithi119 ceph-mon[43834]: from='client.16959 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:20:42.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:42 smithi069 ceph-mon[42034]: from='client.16965 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:20:42.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:42 smithi081 ceph-mon[43371]: from='client.16965 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:20:43.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:42 smithi119 ceph-mon[43834]: from='client.16965 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T14:20:43.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:43 smithi069 ceph-mon[42034]: pgmap v313: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:43.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:43 smithi081 ceph-mon[43371]: pgmap v313: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:44.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:43 smithi119 ceph-mon[43834]: pgmap v313: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:45.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:45 smithi069 ceph-mon[42034]: pgmap v314: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-14T14:20:45.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:45 smithi081 ceph-mon[43371]: pgmap v314: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-14T14:20:46.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:45 smithi119 ceph-mon[43834]: pgmap v314: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-14T14:20:47.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:47 smithi119 ceph-mon[43834]: pgmap v315: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2023-12-14T14:20:47.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:47 smithi069 ceph-mon[42034]: pgmap v315: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2023-12-14T14:20:47.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:47 smithi081 ceph-mon[43371]: pgmap v315: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2023-12-14T14:20:49.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:49 smithi069 ceph-mon[42034]: pgmap v316: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2023-12-14T14:20:49.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:49 smithi081 ceph-mon[43371]: pgmap v316: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2023-12-14T14:20:50.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:49 smithi119 ceph-mon[43834]: pgmap v316: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2023-12-14T14:20:50.856 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T14:20:50.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.995+0000 7f1d8c346700 1 -- 172.21.15.69:0/4010160695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ff390 msgr2=0x7f1d840ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:50.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.995+0000 7f1d8c346700 1 --2- 172.21.15.69:0/4010160695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ff390 0x7f1d840ff760 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1d800099c0 tx=0x7f1d80009cd0 comp rx=0 tx=0).stop 2023-12-14T14:20:50.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.995+0000 7f1d8c346700 1 -- 172.21.15.69:0/4010160695 shutdown_connections 2023-12-14T14:20:50.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.995+0000 7f1d8c346700 1 --2- 172.21.15.69:0/4010160695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d841043d0 0x7f1d8410bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:50.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.995+0000 7f1d8c346700 1 --2- 172.21.15.69:0/4010160695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ff390 0x7f1d840ff760 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:50.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.995+0000 7f1d8c346700 1 --2- 172.21.15.69:0/4010160695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d840ffd30 0x7f1d84103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:50.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.995+0000 7f1d8c346700 1 -- 172.21.15.69:0/4010160695 >> 172.21.15.69:0/4010160695 conn(0x7f1d84075fd0 msgr2=0x7f1d840763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:50.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.995+0000 7f1d8c346700 1 -- 172.21.15.69:0/4010160695 shutdown_connections 2023-12-14T14:20:50.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.995+0000 7f1d8c346700 1 -- 172.21.15.69:0/4010160695 wait complete. 2023-12-14T14:20:50.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8c346700 1 Processor -- start 2023-12-14T14:20:50.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8c346700 1 -- start start 2023-12-14T14:20:50.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8c346700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d840ff390 0x7f1d84195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:50.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8c346700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ffd30 0x7f1d84195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:50.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8c346700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841043d0 0x7f1d84199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:50.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8c346700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8419a2f0 con 0x7f1d840ffd30 2023-12-14T14:20:50.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8c346700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8419a460 con 0x7f1d841043d0 2023-12-14T14:20:50.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8c346700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8419a620 con 0x7f1d840ff390 2023-12-14T14:20:50.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d898e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ffd30 0x7f1d84195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d898e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ffd30 0x7f1d84195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45700/0 (socket says 172.21.15.69:45700) 2023-12-14T14:20:51.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d898e1700 1 -- 172.21.15.69:0/3624254105 learned_addr learned my addr 172.21.15.69:0/3624254105 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8a8e3700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841043d0 0x7f1d84199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d840ff390 0x7f1d84195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d898e1700 1 -- 172.21.15.69:0/3624254105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d840ff390 msgr2=0x7f1d84195310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d840ff390 0x7f1d84195310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d898e1700 1 -- 172.21.15.69:0/3624254105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841043d0 msgr2=0x7f1d84199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841043d0 0x7f1d84199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.996+0000 7f1d898e1700 1 -- 172.21.15.69:0/3624254105 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d800095f0 con 0x7f1d840ffd30 2023-12-14T14:20:51.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.997+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ffd30 0x7f1d84195850 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c8c0 tx=0x7f1d7800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.997+0000 7f1d777fe700 1 -- 172.21.15.69:0/3624254105 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78004220 con 0x7f1d840ffd30 2023-12-14T14:20:51.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.997+0000 7f1d777fe700 1 -- 172.21.15.69:0/3624254105 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d78004cf0 con 0x7f1d840ffd30 2023-12-14T14:20:51.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.997+0000 7f1d8c346700 1 -- 172.21.15.69:0/3624254105 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8410f260 con 0x7f1d840ffd30 2023-12-14T14:20:51.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.997+0000 7f1d777fe700 1 -- 172.21.15.69:0/3624254105 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78003680 con 0x7f1d840ffd30 2023-12-14T14:20:51.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.997+0000 7f1d8c346700 1 -- 172.21.15.69:0/3624254105 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8410f0d0 con 0x7f1d840ffd30 2023-12-14T14:20:51.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.999+0000 7f1d777fe700 1 -- 172.21.15.69:0/3624254105 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1d78004750 con 0x7f1d840ffd30 2023-12-14T14:20:51.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.999+0000 7f1d777fe700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1d700a12c0 0x7f1d700a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.999+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1d700a12c0 0x7f1d700a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:50.999+0000 7f1d777fe700 1 -- 172.21.15.69:0/3624254105 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1d780ccb40 con 0x7f1d840ffd30 2023-12-14T14:20:51.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.000+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1d700a12c0 0x7f1d700a3770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d80006010 tx=0x7f1d80009f10 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.000+0000 7f1d984d4b80 1 Processor -- start 2023-12-14T14:20:51.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.000+0000 7f1d984d4b80 1 -- start start 2023-12-14T14:20:51.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.000+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871380 0x555739871750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.000+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 0x55573987c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.000+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55573987cb50 0x55573987ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.000+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573975b5e0 con 0x55573987cb50 2023-12-14T14:20:51.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.000+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557397ca870 con 0x555739871380 2023-12-14T14:20:51.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.000+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557397c3d00 con 0x555739871c90 2023-12-14T14:20:51.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a8e3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55573987cb50 0x55573987ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a8e3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55573987cb50 0x55573987ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45702/0 (socket says 172.21.15.69:45702) 2023-12-14T14:20:51.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a8e3700 1 -- 172.21.15.69:0/2577289196 learned_addr learned my addr 172.21.15.69:0/2577289196 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871380 0x555739871750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d898e1700 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 0x55573987c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a8e3700 1 -- 172.21.15.69:0/2577289196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 msgr2=0x55573987c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a8e3700 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 0x55573987c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a8e3700 1 -- 172.21.15.69:0/2577289196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871380 msgr2=0x555739871750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a8e3700 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871380 0x555739871750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a8e3700 1 -- 172.21.15.69:0/2577289196 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557396453b0 con 0x55573987cb50 2023-12-14T14:20:51.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871380 0x555739871750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:51.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d8a8e3700 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55573987cb50 0x55573987ef30 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00a430 tx=0x7f1d7c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e354e54aa7e3225b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d74dac700 1 -- 172.21.15.69:0/2577289196 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c010040 con 0x55573987cb50 2023-12-14T14:20:51.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d74dac700 1 -- 172.21.15.69:0/2577289196 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d7c013a50 con 0x55573987cb50 2023-12-14T14:20:51.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.001+0000 7f1d74dac700 1 -- 172.21.15.69:0/2577289196 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c014b20 con 0x55573987cb50 2023-12-14T14:20:51.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2577289196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55573987cb50 msgr2=0x55573987ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55573987cb50 0x55573987ef30 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00a430 tx=0x7f1d7c009650 comp rx=0 tx=0).stop 2023-12-14T14:20:51.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2577289196 shutdown_connections 2023-12-14T14:20:51.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55573987cb50 0x55573987ef30 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871380 0x555739871750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2577289196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 0x55573987c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2577289196 >> 172.21.15.69:0/2577289196 conn(0x555739867ca0 msgr2=0x55573986d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2577289196 shutdown_connections 2023-12-14T14:20:51.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2577289196 wait complete. 2023-12-14T14:20:51.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.002+0000 7f1d984d4b80 1 -- start start 2023-12-14T14:20:51.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d984d4b80 1 Processor -- start 2023-12-14T14:20:51.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 0x555739879730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55573987cb50 0x555739879c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573975ff90 con 0x555739871380 2023-12-14T14:20:51.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573975fc30 con 0x55573987cb50 2023-12-14T14:20:51.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557396476a0 con 0x555739871c90 2023-12-14T14:20:51.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a0e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d984d4b80 10 client.0 _ll_register_callbacks cb 0x555739783910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:51.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a0e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45706/0 (socket says 172.21.15.69:45706) 2023-12-14T14:20:51.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a0e2700 1 -- 172.21.15.69:0/3913031967 learned_addr learned my addr 172.21.15.69:0/3913031967 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a8e3700 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55573987cb50 0x555739879c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 0x555739879730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a0e2700 1 -- 172.21.15.69:0/3913031967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 msgr2=0x555739879730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 0x555739879730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a0e2700 1 -- 172.21.15.69:0/3913031967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55573987cb50 msgr2=0x555739879c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55573987cb50 0x555739879c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a0e2700 1 -- 172.21.15.69:0/3913031967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c009c60 con 0x555739871380 2023-12-14T14:20:51.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 0x555739879730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a8e3700 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55573987cb50 0x555739879c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987c480 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1d80015000 tx=0x7f1d8001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f5767ff29b8218 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.003+0000 7f1d6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:51.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d6dffb700 1 -- 172.21.15.69:0/3913031967 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80004050 con 0x555739871380 2023-12-14T14:20:51.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d6dffb700 1 -- 172.21.15.69:0/3913031967 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1d800041b0 con 0x555739871380 2023-12-14T14:20:51.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3913031967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557398652b0 con 0x555739871380 2023-12-14T14:20:51.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d6dffb700 1 -- 172.21.15.69:0/3913031967 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d8000f460 con 0x555739871380 2023-12-14T14:20:51.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d984d4b80 10 client.16977 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:51.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3913031967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55573978a170 con 0x555739871380 2023-12-14T14:20:51.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d6dffb700 1 -- 172.21.15.69:0/3913031967 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d8003d020 con 0x555739871380 2023-12-14T14:20:51.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d6dffb700 1 -- 172.21.15.69:0/3913031967 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1d80030630 con 0x555739871380 2023-12-14T14:20:51.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d984d4b80 10 client.16977 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:51.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d984d4b80 10 client.16977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:51.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d984d4b80 20 client.16977 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:51.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55573988c3e0 0x55573988e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d984d4b80 4 client.16977 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:51.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.004+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3913031967 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557397bcce0 con 0x55573988c3e0 2023-12-14T14:20:51.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.005+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55573988c3e0 0x55573988e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.005+0000 7f1d6dffb700 10 client.16977 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:51.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.005+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55573988c3e0 0x55573988e7f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8959517d68871f35 server_cookie=88aa02460050d1f6 in_seq=0 out_seq=0 2023-12-14T14:20:51.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d6dffb700 1 -- 172.21.15.69:0/3913031967 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5557397bcce0 con 0x55573988c3e0 2023-12-14T14:20:51.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d6dffb700 10 client.16977 handle_command_reply: tid=0 2023-12-14T14:20:51.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 client.16977 shutdown 2023-12-14T14:20:51.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3913031967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 msgr2=0x55573987c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987c480 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1d80015000 tx=0x7f1d8001a050 comp rx=0 tx=0).stop 2023-12-14T14:20:51.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3913031967 shutdown_connections 2023-12-14T14:20:51.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55573988c3e0 0x55573988e7f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55573987cb50 0x555739879c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987c480 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d6dffb700 0 client.16977 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:51.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3913031967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871c90 0x555739879730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3913031967 >> 172.21.15.69:0/3913031967 conn(0x555739867ca0 msgr2=0x55573986d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3913031967 shutdown_connections 2023-12-14T14:20:51.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3913031967 wait complete. 2023-12-14T14:20:51.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.006+0000 7f1d984d4b80 20 client.16977 trim_cache size 0 max 16384 2023-12-14T14:20:51.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d984d4b80 1 Processor -- start 2023-12-14T14:20:51.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d984d4b80 1 -- start start 2023-12-14T14:20:51.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739867ca0 0x555739883680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 0x55573987c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555739888ec0 con 0x555739871380 2023-12-14T14:20:51.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573987a010 con 0x555739871c90 2023-12-14T14:20:51.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555739877c90 con 0x555739867ca0 2023-12-14T14:20:51.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d898e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d898e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45710/0 (socket says 172.21.15.69:45710) 2023-12-14T14:20:51.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d898e1700 1 -- 172.21.15.69:0/3973746259 learned_addr learned my addr 172.21.15.69:0/3973746259 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d898e1700 1 -- 172.21.15.69:0/3973746259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739867ca0 msgr2=0x555739883680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3973746259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739867ca0 0x555739883680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d898e1700 1 -- 172.21.15.69:0/3973746259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 msgr2=0x55573987c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3973746259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 0x55573987c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d898e1700 1 -- 172.21.15.69:0/3973746259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555739789ec0 con 0x555739871380 2023-12-14T14:20:51.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d898e1700 1 --2- 172.21.15.69:0/3973746259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987bf40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1d78000c00 tx=0x7f1d780043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461f2e43b9b13889 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d755ad700 1 -- 172.21.15.69:0/3973746259 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780a2070 con 0x555739871380 2023-12-14T14:20:51.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d755ad700 1 -- 172.21.15.69:0/3973746259 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d78097d60 con 0x555739871380 2023-12-14T14:20:51.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.023+0000 7f1d755ad700 1 -- 172.21.15.69:0/3973746259 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78096330 con 0x555739871380 2023-12-14T14:20:51.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3973746259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 msgr2=0x55573987bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3973746259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987bf40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1d78000c00 tx=0x7f1d780043f0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3973746259 shutdown_connections 2023-12-14T14:20:51.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3973746259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 0x55573987c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3973746259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739867ca0 0x555739883680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/3973746259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739871380 0x55573987bf40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3973746259 >> 172.21.15.69:0/3973746259 conn(0x55573987f200 msgr2=0x555739874a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3973746259 shutdown_connections 2023-12-14T14:20:51.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 -- 172.21.15.69:0/3973746259 wait complete. 2023-12-14T14:20:51.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 -- start start 2023-12-14T14:20:51.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.024+0000 7f1d984d4b80 1 Processor -- start 2023-12-14T14:20:51.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739867ca0 0x5557398d6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871380 0x5557398d6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d984d4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 0x5557398da9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557398dafa0 con 0x555739867ca0 2023-12-14T14:20:51.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557398db110 con 0x555739871c90 2023-12-14T14:20:51.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d984d4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557398db2d0 con 0x555739871380 2023-12-14T14:20:51.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d984d4b80 10 client.0 _ll_register_callbacks cb 0x555739783910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:51.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a0e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739867ca0 0x5557398d6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a0e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739867ca0 0x5557398d6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45718/0 (socket says 172.21.15.69:45718) 2023-12-14T14:20:51.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a0e2700 1 -- 172.21.15.69:0/2761103677 learned_addr learned my addr 172.21.15.69:0/2761103677 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a8e3700 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 0x5557398da9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d898e1700 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871380 0x5557398d6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a0e2700 1 -- 172.21.15.69:0/2761103677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871380 msgr2=0x5557398d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871380 0x5557398d6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a0e2700 1 -- 172.21.15.69:0/2761103677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 msgr2=0x5557398da9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 0x5557398da9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a0e2700 1 -- 172.21.15.69:0/2761103677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8410f0d0 con 0x555739867ca0 2023-12-14T14:20:51.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a8e3700 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 0x5557398da9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:51.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d8a0e2700 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739867ca0 0x5557398d6450 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1d80003760 tx=0x7f1d800093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7372ab570daa68 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.025+0000 7f1d6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:51.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d6dffb700 1 -- 172.21.15.69:0/2761103677 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000b5c0 con 0x555739867ca0 2023-12-14T14:20:51.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d6dffb700 1 -- 172.21.15.69:0/2761103677 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1d8003e080 con 0x555739867ca0 2023-12-14T14:20:51.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2761103677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d7c013a50 con 0x555739867ca0 2023-12-14T14:20:51.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d6dffb700 1 -- 172.21.15.69:0/2761103677 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d80004050 con 0x555739867ca0 2023-12-14T14:20:51.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d984d4b80 10 client.16983 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:51.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2761103677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5557397709a0 con 0x555739867ca0 2023-12-14T14:20:51.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d6dffb700 1 -- 172.21.15.69:0/2761103677 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d7c013a50 con 0x555739867ca0 2023-12-14T14:20:51.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d6dffb700 1 -- 172.21.15.69:0/2761103677 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1d8000fb50 con 0x555739867ca0 2023-12-14T14:20:51.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d984d4b80 10 client.16983 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:51.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d984d4b80 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:51.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d984d4b80 20 client.16983 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:51.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55573987cb50 0x5557398e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d984d4b80 4 client.16983 mds_command: new command op to 24500 tid=0[{"prefix": "scrub status"}] 2023-12-14T14:20:51.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2761103677 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5557397bca00 con 0x55573987cb50 2023-12-14T14:20:51.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.026+0000 7f1d898e1700 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55573987cb50 0x5557398e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d6dffb700 10 client.16983 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:51.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d898e1700 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55573987cb50 0x5557398e58c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc2f6cdd2a6d9ec0 server_cookie=ecd89a05cd715cd1 in_seq=0 out_seq=0 2023-12-14T14:20:51.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d6dffb700 1 -- 172.21.15.69:0/2761103677 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5557397bca00 con 0x55573987cb50 2023-12-14T14:20:51.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d6dffb700 10 client.16983 handle_command_reply: tid=0 2023-12-14T14:20:51.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 client.16983 shutdown 2023-12-14T14:20:51.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2761103677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739867ca0 msgr2=0x5557398d6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739867ca0 0x5557398d6450 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1d80003760 tx=0x7f1d800093b0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2761103677 shutdown_connections 2023-12-14T14:20:51.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x55573987cb50 0x5557398e58c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555739871c90 0x5557398da9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555739867ca0 0x5557398d6450 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 --2- 172.21.15.69:0/2761103677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555739871380 0x5557398d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d6dffb700 0 client.16983 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:51.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2761103677 >> 172.21.15.69:0/2761103677 conn(0x55573987f200 msgr2=0x555739873350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2761103677 shutdown_connections 2023-12-14T14:20:51.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 1 -- 172.21.15.69:0/2761103677 wait complete. 2023-12-14T14:20:51.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.027+0000 7f1d984d4b80 20 client.16983 trim_cache size 0 max 16384 2023-12-14T14:20:51.040 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:20:51.040 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T14:20:51.040 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T14:20:51.040 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:20:51.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 -- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1d700a12c0 msgr2=0x7f1d700a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1d700a12c0 0x7f1d700a3770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d80006010 tx=0x7f1d80009f10 comp rx=0 tx=0).stop 2023-12-14T14:20:51.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 -- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ffd30 msgr2=0x7f1d84195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ffd30 0x7f1d84195850 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c8c0 tx=0x7f1d7800cbd0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 -- 172.21.15.69:0/3624254105 shutdown_connections 2023-12-14T14:20:51.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f1d700a12c0 0x7f1d700a3770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841043d0 0x7f1d84199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d840ff390 0x7f1d84195310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 --2- 172.21.15.69:0/3624254105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d840ffd30 0x7f1d84195850 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 -- 172.21.15.69:0/3624254105 >> 172.21.15.69:0/3624254105 conn(0x7f1d84075fd0 msgr2=0x7f1d840fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 -- 172.21.15.69:0/3624254105 shutdown_connections 2023-12-14T14:20:51.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.028+0000 7f1d8c346700 1 -- 172.21.15.69:0/3624254105 wait complete. 2023-12-14T14:20:51.043 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T14:20:51.044 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:20:51.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.166+0000 7fea592da700 1 -- 172.21.15.69:0/3079392986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 msgr2=0x7fea540ffea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.166+0000 7fea592da700 1 --2- 172.21.15.69:0/3079392986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 0x7fea540ffea0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fea44009990 tx=0x7fea44009ca0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.166+0000 7fea592da700 1 -- 172.21.15.69:0/3079392986 shutdown_connections 2023-12-14T14:20:51.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.166+0000 7fea592da700 1 --2- 172.21.15.69:0/3079392986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5410a880 0x7fea5410cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.166+0000 7fea592da700 1 --2- 172.21.15.69:0/3079392986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea54068c70 0x7fea540ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.166+0000 7fea592da700 1 --2- 172.21.15.69:0/3079392986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 0x7fea540ffea0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.166+0000 7fea592da700 1 -- 172.21.15.69:0/3079392986 >> 172.21.15.69:0/3079392986 conn(0x7fea54074a50 msgr2=0x7fea54074e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.166+0000 7fea592da700 1 -- 172.21.15.69:0/3079392986 shutdown_connections 2023-12-14T14:20:51.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.166+0000 7fea592da700 1 -- 172.21.15.69:0/3079392986 wait complete. 2023-12-14T14:20:51.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea592da700 1 Processor -- start 2023-12-14T14:20:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea592da700 1 -- start start 2023-12-14T14:20:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea592da700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 0x7fea54196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea592da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea5410a880 0x7fea54196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea592da700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5419adb0 0x7fea5419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea592da700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5419b820 con 0x7fea540ffa30 2023-12-14T14:20:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea592da700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5419b990 con 0x7fea5410a880 2023-12-14T14:20:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea592da700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5419bb50 con 0x7fea5419adb0 2023-12-14T14:20:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea52ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 0x7fea54196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea52ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 0x7fea54196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45736/0 (socket says 172.21.15.69:45736) 2023-12-14T14:20:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea52ffd700 1 -- 172.21.15.69:0/704933049 learned_addr learned my addr 172.21.15.69:0/704933049 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea527fc700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea5410a880 0x7fea54196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea52ffd700 1 -- 172.21.15.69:0/704933049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5419adb0 msgr2=0x7fea5419b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea52ffd700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5419adb0 0x7fea5419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea52ffd700 1 -- 172.21.15.69:0/704933049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea5410a880 msgr2=0x7fea54196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea52ffd700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea5410a880 0x7fea54196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.167+0000 7fea52ffd700 1 -- 172.21.15.69:0/704933049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440095f0 con 0x7fea540ffa30 2023-12-14T14:20:51.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.168+0000 7fea52ffd700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 0x7fea54196410 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00d950 tx=0x7fea3c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.168+0000 7fea4bfff700 1 -- 172.21.15.69:0/704933049 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c009b40 con 0x7fea540ffa30 2023-12-14T14:20:51.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.168+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea54110360 con 0x7fea540ffa30 2023-12-14T14:20:51.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.168+0000 7fea4bfff700 1 -- 172.21.15.69:0/704933049 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea3c009ca0 con 0x7fea540ffa30 2023-12-14T14:20:51.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.168+0000 7fea4bfff700 1 -- 172.21.15.69:0/704933049 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00f620 con 0x7fea540ffa30 2023-12-14T14:20:51.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.168+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea541101d0 con 0x7fea540ffa30 2023-12-14T14:20:51.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.169+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea541104f0 con 0x7fea540ffa30 2023-12-14T14:20:51.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.170+0000 7fea4bfff700 1 -- 172.21.15.69:0/704933049 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fea3c010460 con 0x7fea540ffa30 2023-12-14T14:20:51.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.170+0000 7fea4bfff700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fea400a12c0 0x7fea400a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.170+0000 7fea527fc700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fea400a12c0 0x7fea400a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.170+0000 7fea4bfff700 1 -- 172.21.15.69:0/704933049 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fea3c0cd090 con 0x7fea540ffa30 2023-12-14T14:20:51.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.171+0000 7fea527fc700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fea400a12c0 0x7fea400a3770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fea4400b5c0 tx=0x7fea44005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.174+0000 7fea4bfff700 1 -- 172.21.15.69:0/704933049 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fea3c0964b0 con 0x7fea540ffa30 2023-12-14T14:20:51.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.406+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea5402d010 con 0x7fea540ffa30 2023-12-14T14:20:51.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.407+0000 7fea4bfff700 1 -- 172.21.15.69:0/704933049 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+10801 (secure 0 0 0) 0x7fea3c099ad0 con 0x7fea540ffa30 2023-12-14T14:20:51.407 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:20:51.407 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:19:58.550404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:20:51.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.409+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fea400a12c0 msgr2=0x7fea400a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.409+0000 7fea592da700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fea400a12c0 0x7fea400a3770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fea4400b5c0 tx=0x7fea44005fb0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.409+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 msgr2=0x7fea54196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.409+0000 7fea592da700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 0x7fea54196410 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00d950 tx=0x7fea3c00dd10 comp rx=0 tx=0).stop 2023-12-14T14:20:51.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.409+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 shutdown_connections 2023-12-14T14:20:51.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.409+0000 7fea592da700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fea400a12c0 0x7fea400a3770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.409+0000 7fea592da700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5419adb0 0x7fea5419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.409+0000 7fea592da700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea540ffa30 0x7fea54196410 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.410+0000 7fea592da700 1 --2- 172.21.15.69:0/704933049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea5410a880 0x7fea54196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.410+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 >> 172.21.15.69:0/704933049 conn(0x7fea54074a50 msgr2=0x7fea54102780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.410+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 shutdown_connections 2023-12-14T14:20:51.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.410+0000 7fea592da700 1 -- 172.21.15.69:0/704933049 wait complete. 2023-12-14T14:20:51.411 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 33 2023-12-14T14:20:51.422 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T14:20:51.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.548+0000 7f14189a8700 1 -- 172.21.15.69:0/2158788062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14141043d0 msgr2=0x7f141410bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.548+0000 7f14189a8700 1 --2- 172.21.15.69:0/2158788062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14141043d0 0x7f141410bfa0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f140c00b0d0 tx=0x7f140c00b3e0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.549+0000 7f14189a8700 1 -- 172.21.15.69:0/2158788062 shutdown_connections 2023-12-14T14:20:51.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.549+0000 7f14189a8700 1 --2- 172.21.15.69:0/2158788062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14141043d0 0x7f141410bfa0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.549+0000 7f14189a8700 1 --2- 172.21.15.69:0/2158788062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14140ff390 0x7f14140ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.549+0000 7f14189a8700 1 --2- 172.21.15.69:0/2158788062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14140ffd30 0x7f1414103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.549+0000 7f14189a8700 1 -- 172.21.15.69:0/2158788062 >> 172.21.15.69:0/2158788062 conn(0x7f1414075fd0 msgr2=0x7f14140763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.549+0000 7f14189a8700 1 -- 172.21.15.69:0/2158788062 shutdown_connections 2023-12-14T14:20:51.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.549+0000 7f14189a8700 1 -- 172.21.15.69:0/2158788062 wait complete. 2023-12-14T14:20:51.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.549+0000 7f14189a8700 1 Processor -- start 2023-12-14T14:20:51.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14189a8700 1 -- start start 2023-12-14T14:20:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14189a8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14140ff390 0x7f1414195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14189a8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14140ffd30 0x7f14141958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14189a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14141043d0 0x7f1414199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14189a8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141419a350 con 0x7f14140ffd30 2023-12-14T14:20:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14189a8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141419a4c0 con 0x7f14141043d0 2023-12-14T14:20:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14189a8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141419a680 con 0x7f14140ff390 2023-12-14T14:20:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1411d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14140ffd30 0x7f14141958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1411d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14140ffd30 0x7f14141958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45758/0 (socket says 172.21.15.69:45758) 2023-12-14T14:20:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1411d9b700 1 -- 172.21.15.69:0/3446001375 learned_addr learned my addr 172.21.15.69:0/3446001375 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f141259c700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14140ff390 0x7f1414195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14141043d0 0x7f1414199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1411d9b700 1 -- 172.21.15.69:0/3446001375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14140ff390 msgr2=0x7f1414195370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1411d9b700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14140ff390 0x7f1414195370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1411d9b700 1 -- 172.21.15.69:0/3446001375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14141043d0 msgr2=0x7f1414199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1411d9b700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14141043d0 0x7f1414199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1411d9b700 1 -- 172.21.15.69:0/3446001375 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c009d00 con 0x7f14140ffd30 2023-12-14T14:20:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14141043d0 0x7f1414199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f1411d9b700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14140ffd30 0x7f14141958b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f140800e940 tx=0x7f140800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14037fe700 1 -- 172.21.15.69:0/3446001375 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408009730 con 0x7f14140ffd30 2023-12-14T14:20:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14037fe700 1 -- 172.21.15.69:0/3446001375 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f140800ee90 con 0x7f14140ffd30 2023-12-14T14:20:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.550+0000 7f14189a8700 1 -- 172.21.15.69:0/3446001375 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141410f1a0 con 0x7f14140ffd30 2023-12-14T14:20:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.551+0000 7f14037fe700 1 -- 172.21.15.69:0/3446001375 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408010ea0 con 0x7f14140ffd30 2023-12-14T14:20:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.551+0000 7f14189a8700 1 -- 172.21.15.69:0/3446001375 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141410f010 con 0x7f14140ffd30 2023-12-14T14:20:51.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.553+0000 7f14037fe700 1 -- 172.21.15.69:0/3446001375 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f140800cbd0 con 0x7f14140ffd30 2023-12-14T14:20:51.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.553+0000 7f14037fe700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13fc0a12c0 0x7f13fc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.553+0000 7f14037fe700 1 -- 172.21.15.69:0/3446001375 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1408014070 con 0x7f14140ffd30 2023-12-14T14:20:51.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.553+0000 7f141259c700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13fc0a12c0 0x7f13fc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.554+0000 7f141259c700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13fc0a12c0 0x7f13fc0a3770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1404009c60 tx=0x7f1404009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.554+0000 7f1424b36b80 1 Processor -- start 2023-12-14T14:20:51.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.554+0000 7f1424b36b80 1 -- start start 2023-12-14T14:20:51.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 0x55ccd285f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285fc90 0x55ccd286c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd286f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1424b36b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd27495e0 con 0x55ccd286cd60 2023-12-14T14:20:51.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1424b36b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd27b8870 con 0x55ccd285fc90 2023-12-14T14:20:51.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1424b36b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd27b1d00 con 0x55ccd285f380 2023-12-14T14:20:51.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1412d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd286f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1412d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd286f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45770/0 (socket says 172.21.15.69:45770) 2023-12-14T14:20:51.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f141259c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 0x55ccd285f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1412d9d700 1 -- 172.21.15.69:0/3437338581 learned_addr learned my addr 172.21.15.69:0/3437338581 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1411d9b700 1 --2- 172.21.15.69:0/3437338581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285fc90 0x55ccd286c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1412d9d700 1 -- 172.21.15.69:0/3437338581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 msgr2=0x55ccd285f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3437338581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 0x55ccd285f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1412d9d700 1 -- 172.21.15.69:0/3437338581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285fc90 msgr2=0x55ccd286c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3437338581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285fc90 0x55ccd286c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1412d9d700 1 -- 172.21.15.69:0/3437338581 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccd26333b0 con 0x55ccd286cd60 2023-12-14T14:20:51.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1411d9b700 1 --2- 172.21.15.69:0/3437338581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285fc90 0x55ccd286c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3437338581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd286f140 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f140c009310 tx=0x7f140c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973184b48b3b204e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1400ff9700 1 -- 172.21.15.69:0/3437338581 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00e040 con 0x55ccd286cd60 2023-12-14T14:20:51.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1400ff9700 1 -- 172.21.15.69:0/3437338581 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f140c00bca0 con 0x55ccd286cd60 2023-12-14T14:20:51.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.555+0000 7f1400ff9700 1 -- 172.21.15.69:0/3437338581 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c01c6a0 con 0x55ccd286cd60 2023-12-14T14:20:51.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.556+0000 7f1424b36b80 1 -- 172.21.15.69:0/3437338581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 msgr2=0x55ccd286f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.556+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3437338581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd286f140 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f140c009310 tx=0x7f140c009340 comp rx=0 tx=0).stop 2023-12-14T14:20:51.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.556+0000 7f1424b36b80 1 -- 172.21.15.69:0/3437338581 shutdown_connections 2023-12-14T14:20:51.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.556+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3437338581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd286f140 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.556+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3437338581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 0x55ccd285f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.556+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3437338581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285fc90 0x55ccd286c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.556+0000 7f1424b36b80 1 -- 172.21.15.69:0/3437338581 >> 172.21.15.69:0/3437338581 conn(0x55ccd2855ca0 msgr2=0x55ccd285b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.556+0000 7f1424b36b80 1 -- 172.21.15.69:0/3437338581 shutdown_connections 2023-12-14T14:20:51.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.556+0000 7f1424b36b80 1 -- 172.21.15.69:0/3437338581 wait complete. 2023-12-14T14:20:51.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1424b36b80 1 -- start start 2023-12-14T14:20:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1424b36b80 1 Processor -- start 2023-12-14T14:20:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 0x55ccd286c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd28699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2869f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1424b36b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd274df90 con 0x55ccd286cd60 2023-12-14T14:20:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1424b36b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd274dc30 con 0x55ccd285f380 2023-12-14T14:20:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1424b36b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd26356a0 con 0x55ccd285fc90 2023-12-14T14:20:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1424b36b80 10 client.0 _ll_register_callbacks cb 0x55ccd2771910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:51.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1412d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2869f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1412d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2869f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45778/0 (socket says 172.21.15.69:45778) 2023-12-14T14:20:51.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1412d9d700 1 -- 172.21.15.69:0/3604046162 learned_addr learned my addr 172.21.15.69:0/3604046162 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f141259c700 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 0x55ccd286c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1411d9b700 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd28699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1412d9d700 1 -- 172.21.15.69:0/3604046162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 msgr2=0x55ccd28699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd28699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1412d9d700 1 -- 172.21.15.69:0/3604046162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 msgr2=0x55ccd286c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 0x55ccd286c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1412d9d700 1 -- 172.21.15.69:0/3604046162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141410c7e0 con 0x55ccd286cd60 2023-12-14T14:20:51.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1411d9b700 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd28699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:51.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2869f80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f140c0092e0 tx=0x7f140c0074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271f4d8653b8a629 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.557+0000 7f13f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:51.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f13f9ffb700 1 -- 172.21.15.69:0/3604046162 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00e040 con 0x55ccd286cd60 2023-12-14T14:20:51.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f13f9ffb700 1 -- 172.21.15.69:0/3604046162 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f140c02b070 con 0x55ccd286cd60 2023-12-14T14:20:51.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f1424b36b80 1 -- 172.21.15.69:0/3604046162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ccd28532b0 con 0x55ccd286cd60 2023-12-14T14:20:51.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f13f9ffb700 1 -- 172.21.15.69:0/3604046162 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f140c030480 con 0x55ccd286cd60 2023-12-14T14:20:51.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f1424b36b80 10 client.17001 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:51.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f1424b36b80 1 -- 172.21.15.69:0/3604046162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55ccd2778170 con 0x55ccd286cd60 2023-12-14T14:20:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f13f9ffb700 1 -- 172.21.15.69:0/3604046162 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ccd28532b0 con 0x55ccd286cd60 2023-12-14T14:20:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f13f9ffb700 1 -- 172.21.15.69:0/3604046162 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f140c037070 con 0x55ccd286cd60 2023-12-14T14:20:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f1424b36b80 10 client.17001 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f1424b36b80 10 client.17001 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:20:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f1424b36b80 20 client.17001 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ccd287c0f0 0x55ccd287e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f1424b36b80 4 client.17001 mds_command: new command op to 24467 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f1424b36b80 1 -- 172.21.15.69:0/3604046162 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ccd27aace0 con 0x55ccd287c0f0 2023-12-14T14:20:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.558+0000 7f141259c700 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ccd287c0f0 0x55ccd287e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.559+0000 7f13f9ffb700 10 client.17001 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:20:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.559+0000 7f141259c700 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ccd287c0f0 0x55ccd287e4d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2338631b89045fe0 server_cookie=1fee615036b4b52d in_seq=0 out_seq=0 2023-12-14T14:20:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f13f9ffb700 1 -- 172.21.15.69:0/3604046162 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ccd27aace0 con 0x55ccd287c0f0 2023-12-14T14:20:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f13f9ffb700 10 client.17001 handle_command_reply: tid=0 2023-12-14T14:20:51.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 client.17001 shutdown 2023-12-14T14:20:51.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 -- 172.21.15.69:0/3604046162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 msgr2=0x55ccd2869f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2869f80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f140c0092e0 tx=0x7f140c0074a0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 -- 172.21.15.69:0/3604046162 shutdown_connections 2023-12-14T14:20:51.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ccd287c0f0 0x55ccd287e4d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2869f80 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 0x55ccd286c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f13f9ffb700 0 client.17001 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:20:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3604046162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd28699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 -- 172.21.15.69:0/3604046162 >> 172.21.15.69:0/3604046162 conn(0x55ccd2855ca0 msgr2=0x55ccd285b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 -- 172.21.15.69:0/3604046162 shutdown_connections 2023-12-14T14:20:51.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 1 -- 172.21.15.69:0/3604046162 wait complete. 2023-12-14T14:20:51.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.560+0000 7f1424b36b80 20 client.17001 trim_cache size 0 max 16384 2023-12-14T14:20:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1424b36b80 1 Processor -- start 2023-12-14T14:20:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1424b36b80 1 -- start start 2023-12-14T14:20:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 0x55ccd286c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd286c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2864ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1424b36b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd2860580 con 0x55ccd286cd60 2023-12-14T14:20:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1424b36b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd2867f20 con 0x55ccd285f380 2023-12-14T14:20:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1424b36b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd2865810 con 0x55ccd285fc90 2023-12-14T14:20:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1412d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2864ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1412d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2864ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45788/0 (socket says 172.21.15.69:45788) 2023-12-14T14:20:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1412d9d700 1 -- 172.21.15.69:0/3052350870 learned_addr learned my addr 172.21.15.69:0/3052350870 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f141259c700 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 0x55ccd286c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1411d9b700 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd286c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1412d9d700 1 -- 172.21.15.69:0/3052350870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 msgr2=0x55ccd286c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.573+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd286c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1412d9d700 1 -- 172.21.15.69:0/3052350870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 msgr2=0x55ccd286c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 0x55ccd286c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1412d9d700 1 -- 172.21.15.69:0/3052350870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccd2777ec0 con 0x55ccd286cd60 2023-12-14T14:20:51.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f141259c700 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 0x55ccd286c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1411d9b700 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd286c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1412d9d700 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2864ce0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f140c007aa0 tx=0x7f140c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163478c2c4f709cc server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f14017fa700 1 -- 172.21.15.69:0/3052350870 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00e070 con 0x55ccd286cd60 2023-12-14T14:20:51.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f14017fa700 1 -- 172.21.15.69:0/3052350870 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f140c029070 con 0x55ccd286cd60 2023-12-14T14:20:51.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f14017fa700 1 -- 172.21.15.69:0/3052350870 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c030ba0 con 0x55ccd286cd60 2023-12-14T14:20:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1424b36b80 1 -- 172.21.15.69:0/3052350870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 msgr2=0x55ccd2864ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2864ce0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f140c007aa0 tx=0x7f140c009b80 comp rx=0 tx=0).stop 2023-12-14T14:20:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1424b36b80 1 -- 172.21.15.69:0/3052350870 shutdown_connections 2023-12-14T14:20:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd286cd60 0x55ccd2864ce0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd285f380 0x55ccd286c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1424b36b80 1 --2- 172.21.15.69:0/3052350870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285fc90 0x55ccd286c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1424b36b80 1 -- 172.21.15.69:0/3052350870 >> 172.21.15.69:0/3052350870 conn(0x55ccd2855ca0 msgr2=0x55ccd2878a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1424b36b80 1 -- 172.21.15.69:0/3052350870 shutdown_connections 2023-12-14T14:20:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.574+0000 7f1424b36b80 1 -- 172.21.15.69:0/3052350870 wait complete. 2023-12-14T14:20:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1424b36b80 1 -- start start 2023-12-14T14:20:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1424b36b80 1 Processor -- start 2023-12-14T14:20:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 0x55ccd2871610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd285fc90 0x55ccd2871b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1424b36b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd286cd60 0x55ccd28cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1424b36b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd28cf490 con 0x55ccd285fc90 2023-12-14T14:20:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1424b36b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd28cf5d0 con 0x55ccd286cd60 2023-12-14T14:20:51.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1424b36b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccd28cf710 con 0x55ccd285f380 2023-12-14T14:20:51.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1424b36b80 10 client.0 _ll_register_callbacks cb 0x7f14040096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:51.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1411d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd285fc90 0x55ccd2871b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1411d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd285fc90 0x55ccd2871b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45802/0 (socket says 172.21.15.69:45802) 2023-12-14T14:20:51.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1411d9b700 1 -- 172.21.15.69:0/2672672572 learned_addr learned my addr 172.21.15.69:0/2672672572 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1412d9d700 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd286cd60 0x55ccd28cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f141259c700 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 0x55ccd2871610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1411d9b700 1 -- 172.21.15.69:0/2672672572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 msgr2=0x55ccd2871610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1411d9b700 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 0x55ccd2871610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1411d9b700 1 -- 172.21.15.69:0/2672672572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd286cd60 msgr2=0x55ccd28cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1411d9b700 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd286cd60 0x55ccd28cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.575+0000 7f1411d9b700 1 -- 172.21.15.69:0/2672672572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ccd2778170 con 0x55ccd285fc90 2023-12-14T14:20:51.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1411d9b700 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd285fc90 0x55ccd2871b50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1408096470 tx=0x7f140809a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb7b7388fdee9a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f13f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:51.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f13f9ffb700 1 -- 172.21.15.69:0/2672672572 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080a23c0 con 0x55ccd285fc90 2023-12-14T14:20:51.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f13f9ffb700 1 -- 172.21.15.69:0/2672672572 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f14080a1f30 con 0x55ccd285fc90 2023-12-14T14:20:51.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1424b36b80 1 -- 172.21.15.69:0/2672672572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f140c00bca0 con 0x55ccd285fc90 2023-12-14T14:20:51.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f13f9ffb700 1 -- 172.21.15.69:0/2672672572 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14080b8300 con 0x55ccd285fc90 2023-12-14T14:20:51.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1424b36b80 10 client.17007 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:51.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1424b36b80 1 -- 172.21.15.69:0/2672672572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55ccd275e9a0 con 0x55ccd285fc90 2023-12-14T14:20:51.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f13f9ffb700 1 -- 172.21.15.69:0/2672672572 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14080c8020 con 0x55ccd285fc90 2023-12-14T14:20:51.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f13f9ffb700 1 -- 172.21.15.69:0/2672672572 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1408098ed0 con 0x55ccd285fc90 2023-12-14T14:20:51.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1424b36b80 10 client.17007 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:51.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1424b36b80 10 client.17007 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-14T14:20:51.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1424b36b80 20 client.17007 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:51.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1424b36b80 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ccd28d0da0 0x55ccd28d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1424b36b80 4 client.17007 mds_command: new command op to 24467 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:20:51.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f1424b36b80 1 -- 172.21.15.69:0/2672672572 --> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ccd27aaa00 con 0x55ccd28d0da0 2023-12-14T14:20:51.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.576+0000 7f141259c700 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ccd28d0da0 0x55ccd28d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f13f9ffb700 10 client.17007 ms_handle_connect on v2:172.21.15.81:6836/3031029983 2023-12-14T14:20:51.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f141259c700 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ccd28d0da0 0x55ccd28d31b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40d4ebc7b2348744 server_cookie=94225cd8e7744538 in_seq=0 out_seq=0 2023-12-14T14:20:51.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f13f9ffb700 1 -- 172.21.15.69:0/2672672572 <== mds.2 v2:172.21.15.81:6836/3031029983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ccd27aaa00 con 0x55ccd28d0da0 2023-12-14T14:20:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f13f9ffb700 10 client.17007 handle_command_reply: tid=0 2023-12-14T14:20:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 client.17007 shutdown 2023-12-14T14:20:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 -- 172.21.15.69:0/2672672572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd285fc90 msgr2=0x55ccd2871b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd285fc90 0x55ccd2871b50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1408096470 tx=0x7f140809a060 comp rx=0 tx=0).stop 2023-12-14T14:20:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 -- 172.21.15.69:0/2672672572 shutdown_connections 2023-12-14T14:20:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ccd286cd60 0x55ccd28cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccd285f380 0x55ccd2871610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.81:6836/3031029983,v1:172.21.15.81:6837/3031029983] conn(0x55ccd28d0da0 0x55ccd28d31b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 --2- 172.21.15.69:0/2672672572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccd285fc90 0x55ccd2871b50 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f13f9ffb700 0 client.17007 ms_handle_reset on v2:172.21.15.81:6836/3031029983 2023-12-14T14:20:51.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 -- 172.21.15.69:0/2672672572 >> 172.21.15.69:0/2672672572 conn(0x55ccd2855ca0 msgr2=0x55ccd2864ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 -- 172.21.15.69:0/2672672572 shutdown_connections 2023-12-14T14:20:51.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 1 -- 172.21.15.69:0/2672672572 wait complete. 2023-12-14T14:20:51.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.577+0000 7f1424b36b80 20 client.17007 trim_cache size 0 max 16384 2023-12-14T14:20:51.592 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:20:51.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 -- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13fc0a12c0 msgr2=0x7f13fc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13fc0a12c0 0x7f13fc0a3770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1404009c60 tx=0x7f1404009260 comp rx=0 tx=0).stop 2023-12-14T14:20:51.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 -- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14140ffd30 msgr2=0x7f14141958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14140ffd30 0x7f14141958b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f140800e940 tx=0x7f140800ec50 comp rx=0 tx=0).stop 2023-12-14T14:20:51.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 -- 172.21.15.69:0/3446001375 shutdown_connections 2023-12-14T14:20:51.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13fc0a12c0 0x7f13fc0a3770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14141043d0 0x7f1414199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14140ff390 0x7f1414195370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 --2- 172.21.15.69:0/3446001375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14140ffd30 0x7f14141958b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 -- 172.21.15.69:0/3446001375 >> 172.21.15.69:0/3446001375 conn(0x7f1414075fd0 msgr2=0x7f14140fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 -- 172.21.15.69:0/3446001375 shutdown_connections 2023-12-14T14:20:51.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.578+0000 7f14189a8700 1 -- 172.21.15.69:0/3446001375 wait complete. 2023-12-14T14:20:51.596 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T14:20:51.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.721+0000 7f82d5831700 1 -- 172.21.15.69:0/3293071323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0105510 msgr2=0x7f82d010d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.721+0000 7f82d5831700 1 --2- 172.21.15.69:0/3293071323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0105510 0x7f82d010d0e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f82c800b0d0 tx=0x7f82c800b3e0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.721+0000 7f82d5831700 1 -- 172.21.15.69:0/3293071323 shutdown_connections 2023-12-14T14:20:51.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.721+0000 7f82d5831700 1 --2- 172.21.15.69:0/3293071323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0105510 0x7f82d010d0e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.721+0000 7f82d5831700 1 --2- 172.21.15.69:0/3293071323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d01004d0 0x7f82d01008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.721+0000 7f82d5831700 1 --2- 172.21.15.69:0/3293071323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d0100e70 0x7f82d0104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.721+0000 7f82d5831700 1 -- 172.21.15.69:0/3293071323 >> 172.21.15.69:0/3293071323 conn(0x7f82d00fbd20 msgr2=0x7f82d00fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.721+0000 7f82d5831700 1 -- 172.21.15.69:0/3293071323 shutdown_connections 2023-12-14T14:20:51.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.721+0000 7f82d5831700 1 -- 172.21.15.69:0/3293071323 wait complete. 2023-12-14T14:20:51.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.722+0000 7f82d5831700 1 Processor -- start 2023-12-14T14:20:51.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.722+0000 7f82d5831700 1 -- start start 2023-12-14T14:20:51.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.722+0000 7f82d5831700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01004d0 0x7f82d01964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.722+0000 7f82d5831700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0100e70 0x7f82d0196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.722+0000 7f82d5831700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d0105510 0x7f82d019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.722+0000 7f82d5831700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d019b4b0 con 0x7f82d0100e70 2023-12-14T14:20:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.722+0000 7f82d5831700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d019b620 con 0x7f82d01004d0 2023-12-14T14:20:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.722+0000 7f82d5831700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d019b7e0 con 0x7f82d0105510 2023-12-14T14:20:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ce7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0100e70 0x7f82d0196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ce7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0100e70 0x7f82d0196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45820/0 (socket says 172.21.15.69:45820) 2023-12-14T14:20:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ce7fc700 1 -- 172.21.15.69:0/1010575985 learned_addr learned my addr 172.21.15.69:0/1010575985 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82cf7fe700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d0105510 0x7f82d019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01004d0 0x7f82d01964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ce7fc700 1 -- 172.21.15.69:0/1010575985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d0105510 msgr2=0x7f82d019ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d0105510 0x7f82d019ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ce7fc700 1 -- 172.21.15.69:0/1010575985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01004d0 msgr2=0x7f82d01964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01004d0 0x7f82d01964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ce7fc700 1 -- 172.21.15.69:0/1010575985 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009d00 con 0x7f82d0100e70 2023-12-14T14:20:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0100e70 0x7f82d0196a10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f82c400e940 tx=0x7f82c400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82d482f700 1 -- 172.21.15.69:0/1010575985 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4009730 con 0x7f82d0100e70 2023-12-14T14:20:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82d482f700 1 -- 172.21.15.69:0/1010575985 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82c400ee90 con 0x7f82d0100e70 2023-12-14T14:20:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82d5831700 1 -- 172.21.15.69:0/1010575985 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d01102e0 con 0x7f82d0100e70 2023-12-14T14:20:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82d482f700 1 -- 172.21.15.69:0/1010575985 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4010ea0 con 0x7f82d0100e70 2023-12-14T14:20:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.723+0000 7f82d5831700 1 -- 172.21.15.69:0/1010575985 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d0110150 con 0x7f82d0100e70 2023-12-14T14:20:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.725+0000 7f82d482f700 1 -- 172.21.15.69:0/1010575985 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f82c400cbd0 con 0x7f82d0100e70 2023-12-14T14:20:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.726+0000 7f82d482f700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f82b80a12c0 0x7f82b80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.726+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f82b80a12c0 0x7f82b80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.726+0000 7f82d482f700 1 -- 172.21.15.69:0/1010575985 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f82c4014070 con 0x7f82d0100e70 2023-12-14T14:20:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.726+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f82b80a12c0 0x7f82b80a3770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009bf0 tx=0x7f82c0009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.726+0000 7f82e19bfb80 1 Processor -- start 2023-12-14T14:20:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.726+0000 7f82e19bfb80 1 -- start start 2023-12-14T14:20:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83380 0x5586efa83750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83c90 0x5586efa8e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa90f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586ef96d5e0 con 0x5586efa83c90 2023-12-14T14:20:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586ef9dc870 con 0x5586efa83380 2023-12-14T14:20:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586ef9d5d00 con 0x5586efa8eb50 2023-12-14T14:20:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ce7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83c90 0x5586efa8e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ce7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83c90 0x5586efa8e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45822/0 (socket says 172.21.15.69:45822) 2023-12-14T14:20:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ce7fc700 1 -- 172.21.15.69:0/1953226126 learned_addr learned my addr 172.21.15.69:0/1953226126 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82cf7fe700 1 --2- 172.21.15.69:0/1953226126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa90f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ce7fc700 1 -- 172.21.15.69:0/1953226126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 msgr2=0x5586efa90f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1953226126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa90f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ce7fc700 1 -- 172.21.15.69:0/1953226126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83380 msgr2=0x5586efa83750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1953226126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83380 0x5586efa83750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1953226126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83380 0x5586efa83750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ce7fc700 1 -- 172.21.15.69:0/1953226126 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586ef8573b0 con 0x5586efa83c90 2023-12-14T14:20:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1953226126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83c90 0x5586efa8e610 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009230 tx=0x7f82c4099ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5d824eb8b9eac9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82b5ffb700 1 -- 172.21.15.69:0/1953226126 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c409a1d0 con 0x5586efa83c90 2023-12-14T14:20:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82b5ffb700 1 -- 172.21.15.69:0/1953226126 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82c409a330 con 0x5586efa83c90 2023-12-14T14:20:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.727+0000 7f82b5ffb700 1 -- 172.21.15.69:0/1953226126 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4094b80 con 0x5586efa83c90 2023-12-14T14:20:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1953226126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83c90 msgr2=0x5586efa8e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1953226126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83c90 0x5586efa8e610 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009230 tx=0x7f82c4099ff0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1953226126 shutdown_connections 2023-12-14T14:20:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1953226126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa90f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1953226126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83380 0x5586efa83750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1953226126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83c90 0x5586efa8e610 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1953226126 >> 172.21.15.69:0/1953226126 conn(0x5586efa79ca0 msgr2=0x5586efa7f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1953226126 shutdown_connections 2023-12-14T14:20:51.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1953226126 wait complete. 2023-12-14T14:20:51.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.728+0000 7f82e19bfb80 1 -- start start 2023-12-14T14:20:51.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82e19bfb80 1 Processor -- start 2023-12-14T14:20:51.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa8e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa8b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa8bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586ef971f90 con 0x5586efa83380 2023-12-14T14:20:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586ef971c30 con 0x5586efa83c90 2023-12-14T14:20:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586ef8596a0 con 0x5586efa8eb50 2023-12-14T14:20:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82e19bfb80 10 client.0 _ll_register_callbacks cb 0x5586ef995910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82ceffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa8e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82ceffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa8e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45824/0 (socket says 172.21.15.69:45824) 2023-12-14T14:20:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82ceffd700 1 -- 172.21.15.69:0/1570996456 learned_addr learned my addr 172.21.15.69:0/1570996456 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa8b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.729+0000 7f82cf7fe700 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa8bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82ceffd700 1 -- 172.21.15.69:0/1570996456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 msgr2=0x5586efa8bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa8bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82ceffd700 1 -- 172.21.15.69:0/1570996456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 msgr2=0x5586efa8b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa8b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82ceffd700 1 -- 172.21.15.69:0/1570996456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d0110150 con 0x5586efa83380 2023-12-14T14:20:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82cf7fe700 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa8bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa8e5d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005910 tx=0x7f82c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da04f2218d7f4b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82aeffd700 1 -- 172.21.15.69:0/1570996456 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0004220 con 0x5586efa83380 2023-12-14T14:20:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82aeffd700 1 -- 172.21.15.69:0/1570996456 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f82c0018070 con 0x5586efa83380 2023-12-14T14:20:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1570996456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586efa772b0 con 0x5586efa83380 2023-12-14T14:20:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82aeffd700 1 -- 172.21.15.69:0/1570996456 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82c0004380 con 0x5586efa83380 2023-12-14T14:20:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82e19bfb80 10 client.17019 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1570996456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5586ef99c170 con 0x5586efa83380 2023-12-14T14:20:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82aeffd700 1 -- 172.21.15.69:0/1570996456 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5586efa772b0 con 0x5586efa83380 2023-12-14T14:20:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82aeffd700 1 -- 172.21.15.69:0/1570996456 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f82c002e070 con 0x5586efa83380 2023-12-14T14:20:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82e19bfb80 10 client.17019 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82e19bfb80 10 client.17019 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:20:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82e19bfb80 20 client.17019 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5586efa9e550 0x5586efaa0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82e19bfb80 4 client.17019 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:51.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.730+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1570996456 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586ef9cece0 con 0x5586efa9e550 2023-12-14T14:20:51.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.731+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5586efa9e550 0x5586efaa0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.731+0000 7f82aeffd700 10 client.17019 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:20:51.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.731+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5586efa9e550 0x5586efaa0960 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4e99ab915b6cf5c server_cookie=aed49e5fd683a846 in_seq=0 out_seq=0 2023-12-14T14:20:51.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82aeffd700 1 -- 172.21.15.69:0/1570996456 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5586ef9cece0 con 0x5586efa9e550 2023-12-14T14:20:51.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82aeffd700 10 client.17019 handle_command_reply: tid=0 2023-12-14T14:20:51.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 client.17019 shutdown 2023-12-14T14:20:51.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1570996456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 msgr2=0x5586efa8e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa8e5d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005910 tx=0x7f82c00047c0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1570996456 shutdown_connections 2023-12-14T14:20:51.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa8bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5586efa9e550 0x5586efaa0960 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa8e5d0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1570996456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa8b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1570996456 >> 172.21.15.69:0/1570996456 conn(0x5586efa79ca0 msgr2=0x5586efa7f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82aeffd700 0 client.17019 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:20:51.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1570996456 shutdown_connections 2023-12-14T14:20:51.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1570996456 wait complete. 2023-12-14T14:20:51.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.732+0000 7f82e19bfb80 20 client.17019 trim_cache size 0 max 16384 2023-12-14T14:20:51.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.745+0000 7f82e19bfb80 1 Processor -- start 2023-12-14T14:20:51.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.745+0000 7f82e19bfb80 1 -- start start 2023-12-14T14:20:51.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.745+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa86270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.745+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa8e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.745+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa8e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.745+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586efa80550 con 0x5586efa83380 2023-12-14T14:20:51.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.745+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586efa7e5b0 con 0x5586efa83c90 2023-12-14T14:20:51.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.745+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586efa87740 con 0x5586efa8eb50 2023-12-14T14:20:51.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.745+0000 7f82ceffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa86270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ceffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa86270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45828/0 (socket says 172.21.15.69:45828) 2023-12-14T14:20:51.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ceffd700 1 -- 172.21.15.69:0/1079513073 learned_addr learned my addr 172.21.15.69:0/1079513073 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ceffd700 1 -- 172.21.15.69:0/1079513073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 msgr2=0x5586efa8e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1079513073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa8e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1079513073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ceffd700 1 -- 172.21.15.69:0/1079513073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 msgr2=0x5586efa8e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1079513073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa8e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ceffd700 1 -- 172.21.15.69:0/1079513073 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586ef99bec0 con 0x5586efa83380 2023-12-14T14:20:51.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/1079513073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa8e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82ceffd700 1 --2- 172.21.15.69:0/1079513073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa86270 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f82c0011f80 tx=0x7f82c0011fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d69ff9efe93d65 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82b67fc700 1 -- 172.21.15.69:0/1079513073 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0005ce0 con 0x5586efa83380 2023-12-14T14:20:51.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82b67fc700 1 -- 172.21.15.69:0/1079513073 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82c0016070 con 0x5586efa83380 2023-12-14T14:20:51.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.746+0000 7f82b67fc700 1 -- 172.21.15.69:0/1079513073 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0030420 con 0x5586efa83380 2023-12-14T14:20:51.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1079513073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 msgr2=0x5586efa86270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1079513073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa86270 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f82c0011f80 tx=0x7f82c0011fb0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1079513073 shutdown_connections 2023-12-14T14:20:51.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1079513073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa8e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1079513073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa86270 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/1079513073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa8e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1079513073 >> 172.21.15.69:0/1079513073 conn(0x5586efa79ca0 msgr2=0x5586efa86bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1079513073 shutdown_connections 2023-12-14T14:20:51.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 -- 172.21.15.69:0/1079513073 wait complete. 2023-12-14T14:20:51.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 -- start start 2023-12-14T14:20:51.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 Processor -- start 2023-12-14T14:20:51.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa95820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa937c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586efa93ed0 con 0x5586efa83380 2023-12-14T14:20:51.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586efa94040 con 0x5586efa83c90 2023-12-14T14:20:51.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.747+0000 7f82e19bfb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586efa94200 con 0x5586efa8eb50 2023-12-14T14:20:51.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82e19bfb80 10 client.0 _ll_register_callbacks cb 0x7f82c0011de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:51.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ceffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ceffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa952e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45832/0 (socket says 172.21.15.69:45832) 2023-12-14T14:20:51.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ceffd700 1 -- 172.21.15.69:0/3778370593 learned_addr learned my addr 172.21.15.69:0/3778370593 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82cf7fe700 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa937c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa95820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ceffd700 1 -- 172.21.15.69:0/3778370593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 msgr2=0x5586efa937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ceffd700 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa937c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ceffd700 1 -- 172.21.15.69:0/3778370593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 msgr2=0x5586efa95820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ceffd700 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa95820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ceffd700 1 -- 172.21.15.69:0/3778370593 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586ef99c170 con 0x5586efa83380 2023-12-14T14:20:51.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82ceffd700 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa952e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f82c001f820 tx=0x7f82c00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f63bdc4fcf30892 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:51.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82aeffd700 1 -- 172.21.15.69:0/3778370593 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0005590 con 0x5586efa83380 2023-12-14T14:20:51.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82aeffd700 1 -- 172.21.15.69:0/3778370593 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f82c0035030 con 0x5586efa83380 2023-12-14T14:20:51.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82e19bfb80 1 -- 172.21.15.69:0/3778370593 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82c409a330 con 0x5586efa83380 2023-12-14T14:20:51.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82aeffd700 1 -- 172.21.15.69:0/3778370593 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82c00056f0 con 0x5586efa83380 2023-12-14T14:20:51.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82e19bfb80 10 client.17025 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:51.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82e19bfb80 1 -- 172.21.15.69:0/3778370593 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5586ef9829a0 con 0x5586efa83380 2023-12-14T14:20:51.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.748+0000 7f82aeffd700 1 -- 172.21.15.69:0/3778370593 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82c409a330 con 0x5586efa83380 2023-12-14T14:20:51.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82aeffd700 1 -- 172.21.15.69:0/3778370593 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f82c002e070 con 0x5586efa83380 2023-12-14T14:20:51.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82e19bfb80 10 client.17025 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:51.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82e19bfb80 10 client.17025 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-14T14:20:51.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82e19bfb80 20 client.17025 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:51.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5586efaf3150 0x5586efaf5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82e19bfb80 4 client.17025 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:20:51.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82e19bfb80 1 -- 172.21.15.69:0/3778370593 --> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5586ef9cea00 con 0x5586efaf3150 2023-12-14T14:20:51.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5586efaf3150 0x5586efaf5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82aeffd700 10 client.17025 ms_handle_connect on v2:172.21.15.119:6838/1957200331 2023-12-14T14:20:51.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82ce7fc700 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5586efaf3150 0x5586efaf5530 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bcaa26459ac7b0f3 server_cookie=a3bc9a00d757466 in_seq=0 out_seq=0 2023-12-14T14:20:51.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82aeffd700 1 -- 172.21.15.69:0/3778370593 <== mds.1 v2:172.21.15.119:6838/1957200331 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5586ef9cea00 con 0x5586efaf3150 2023-12-14T14:20:51.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.749+0000 7f82aeffd700 10 client.17025 handle_command_reply: tid=0 2023-12-14T14:20:51.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 client.17025 shutdown 2023-12-14T14:20:51.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 -- 172.21.15.69:0/3778370593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 msgr2=0x5586efa952e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa952e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f82c001f820 tx=0x7f82c00058a0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 -- 172.21.15.69:0/3778370593 shutdown_connections 2023-12-14T14:20:51.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5586efa8eb50 0x5586efa937c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.119:6838/1957200331,v1:172.21.15.119:6839/1957200331] conn(0x5586efaf3150 0x5586efaf5530 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5586efa83380 0x5586efa952e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82aeffd700 0 client.17025 ms_handle_reset on v2:172.21.15.119:6838/1957200331 2023-12-14T14:20:51.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 --2- 172.21.15.69:0/3778370593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586efa83c90 0x5586efa95820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 -- 172.21.15.69:0/3778370593 >> 172.21.15.69:0/3778370593 conn(0x5586efa79ca0 msgr2=0x5586efa8b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 -- 172.21.15.69:0/3778370593 shutdown_connections 2023-12-14T14:20:51.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 1 -- 172.21.15.69:0/3778370593 wait complete. 2023-12-14T14:20:51.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82e19bfb80 20 client.17025 trim_cache size 0 max 16384 2023-12-14T14:20:51.766 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:20:51.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 -- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f82b80a12c0 msgr2=0x7f82b80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f82b80a12c0 0x7f82b80a3770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009bf0 tx=0x7f82c0009260 comp rx=0 tx=0).stop 2023-12-14T14:20:51.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 -- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0100e70 msgr2=0x7f82d0196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0100e70 0x7f82d0196a10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f82c400e940 tx=0x7f82c400ec50 comp rx=0 tx=0).stop 2023-12-14T14:20:51.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 -- 172.21.15.69:0/1010575985 shutdown_connections 2023-12-14T14:20:51.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f82b80a12c0 0x7f82b80a3770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d0105510 0x7f82d019ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01004d0 0x7f82d01964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 --2- 172.21.15.69:0/1010575985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82d0100e70 0x7f82d0196a10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 -- 172.21.15.69:0/1010575985 >> 172.21.15.69:0/1010575985 conn(0x7f82d00fbd20 msgr2=0x7f82d00fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.750+0000 7f82d5831700 1 -- 172.21.15.69:0/1010575985 shutdown_connections 2023-12-14T14:20:51.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.751+0000 7f82d5831700 1 -- 172.21.15.69:0/1010575985 wait complete. 2023-12-14T14:20:51.769 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:51 smithi069 ceph-mon[42034]: pgmap v317: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-14T14:20:51.769 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:51 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/704933049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:20:51.769 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T14:20:51.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.893+0000 7f19a0890700 1 -- 172.21.15.69:0/914092446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 msgr2=0x7f199c10cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.893+0000 7f19a0890700 1 --2- 172.21.15.69:0/914092446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 0x7f199c10cc60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f199400b0a0 tx=0x7f199400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.893+0000 7f19a0890700 1 -- 172.21.15.69:0/914092446 shutdown_connections 2023-12-14T14:20:51.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.893+0000 7f19a0890700 1 --2- 172.21.15.69:0/914092446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 0x7f199c10cc60 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.893+0000 7f19a0890700 1 --2- 172.21.15.69:0/914092446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f199c0760f0 0x7f199c0ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.893+0000 7f19a0890700 1 --2- 172.21.15.69:0/914092446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f199c0ff9b0 0x7f199c0ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.893+0000 7f19a0890700 1 -- 172.21.15.69:0/914092446 >> 172.21.15.69:0/914092446 conn(0x7f199c074a60 msgr2=0x7f199c074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.893+0000 7f19a0890700 1 -- 172.21.15.69:0/914092446 shutdown_connections 2023-12-14T14:20:51.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.893+0000 7f19a0890700 1 -- 172.21.15.69:0/914092446 wait complete. 2023-12-14T14:20:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f19a0890700 1 Processor -- start 2023-12-14T14:20:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f19a0890700 1 -- start start 2023-12-14T14:20:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f19a0890700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f199c0760f0 0x7f199c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f19a0890700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f199c0ff9b0 0x7f199c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f19a0890700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 0x7f199c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f19a0890700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19d580 con 0x7f199c10a880 2023-12-14T14:20:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f19a0890700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19d6f0 con 0x7f199c0ff9b0 2023-12-14T14:20:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f19a0890700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19d8b0 con 0x7f199c0760f0 2023-12-14T14:20:51.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 0x7f199c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 0x7f199c19cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45842/0 (socket says 172.21.15.69:45842) 2023-12-14T14:20:51.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.894+0000 7f199ad9d700 1 -- 172.21.15.69:0/4051525884 learned_addr learned my addr 172.21.15.69:0/4051525884 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f199a59c700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f199c0760f0 0x7f199c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f1999d9b700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f199c0ff9b0 0x7f199c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f199ad9d700 1 -- 172.21.15.69:0/4051525884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f199c0760f0 msgr2=0x7f199c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f199ad9d700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f199c0760f0 0x7f199c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f199ad9d700 1 -- 172.21.15.69:0/4051525884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f199c0ff9b0 msgr2=0x7f199c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f199ad9d700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f199c0ff9b0 0x7f199c198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f199ad9d700 1 -- 172.21.15.69:0/4051525884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994009d00 con 0x7f199c10a880 2023-12-14T14:20:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f199ad9d700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 0x7f199c19cf40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f19940062a0 tx=0x7f19940079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f198b7fe700 1 -- 172.21.15.69:0/4051525884 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400e040 con 0x7f199c10a880 2023-12-14T14:20:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f19a0890700 1 -- 172.21.15.69:0/4051525884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c110240 con 0x7f199c10a880 2023-12-14T14:20:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f198b7fe700 1 -- 172.21.15.69:0/4051525884 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1994004d60 con 0x7f199c10a880 2023-12-14T14:20:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f198b7fe700 1 -- 172.21.15.69:0/4051525884 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199401d480 con 0x7f199c10a880 2023-12-14T14:20:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.895+0000 7f19a0890700 1 -- 172.21.15.69:0/4051525884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c1100b0 con 0x7f199c10a880 2023-12-14T14:20:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.897+0000 7f198b7fe700 1 -- 172.21.15.69:0/4051525884 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f19940040b0 con 0x7f199c10a880 2023-12-14T14:20:51.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:51 smithi081 ceph-mon[43371]: pgmap v317: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-14T14:20:51.901 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:51 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/704933049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:20:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.898+0000 7f198b7fe700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f19840a12c0 0x7f19840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.898+0000 7f198b7fe700 1 -- 172.21.15.69:0/4051525884 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f19940ce730 con 0x7f199c10a880 2023-12-14T14:20:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.898+0000 7f199a59c700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f19840a12c0 0x7f19840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.898+0000 7f199a59c700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f19840a12c0 0x7f19840a3770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1990005950 tx=0x7f199000b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f19aca1eb80 1 Processor -- start 2023-12-14T14:20:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f19aca1eb80 1 -- start start 2023-12-14T14:20:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 0x5563f32df750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f32ea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32eab50 0x5563f32ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f31c95e0 con 0x5563f32dfc90 2023-12-14T14:20:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f3238870 con 0x5563f32df380 2023-12-14T14:20:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f3231d00 con 0x5563f32eab50 2023-12-14T14:20:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f1999d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f32ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f1999d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f32ea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45846/0 (socket says 172.21.15.69:45846) 2023-12-14T14:20:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f1999d9b700 1 -- 172.21.15.69:0/1053717124 learned_addr learned my addr 172.21.15.69:0/1053717124 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.899+0000 7f199a59c700 1 --2- 172.21.15.69:0/1053717124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 0x5563f32df750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f199ad9d700 1 --2- 172.21.15.69:0/1053717124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32eab50 0x5563f32ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f1999d9b700 1 -- 172.21.15.69:0/1053717124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32eab50 msgr2=0x5563f32ecf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f1999d9b700 1 --2- 172.21.15.69:0/1053717124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32eab50 0x5563f32ecf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f1999d9b700 1 -- 172.21.15.69:0/1053717124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 msgr2=0x5563f32df750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f1999d9b700 1 --2- 172.21.15.69:0/1053717124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 0x5563f32df750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f1999d9b700 1 -- 172.21.15.69:0/1053717124 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563f30b33b0 con 0x5563f32dfc90 2023-12-14T14:20:51.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f1999d9b700 1 --2- 172.21.15.69:0/1053717124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f32ea610 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f198c008c30 tx=0x7f198c008f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ff0725e462dc14 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f1988ff9700 1 -- 172.21.15.69:0/1053717124 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c00ed70 con 0x5563f32dfc90 2023-12-14T14:20:51.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f1988ff9700 1 -- 172.21.15.69:0/1053717124 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f198c00eed0 con 0x5563f32dfc90 2023-12-14T14:20:51.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.900+0000 7f1988ff9700 1 -- 172.21.15.69:0/1053717124 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c010430 con 0x5563f32dfc90 2023-12-14T14:20:51.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1053717124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 msgr2=0x5563f32ea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1053717124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f32ea610 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f198c008c30 tx=0x7f198c008f40 comp rx=0 tx=0).stop 2023-12-14T14:20:51.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1053717124 shutdown_connections 2023-12-14T14:20:51.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1053717124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32eab50 0x5563f32ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1053717124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 0x5563f32df750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1053717124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f32ea610 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1053717124 >> 172.21.15.69:0/1053717124 conn(0x5563f32d5ca0 msgr2=0x5563f32db7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1053717124 shutdown_connections 2023-12-14T14:20:51.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1053717124 wait complete. 2023-12-14T14:20:51.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 -- start start 2023-12-14T14:20:51.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.901+0000 7f19aca1eb80 1 Processor -- start 2023-12-14T14:20:51.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 0x5563f32ea4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32dfc90 0x5563f32e7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32eab50 0x5563f32e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f31cdf90 con 0x5563f32eab50 2023-12-14T14:20:51.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f31cdc30 con 0x5563f32df380 2023-12-14T14:20:51.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f30b56a0 con 0x5563f32dfc90 2023-12-14T14:20:51.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 10 client.0 _ll_register_callbacks cb 0x5563f31f1910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:51.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32eab50 0x5563f32e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32eab50 0x5563f32e7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45858/0 (socket says 172.21.15.69:45858) 2023-12-14T14:20:51.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199ad9d700 1 -- 172.21.15.69:0/1536799027 learned_addr learned my addr 172.21.15.69:0/1536799027 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199a59c700 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 0x5563f32ea4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f1999d9b700 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32dfc90 0x5563f32e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199ad9d700 1 -- 172.21.15.69:0/1536799027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32dfc90 msgr2=0x5563f32e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199ad9d700 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32dfc90 0x5563f32e7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199ad9d700 1 -- 172.21.15.69:0/1536799027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 msgr2=0x5563f32ea4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199ad9d700 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 0x5563f32ea4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199ad9d700 1 -- 172.21.15.69:0/1536799027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c008890 con 0x5563f32eab50 2023-12-14T14:20:51.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f199ad9d700 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32eab50 0x5563f32e7e80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1994097d40 tx=0x7f199409b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab12f13625206f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f1981ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:51.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f1981ffb700 1 -- 172.21.15.69:0/1536799027 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994003ec0 con 0x5563f32eab50 2023-12-14T14:20:51.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f1981ffb700 1 -- 172.21.15.69:0/1536799027 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f1994011390 con 0x5563f32eab50 2023-12-14T14:20:51.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1536799027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563f32d32b0 con 0x5563f32eab50 2023-12-14T14:20:51.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f1981ffb700 1 -- 172.21.15.69:0/1536799027 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19940bb2c0 con 0x5563f32eab50 2023-12-14T14:20:51.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 10 client.17037 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:51.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.902+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1536799027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5563f31f8170 con 0x5563f32eab50 2023-12-14T14:20:51.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f1981ffb700 1 -- 172.21.15.69:0/1536799027 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5563f32d32b0 con 0x5563f32eab50 2023-12-14T14:20:51.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f1981ffb700 1 -- 172.21.15.69:0/1536799027 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f199409ad30 con 0x5563f32eab50 2023-12-14T14:20:51.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f19aca1eb80 10 client.17037 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:51.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f19aca1eb80 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:51.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f19aca1eb80 20 client.17037 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:51.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5563f32fa2b0 0x5563f32fc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f19aca1eb80 4 client.17037 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T14:20:51.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1536799027 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563f322ace0 con 0x5563f32fa2b0 2023-12-14T14:20:51.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f199a59c700 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5563f32fa2b0 0x5563f32fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f1981ffb700 10 client.17037 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:51.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.903+0000 7f199a59c700 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5563f32fa2b0 0x5563f32fc690 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec13b4bcd332b9ed server_cookie=ec491ec337e471df in_seq=0 out_seq=0 2023-12-14T14:20:51.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f1981ffb700 1 -- 172.21.15.69:0/1536799027 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5563f322ace0 con 0x5563f32fa2b0 2023-12-14T14:20:51.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f1981ffb700 10 client.17037 handle_command_reply: tid=0 2023-12-14T14:20:51.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 client.17037 shutdown 2023-12-14T14:20:51.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1536799027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32eab50 msgr2=0x5563f32e7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32eab50 0x5563f32e7e80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1994097d40 tx=0x7f199409b700 comp rx=0 tx=0).stop 2023-12-14T14:20:51.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1536799027 shutdown_connections 2023-12-14T14:20:51.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5563f32fa2b0 0x5563f32fc690 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32eab50 0x5563f32e7e80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32df380 0x5563f32ea4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f1981ffb700 0 client.17037 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:51.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/1536799027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32dfc90 0x5563f32e7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1536799027 >> 172.21.15.69:0/1536799027 conn(0x5563f32d5ca0 msgr2=0x5563f32db3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1536799027 shutdown_connections 2023-12-14T14:20:51.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 1 -- 172.21.15.69:0/1536799027 wait complete. 2023-12-14T14:20:51.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.904+0000 7f19aca1eb80 20 client.17037 trim_cache size 0 max 16384 2023-12-14T14:20:51.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f19aca1eb80 1 Processor -- start 2023-12-14T14:20:51.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f19aca1eb80 1 -- start start 2023-12-14T14:20:51.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32d5ca0 0x5563f32f1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 0x5563f32e2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32dfc90 0x5563f32e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f32e05b0 con 0x5563f32d5ca0 2023-12-14T14:20:51.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f32f6f70 con 0x5563f32dfc90 2023-12-14T14:20:51.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f32e22c0 con 0x5563f32df380 2023-12-14T14:20:51.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f199a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32d5ca0 0x5563f32f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f199a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32d5ca0 0x5563f32f1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45872/0 (socket says 172.21.15.69:45872) 2023-12-14T14:20:51.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.917+0000 7f199a59c700 1 -- 172.21.15.69:0/3079787754 learned_addr learned my addr 172.21.15.69:0/3079787754 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f199ad9d700 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32dfc90 0x5563f32e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f199a59c700 1 -- 172.21.15.69:0/3079787754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 msgr2=0x5563f32e2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f1999d9b700 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 0x5563f32e2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f199a59c700 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 0x5563f32e2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f199a59c700 1 -- 172.21.15.69:0/3079787754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32dfc90 msgr2=0x5563f32e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f199a59c700 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32dfc90 0x5563f32e3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f199a59c700 1 -- 172.21.15.69:0/3079787754 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563f31f7ec0 con 0x5563f32d5ca0 2023-12-14T14:20:51.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f199ad9d700 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32dfc90 0x5563f32e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f1999d9b700 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 0x5563f32e2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f199a59c700 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32d5ca0 0x5563f32f1690 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1990010a40 tx=0x7f1990013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16285a9d8e092268 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19897fa700 1 -- 172.21.15.69:0/3079787754 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990024040 con 0x5563f32d5ca0 2023-12-14T14:20:51.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19897fa700 1 -- 172.21.15.69:0/3079787754 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1990015070 con 0x5563f32d5ca0 2023-12-14T14:20:51.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19897fa700 1 -- 172.21.15.69:0/3079787754 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990004a90 con 0x5563f32d5ca0 2023-12-14T14:20:51.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19aca1eb80 1 -- 172.21.15.69:0/3079787754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32d5ca0 msgr2=0x5563f32f1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32d5ca0 0x5563f32f1690 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1990010a40 tx=0x7f1990013000 comp rx=0 tx=0).stop 2023-12-14T14:20:51.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19aca1eb80 1 -- 172.21.15.69:0/3079787754 shutdown_connections 2023-12-14T14:20:51.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32dfc90 0x5563f32e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32d5ca0 0x5563f32f1690 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/3079787754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 0x5563f32e2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19aca1eb80 1 -- 172.21.15.69:0/3079787754 >> 172.21.15.69:0/3079787754 conn(0x5563f32ed200 msgr2=0x5563f32f6860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.918+0000 7f19aca1eb80 1 -- 172.21.15.69:0/3079787754 shutdown_connections 2023-12-14T14:20:51.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 1 -- 172.21.15.69:0/3079787754 wait complete. 2023-12-14T14:20:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 1 -- start start 2023-12-14T14:20:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 1 Processor -- start 2023-12-14T14:20:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32d5ca0 0x5563f33464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 0x5563f33469e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f3342070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f3342640 con 0x5563f32dfc90 2023-12-14T14:20:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f33427b0 con 0x5563f32d5ca0 2023-12-14T14:20:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f3342970 con 0x5563f32df380 2023-12-14T14:20:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f19aca1eb80 10 client.0 _ll_register_callbacks cb 0x7f1994097b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T14:20:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f3342070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f3342070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45888/0 (socket says 172.21.15.69:45888) 2023-12-14T14:20:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f199ad9d700 1 -- 172.21.15.69:0/2284498650 learned_addr learned my addr 172.21.15.69:0/2284498650 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.919+0000 7f1999d9b700 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 0x5563f33469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f199a59c700 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32d5ca0 0x5563f33464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f199ad9d700 1 -- 172.21.15.69:0/2284498650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 msgr2=0x5563f33469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f199ad9d700 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 0x5563f33469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f199ad9d700 1 -- 172.21.15.69:0/2284498650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32d5ca0 msgr2=0x5563f33464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T14:20:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f199ad9d700 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32d5ca0 0x5563f33464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f199ad9d700 1 -- 172.21.15.69:0/2284498650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1990010e80 con 0x5563f32dfc90 2023-12-14T14:20:51.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f199a59c700 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32d5ca0 0x5563f33464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:20:51.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f199ad9d700 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f3342070 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f19940a3770 tx=0x7f1994004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fd2083d8d2bf97 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:51.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f1981ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T14:20:51.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f1981ffb700 1 -- 172.21.15.69:0/2284498650 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940ca070 con 0x5563f32dfc90 2023-12-14T14:20:51.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f1981ffb700 1 -- 172.21.15.69:0/2284498650 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f19940b5030 con 0x5563f32dfc90 2023-12-14T14:20:51.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f19aca1eb80 1 -- 172.21.15.69:0/2284498650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f198c00eed0 con 0x5563f32dfc90 2023-12-14T14:20:51.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f1981ffb700 1 -- 172.21.15.69:0/2284498650 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f199409b1a0 con 0x5563f32dfc90 2023-12-14T14:20:51.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f19aca1eb80 10 client.17043 fetch_fsmap learned FSMap version 33 2023-12-14T14:20:51.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f19aca1eb80 1 -- 172.21.15.69:0/2284498650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5563f31de9a0 con 0x5563f32dfc90 2023-12-14T14:20:51.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f1981ffb700 1 -- 172.21.15.69:0/2284498650 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f198c00eed0 con 0x5563f32dfc90 2023-12-14T14:20:51.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f1981ffb700 1 -- 172.21.15.69:0/2284498650 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f19940a3830 con 0x5563f32dfc90 2023-12-14T14:20:51.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f19aca1eb80 10 client.17043 fetch_fsmap finished waiting for FSMap version 33 2023-12-14T14:20:51.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f19aca1eb80 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T14:20:51.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f19aca1eb80 20 client.17043 populate_metadata read hostname 'smithi069' 2023-12-14T14:20:51.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5563f32eab50 0x5563f3350e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:51.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f19aca1eb80 4 client.17043 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-12-14T14:20:51.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.920+0000 7f19aca1eb80 1 -- 172.21.15.69:0/2284498650 --> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5563f322aa00 con 0x5563f32eab50 2023-12-14T14:20:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f199a59c700 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5563f32eab50 0x5563f3350e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f1981ffb700 10 client.17043 ms_handle_connect on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f199a59c700 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5563f32eab50 0x5563f3350e60 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcc7077c6a5fae51 server_cookie=8e8734a46307c2cb in_seq=0 out_seq=0 2023-12-14T14:20:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f1981ffb700 1 -- 172.21.15.69:0/2284498650 <== mds.0 v2:172.21.15.81:6838/2690299654 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5563f322aa00 con 0x5563f32eab50 2023-12-14T14:20:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f1981ffb700 10 client.17043 handle_command_reply: tid=0 2023-12-14T14:20:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 client.17043 shutdown 2023-12-14T14:20:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 -- 172.21.15.69:0/2284498650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 msgr2=0x5563f3342070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f3342070 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f19940a3770 tx=0x7f1994004ed0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 -- 172.21.15.69:0/2284498650 shutdown_connections 2023-12-14T14:20:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.81:6838/2690299654,v1:172.21.15.81:6839/2690299654] conn(0x5563f32eab50 0x5563f3350e60 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5563f32dfc90 0x5563f3342070 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f1981ffb700 0 client.17043 ms_handle_reset on v2:172.21.15.81:6838/2690299654 2023-12-14T14:20:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f32d5ca0 0x5563f33464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 --2- 172.21.15.69:0/2284498650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5563f32df380 0x5563f33469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 -- 172.21.15.69:0/2284498650 >> 172.21.15.69:0/2284498650 conn(0x5563f32ed200 msgr2=0x5563f32e2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 -- 172.21.15.69:0/2284498650 shutdown_connections 2023-12-14T14:20:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.921+0000 7f19aca1eb80 1 -- 172.21.15.69:0/2284498650 wait complete. 2023-12-14T14:20:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19aca1eb80 20 client.17043 trim_cache size 0 max 16384 2023-12-14T14:20:51.939 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T14:20:51.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 -- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f19840a12c0 msgr2=0x7f19840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f19840a12c0 0x7f19840a3770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1990005950 tx=0x7f199000b410 comp rx=0 tx=0).stop 2023-12-14T14:20:51.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 -- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 msgr2=0x7f199c19cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:51.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 0x7f199c19cf40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f19940062a0 tx=0x7f19940079b0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 -- 172.21.15.69:0/4051525884 shutdown_connections 2023-12-14T14:20:51.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f19840a12c0 0x7f19840a3770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c10a880 0x7f199c19cf40 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f199c0760f0 0x7f199c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 --2- 172.21.15.69:0/4051525884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f199c0ff9b0 0x7f199c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 -- 172.21.15.69:0/4051525884 >> 172.21.15.69:0/4051525884 conn(0x7f199c074a60 msgr2=0x7f199c101170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 -- 172.21.15.69:0/4051525884 shutdown_connections 2023-12-14T14:20:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:51.922+0000 7f19a0890700 1 -- 172.21.15.69:0/4051525884 wait complete. 2023-12-14T14:20:52.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:51 smithi119 ceph-mon[43834]: pgmap v317: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-14T14:20:52.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:51 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/704933049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:20:52.943 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2023-12-14T14:20:52.943 INFO:tasks.fwd_scrub:done joining 2023-12-14T14:20:52.944 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-12-14T14:20:52.954 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:20:53.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 -- 172.21.15.69:0/3701708312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 msgr2=0x7fa1b4100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 --2- 172.21.15.69:0/3701708312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 0x7fa1b4100e50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009990 tx=0x7fa1a8009ca0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 -- 172.21.15.69:0/3701708312 shutdown_connections 2023-12-14T14:20:53.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 --2- 172.21.15.69:0/3701708312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4101390 0x7fa1b410cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 --2- 172.21.15.69:0/3701708312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b4106330 0x7fa1b4106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 --2- 172.21.15.69:0/3701708312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 0x7fa1b4100e50 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 -- 172.21.15.69:0/3701708312 >> 172.21.15.69:0/3701708312 conn(0x7fa1b4077530 msgr2=0x7fa1b4077930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:53.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 -- 172.21.15.69:0/3701708312 shutdown_connections 2023-12-14T14:20:53.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 -- 172.21.15.69:0/3701708312 wait complete. 2023-12-14T14:20:53.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 Processor -- start 2023-12-14T14:20:53.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.090+0000 7fa1b9970700 1 -- start start 2023-12-14T14:20:53.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b9970700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 0x7fa1b41963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b9970700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4101390 0x7fa1b4196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b9970700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b4106330 0x7fa1b419ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b9970700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b419b3a0 con 0x7fa1b41009e0 2023-12-14T14:20:53.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b9970700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b419b510 con 0x7fa1b4106330 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b9970700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b419b6d0 con 0x7fa1b4101390 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 0x7fa1b41963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 0x7fa1b41963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45904/0 (socket says 172.21.15.69:45904) 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b2ffd700 1 -- 172.21.15.69:0/1060806706 learned_addr learned my addr 172.21.15.69:0/1060806706 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b37fe700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b4106330 0x7fa1b419ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b27fc700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4101390 0x7fa1b4196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b2ffd700 1 -- 172.21.15.69:0/1060806706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4101390 msgr2=0x7fa1b4196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b2ffd700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4101390 0x7fa1b4196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b2ffd700 1 -- 172.21.15.69:0/1060806706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b4106330 msgr2=0x7fa1b419ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b2ffd700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b4106330 0x7fa1b419ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b2ffd700 1 -- 172.21.15.69:0/1060806706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80095f0 con 0x7fa1b41009e0 2023-12-14T14:20:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b27fc700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4101390 0x7fa1b4196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b2ffd700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 0x7fa1b41963c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400e9a0 tx=0x7fa1a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b896e700 1 -- 172.21.15.69:0/1060806706 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4009790 con 0x7fa1b41009e0 2023-12-14T14:20:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b896e700 1 -- 172.21.15.69:0/1060806706 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1a400cbd0 con 0x7fa1b41009e0 2023-12-14T14:20:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.091+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b4110380 con 0x7fa1b41009e0 2023-12-14T14:20:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.092+0000 7fa1b896e700 1 -- 172.21.15.69:0/1060806706 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4018680 con 0x7fa1b41009e0 2023-12-14T14:20:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.092+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b41101f0 con 0x7fa1b41009e0 2023-12-14T14:20:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.092+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b4110510 con 0x7fa1b41009e0 2023-12-14T14:20:53.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.094+0000 7fa1b896e700 1 -- 172.21.15.69:0/1060806706 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa1a400cd40 con 0x7fa1b41009e0 2023-12-14T14:20:53.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.094+0000 7fa1b896e700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa19c0a12c0 0x7fa19c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.094+0000 7fa1b27fc700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa19c0a12c0 0x7fa19c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.094+0000 7fa1b896e700 1 -- 172.21.15.69:0/1060806706 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fa1a4014070 con 0x7fa1b41009e0 2023-12-14T14:20:53.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.095+0000 7fa1b27fc700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa19c0a12c0 0x7fa19c0a3770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1b41979d0 tx=0x7fa1a8005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:53.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.097+0000 7fa1b896e700 1 -- 172.21.15.69:0/1060806706 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa1a4096660 con 0x7fa1b41009e0 2023-12-14T14:20:53.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.287+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1b41a3490 con 0x7fa1b41009e0 2023-12-14T14:20:53.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.289+0000 7fa1b896e700 1 -- 172.21.15.69:0/1060806706 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+22961 (secure 0 0 0) 0x7fa1a4099c80 con 0x7fa1b41009e0 2023-12-14T14:20:53.288 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:20:53.288 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":93,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:20:21.408500+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2692968417":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6801/933503151":"2023-12-15T14:10:38.311291+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3434546944":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/4262786097":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/3288224909":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/933503151":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/590492119":"2023-12-15T14:10:38.311291+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:20:53.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa19c0a12c0 msgr2=0x7fa19c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa19c0a12c0 0x7fa19c0a3770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1b41979d0 tx=0x7fa1a8005fb0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 msgr2=0x7fa1b41963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 0x7fa1b41963c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400e9a0 tx=0x7fa1a400ecb0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 shutdown_connections 2023-12-14T14:20:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa19c0a12c0 0x7fa19c0a3770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b4106330 0x7fa1b419ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1b41009e0 0x7fa1b41963c0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 --2- 172.21.15.69:0/1060806706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4101390 0x7fa1b4196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 >> 172.21.15.69:0/1060806706 conn(0x7fa1b4077530 msgr2=0x7fa1b40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 shutdown_connections 2023-12-14T14:20:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.291+0000 7fa1b9970700 1 -- 172.21.15.69:0/1060806706 wait complete. 2023-12-14T14:20:53.303 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T14:09:08.720147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T14:09:09.776845+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 92, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:20:53.303 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:20:53.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.428+0000 7f7c37c35700 1 -- 172.21.15.69:0/3921701447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 msgr2=0x7f7c3010bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.428+0000 7f7c37c35700 1 --2- 172.21.15.69:0/3921701447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 0x7f7c3010bfa0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800b0d0 tx=0x7f7c2800b3e0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 -- 172.21.15.69:0/3921701447 shutdown_connections 2023-12-14T14:20:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 --2- 172.21.15.69:0/3921701447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 0x7f7c3010bfa0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 --2- 172.21.15.69:0/3921701447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300ff390 0x7f7c300ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 --2- 172.21.15.69:0/3921701447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c300ffd30 0x7f7c30103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 -- 172.21.15.69:0/3921701447 >> 172.21.15.69:0/3921701447 conn(0x7f7c30075fd0 msgr2=0x7f7c300763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 -- 172.21.15.69:0/3921701447 shutdown_connections 2023-12-14T14:20:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 -- 172.21.15.69:0/3921701447 wait complete. 2023-12-14T14:20:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 Processor -- start 2023-12-14T14:20:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 -- start start 2023-12-14T14:20:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c300ff390 0x7f7c30100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300ffd30 0x7f7c301012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 0x7f7c301a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30101b00 con 0x7f7c301043d0 2023-12-14T14:20:53.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c301a4cb0 con 0x7f7c300ff390 2023-12-14T14:20:53.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.429+0000 7f7c37c35700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c301a4df0 con 0x7f7c300ffd30 2023-12-14T14:20:53.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c361d2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 0x7f7c301a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c361d2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 0x7f7c301a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45924/0 (socket says 172.21.15.69:45924) 2023-12-14T14:20:53.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c361d2700 1 -- 172.21.15.69:0/749945906 learned_addr learned my addr 172.21.15.69:0/749945906 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:53.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c351d0700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300ffd30 0x7f7c301012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c361d2700 1 -- 172.21.15.69:0/749945906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300ffd30 msgr2=0x7f7c301012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c361d2700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300ffd30 0x7f7c301012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c361d2700 1 -- 172.21.15.69:0/749945906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c300ff390 msgr2=0x7f7c30100d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c361d2700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c300ff390 0x7f7c30100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c361d2700 1 -- 172.21.15.69:0/749945906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28009d00 con 0x7f7c301043d0 2023-12-14T14:20:53.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c361d2700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 0x7f7c301a4770 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7c280077f0 tx=0x7f7c280078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:53.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c26ffd700 1 -- 172.21.15.69:0/749945906 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800e040 con 0x7f7c301043d0 2023-12-14T14:20:53.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c26ffd700 1 -- 172.21.15.69:0/749945906 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c28003e10 con 0x7f7c301043d0 2023-12-14T14:20:53.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3010f260 con 0x7f7c301043d0 2023-12-14T14:20:53.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c26ffd700 1 -- 172.21.15.69:0/749945906 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2801b9d0 con 0x7f7c301043d0 2023-12-14T14:20:53.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.430+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3010f0d0 con 0x7f7c301043d0 2023-12-14T14:20:53.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.431+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3010f3f0 con 0x7f7c301043d0 2023-12-14T14:20:53.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.432+0000 7f7c26ffd700 1 -- 172.21.15.69:0/749945906 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7c280056a0 con 0x7f7c301043d0 2023-12-14T14:20:53.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.433+0000 7f7c26ffd700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7c1c0a1340 0x7f7c1c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.433+0000 7f7c359d1700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7c1c0a1340 0x7f7c1c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.433+0000 7f7c26ffd700 1 -- 172.21.15.69:0/749945906 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f7c280ceea0 con 0x7f7c301043d0 2023-12-14T14:20:53.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.433+0000 7f7c359d1700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7c1c0a1340 0x7f7c1c0a37f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0097b0 tx=0x7f7c2c006d20 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:53.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.437+0000 7f7c26ffd700 1 -- 172.21.15.69:0/749945906 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7c28098330 con 0x7f7c301043d0 2023-12-14T14:20:53.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:53 smithi069 ceph-mon[42034]: pgmap v318: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2023-12-14T14:20:53.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:53 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1060806706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:20:53.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.624+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c301a5760 con 0x7f7c301043d0 2023-12-14T14:20:53.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.624+0000 7f7c26ffd700 1 -- 172.21.15.69:0/749945906 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c2801f020 con 0x7f7c301043d0 2023-12-14T14:20:53.624 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:20:53.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.626+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7c1c0a1340 msgr2=0x7f7c1c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.626+0000 7f7c37c35700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7c1c0a1340 0x7f7c1c0a37f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0097b0 tx=0x7f7c2c006d20 comp rx=0 tx=0).stop 2023-12-14T14:20:53.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.626+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 msgr2=0x7f7c301a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.626+0000 7f7c37c35700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 0x7f7c301a4770 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7c280077f0 tx=0x7f7c280078d0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.626+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 shutdown_connections 2023-12-14T14:20:53.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.626+0000 7f7c37c35700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f7c1c0a1340 0x7f7c1c0a37f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.626+0000 7f7c37c35700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c301043d0 0x7f7c301a4770 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.626+0000 7f7c37c35700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c300ff390 0x7f7c30100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.627+0000 7f7c37c35700 1 --2- 172.21.15.69:0/749945906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300ffd30 0x7f7c301012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.627+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 >> 172.21.15.69:0/749945906 conn(0x7f7c30075fd0 msgr2=0x7f7c30067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:53.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.627+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 shutdown_connections 2023-12-14T14:20:53.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.627+0000 7f7c37c35700 1 -- 172.21.15.69:0/749945906 wait complete. 2023-12-14T14:20:53.638 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T14:20:53.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.762+0000 7f9816dae700 1 -- 172.21.15.69:0/2536854819 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810109af0 msgr2=0x7f981010bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.762+0000 7f9816dae700 1 --2- 172.21.15.69:0/2536854819 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810109af0 0x7f981010bed0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f980800b0a0 tx=0x7f980800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.762+0000 7f9816dae700 1 -- 172.21.15.69:0/2536854819 shutdown_connections 2023-12-14T14:20:53.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.762+0000 7f9816dae700 1 --2- 172.21.15.69:0/2536854819 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810109af0 0x7f981010bed0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.762+0000 7f9816dae700 1 --2- 172.21.15.69:0/2536854819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810100540 0x7f9810100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.762+0000 7f9816dae700 1 --2- 172.21.15.69:0/2536854819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9810100e50 0x7f98101095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.762+0000 7f9816dae700 1 -- 172.21.15.69:0/2536854819 >> 172.21.15.69:0/2536854819 conn(0x7f98100749c0 msgr2=0x7f9810074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:53.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.762+0000 7f9816dae700 1 -- 172.21.15.69:0/2536854819 shutdown_connections 2023-12-14T14:20:53.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.762+0000 7f9816dae700 1 -- 172.21.15.69:0/2536854819 wait complete. 2023-12-14T14:20:53.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.763+0000 7f9816dae700 1 Processor -- start 2023-12-14T14:20:53.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.763+0000 7f9816dae700 1 -- start start 2023-12-14T14:20:53.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.763+0000 7f9816dae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810100540 0x7f9810195320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.763+0000 7f9816dae700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810100e50 0x7f9810195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.763+0000 7f9816dae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9810109af0 0x7f9810199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.763+0000 7f9816dae700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981019a300 con 0x7f9810100540 2023-12-14T14:20:53.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.763+0000 7f9816dae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981019a470 con 0x7f9810109af0 2023-12-14T14:20:53.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.763+0000 7f9816dae700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981019a630 con 0x7f9810100e50 2023-12-14T14:20:53.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9814b4a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810100540 0x7f9810195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9814b4a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810100540 0x7f9810195320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45940/0 (socket says 172.21.15.69:45940) 2023-12-14T14:20:53.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9814b4a700 1 -- 172.21.15.69:0/149157715 learned_addr learned my addr 172.21.15.69:0/149157715 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:53.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f980ffff700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810100e50 0x7f9810195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f981534b700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9810109af0 0x7f9810199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9814b4a700 1 -- 172.21.15.69:0/149157715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810100e50 msgr2=0x7f9810195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9814b4a700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810100e50 0x7f9810195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9814b4a700 1 -- 172.21.15.69:0/149157715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9810109af0 msgr2=0x7f9810199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9814b4a700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9810109af0 0x7f9810199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9814b4a700 1 -- 172.21.15.69:0/149157715 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808009d00 con 0x7f9810100540 2023-12-14T14:20:53.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9814b4a700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810100540 0x7f9810195320 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f980400d950 tx=0x7f980400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:53.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f980dffb700 1 -- 172.21.15.69:0/149157715 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804009940 con 0x7f9810100540 2023-12-14T14:20:53.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f980dffb700 1 -- 172.21.15.69:0/149157715 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9804010460 con 0x7f9810100540 2023-12-14T14:20:53.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981010f140 con 0x7f9810100540 2023-12-14T14:20:53.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f980dffb700 1 -- 172.21.15.69:0/149157715 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400f620 con 0x7f9810100540 2023-12-14T14:20:53.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.764+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981010efb0 con 0x7f9810100540 2023-12-14T14:20:53.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.765+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981010f2d0 con 0x7f9810100540 2023-12-14T14:20:53.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.766+0000 7f980dffb700 1 -- 172.21.15.69:0/149157715 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f98040108d0 con 0x7f9810100540 2023-12-14T14:20:53.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.767+0000 7f980dffb700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98000a12c0 0x7f98000a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:53.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.767+0000 7f980dffb700 1 -- 172.21.15.69:0/149157715 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f98040ccb90 con 0x7f9810100540 2023-12-14T14:20:53.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.767+0000 7f980ffff700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98000a12c0 0x7f98000a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:53.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.767+0000 7f980ffff700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98000a12c0 0x7f98000a3770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9810196930 tx=0x7f97fc00a300 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:53.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.771+0000 7f980dffb700 1 -- 172.21.15.69:0/149157715 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9804095fb0 con 0x7f9810100540 2023-12-14T14:20:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:53 smithi081 ceph-mon[43371]: pgmap v318: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2023-12-14T14:20:53.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:53 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1060806706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:20:53.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.956+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9810067e40 con 0x7f9810100540 2023-12-14T14:20:53.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.957+0000 7f980dffb700 1 -- 172.21.15.69:0/149157715 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9804016020 con 0x7f9810100540 2023-12-14T14:20:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T14:20:53.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98000a12c0 msgr2=0x7f98000a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98000a12c0 0x7f98000a3770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9810196930 tx=0x7f97fc00a300 comp rx=0 tx=0).stop 2023-12-14T14:20:53.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810100540 msgr2=0x7f9810195320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:53.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810100540 0x7f9810195320 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f980400d950 tx=0x7f980400dc60 comp rx=0 tx=0).stop 2023-12-14T14:20:53.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 shutdown_connections 2023-12-14T14:20:53.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f98000a12c0 0x7f98000a3770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9810109af0 0x7f9810199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9810100540 0x7f9810195320 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 --2- 172.21.15.69:0/149157715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810100e50 0x7f9810195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:53.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 >> 172.21.15.69:0/149157715 conn(0x7f98100749c0 msgr2=0x7f98100fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:53.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 shutdown_connections 2023-12-14T14:20:53.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:53.959+0000 7f9816dae700 1 -- 172.21.15.69:0/149157715 wait complete. 2023-12-14T14:20:53.970 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T14:20:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:53 smithi119 ceph-mon[43834]: pgmap v318: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2023-12-14T14:20:54.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:53 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1060806706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:20:54.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.095+0000 7f2119eac700 1 -- 172.21.15.69:0/2685266219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141054f0 msgr2=0x7f211410d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:54.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.095+0000 7f2119eac700 1 --2- 172.21.15.69:0/2685266219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141054f0 0x7f211410d0c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f210c00b0d0 tx=0x7f210c00b3e0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.095+0000 7f2119eac700 1 -- 172.21.15.69:0/2685266219 shutdown_connections 2023-12-14T14:20:54.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.095+0000 7f2119eac700 1 --2- 172.21.15.69:0/2685266219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141054f0 0x7f211410d0c0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.095+0000 7f2119eac700 1 --2- 172.21.15.69:0/2685266219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21141004b0 0x7f2114100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.095+0000 7f2119eac700 1 --2- 172.21.15.69:0/2685266219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2114100e50 0x7f2114104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.095+0000 7f2119eac700 1 -- 172.21.15.69:0/2685266219 >> 172.21.15.69:0/2685266219 conn(0x7f21140fbd40 msgr2=0x7f21140fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:54.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.095+0000 7f2119eac700 1 -- 172.21.15.69:0/2685266219 shutdown_connections 2023-12-14T14:20:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.095+0000 7f2119eac700 1 -- 172.21.15.69:0/2685266219 wait complete. 2023-12-14T14:20:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f2119eac700 1 Processor -- start 2023-12-14T14:20:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f2119eac700 1 -- start start 2023-12-14T14:20:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f2119eac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141004b0 0x7f2114196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f2119eac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2114100e50 0x7f21141969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f2119eac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21141054f0 0x7f211419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f2119eac700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211419b470 con 0x7f21141004b0 2023-12-14T14:20:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f2119eac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211419b5e0 con 0x7f2114100e50 2023-12-14T14:20:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f2119eac700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211419b7a0 con 0x7f21141054f0 2023-12-14T14:20:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f21137fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141004b0 0x7f2114196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f21137fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141004b0 0x7f2114196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45956/0 (socket says 172.21.15.69:45956) 2023-12-14T14:20:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.096+0000 7f21137fe700 1 -- 172.21.15.69:0/18165879 learned_addr learned my addr 172.21.15.69:0/18165879 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f2113fff700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21141054f0 0x7f211419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f2112ffd700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2114100e50 0x7f21141969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f21137fe700 1 -- 172.21.15.69:0/18165879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21141054f0 msgr2=0x7f211419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f21137fe700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21141054f0 0x7f211419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f21137fe700 1 -- 172.21.15.69:0/18165879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2114100e50 msgr2=0x7f21141969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f21137fe700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2114100e50 0x7f21141969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f21137fe700 1 -- 172.21.15.69:0/18165879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c009d00 con 0x7f21141004b0 2023-12-14T14:20:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f21137fe700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141004b0 0x7f2114196490 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f210400c920 tx=0x7f210400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f2110ff9700 1 -- 172.21.15.69:0/18165879 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104007b00 con 0x7f21141004b0 2023-12-14T14:20:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21141102c0 con 0x7f21141004b0 2023-12-14T14:20:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f2110ff9700 1 -- 172.21.15.69:0/18165879 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2104004cf0 con 0x7f21141004b0 2023-12-14T14:20:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f2110ff9700 1 -- 172.21.15.69:0/18165879 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104005520 con 0x7f21141004b0 2023-12-14T14:20:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.097+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2114110130 con 0x7f21141004b0 2023-12-14T14:20:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.098+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2114110450 con 0x7f21141004b0 2023-12-14T14:20:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.099+0000 7f2110ff9700 1 -- 172.21.15.69:0/18165879 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2104004750 con 0x7f21141004b0 2023-12-14T14:20:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.100+0000 7f2110ff9700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f20fc0a12c0 0x7f20fc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.100+0000 7f2112ffd700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f20fc0a12c0 0x7f20fc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.100+0000 7f2110ff9700 1 -- 172.21.15.69:0/18165879 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f21040cc9b0 con 0x7f21141004b0 2023-12-14T14:20:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.100+0000 7f2112ffd700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f20fc0a12c0 0x7f20fc0a3770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2114197aa0 tx=0x7f210800d4b0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.104+0000 7f2110ff9700 1 -- 172.21.15.69:0/18165879 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2104095dd0 con 0x7f21141004b0 2023-12-14T14:20:54.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.293+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21141a35c0 con 0x7f21141004b0 2023-12-14T14:20:54.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.293+0000 7f2110ff9700 1 -- 172.21.15.69:0/18165879 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f210401d020 con 0x7f21141004b0 2023-12-14T14:20:54.293 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T14:20:54.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f20fc0a12c0 msgr2=0x7f20fc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:54.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f20fc0a12c0 0x7f20fc0a3770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2114197aa0 tx=0x7f210800d4b0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141004b0 msgr2=0x7f2114196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:54.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141004b0 0x7f2114196490 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f210400c920 tx=0x7f210400cce0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 shutdown_connections 2023-12-14T14:20:54.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f20fc0a12c0 0x7f20fc0a3770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21141054f0 0x7f211419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21141004b0 0x7f2114196490 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 --2- 172.21.15.69:0/18165879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2114100e50 0x7f21141969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 >> 172.21.15.69:0/18165879 conn(0x7f21140fbd40 msgr2=0x7f21140fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:54.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.295+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 shutdown_connections 2023-12-14T14:20:54.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.296+0000 7f2119eac700 1 -- 172.21.15.69:0/18165879 wait complete. 2023-12-14T14:20:54.307 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-12-14T14:20:54.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.431+0000 7fd020ab8700 1 -- 172.21.15.69:0/2772915878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 msgr2=0x7fd01c1095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.431+0000 7fd020ab8700 1 --2- 172.21.15.69:0/2772915878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 0x7fd01c1095e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009990 tx=0x7fd00c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.431+0000 7fd020ab8700 1 -- 172.21.15.69:0/2772915878 shutdown_connections 2023-12-14T14:20:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.431+0000 7fd020ab8700 1 --2- 172.21.15.69:0/2772915878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd01c109b20 0x7fd01c10bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.431+0000 7fd020ab8700 1 --2- 172.21.15.69:0/2772915878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd01c100570 0x7fd01c100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.431+0000 7fd020ab8700 1 --2- 172.21.15.69:0/2772915878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 0x7fd01c1095e0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.431+0000 7fd020ab8700 1 -- 172.21.15.69:0/2772915878 >> 172.21.15.69:0/2772915878 conn(0x7fd01c074a50 msgr2=0x7fd01c074e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.431+0000 7fd020ab8700 1 -- 172.21.15.69:0/2772915878 shutdown_connections 2023-12-14T14:20:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.431+0000 7fd020ab8700 1 -- 172.21.15.69:0/2772915878 wait complete. 2023-12-14T14:20:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd020ab8700 1 Processor -- start 2023-12-14T14:20:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd020ab8700 1 -- start start 2023-12-14T14:20:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd020ab8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd01c100570 0x7fd01c1963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd020ab8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 0x7fd01c196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd020ab8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd01c109b20 0x7fd01c19ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd020ab8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c19b3a0 con 0x7fd01c100e80 2023-12-14T14:20:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd020ab8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c19b510 con 0x7fd01c109b20 2023-12-14T14:20:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd020ab8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c19b6d0 con 0x7fd01c100570 2023-12-14T14:20:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd019d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 0x7fd01c196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd019d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 0x7fd01c196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45972/0 (socket says 172.21.15.69:45972) 2023-12-14T14:20:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd019d9b700 1 -- 172.21.15.69:0/644455446 learned_addr learned my addr 172.21.15.69:0/644455446 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:20:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd01ad9d700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd01c109b20 0x7fd01c19ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd019d9b700 1 -- 172.21.15.69:0/644455446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd01c100570 msgr2=0x7fd01c1963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd019d9b700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd01c100570 0x7fd01c1963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd019d9b700 1 -- 172.21.15.69:0/644455446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd01c109b20 msgr2=0x7fd01c19ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd019d9b700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd01c109b20 0x7fd01c19ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd019d9b700 1 -- 172.21.15.69:0/644455446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c0095f0 con 0x7fd01c100e80 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.432+0000 7fd01ad9d700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd01c109b20 0x7fd01c19ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.433+0000 7fd019d9b700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 0x7fd01c196900 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0095c0 tx=0x7fd00c00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.433+0000 7fd00b7fe700 1 -- 172.21.15.69:0/644455446 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c01d070 con 0x7fd01c100e80 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.433+0000 7fd00b7fe700 1 -- 172.21.15.69:0/644455446 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd00c00fc00 con 0x7fd01c100e80 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.433+0000 7fd00b7fe700 1 -- 172.21.15.69:0/644455446 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0173f0 con 0x7fd01c100e80 2023-12-14T14:20:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.433+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c110310 con 0x7fd01c100e80 2023-12-14T14:20:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.433+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c110180 con 0x7fd01c100e80 2023-12-14T14:20:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.434+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c1104a0 con 0x7fd01c100e80 2023-12-14T14:20:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.435+0000 7fd00b7fe700 1 -- 172.21.15.69:0/644455446 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd00c022470 con 0x7fd01c100e80 2023-12-14T14:20:54.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.435+0000 7fd00b7fe700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd0040a12c0 0x7fd0040a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:20:54.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.435+0000 7fd01a59c700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd0040a12c0 0x7fd0040a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:20:54.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.435+0000 7fd00b7fe700 1 -- 172.21.15.69:0/644455446 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fd00c0cdf40 con 0x7fd01c100e80 2023-12-14T14:20:54.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.436+0000 7fd01a59c700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd0040a12c0 0x7fd0040a3770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd010005950 tx=0x7fd0100058e0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:20:54.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.439+0000 7fd00b7fe700 1 -- 172.21.15.69:0/644455446 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd00c0973f0 con 0x7fd01c100e80 2023-12-14T14:20:54.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:54 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/749945906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:20:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:54 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/149157715' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:20:54.586 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:54 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/18165879' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:20:54.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.689+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fd01c1a3430 con 0x7fd01c100e80 2023-12-14T14:20:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.696+0000 7fd00b7fe700 1 -- 172.21.15.69:0/644455446 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) v1 ==== 81+0+733772 (secure 0 0 0) 0x7fd00c027020 con 0x7fd01c100e80 2023-12-14T14:20:54.706 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:20:54.707 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:20:54.707 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 24, 2023-12-14T14:20:54.707 INFO:teuthology.orchestra.run.smithi069.stdout: "active_gid": 15411, 2023-12-14T14:20:54.707 INFO:teuthology.orchestra.run.smithi069.stdout: "active_name": "x", 2023-12-14T14:20:54.707 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addrs": { 2023-12-14T14:20:54.707 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T14:20:54.707 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:54.707 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T14:20:54.708 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6800", 2023-12-14T14:20:54.708 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 4150820502 2023-12-14T14:20:54.708 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.708 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:54.708 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-12-14T14:20:54.708 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6801", 2023-12-14T14:20:54.708 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 4150820502 2023-12-14T14:20:54.708 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.708 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:54.709 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.709 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addr": "172.21.15.69:6801/4150820502", 2023-12-14T14:20:54.709 INFO:teuthology.orchestra.run.smithi069.stdout: "active_change": "2023-12-14T14:10:38.311593+0000", 2023-12-14T14:20:54.709 INFO:teuthology.orchestra.run.smithi069.stdout: "active_mgr_features": 4540138322906710015, 2023-12-14T14:20:54.709 INFO:teuthology.orchestra.run.smithi069.stdout: "available": true, 2023-12-14T14:20:54.709 INFO:teuthology.orchestra.run.smithi069.stdout: "standbys": [ 2023-12-14T14:20:54.709 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:54.709 INFO:teuthology.orchestra.run.smithi069.stdout: "gid": 24952, 2023-12-14T14:20:54.709 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "z", 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_features": 4540138322906710015, 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:54.710 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.711 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.711 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.711 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:54.711 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.711 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.711 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.712 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2023-12-14T14:20:54.712 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.712 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.712 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.712 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.712 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:54.712 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:54.712 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.713 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.713 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.713 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.713 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.713 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.713 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.714 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.714 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.714 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.714 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.714 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.714 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.714 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.714 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.714 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.715 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.715 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.715 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.715 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:54.715 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:54.715 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.715 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.716 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.716 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.716 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.716 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.716 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.716 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.716 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.716 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.716 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.717 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.717 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:54.717 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:54.717 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.717 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.717 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.717 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:54.718 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.718 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.718 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.718 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.718 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.718 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.718 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.718 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.718 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.719 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.719 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.719 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.719 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.719 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.719 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.719 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:54.719 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:54.719 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.720 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.721 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.721 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.721 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2023-12-14T14:20:54.721 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2023-12-14T14:20:54.721 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.721 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.721 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.721 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.721 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.722 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.722 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.722 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2023-12-14T14:20:54.722 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.722 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.722 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.722 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.722 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2023-12-14T14:20:54.722 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2023-12-14T14:20:54.723 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.723 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.723 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.723 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2023-12-14T14:20:54.723 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.723 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.723 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.724 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2023-12-14T14:20:54.724 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.724 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.724 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.724 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.724 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2023-12-14T14:20:54.724 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2023-12-14T14:20:54.724 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.724 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.725 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.725 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.725 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.725 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.725 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.725 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2023-12-14T14:20:54.725 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.725 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.725 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.727 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2023-12-14T14:20:54.727 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.727 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.727 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.727 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.727 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2023-12-14T14:20:54.727 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2023-12-14T14:20:54.727 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.727 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.728 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.728 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2023-12-14T14:20:54.728 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.728 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.728 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.728 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2023-12-14T14:20:54.728 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.728 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.728 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.729 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.729 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2023-12-14T14:20:54.729 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2023-12-14T14:20:54.729 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.729 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.729 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.729 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.729 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.730 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.730 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.730 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2023-12-14T14:20:54.730 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.730 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.730 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.730 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.731 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-14T14:20:54.732 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.732 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.732 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.732 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.732 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2023-12-14T14:20:54.732 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2023-12-14T14:20:54.732 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.733 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.733 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.733 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.733 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.733 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.733 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.733 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2023-12-14T14:20:54.733 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.734 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.734 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.734 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.734 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.734 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.734 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:54.734 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2023-12-14T14:20:54.734 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:54.735 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:54.735 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:54.735 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2023-12-14T14:20:54.735 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2023-12-14T14:20:54.735 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.735 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.735 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.735 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.736 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.736 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.736 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2023-12-14T14:20:54.736 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.736 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.736 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.736 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.736 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2023-12-14T14:20:54.737 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2023-12-14T14:20:54.737 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.737 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.737 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.737 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2023-12-14T14:20:54.737 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.737 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.737 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.737 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2023-12-14T14:20:54.738 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T14:20:54.738 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.738 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.738 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.738 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2023-12-14T14:20:54.738 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2023-12-14T14:20:54.738 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:54.738 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.738 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.739 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:54.739 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T14:20:54.739 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T14:20:54.739 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.739 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-14T14:20:54.739 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T14:20:54.739 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.739 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2023-12-14T14:20:54.740 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.741 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-14T14:20:54.741 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.741 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.741 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.741 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.741 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2023-12-14T14:20:54.741 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2023-12-14T14:20:54.741 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.742 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.742 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.742 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2023-12-14T14:20:54.742 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.742 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.742 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.742 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-14T14:20:54.742 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-14T14:20:54.742 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.743 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.743 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.743 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2023-12-14T14:20:54.743 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2023-12-14T14:20:54.743 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:54.743 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.743 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.743 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2023-12-14T14:20:54.743 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2023-12-14T14:20:54.744 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2023-12-14T14:20:54.744 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.744 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2023-12-14T14:20:54.744 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-14T14:20:54.744 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.744 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.744 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.744 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2023-12-14T14:20:54.744 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2023-12-14T14:20:54.745 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.745 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.745 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.745 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2023-12-14T14:20:54.745 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.745 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.745 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.745 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2023-12-14T14:20:54.745 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:54.746 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T14:20:54.747 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T14:20:54.747 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.747 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-14T14:20:54.747 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T14:20:54.747 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.747 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.747 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.747 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:54.747 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:54.748 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.748 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.748 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.748 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.748 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.748 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.748 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.748 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.748 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.749 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.749 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.749 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.749 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.749 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.749 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.749 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.749 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.749 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.750 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.750 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:54.750 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:54.750 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.750 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.750 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.750 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:54.751 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:54.752 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.752 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.752 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.752 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:54.752 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.752 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.753 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.753 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.753 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.753 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.753 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.753 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.753 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.753 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.754 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.754 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.754 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.754 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.754 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.754 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:54.754 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:54.755 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.755 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.755 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.755 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.755 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.755 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.755 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.755 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.755 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.756 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.756 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.756 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.756 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2023-12-14T14:20:54.756 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2023-12-14T14:20:54.756 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:54.756 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.757 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.757 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:54.757 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.757 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.757 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.757 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-14T14:20:54.757 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.757 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.757 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.758 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T14:20:54.758 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T14:20:54.758 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.758 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.758 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.758 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2023-12-14T14:20:54.758 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.759 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.759 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.759 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2023-12-14T14:20:54.759 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2023-12-14T14:20:54.759 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap" 2023-12-14T14:20:54.759 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.759 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2023-12-14T14:20:54.759 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.759 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.760 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.761 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.761 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-14T14:20:54.761 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.761 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.761 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.761 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.761 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:54.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:54.762 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.762 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.762 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.762 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:54.762 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.762 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.762 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.762 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-14T14:20:54.763 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.763 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.763 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.763 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.763 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2023-12-14T14:20:54.763 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2023-12-14T14:20:54.763 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.763 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.764 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.764 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:54.764 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:54.764 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.764 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.764 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-14T14:20:54.764 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-14T14:20:54.765 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.765 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.765 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.765 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2023-12-14T14:20:54.765 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2023-12-14T14:20:54.765 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:54.766 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.766 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.766 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:54.766 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.766 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.766 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.766 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-14T14:20:54.766 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.766 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.767 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.767 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.767 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.767 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.767 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:54.767 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2023-12-14T14:20:54.767 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:54.767 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:54.767 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:54.768 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2023-12-14T14:20:54.768 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2023-12-14T14:20:54.768 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:54.768 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.768 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T14:20:54.768 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.768 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.769 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.770 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.770 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2023-12-14T14:20:54.770 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.770 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.770 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.770 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-14T14:20:54.770 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.770 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.770 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.771 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.771 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2023-12-14T14:20:54.771 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2023-12-14T14:20:54.771 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.771 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.771 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.771 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2023-12-14T14:20:54.771 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.772 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.772 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.772 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-14T14:20:54.772 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.772 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.772 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.772 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.772 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_password": { 2023-12-14T14:20:54.773 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_password", 2023-12-14T14:20:54.773 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.773 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.773 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.773 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:54.773 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.774 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.774 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.774 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web password", 2023-12-14T14:20:54.774 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.774 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.774 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.774 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.774 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_user": { 2023-12-14T14:20:54.774 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_user", 2023-12-14T14:20:54.775 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.775 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.775 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.775 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:54.775 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.775 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.775 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.775 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web user", 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.776 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.777 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.777 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.777 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.777 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-14T14:20:54.777 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-14T14:20:54.777 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.777 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.778 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.778 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2023-12-14T14:20:54.778 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2023-12-14T14:20:54.778 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.778 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.778 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.778 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:54.778 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.778 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.779 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.779 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-14T14:20:54.779 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.779 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.779 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.779 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.779 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2023-12-14T14:20:54.779 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2023-12-14T14:20:54.780 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:54.780 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.780 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.780 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2023-12-14T14:20:54.780 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.780 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.780 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.780 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-14T14:20:54.781 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.781 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.781 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.781 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.781 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2023-12-14T14:20:54.781 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2023-12-14T14:20:54.781 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.781 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.782 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.782 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.782 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.782 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.782 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.782 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-14T14:20:54.782 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.782 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.782 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.783 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.783 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2023-12-14T14:20:54.783 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2023-12-14T14:20:54.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.783 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.783 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.783 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.783 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.783 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.784 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.784 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-14T14:20:54.784 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.784 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.784 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.784 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.784 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2023-12-14T14:20:54.784 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2023-12-14T14:20:54.784 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.785 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.785 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.785 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.785 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.785 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.785 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.785 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-14T14:20:54.785 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.785 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.786 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.786 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.786 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2023-12-14T14:20:54.786 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2023-12-14T14:20:54.786 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.786 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.786 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.786 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-14T14:20:54.786 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.787 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.787 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.787 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:54.787 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.787 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.787 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.787 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.787 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2023-12-14T14:20:54.787 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2023-12-14T14:20:54.788 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.788 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.788 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.788 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-14T14:20:54.788 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.788 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.788 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.788 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2023-12-14T14:20:54.788 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.789 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.789 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.789 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.789 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2023-12-14T14:20:54.789 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2023-12-14T14:20:54.789 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.789 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.789 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.789 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-14T14:20:54.790 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.790 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.790 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.790 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2023-12-14T14:20:54.790 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.790 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.790 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.790 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.790 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2023-12-14T14:20:54.791 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2023-12-14T14:20:54.791 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.791 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.791 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.791 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-14T14:20:54.791 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.791 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.791 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.791 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:54.792 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.792 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.792 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.792 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.792 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2023-12-14T14:20:54.792 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2023-12-14T14:20:54.793 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.793 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.793 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.793 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-14T14:20:54.793 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.793 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.793 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.793 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2023-12-14T14:20:54.794 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.794 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.794 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.794 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.794 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2023-12-14T14:20:54.794 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.795 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.796 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.796 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.796 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2023-12-14T14:20:54.796 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2023-12-14T14:20:54.796 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.796 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.797 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.797 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-14T14:20:54.797 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.797 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.797 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.797 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2023-12-14T14:20:54.797 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.797 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.797 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.798 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.798 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2023-12-14T14:20:54.798 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2023-12-14T14:20:54.798 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.798 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.798 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.798 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-14T14:20:54.799 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.799 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.799 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.799 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2023-12-14T14:20:54.799 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.799 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.799 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.799 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.799 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2023-12-14T14:20:54.800 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.801 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.801 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.801 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.801 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2023-12-14T14:20:54.801 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2023-12-14T14:20:54.801 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.801 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.801 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.802 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2023-12-14T14:20:54.803 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2023-12-14T14:20:54.803 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.803 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.803 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.803 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-14T14:20:54.803 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.803 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.803 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.804 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:54.804 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.804 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.804 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.804 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.804 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2023-12-14T14:20:54.804 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2023-12-14T14:20:54.804 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.804 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.805 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.805 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-14T14:20:54.805 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.805 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.805 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.805 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:54.805 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-14T14:20:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.807 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.807 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.807 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2023-12-14T14:20:54.807 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.807 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.807 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.807 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.808 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2023-12-14T14:20:54.808 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2023-12-14T14:20:54.808 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.808 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.808 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.808 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-14T14:20:54.808 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.808 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.809 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.809 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2023-12-14T14:20:54.809 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.809 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.809 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.809 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.809 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2023-12-14T14:20:54.809 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2023-12-14T14:20:54.809 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.810 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.810 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.810 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.810 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.810 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.810 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.810 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2023-12-14T14:20:54.810 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.811 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.811 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.811 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.811 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2023-12-14T14:20:54.811 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2023-12-14T14:20:54.811 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.811 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.811 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.812 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:54.812 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.812 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.812 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.812 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-14T14:20:54.812 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.812 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.812 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.813 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.813 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2023-12-14T14:20:54.813 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2023-12-14T14:20:54.813 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.813 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.813 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.813 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2023-12-14T14:20:54.813 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.814 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.814 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.814 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-14T14:20:54.814 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.814 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.814 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.814 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.814 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2023-12-14T14:20:54.815 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2023-12-14T14:20:54.815 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.815 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.815 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2023-12-14T14:20:54.815 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.815 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.815 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.816 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-14T14:20:54.816 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.816 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.816 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.816 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.816 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2023-12-14T14:20:54.816 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2023-12-14T14:20:54.816 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.816 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.817 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.817 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2023-12-14T14:20:54.817 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.817 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.817 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.817 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2023-12-14T14:20:54.817 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.817 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.818 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.818 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.818 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2023-12-14T14:20:54.818 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2023-12-14T14:20:54.818 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.818 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.818 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.818 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.818 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.819 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.819 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.819 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-14T14:20:54.819 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.819 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.819 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.819 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.819 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2023-12-14T14:20:54.819 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.820 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.821 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.821 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.821 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2023-12-14T14:20:54.821 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2023-12-14T14:20:54.821 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.821 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.821 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.821 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:54.821 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.822 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.822 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.822 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2023-12-14T14:20:54.822 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.822 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.822 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.822 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.822 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:54.822 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:54.823 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.823 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.823 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.823 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.823 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.823 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.823 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.823 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.824 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.825 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.825 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2023-12-14T14:20:54.825 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2023-12-14T14:20:54.825 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.825 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.825 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.825 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.825 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.825 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.826 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.826 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-14T14:20:54.826 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.826 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.826 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.826 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.827 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-14T14:20:54.828 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.828 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.828 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.828 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.828 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:54.828 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:54.829 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.829 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.829 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.829 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:54.829 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.829 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.829 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.829 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.829 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.830 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.830 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.830 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.830 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.830 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.830 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.830 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.831 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.831 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.831 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.831 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:54.831 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:54.831 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.831 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.831 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.831 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.832 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.832 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.832 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.832 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.832 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.832 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.832 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.833 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.833 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-14T14:20:54.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-14T14:20:54.833 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.833 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.833 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.833 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.834 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.834 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.834 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.834 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-14T14:20:54.834 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.834 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.834 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.834 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.834 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-14T14:20:54.835 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-14T14:20:54.835 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.835 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.835 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.835 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2023-12-14T14:20:54.835 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.835 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.835 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.835 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-14T14:20:54.836 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.836 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.836 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.836 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.836 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2023-12-14T14:20:54.836 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2023-12-14T14:20:54.836 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.836 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.836 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.837 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:54.837 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.837 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.837 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.837 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2023-12-14T14:20:54.837 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.837 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.837 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.837 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.838 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2023-12-14T14:20:54.838 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2023-12-14T14:20:54.838 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.838 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.838 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.838 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:54.838 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.838 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.838 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.839 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-14T14:20:54.839 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.839 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.839 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.839 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.839 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2023-12-14T14:20:54.839 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2023-12-14T14:20:54.839 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.840 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.840 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.840 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.840 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.840 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.840 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.840 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2023-12-14T14:20:54.841 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.841 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.841 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.841 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.841 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T14:20:54.841 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T14:20:54.841 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.841 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.841 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.842 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2023-12-14T14:20:54.842 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.842 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.842 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.842 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2023-12-14T14:20:54.842 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2023-12-14T14:20:54.842 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.842 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2023-12-14T14:20:54.842 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.843 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.843 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.843 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.843 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2023-12-14T14:20:54.843 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2023-12-14T14:20:54.843 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.843 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.843 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.844 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-14T14:20:54.844 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.844 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.844 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.844 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-14T14:20:54.844 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.844 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.845 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.845 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.845 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_password": { 2023-12-14T14:20:54.845 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_password", 2023-12-14T14:20:54.845 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.845 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.845 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.845 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web password", 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_user": { 2023-12-14T14:20:54.846 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_user", 2023-12-14T14:20:54.847 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.847 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.847 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.847 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:54.847 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.847 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.847 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.847 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web user", 2023-12-14T14:20:54.848 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.848 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.848 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.848 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.848 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2023-12-14T14:20:54.848 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2023-12-14T14:20:54.848 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.848 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.848 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.849 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.849 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.849 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.849 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.849 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-14T14:20:54.849 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.849 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.850 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.851 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.851 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-14T14:20:54.851 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.851 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.851 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.851 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.851 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2023-12-14T14:20:54.851 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2023-12-14T14:20:54.852 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.852 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.852 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.852 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.852 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.852 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.852 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.852 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-14T14:20:54.852 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.853 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.853 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.853 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.853 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2023-12-14T14:20:54.853 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2023-12-14T14:20:54.853 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.853 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.854 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.854 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.854 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.854 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.854 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.854 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-14T14:20:54.854 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.854 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.855 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.855 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.855 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2023-12-14T14:20:54.855 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2023-12-14T14:20:54.855 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.855 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.855 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.855 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.856 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.856 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.856 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.856 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-14T14:20:54.856 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.856 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.856 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.856 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.856 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2023-12-14T14:20:54.857 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2023-12-14T14:20:54.857 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.857 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.857 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.857 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2023-12-14T14:20:54.857 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.857 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.857 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.857 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2023-12-14T14:20:54.858 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.858 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.858 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.858 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.858 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2023-12-14T14:20:54.858 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2023-12-14T14:20:54.858 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.858 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.858 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-14T14:20:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.860 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-14T14:20:54.861 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.861 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.861 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.861 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.861 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2023-12-14T14:20:54.861 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2023-12-14T14:20:54.861 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.861 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.861 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.862 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.862 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.862 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.862 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.862 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-14T14:20:54.862 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.862 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.862 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.862 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.863 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2023-12-14T14:20:54.863 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2023-12-14T14:20:54.863 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.863 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.863 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.863 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.863 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.863 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.864 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.864 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2023-12-14T14:20:54.864 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.864 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.864 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.864 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.864 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2023-12-14T14:20:54.864 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2023-12-14T14:20:54.865 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.865 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.865 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.865 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.865 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.865 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.865 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.865 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-14T14:20:54.865 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.866 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.866 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.866 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.866 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2023-12-14T14:20:54.866 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2023-12-14T14:20:54.866 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.866 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.866 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.867 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.867 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.867 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.867 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.867 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-14T14:20:54.867 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.867 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.867 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.868 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.868 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.868 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.868 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:54.868 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2023-12-14T14:20:54.868 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:54.868 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:54.868 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:54.869 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:54.869 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:54.869 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.869 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.869 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.869 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.869 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.870 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.870 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.870 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.870 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.870 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.870 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.870 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.870 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.871 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.871 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.871 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.871 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.871 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.871 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.871 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:54.871 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:54.871 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.872 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.872 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.872 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.872 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.872 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.872 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.872 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.872 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.873 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.873 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.873 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.873 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:54.873 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:54.873 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.873 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.873 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.873 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:54.874 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.874 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.874 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.874 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.874 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.874 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.874 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.874 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.874 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.875 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.875 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.875 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.875 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.875 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.875 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.875 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:54.875 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:54.875 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.876 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.877 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.877 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2023-12-14T14:20:54.877 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2023-12-14T14:20:54.877 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.877 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.877 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.877 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2023-12-14T14:20:54.878 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.878 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.878 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.878 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-14T14:20:54.878 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.878 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.878 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.878 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.879 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2023-12-14T14:20:54.879 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2023-12-14T14:20:54.879 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.879 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.879 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.879 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2023-12-14T14:20:54.879 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.879 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.880 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.880 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-14T14:20:54.880 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.880 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.880 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.880 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.880 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.880 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.881 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:54.881 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2023-12-14T14:20:54.881 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:54.881 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:54.881 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:54.881 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-14T14:20:54.881 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-14T14:20:54.882 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.882 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.882 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.882 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:54.882 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.882 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.882 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.882 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.882 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.883 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.883 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.883 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.883 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2023-12-14T14:20:54.883 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-14T14:20:54.883 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.883 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.883 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.884 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.884 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.884 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.884 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.884 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.884 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.884 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.884 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.885 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.885 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-14T14:20:54.885 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-14T14:20:54.885 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.885 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.885 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.885 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.885 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.886 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.886 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.886 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.886 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.886 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.886 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.886 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.886 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2023-12-14T14:20:54.887 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2023-12-14T14:20:54.887 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.887 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.887 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.887 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.887 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.887 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.887 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.888 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.888 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.888 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.888 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.888 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.888 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-14T14:20:54.888 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-14T14:20:54.888 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.888 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.889 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.889 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.889 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.889 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.889 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.889 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.889 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.889 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.890 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.890 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.890 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2023-12-14T14:20:54.890 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-14T14:20:54.890 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.890 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.890 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.890 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.890 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-14T14:20:54.891 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.892 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.892 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.892 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.892 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.892 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.892 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.892 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.892 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.892 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.893 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.893 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.893 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-14T14:20:54.893 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-14T14:20:54.893 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.893 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.893 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.893 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.893 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.894 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.894 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.894 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.894 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.894 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.894 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.894 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-14T14:20:54.894 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.895 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.896 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.896 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.896 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-14T14:20:54.896 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-14T14:20:54.896 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.896 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.896 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.896 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.896 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.897 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.897 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.897 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.897 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.897 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.897 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.897 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.898 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-14T14:20:54.898 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-14T14:20:54.898 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.898 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.898 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.898 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.898 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-14T14:20:54.899 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.900 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.900 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.900 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.900 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.900 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.900 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.900 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.901 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.901 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.901 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.901 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.901 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-14T14:20:54.901 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-14T14:20:54.901 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.901 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.901 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.902 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.902 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.902 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.902 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.902 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.902 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.902 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.902 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.903 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.903 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-14T14:20:54.903 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-14T14:20:54.903 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.903 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.903 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.903 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.904 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.904 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.904 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.904 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.904 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.904 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.904 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.904 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.905 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2023-12-14T14:20:54.905 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-14T14:20:54.905 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.905 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.905 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.905 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:54.905 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.905 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.905 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.906 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.906 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.906 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.906 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.906 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.906 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-14T14:20:54.906 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-14T14:20:54.906 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.906 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.907 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.907 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.907 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.907 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.907 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.907 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.907 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.907 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.907 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.908 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2023-12-14T14:20:54.908 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2023-12-14T14:20:54.908 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.908 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.908 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.908 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.908 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.909 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.909 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.909 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.909 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.909 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.909 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.909 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.909 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2023-12-14T14:20:54.909 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.910 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.911 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.911 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.911 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-14T14:20:54.911 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-14T14:20:54.911 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.911 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.911 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.911 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.912 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.912 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.912 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.912 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.912 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.912 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.912 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.912 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-14T14:20:54.913 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-14T14:20:54.913 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.913 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.913 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.913 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.913 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.913 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.913 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.914 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.916 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-14T14:20:54.916 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-14T14:20:54.916 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.916 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.916 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.916 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.916 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.916 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.917 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.917 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.917 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.917 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.917 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.917 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.918 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.919 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.919 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.919 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.919 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-14T14:20:54.919 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-14T14:20:54.919 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.919 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.920 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.920 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.920 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.920 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.920 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.920 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.920 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.920 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.920 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.921 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.921 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-14T14:20:54.921 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-14T14:20:54.921 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.921 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.921 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.921 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.921 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.921 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.922 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.922 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.922 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.922 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.922 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.922 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.922 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-14T14:20:54.922 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-14T14:20:54.922 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.923 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.923 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.923 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.923 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.923 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.923 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.923 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.924 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.924 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.924 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.924 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.924 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-14T14:20:54.924 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-14T14:20:54.924 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.924 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.925 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.925 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.925 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.925 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.925 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.925 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.925 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.925 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.926 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.926 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.926 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-14T14:20:54.926 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-14T14:20:54.926 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.926 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.926 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.926 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.926 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.927 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.927 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.927 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.927 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.927 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.927 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.927 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.927 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-14T14:20:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-14T14:20:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.928 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.929 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.929 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.929 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.929 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.929 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-14T14:20:54.929 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-14T14:20:54.929 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.929 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.929 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.930 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.931 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.932 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.933 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.933 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.933 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.933 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.933 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.933 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.933 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.933 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-14T14:20:54.934 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-14T14:20:54.934 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.934 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.934 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.934 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-14T14:20:54.934 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.934 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.934 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.934 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.935 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.935 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.935 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.935 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.935 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-14T14:20:54.935 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-14T14:20:54.935 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.936 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.937 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.937 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-14T14:20:54.937 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-14T14:20:54.937 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.937 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.937 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.937 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2023-12-14T14:20:54.937 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.938 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.938 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.938 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.938 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.938 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.938 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.938 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.938 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-14T14:20:54.938 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-14T14:20:54.939 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.939 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.939 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.939 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2023-12-14T14:20:54.939 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.939 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.939 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.939 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.940 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.940 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.940 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.940 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.940 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2023-12-14T14:20:54.940 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-14T14:20:54.940 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.940 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.942 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.942 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.942 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.942 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-14T14:20:54.942 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-14T14:20:54.942 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.942 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.942 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.943 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:54.943 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.943 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.943 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.943 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.943 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.943 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.943 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.943 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.944 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2023-12-14T14:20:54.944 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-14T14:20:54.944 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.944 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.944 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.944 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.944 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.944 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.944 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.945 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.945 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.945 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.945 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.945 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.945 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2023-12-14T14:20:54.945 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-14T14:20:54.945 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.945 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.946 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.947 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-14T14:20:54.947 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-14T14:20:54.947 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.947 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.947 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.947 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:54.947 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.947 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.947 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.948 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.948 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.948 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.948 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.948 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.948 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-14T14:20:54.948 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-14T14:20:54.948 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.949 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.949 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.949 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:54.949 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.949 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.949 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.949 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.949 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.950 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.950 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.950 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.950 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-14T14:20:54.950 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-14T14:20:54.950 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.950 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.950 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.950 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:54.951 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.951 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.951 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.951 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.951 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.951 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.951 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.951 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.952 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2023-12-14T14:20:54.952 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2023-12-14T14:20:54.952 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.952 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.952 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.952 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.952 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.952 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.952 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.953 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.953 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.953 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.953 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.953 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.953 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2023-12-14T14:20:54.953 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2023-12-14T14:20:54.954 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.954 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.954 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.954 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.954 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.954 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.954 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.954 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.954 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.955 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.955 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.955 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.955 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2023-12-14T14:20:54.955 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2023-12-14T14:20:54.955 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.955 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.955 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.956 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.956 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.956 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.956 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.956 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2023-12-14T14:20:54.956 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.956 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.957 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.957 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.957 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2023-12-14T14:20:54.957 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2023-12-14T14:20:54.957 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.957 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.957 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.957 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2023-12-14T14:20:54.957 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.958 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.958 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.958 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.958 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.958 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.958 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.958 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.958 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.959 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.960 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.961 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.961 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.961 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.961 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.961 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.961 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.961 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.961 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.961 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.962 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.962 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.962 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.962 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.962 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:54.962 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:54.962 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.962 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.962 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.963 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.964 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.965 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.965 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.965 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.965 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.965 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.965 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.965 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.965 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.965 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.966 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.966 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:54.966 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:54.966 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.966 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.966 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.966 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2023-12-14T14:20:54.967 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2023-12-14T14:20:54.968 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.968 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.968 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.968 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.968 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.968 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.968 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.968 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2023-12-14T14:20:54.969 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.969 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.969 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.969 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.969 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2023-12-14T14:20:54.969 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2023-12-14T14:20:54.969 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.969 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.969 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.970 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.970 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.970 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.970 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.970 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.970 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.970 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.970 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.971 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.971 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T14:20:54.971 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T14:20:54.971 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.971 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.971 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.971 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T14:20:54.971 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.971 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.972 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.972 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.972 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.972 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.972 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.972 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.972 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T14:20:54.972 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T14:20:54.973 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.973 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.973 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.973 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2023-12-14T14:20:54.973 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.973 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.973 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.973 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.974 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.974 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.974 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.974 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.974 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T14:20:54.974 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T14:20:54.974 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.974 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.975 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.976 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.977 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2023-12-14T14:20:54.978 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.978 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.978 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.978 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.978 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2023-12-14T14:20:54.978 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.978 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.978 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T14:20:54.979 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T14:20:54.980 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T14:20:54.980 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.980 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.980 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.980 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.980 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.980 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.981 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2023-12-14T14:20:54.981 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2023-12-14T14:20:54.981 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.981 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.981 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:54.981 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.981 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.981 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.981 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.982 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.982 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.982 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.982 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.982 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.982 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:54.982 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.982 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:54.983 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-12-14T14:20:54.983 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:54.983 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:54.983 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:54.983 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2023-12-14T14:20:54.983 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2023-12-14T14:20:54.983 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.983 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.984 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.984 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.984 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.984 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.984 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.984 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2023-12-14T14:20:54.984 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.984 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.985 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.985 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.985 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:54.985 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:54.985 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.985 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.985 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.985 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:54.985 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.986 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.986 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.986 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.986 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.986 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.986 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.986 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.986 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.987 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.987 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.987 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.987 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.987 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.987 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.987 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:54.987 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:54.987 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.988 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.988 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.988 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.988 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.988 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.988 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.988 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.988 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.989 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.989 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.989 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.989 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:54.989 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:54.989 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.989 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.989 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.989 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:54.990 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.991 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2023-12-14T14:20:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2023-12-14T14:20:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2023-12-14T14:20:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.994 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.995 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2023-12-14T14:20:54.996 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2023-12-14T14:20:54.996 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.996 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.996 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.996 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2023-12-14T14:20:54.996 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.997 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.997 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.997 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2023-12-14T14:20:54.997 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.997 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.997 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.997 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.997 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2023-12-14T14:20:54.997 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2023-12-14T14:20:54.998 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:54.998 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.998 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.998 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T14:20:54.998 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.998 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:54.998 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:54.998 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-14T14:20:54.998 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:54.999 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.000 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.001 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.001 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:55.001 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.001 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.001 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.001 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2023-12-14T14:20:55.001 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.001 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.002 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.002 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.002 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2023-12-14T14:20:55.002 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2023-12-14T14:20:55.002 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.002 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.002 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.002 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2023-12-14T14:20:55.003 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.003 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.003 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.003 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-14T14:20:55.003 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.003 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.003 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.004 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.004 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.004 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.004 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.004 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2023-12-14T14:20:55.004 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.004 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.004 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.005 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.005 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.005 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.005 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.005 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.005 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.005 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.006 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.006 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.006 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.006 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.006 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.006 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.006 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.006 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.006 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.007 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.007 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.007 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.007 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.007 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.007 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.007 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.007 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.007 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.008 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.008 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.008 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.008 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.008 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.008 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.008 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.008 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.008 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.009 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.009 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.009 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.009 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.009 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.009 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.009 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.009 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.009 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.010 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.011 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.012 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.012 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.012 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.012 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.012 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.012 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.012 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.013 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2023-12-14T14:20:55.013 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2023-12-14T14:20:55.013 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.013 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.013 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.013 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T14:20:55.013 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.013 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.014 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.014 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.014 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.014 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.014 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.014 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.014 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2023-12-14T14:20:55.014 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2023-12-14T14:20:55.014 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.015 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.015 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.015 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2023-12-14T14:20:55.015 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.015 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.015 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.015 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.015 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:55.016 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.017 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.017 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.017 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.017 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.017 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.017 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2023-12-14T14:20:55.018 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2023-12-14T14:20:55.019 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.019 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.019 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.019 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2023-12-14T14:20:55.019 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.019 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.019 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.020 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.021 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2023-12-14T14:20:55.021 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.021 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.021 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.021 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-14T14:20:55.021 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.021 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.022 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.022 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.022 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2023-12-14T14:20:55.022 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2023-12-14T14:20:55.022 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.022 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.022 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.022 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.023 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.023 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.023 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.023 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2023-12-14T14:20:55.023 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.023 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.023 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.023 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.023 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:55.024 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:55.024 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.024 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.024 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.024 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2023-12-14T14:20:55.024 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2023-12-14T14:20:55.024 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.024 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.025 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.026 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.027 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.028 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.028 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.028 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.028 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.028 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.028 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.028 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.028 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.028 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.029 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.029 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.029 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.029 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.029 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.029 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.029 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.029 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.029 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.030 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.030 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.030 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.030 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.030 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.030 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.031 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.032 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.032 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.032 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.032 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.032 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.032 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.032 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2023-12-14T14:20:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2023-12-14T14:20:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.034 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.034 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.034 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.034 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.034 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2023-12-14T14:20:55.034 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.035 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.035 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.035 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.035 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2023-12-14T14:20:55.035 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2023-12-14T14:20:55.035 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.035 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.035 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.035 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2023-12-14T14:20:55.036 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.036 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.036 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.036 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2023-12-14T14:20:55.036 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.036 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.036 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.036 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.036 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T14:20:55.037 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T14:20:55.037 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.037 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.037 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.037 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2023-12-14T14:20:55.037 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.037 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.037 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.038 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T14:20:55.038 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.038 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.038 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.038 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.038 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2023-12-14T14:20:55.038 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2023-12-14T14:20:55.038 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.039 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.040 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.041 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.042 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2023-12-14T14:20:55.042 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.042 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.042 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.042 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T14:20:55.042 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.042 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.042 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.043 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.043 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.043 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.043 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.043 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2023-12-14T14:20:55.043 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.043 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.043 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.043 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.044 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.044 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.044 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.044 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.044 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.044 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.044 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.044 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.046 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.046 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.046 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.046 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.046 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.046 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.046 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.046 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.047 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.047 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.047 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.047 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.047 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.047 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.047 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.047 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.047 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.048 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.048 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.048 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.048 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.048 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.048 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.048 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.049 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.049 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.049 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.049 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.049 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.049 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.049 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.049 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.050 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.050 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.050 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.050 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.050 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.050 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.050 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.050 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.051 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.051 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.051 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.051 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.051 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.051 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.051 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.051 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.052 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.052 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.052 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.052 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.052 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.052 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.052 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2023-12-14T14:20:55.052 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.052 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.053 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.053 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.053 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.053 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.053 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.053 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.053 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.053 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.053 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.054 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.054 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.054 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.054 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.054 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.054 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.054 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.054 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.054 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.055 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.055 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.055 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.055 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.055 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.055 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.055 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.055 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.055 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.056 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.057 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.057 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.057 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.057 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.057 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.057 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.057 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.057 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.057 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.058 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.058 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.058 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.058 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.058 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.058 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.058 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.058 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.058 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.059 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.060 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.060 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.060 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.060 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.060 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.060 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.060 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.061 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.061 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.061 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2023-12-14T14:20:55.061 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.061 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.061 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.061 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2023-12-14T14:20:55.061 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2023-12-14T14:20:55.062 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.062 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.062 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.062 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2023-12-14T14:20:55.062 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.062 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.062 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.063 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-14T14:20:55.063 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.063 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.063 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.063 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2023-12-14T14:20:55.063 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2023-12-14T14:20:55.064 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.064 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.064 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.064 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.064 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2023-12-14T14:20:55.064 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.064 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.064 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-14T14:20:55.064 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.065 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.066 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.066 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.066 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.066 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.066 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.066 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.066 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.066 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.066 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.067 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.067 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.067 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.067 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.067 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.067 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.067 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.067 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.067 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.068 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.068 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.068 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.068 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.068 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.068 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.068 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.068 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.068 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.069 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.070 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.070 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.070 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.070 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.070 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.070 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.072 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.072 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.072 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.072 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.072 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.072 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.073 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.073 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.073 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.073 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.073 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.073 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.073 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.073 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.074 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2023-12-14T14:20:55.074 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.074 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.074 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.074 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2023-12-14T14:20:55.074 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2023-12-14T14:20:55.074 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.074 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.074 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.075 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2023-12-14T14:20:55.075 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.075 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.075 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.075 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2023-12-14T14:20:55.075 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-14T14:20:55.075 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.075 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.076 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.077 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.077 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.077 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.077 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.077 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.077 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.077 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.077 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.077 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.078 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.078 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.078 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.078 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.078 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.078 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.078 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.078 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.079 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.079 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.079 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.079 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.079 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.079 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.079 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.079 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.079 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.080 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.080 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.080 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.080 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.080 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.080 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.080 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.081 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.081 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.081 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.081 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.081 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.081 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.081 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.081 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.081 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.082 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.082 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.082 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.082 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.082 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.082 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.082 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.082 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.083 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.083 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.083 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.083 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.083 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.083 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.083 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.084 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.084 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.084 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.084 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.084 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2023-12-14T14:20:55.084 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2023-12-14T14:20:55.084 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.084 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.084 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.085 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.085 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.085 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.085 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.085 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2023-12-14T14:20:55.085 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-14T14:20:55.085 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.085 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.086 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.086 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2023-12-14T14:20:55.086 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2023-12-14T14:20:55.086 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.086 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.086 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.086 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2023-12-14T14:20:55.086 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.086 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.087 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.087 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2023-12-14T14:20:55.087 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.087 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.087 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.087 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.087 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2023-12-14T14:20:55.087 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2023-12-14T14:20:55.088 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.088 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.088 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.088 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2023-12-14T14:20:55.088 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.088 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.088 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.088 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2023-12-14T14:20:55.088 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.089 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.089 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.089 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.089 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2023-12-14T14:20:55.089 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2023-12-14T14:20:55.089 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.089 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.089 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.089 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.090 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.090 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.090 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.090 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2023-12-14T14:20:55.090 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.090 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.090 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.090 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.090 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-14T14:20:55.091 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-14T14:20:55.092 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.092 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.092 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.092 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.092 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.092 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.092 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2023-12-14T14:20:55.092 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.092 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.093 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.093 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.093 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.093 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.093 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.093 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.093 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.093 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.094 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.095 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.095 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.095 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.095 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.095 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.095 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.095 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.095 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.095 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.096 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.096 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.096 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.096 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.096 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.096 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.096 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.096 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.097 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.097 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.097 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.097 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.097 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.097 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.097 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.098 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.098 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.098 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.098 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.098 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.098 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.098 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.098 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.099 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.099 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.099 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.099 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.099 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.099 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.099 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.099 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.100 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.100 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.100 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.100 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.100 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.100 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.100 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.100 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.101 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.101 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.101 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.101 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.101 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.101 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.101 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.101 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.101 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2023-12-14T14:20:55.102 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.102 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.102 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.102 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.102 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.102 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.102 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.103 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.103 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.103 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.103 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.103 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.103 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.103 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.103 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.103 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.104 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.104 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.104 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.104 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.104 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.104 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.104 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.104 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.104 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.105 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.105 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.105 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.105 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.105 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.105 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.105 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.105 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.105 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.106 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.106 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.106 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.106 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.106 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.106 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.106 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.106 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.106 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.107 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.108 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.109 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.109 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.109 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.109 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.109 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.109 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.109 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.109 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.110 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.110 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.110 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.110 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.110 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.110 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2023-12-14T14:20:55.110 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.110 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.111 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.111 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.111 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.111 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.111 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.111 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.111 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.111 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.111 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.112 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.112 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.112 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.112 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.112 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.112 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.112 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.113 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.113 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.113 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.113 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.113 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.113 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.113 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.113 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.113 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.114 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.114 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.114 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.114 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.114 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.114 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.114 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.115 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.116 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.116 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.116 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.116 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.116 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.116 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.117 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.117 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.117 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.117 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.117 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.117 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.117 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.117 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.117 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.118 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.118 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.118 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.118 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.118 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.118 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.118 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.118 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.119 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.119 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.119 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.119 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.119 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.119 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.119 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.120 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.121 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.121 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.121 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.121 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-14T14:20:55.121 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.121 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.121 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.121 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.121 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.122 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.122 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.122 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.122 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.122 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.122 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.122 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.122 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.122 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.123 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.123 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.123 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.123 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.123 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.123 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.123 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.123 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.124 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.124 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.124 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.124 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.124 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.124 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.124 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.124 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.125 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.125 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.125 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.125 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.125 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.125 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.125 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.125 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.125 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.126 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.126 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.126 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.126 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.126 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.126 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.126 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.126 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.126 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.127 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.127 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.127 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.127 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.127 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.127 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.127 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.127 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.127 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.128 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.128 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.128 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.128 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.128 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.128 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.128 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.128 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.128 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.129 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.129 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.129 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.129 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.129 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.129 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.130 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.130 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2023-12-14T14:20:55.130 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T14:20:55.130 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.130 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.130 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.130 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.130 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.130 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.131 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.131 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-12-14T14:20:55.131 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2023-12-14T14:20:55.131 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2023-12-14T14:20:55.131 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.131 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2023-12-14T14:20:55.131 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.132 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.132 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.132 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.132 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.132 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.132 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.132 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2023-12-14T14:20:55.132 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.133 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.133 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.133 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.133 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.133 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.133 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.133 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.133 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.134 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.134 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.134 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.134 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.134 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.134 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.134 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.134 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.135 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.136 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.136 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.136 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.136 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.136 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.136 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.136 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.136 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.136 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.137 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.137 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.137 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.137 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.137 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.137 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.137 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.138 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.138 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.138 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.138 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.138 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.138 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.138 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.138 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.138 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.139 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.139 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.139 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.139 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.139 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.139 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.139 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.139 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.139 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.140 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.140 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.140 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.140 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.140 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.140 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.140 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.140 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.140 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.141 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.142 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.142 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.142 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.142 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.142 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.142 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.142 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.142 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.143 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.143 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.143 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.143 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.143 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.143 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.143 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.143 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.143 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.144 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.144 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.144 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.144 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.144 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.144 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.144 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.145 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.145 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.145 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.145 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.145 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.145 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.145 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.145 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.145 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.146 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.146 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.146 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.146 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.146 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.146 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.146 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.147 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.148 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.148 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.148 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.148 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.148 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.148 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.148 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.149 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.149 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.149 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.149 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.149 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.149 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.149 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.149 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.149 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.150 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.150 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.150 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.150 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.150 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.150 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.150 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.151 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.152 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.152 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.152 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.152 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.152 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.152 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.152 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.152 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.153 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.153 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.153 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.153 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.153 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.153 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.153 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.153 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.153 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.154 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.154 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.154 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.154 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.154 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.154 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.154 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.154 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.154 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.155 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.156 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.157 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.157 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.157 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.157 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.157 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.157 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.157 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.157 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.158 INFO:teuthology.orchestra.run.smithi069.stdout: "noautoscale": { 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "noautoscale", 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "global autoscale flag", 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-12-14T14:20:55.159 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.160 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.160 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.160 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:55.160 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:55.160 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.160 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.160 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.161 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:55.161 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.161 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.161 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.161 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.161 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.161 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.161 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.162 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.162 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2023-12-14T14:20:55.162 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2023-12-14T14:20:55.162 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.162 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.162 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.162 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T14:20:55.162 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2023-12-14T14:20:55.163 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.163 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.163 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2023-12-14T14:20:55.163 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-14T14:20:55.163 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.163 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.163 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.164 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.164 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.164 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.164 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2023-12-14T14:20:55.164 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.164 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.164 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.164 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2023-12-14T14:20:55.165 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2023-12-14T14:20:55.165 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.165 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.165 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.165 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.165 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.165 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.165 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.166 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-14T14:20:55.166 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.166 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.166 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.166 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.166 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T14:20:55.166 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T14:20:55.167 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.167 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.167 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.167 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.167 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.167 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.167 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.167 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.167 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.168 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.168 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.168 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.168 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.168 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.168 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.168 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.168 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.169 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.170 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.170 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.170 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.170 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.170 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.170 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.170 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.170 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.170 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.171 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.172 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.172 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.172 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.172 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.172 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.172 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.172 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.172 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.173 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.173 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.173 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.173 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.173 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.173 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.173 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.173 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.174 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.174 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.174 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.174 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.174 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.174 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.175 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2023-12-14T14:20:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2023-12-14T14:20:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.177 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2023-12-14T14:20:55.177 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.177 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.177 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.177 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2023-12-14T14:20:55.177 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.177 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.178 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.178 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.178 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:55.178 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:55.178 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.178 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.178 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.178 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:55.179 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.179 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.179 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.179 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2023-12-14T14:20:55.179 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.179 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.179 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.179 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.179 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.180 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.180 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.180 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2023-12-14T14:20:55.180 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.180 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.180 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.180 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2023-12-14T14:20:55.180 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2023-12-14T14:20:55.180 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.181 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.181 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.181 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.181 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.181 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.181 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.181 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.181 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.182 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.182 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.182 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.182 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2023-12-14T14:20:55.182 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2023-12-14T14:20:55.182 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.182 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.182 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.182 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.183 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.183 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.183 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.183 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-14T14:20:55.183 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-14T14:20:55.183 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.183 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.183 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.184 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.185 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.185 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.185 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.185 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.185 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.185 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.185 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.185 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.185 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.186 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.187 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.188 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.188 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.188 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.188 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.188 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.188 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.188 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.188 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.188 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.190 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.190 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.190 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.190 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.190 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.190 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.190 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.191 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.192 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.192 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.192 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.192 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.192 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.192 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.192 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.193 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.193 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.193 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.193 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-14T14:20:55.193 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-14T14:20:55.193 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.193 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.193 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.194 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2023-12-14T14:20:55.194 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.194 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.194 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.194 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.194 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.194 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.195 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.195 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.195 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2023-12-14T14:20:55.195 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2023-12-14T14:20:55.195 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.195 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.195 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.195 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2023-12-14T14:20:55.196 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.196 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.196 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.196 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.196 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.196 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.196 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.196 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.197 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T14:20:55.197 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T14:20:55.197 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.197 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.197 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.197 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T14:20:55.197 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T14:20:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.199 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.199 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.199 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2023-12-14T14:20:55.199 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.199 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.199 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.199 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-14T14:20:55.199 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.199 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.200 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.201 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.201 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.201 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.201 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.201 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.201 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.201 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2023-12-14T14:20:55.202 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.203 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.204 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.204 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T14:20:55.204 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T14:20:55.204 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T14:20:55.204 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.204 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.204 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.204 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.204 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.205 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.205 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.205 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.205 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.205 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-12-14T14:20:55.205 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.205 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.206 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.206 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.206 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.206 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.206 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.206 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.206 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.206 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.206 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.208 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.208 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.208 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.208 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.208 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.208 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.208 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.208 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.209 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.209 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.209 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.209 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.209 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.209 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.209 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.209 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.209 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.210 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.211 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.211 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.211 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.211 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.211 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.211 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.211 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.211 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.212 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.212 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.212 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.212 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.212 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.212 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.212 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.213 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.213 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.213 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.213 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.213 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.213 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.213 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.213 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.214 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.214 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.214 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.214 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2023-12-14T14:20:55.214 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2023-12-14T14:20:55.214 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.214 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.214 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.215 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.215 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.215 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.215 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.215 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.215 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.215 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.215 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.215 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.216 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.217 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.217 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.217 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.217 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.217 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2023-12-14T14:20:55.217 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2023-12-14T14:20:55.217 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.217 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.217 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.218 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.218 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.218 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.218 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.218 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.218 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.218 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.218 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2023-12-14T14:20:55.219 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2023-12-14T14:20:55.220 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.220 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.220 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.220 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.220 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.220 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.220 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.220 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.220 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.221 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.222 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.222 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.222 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.222 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.222 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.222 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.222 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.222 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.223 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.223 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.223 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.223 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.223 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.223 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.224 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.224 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.224 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.224 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.224 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.224 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.224 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.224 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.225 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.225 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.225 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.225 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.225 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.225 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.225 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.225 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.226 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.226 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.226 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.226 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.226 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.226 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.226 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.226 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.227 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.227 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.227 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.227 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.227 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.227 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.227 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.228 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.228 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.228 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.228 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.228 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.229 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.229 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.229 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.229 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.229 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.229 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.229 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.229 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.230 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.230 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.230 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.230 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.230 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.230 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.230 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.230 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.230 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.231 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T14:20:55.232 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T14:20:55.232 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.232 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.232 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.232 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.232 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.232 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.232 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.232 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.233 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.233 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.233 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.233 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.233 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T14:20:55.233 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T14:20:55.233 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.233 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.234 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.235 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.235 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.235 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.235 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2023-12-14T14:20:55.235 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.235 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.235 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.235 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.236 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.236 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.236 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.236 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.236 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.236 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.236 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.236 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.236 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.237 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.237 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.237 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.237 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.237 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.237 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.237 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.238 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.238 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.238 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.238 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.238 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.238 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.238 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.238 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.238 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.239 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.239 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.239 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.239 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.239 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.239 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.239 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.239 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.239 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.240 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.240 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.240 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.240 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.240 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.240 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.240 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.240 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.241 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.241 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.241 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.241 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.241 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.241 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.241 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.241 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.241 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.242 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.242 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.242 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.242 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.242 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.242 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.242 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.243 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.243 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.243 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.243 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.243 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.243 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.243 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.243 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.243 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.244 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.244 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.244 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.244 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.244 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.244 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2023-12-14T14:20:55.244 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.244 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.245 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.245 INFO:teuthology.orchestra.run.smithi069.stdout: "drive_group_interval": { 2023-12-14T14:20:55.245 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "drive_group_interval", 2023-12-14T14:20:55.245 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.245 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.245 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.245 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300.0", 2023-12-14T14:20:55.245 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.246 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.246 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.246 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-14T14:20:55.246 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.246 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.246 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.246 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.246 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.246 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.247 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.248 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.248 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.248 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.248 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.248 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.248 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.248 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.248 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.248 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.249 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.249 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.249 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.249 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.249 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.249 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.249 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.249 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.249 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.250 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.251 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.252 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.252 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.252 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.252 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.252 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.252 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.252 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.252 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.252 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.253 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.253 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.253 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.253 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.253 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.254 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.254 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.254 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.254 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.254 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.254 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.254 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2023-12-14T14:20:55.254 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2023-12-14T14:20:55.254 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.255 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.255 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.255 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2023-12-14T14:20:55.255 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.255 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.255 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.255 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-14T14:20:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2023-12-14T14:20:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.261 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.261 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.261 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.261 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.261 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.261 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.261 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.261 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.261 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.263 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.263 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.263 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.263 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.263 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.263 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.263 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.263 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.263 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.264 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.265 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.266 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.266 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.266 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.266 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.266 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.267 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.268 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.268 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.268 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.268 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2023-12-14T14:20:55.268 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2023-12-14T14:20:55.268 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.268 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.269 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.269 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.269 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.269 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.269 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.269 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.269 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.269 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.269 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.270 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.270 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2023-12-14T14:20:55.270 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2023-12-14T14:20:55.270 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.270 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.270 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.270 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.270 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.271 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.271 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.271 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.271 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.271 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.271 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.271 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.271 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2023-12-14T14:20:55.272 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2023-12-14T14:20:55.272 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.272 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.272 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.272 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.272 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.272 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.272 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.272 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.273 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.273 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.273 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.273 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.273 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2023-12-14T14:20:55.273 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2023-12-14T14:20:55.273 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.274 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.274 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.274 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.274 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.274 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.274 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.274 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.274 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.275 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.275 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.275 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.275 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2023-12-14T14:20:55.275 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2023-12-14T14:20:55.275 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.275 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.275 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.276 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.276 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.276 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.276 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.276 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.276 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.276 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.276 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.276 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.277 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2023-12-14T14:20:55.277 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2023-12-14T14:20:55.277 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.277 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.277 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.277 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.277 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.278 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.278 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.278 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.278 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.278 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.278 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.278 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.278 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.279 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.280 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.280 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.280 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.280 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2023-12-14T14:20:55.280 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2023-12-14T14:20:55.280 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.280 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.280 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.280 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2023-12-14T14:20:55.281 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2023-12-14T14:20:55.282 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.282 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.282 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.282 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.282 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.282 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.282 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.282 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.282 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2023-12-14T14:20:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2023-12-14T14:20:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-12-14T14:20:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2023-12-14T14:20:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2023-12-14T14:20:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.286 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.286 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.286 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.286 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.286 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.286 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2023-12-14T14:20:55.286 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.287 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.287 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.287 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.287 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2023-12-14T14:20:55.287 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2023-12-14T14:20:55.287 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.287 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.287 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.287 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.288 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.288 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.288 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.288 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2023-12-14T14:20:55.288 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.288 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.288 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.289 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.289 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.289 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.289 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.289 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.289 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.289 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.289 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.290 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.290 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.290 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.290 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.290 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.290 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.290 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.290 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.291 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.291 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.291 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.291 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.291 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.291 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.291 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.291 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.291 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.292 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.292 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.292 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.292 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.292 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.292 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.292 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.293 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.293 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.293 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.293 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.293 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.293 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.293 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.293 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.294 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.295 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.295 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.295 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.295 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.295 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.295 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.295 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.295 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.295 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.296 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.296 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.296 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.296 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.296 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.296 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.296 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.296 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.297 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.298 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.298 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.298 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.298 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.298 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.298 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.298 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.299 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.299 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.299 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.299 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.299 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.299 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.299 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.299 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.299 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.300 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.300 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.300 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.300 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.300 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.300 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.300 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.300 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.301 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.301 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.301 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.301 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.301 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.301 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.301 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.301 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.302 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.302 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.302 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.302 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.302 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.302 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.302 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.302 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.303 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.303 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.303 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.303 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.303 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.303 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.303 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.303 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.304 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.304 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.304 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.304 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.304 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.304 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.304 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.304 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.304 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.305 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.305 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.305 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.305 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.305 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.305 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.305 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.306 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.307 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2023-12-14T14:20:55.307 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.307 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.307 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.307 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.307 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.307 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.308 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.308 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.308 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.308 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.308 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.308 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.308 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.308 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.308 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.309 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.309 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.309 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.309 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.309 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.309 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.309 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.309 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.310 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.311 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.311 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.311 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.311 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.311 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.311 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.311 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.311 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.311 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.312 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.312 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.312 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.312 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.312 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.312 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.312 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.313 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.313 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.313 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.313 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.314 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.314 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.314 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.314 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.314 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.314 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.314 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.315 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.315 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.315 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.315 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.315 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.315 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.315 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.315 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.316 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.316 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.316 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.316 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.316 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.316 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.316 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.316 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.316 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2023-12-14T14:20:55.317 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.317 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.317 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.317 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2023-12-14T14:20:55.317 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.318 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.319 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.319 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.319 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:55.319 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:55.319 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.319 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.320 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.320 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2023-12-14T14:20:55.320 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.320 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.320 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.320 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.320 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.320 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.320 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.321 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.321 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.321 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.321 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.321 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.322 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.322 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.322 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.322 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.322 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.322 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.322 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.322 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.322 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.323 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.323 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.323 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.323 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.323 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.323 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.324 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.324 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.324 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.324 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.324 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.324 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.324 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.324 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.324 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.325 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.325 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.325 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.325 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.325 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.325 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.325 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.325 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.326 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.326 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.326 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.326 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.326 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.326 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.326 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.326 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.326 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.327 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.327 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.327 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.327 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.327 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.327 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.327 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.327 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.327 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.328 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.328 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.328 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.328 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.328 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.328 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.328 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.328 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.328 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.329 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.329 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.329 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.329 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.329 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.329 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.329 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.329 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.330 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.330 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.330 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2023-12-14T14:20:55.330 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.330 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.330 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.331 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2023-12-14T14:20:55.331 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2023-12-14T14:20:55.331 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.331 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.332 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.332 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.332 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.332 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.332 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.332 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-14T14:20:55.332 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.332 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.332 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.333 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.333 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2023-12-14T14:20:55.333 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2023-12-14T14:20:55.333 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.333 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.333 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.333 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.334 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.334 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.334 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.334 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-14T14:20:55.334 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.335 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.335 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.335 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.336 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2023-12-14T14:20:55.336 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2023-12-14T14:20:55.336 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.336 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.336 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.336 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.336 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.337 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.337 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.337 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-14T14:20:55.337 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.337 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.337 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.337 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.338 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2023-12-14T14:20:55.338 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2023-12-14T14:20:55.338 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.338 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.338 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.338 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.338 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.338 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.338 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.339 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-14T14:20:55.339 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.339 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.339 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.339 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.339 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2023-12-14T14:20:55.339 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2023-12-14T14:20:55.340 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.340 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.340 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.340 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.340 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.340 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.340 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.340 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-14T14:20:55.340 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.341 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.341 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.341 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.341 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2023-12-14T14:20:55.341 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2023-12-14T14:20:55.341 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.341 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.342 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.342 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.342 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.342 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.342 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.342 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.342 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.342 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.342 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.343 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.343 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2023-12-14T14:20:55.343 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2023-12-14T14:20:55.343 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.343 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.343 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.343 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.343 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.343 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.344 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.345 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.345 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-14T14:20:55.345 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.345 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.345 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.345 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.345 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.345 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.345 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.346 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.346 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T14:20:55.346 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T14:20:55.346 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.346 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.346 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.346 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.346 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.346 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.347 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.347 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.347 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.347 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.347 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.347 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.347 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:55.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:55.347 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.348 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.348 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.348 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2023-12-14T14:20:55.348 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2023-12-14T14:20:55.348 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.348 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.348 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.348 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.348 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.349 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.349 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.349 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2023-12-14T14:20:55.349 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2023-12-14T14:20:55.349 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.349 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.349 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.349 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2023-12-14T14:20:55.350 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.350 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.350 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.350 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.350 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.350 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.350 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.350 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.350 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2023-12-14T14:20:55.351 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2023-12-14T14:20:55.351 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.351 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.351 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.351 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.351 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.351 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.351 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.352 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.352 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.352 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.352 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.352 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.352 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2023-12-14T14:20:55.352 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2023-12-14T14:20:55.353 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.353 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.353 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.353 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.353 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.353 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.353 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.353 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.354 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.354 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.354 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.354 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.354 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.354 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.354 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.355 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.355 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.355 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.355 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.355 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.355 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.355 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.355 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.356 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.356 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.356 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.356 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.356 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.356 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.356 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.356 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.357 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.357 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.357 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.357 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.357 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.357 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.357 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.358 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.358 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.358 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.358 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.358 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.358 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.358 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.358 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.359 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.359 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.359 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.359 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.359 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.359 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.359 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.359 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.360 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.360 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.360 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.360 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.360 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.360 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.360 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.360 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.360 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.361 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.361 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.361 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.361 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.361 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.361 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.361 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.361 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.362 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.362 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.362 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.362 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.362 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.362 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.362 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.362 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.362 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.363 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.363 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.363 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2023-12-14T14:20:55.363 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2023-12-14T14:20:55.363 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.363 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.363 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.363 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.363 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.364 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.364 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.364 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.364 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.364 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.364 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.364 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.364 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2023-12-14T14:20:55.365 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2023-12-14T14:20:55.365 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.365 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.365 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.365 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.365 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.365 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.365 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.366 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.366 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.366 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.366 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.366 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.366 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2023-12-14T14:20:55.366 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2023-12-14T14:20:55.366 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.367 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.367 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.367 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-14T14:20:55.367 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.367 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.367 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.367 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.367 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.367 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.368 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.368 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.368 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.368 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.368 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.368 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2023-12-14T14:20:55.368 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.368 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.369 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.369 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.369 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.369 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.369 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.369 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.369 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.369 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.370 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.370 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.370 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.370 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.370 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.370 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.370 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.371 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.372 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.372 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.372 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.372 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.372 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.372 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.372 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.373 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.373 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.373 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.373 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.373 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.373 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.373 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.373 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.373 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.374 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.374 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.374 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.374 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.374 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.374 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.374 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.374 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.374 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.375 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.376 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.376 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.376 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.376 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.376 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.376 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.376 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.376 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.376 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.377 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.377 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.377 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.377 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.377 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.377 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-12-14T14:20:55.377 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.377 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.377 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.378 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.378 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.378 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.378 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.378 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.378 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.378 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.378 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.378 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.379 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.379 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.379 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.379 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.379 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.379 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.379 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.379 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.379 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.380 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.380 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.380 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.380 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.380 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.380 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.380 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.380 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.380 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.381 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.381 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.381 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.381 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.381 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.381 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.381 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.381 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.382 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.382 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.382 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.382 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.382 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.382 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.382 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.383 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.383 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.383 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.383 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.383 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.383 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.383 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.383 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.383 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.384 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.384 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.384 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.384 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.384 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.384 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.384 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.385 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.385 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.385 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.385 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.385 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.385 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.385 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.386 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.386 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.386 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.386 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.386 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.386 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2023-12-14T14:20:55.386 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2023-12-14T14:20:55.386 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.387 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.387 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.387 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2023-12-14T14:20:55.387 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.387 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.387 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.387 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-14T14:20:55.388 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.388 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.388 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.388 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.388 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2023-12-14T14:20:55.388 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2023-12-14T14:20:55.388 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.388 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.389 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.389 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:55.389 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.389 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.389 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.389 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-14T14:20:55.389 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.389 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.390 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.390 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.390 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.390 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.390 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.390 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2023-12-14T14:20:55.390 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.390 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.390 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.391 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2023-12-14T14:20:55.391 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2023-12-14T14:20:55.391 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:55.391 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.391 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.391 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2023-12-14T14:20:55.391 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.391 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.391 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.392 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.392 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.392 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.392 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.392 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.392 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2023-12-14T14:20:55.392 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2023-12-14T14:20:55.392 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.392 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.393 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.394 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:55.394 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:55.394 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.394 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.394 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.394 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:55.394 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.394 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.395 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.395 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.395 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.395 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.395 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.395 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.395 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.396 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.396 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.396 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.396 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.396 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.396 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.396 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.396 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.396 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.397 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.397 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.397 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.397 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.397 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.397 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.397 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.397 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.398 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.398 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.398 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.398 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.398 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.398 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.398 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.398 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.399 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.400 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.400 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.400 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.400 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.400 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.400 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.400 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.401 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.401 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.401 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.401 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.401 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.401 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.401 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.401 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.401 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.402 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.402 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.402 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.402 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.402 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.402 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.402 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.402 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.404 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2023-12-14T14:20:55.404 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2023-12-14T14:20:55.404 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.404 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.404 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.404 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.404 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.404 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.404 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.405 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.406 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.407 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.408 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.408 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.408 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.408 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.408 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.408 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:55.408 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.408 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.408 INFO:teuthology.orchestra.run.smithi069.stdout: "gid": 25007, 2023-12-14T14:20:55.409 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "y", 2023-12-14T14:20:55.409 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_features": 4540138322906710015, 2023-12-14T14:20:55.409 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2023-12-14T14:20:55.409 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.409 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2023-12-14T14:20:55.409 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.409 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.409 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.409 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.410 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.411 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.411 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.411 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.411 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.411 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.411 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.412 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.412 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.412 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.412 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.412 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.412 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.412 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.412 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.412 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.413 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.414 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.414 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.414 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.414 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.414 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.414 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.414 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.414 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.414 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.415 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.416 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.416 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.416 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.416 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.416 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.416 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.416 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.416 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.417 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.417 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.417 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.417 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.417 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.417 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.417 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.417 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.418 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.418 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.418 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.418 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.418 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.418 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.418 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.418 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.419 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.419 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.419 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.419 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.419 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2023-12-14T14:20:55.419 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2023-12-14T14:20:55.419 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.420 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.420 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.420 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.420 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.420 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.420 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.420 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2023-12-14T14:20:55.421 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.421 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.421 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.421 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.421 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2023-12-14T14:20:55.421 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2023-12-14T14:20:55.421 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.421 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.422 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.422 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2023-12-14T14:20:55.422 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.422 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.422 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.422 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2023-12-14T14:20:55.422 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.422 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.423 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.423 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.423 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2023-12-14T14:20:55.423 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2023-12-14T14:20:55.423 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.423 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.423 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.423 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.423 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.424 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.424 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.424 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2023-12-14T14:20:55.424 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.424 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.424 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.424 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.424 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2023-12-14T14:20:55.424 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.425 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.426 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.426 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.426 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2023-12-14T14:20:55.426 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2023-12-14T14:20:55.426 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.426 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.426 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.426 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2023-12-14T14:20:55.427 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.427 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.427 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.427 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2023-12-14T14:20:55.427 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.427 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.427 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.427 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.428 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2023-12-14T14:20:55.428 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2023-12-14T14:20:55.428 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.428 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.428 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.428 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.428 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.429 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.429 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.429 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2023-12-14T14:20:55.429 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.429 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.429 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.429 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.429 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2023-12-14T14:20:55.429 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2023-12-14T14:20:55.430 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.430 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.430 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.430 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.430 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.430 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.430 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-14T14:20:55.431 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.431 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.431 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.431 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.431 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2023-12-14T14:20:55.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2023-12-14T14:20:55.431 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.431 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.432 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.432 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.432 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.432 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.432 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.432 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2023-12-14T14:20:55.432 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.433 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.433 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.433 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.433 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.433 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.433 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.433 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2023-12-14T14:20:55.433 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.433 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.434 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.434 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2023-12-14T14:20:55.434 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2023-12-14T14:20:55.434 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.434 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.434 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.434 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.434 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.434 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.435 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.435 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2023-12-14T14:20:55.435 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.435 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.435 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.435 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.435 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2023-12-14T14:20:55.435 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T14:20:55.436 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.437 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.437 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.437 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2023-12-14T14:20:55.437 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2023-12-14T14:20:55.437 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:55.437 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.437 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.437 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2023-12-14T14:20:55.438 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.439 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.440 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.441 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.442 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.442 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2023-12-14T14:20:55.442 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2023-12-14T14:20:55.442 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2023-12-14T14:20:55.442 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.442 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2023-12-14T14:20:55.442 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-14T14:20:55.442 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.442 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.443 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.444 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2023-12-14T14:20:55.444 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T14:20:55.444 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.444 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.444 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.444 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2023-12-14T14:20:55.444 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2023-12-14T14:20:55.444 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.445 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.446 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.446 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.446 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.446 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.446 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.446 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.446 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.446 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.447 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.447 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.447 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.447 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.447 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.447 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.447 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.447 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.448 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.448 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.448 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.448 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.448 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.448 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.448 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.449 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.449 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.449 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.449 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.449 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.449 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.449 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.449 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.450 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.450 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.450 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.450 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.450 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.450 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.450 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.450 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.451 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.451 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.451 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.451 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.451 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.451 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.451 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.451 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.452 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.452 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.452 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.452 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.452 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.452 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.452 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.452 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.452 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.453 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.454 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T14:20:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T14:20:55.456 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.456 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.456 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.456 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2023-12-14T14:20:55.456 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.456 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.456 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2023-12-14T14:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2023-12-14T14:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap" 2023-12-14T14:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2023-12-14T14:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.458 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2023-12-14T14:20:55.458 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2023-12-14T14:20:55.458 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.458 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.458 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.458 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.458 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.458 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.459 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.459 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-14T14:20:55.459 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.459 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.459 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.459 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.459 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:55.459 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:55.459 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.460 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.460 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.460 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:55.460 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.460 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.460 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.460 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-14T14:20:55.461 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.461 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.461 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.461 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.461 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2023-12-14T14:20:55.461 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2023-12-14T14:20:55.461 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.461 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.462 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.462 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:55.462 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:55.462 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.462 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.462 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-14T14:20:55.462 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-14T14:20:55.462 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.462 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.463 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.463 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2023-12-14T14:20:55.463 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2023-12-14T14:20:55.463 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:55.463 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.463 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.463 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.463 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.464 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.464 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.464 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-14T14:20:55.464 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.464 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.464 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.464 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.464 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.464 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.465 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.465 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2023-12-14T14:20:55.465 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.465 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.465 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.465 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2023-12-14T14:20:55.465 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2023-12-14T14:20:55.466 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.466 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.466 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.466 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T14:20:55.466 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.466 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.466 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.466 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-14T14:20:55.466 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2023-12-14T14:20:55.467 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.468 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.468 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.468 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-14T14:20:55.468 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.468 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.468 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.468 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.468 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2023-12-14T14:20:55.468 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.469 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_password": { 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_password", 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.470 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.471 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.471 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web password", 2023-12-14T14:20:55.471 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.471 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.471 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.471 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.471 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_user": { 2023-12-14T14:20:55.471 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_user", 2023-12-14T14:20:55.471 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web user", 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.472 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.473 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.474 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-14T14:20:55.474 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-14T14:20:55.474 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.474 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.474 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.474 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-14T14:20:55.475 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.476 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.476 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.476 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.476 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2023-12-14T14:20:55.476 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2023-12-14T14:20:55.476 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.477 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.477 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.477 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2023-12-14T14:20:55.477 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.477 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.477 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.477 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-14T14:20:55.477 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.478 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.478 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.478 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.478 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2023-12-14T14:20:55.478 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2023-12-14T14:20:55.478 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.478 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.478 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.478 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.479 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.479 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.479 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.479 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-14T14:20:55.479 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.479 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.479 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.479 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.480 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2023-12-14T14:20:55.480 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2023-12-14T14:20:55.480 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.480 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.480 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.480 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.480 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.480 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-14T14:20:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2023-12-14T14:20:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2023-12-14T14:20:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.483 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-14T14:20:55.484 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.484 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.484 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.484 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.485 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2023-12-14T14:20:55.485 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2023-12-14T14:20:55.485 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.485 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.485 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.485 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-14T14:20:55.485 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.485 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.485 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.486 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:55.486 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.486 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.486 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.486 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.486 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2023-12-14T14:20:55.487 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2023-12-14T14:20:55.487 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.487 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.487 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.487 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-14T14:20:55.487 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.487 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.487 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.488 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.489 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-14T14:20:55.489 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.489 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.489 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.489 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2023-12-14T14:20:55.489 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.489 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.489 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.489 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.490 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:55.491 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.491 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.491 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.491 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2023-12-14T14:20:55.491 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2023-12-14T14:20:55.491 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.491 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.492 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.492 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-14T14:20:55.492 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.492 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.492 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.492 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2023-12-14T14:20:55.492 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.492 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.492 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.493 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.493 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2023-12-14T14:20:55.493 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2023-12-14T14:20:55.493 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.493 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.493 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.493 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-14T14:20:55.493 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.494 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.494 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.494 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2023-12-14T14:20:55.494 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.494 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.494 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.494 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.495 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2023-12-14T14:20:55.495 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2023-12-14T14:20:55.495 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.495 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.495 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.495 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-14T14:20:55.495 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.495 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.495 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.496 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2023-12-14T14:20:55.496 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.496 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.496 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.496 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.496 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2023-12-14T14:20:55.496 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2023-12-14T14:20:55.496 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.497 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.497 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.497 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-14T14:20:55.497 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.497 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.497 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.497 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2023-12-14T14:20:55.497 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.498 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.498 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.498 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.498 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2023-12-14T14:20:55.498 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2023-12-14T14:20:55.498 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.498 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.498 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.499 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-14T14:20:55.499 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.499 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.499 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.499 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2023-12-14T14:20:55.499 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.499 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.499 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.500 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.501 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2023-12-14T14:20:55.501 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.501 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.501 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.501 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.501 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2023-12-14T14:20:55.501 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2023-12-14T14:20:55.501 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.501 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.502 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.503 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.504 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-14T14:20:55.505 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.505 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.505 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.505 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2023-12-14T14:20:55.505 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.505 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.505 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.505 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.505 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2023-12-14T14:20:55.506 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.507 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2023-12-14T14:20:55.508 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.509 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.509 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.509 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:55.509 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.509 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.509 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.509 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-14T14:20:55.509 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2023-12-14T14:20:55.510 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.511 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.511 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.511 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-14T14:20:55.511 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.511 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.511 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.512 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.512 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2023-12-14T14:20:55.512 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2023-12-14T14:20:55.512 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.512 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.512 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.512 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2023-12-14T14:20:55.512 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.513 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.513 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.513 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-14T14:20:55.513 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.513 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.513 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.513 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.514 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2023-12-14T14:20:55.514 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2023-12-14T14:20:55.514 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.514 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.514 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.514 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2023-12-14T14:20:55.514 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.514 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.514 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.515 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2023-12-14T14:20:55.515 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.515 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.515 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.515 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.515 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2023-12-14T14:20:55.515 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2023-12-14T14:20:55.516 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.516 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.516 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.516 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.516 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.516 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.516 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.516 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-14T14:20:55.517 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.517 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.517 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.517 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.517 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2023-12-14T14:20:55.517 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2023-12-14T14:20:55.517 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.517 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.518 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.518 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:55.518 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.518 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.518 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.518 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2023-12-14T14:20:55.518 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.518 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.518 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.519 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.520 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.521 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.521 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.521 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.521 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.521 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.521 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.521 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.521 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.522 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.522 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.522 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.522 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.522 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.522 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.522 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.523 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2023-12-14T14:20:55.523 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2023-12-14T14:20:55.523 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.523 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.523 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.523 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.523 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.523 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.524 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.525 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.525 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.525 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.525 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.525 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.525 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-14T14:20:55.525 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.525 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.527 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.527 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.527 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.527 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.527 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.527 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.527 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.527 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.527 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.528 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.528 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.528 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.528 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.528 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.528 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.528 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.528 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.529 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.529 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.529 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.529 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.529 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.529 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.529 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.529 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.530 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.530 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.530 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.530 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-14T14:20:55.530 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-14T14:20:55.530 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.530 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.530 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.530 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.531 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.531 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.531 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.531 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-14T14:20:55.531 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.531 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.531 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.531 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.531 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-14T14:20:55.532 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-14T14:20:55.532 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.532 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.532 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.532 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2023-12-14T14:20:55.532 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.532 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.532 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.532 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-14T14:20:55.533 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.533 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.533 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.533 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.533 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2023-12-14T14:20:55.533 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2023-12-14T14:20:55.533 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.533 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.533 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2023-12-14T14:20:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-14T14:20:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2023-12-14T14:20:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2023-12-14T14:20:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2023-12-14T14:20:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T14:20:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T14:20:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2023-12-14T14:20:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2023-12-14T14:20:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2023-12-14T14:20:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2023-12-14T14:20:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2023-12-14T14:20:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2023-12-14T14:20:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-14T14:20:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-14T14:20:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_password": { 2023-12-14T14:20:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_password", 2023-12-14T14:20:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web password", 2023-12-14T14:20:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_user": { 2023-12-14T14:20:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_user", 2023-12-14T14:20:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web user", 2023-12-14T14:20:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2023-12-14T14:20:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2023-12-14T14:20:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.546 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.546 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.546 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.546 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.546 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.546 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-14T14:20:55.546 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.546 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.547 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.548 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.548 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-14T14:20:55.548 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.548 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.548 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.548 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.548 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2023-12-14T14:20:55.548 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2023-12-14T14:20:55.548 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.549 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.550 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.550 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2023-12-14T14:20:55.550 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2023-12-14T14:20:55.550 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.550 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.550 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.550 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.550 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.550 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.551 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.551 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-14T14:20:55.551 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.551 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.551 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.551 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2023-12-14T14:20:55.551 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2023-12-14T14:20:55.552 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.552 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.552 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.552 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.552 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.552 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.552 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.552 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-14T14:20:55.552 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.553 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.553 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.553 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2023-12-14T14:20:55.553 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2023-12-14T14:20:55.553 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.553 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.553 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.553 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2023-12-14T14:20:55.554 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.555 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.555 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.555 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.555 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.555 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.555 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.555 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-14T14:20:55.555 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.556 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.556 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.556 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2023-12-14T14:20:55.556 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2023-12-14T14:20:55.556 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.556 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.556 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.557 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.557 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.557 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.557 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.557 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-14T14:20:55.557 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.557 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.558 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.558 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.558 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2023-12-14T14:20:55.558 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2023-12-14T14:20:55.558 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.558 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.558 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.558 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.558 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.559 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.559 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.559 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-14T14:20:55.559 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.559 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.559 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.559 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2023-12-14T14:20:55.560 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2023-12-14T14:20:55.560 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.560 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.560 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.560 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.560 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.560 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.560 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.561 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2023-12-14T14:20:55.561 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.561 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.561 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.561 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2023-12-14T14:20:55.561 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2023-12-14T14:20:55.561 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.562 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.562 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.562 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.562 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.562 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.562 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.562 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-14T14:20:55.562 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.562 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.563 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.563 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2023-12-14T14:20:55.563 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2023-12-14T14:20:55.563 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.563 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.563 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.563 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.564 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.564 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.564 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.564 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-14T14:20:55.564 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.564 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.564 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.564 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.564 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.565 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.565 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.565 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2023-12-14T14:20:55.565 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.565 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.565 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.565 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.565 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.565 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.566 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.567 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.568 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.568 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.568 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.568 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.568 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.568 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.568 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.568 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.568 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.569 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.570 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.570 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.570 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.570 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.570 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.570 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.570 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.570 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.570 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.572 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.572 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.572 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.572 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.572 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.572 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.572 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.572 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.572 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.573 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2023-12-14T14:20:55.573 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2023-12-14T14:20:55.573 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.573 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.573 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.573 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2023-12-14T14:20:55.573 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.573 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.573 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.574 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-14T14:20:55.574 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.574 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.574 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.574 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2023-12-14T14:20:55.574 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2023-12-14T14:20:55.574 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.574 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.575 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.575 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2023-12-14T14:20:55.575 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.575 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.575 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.575 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-14T14:20:55.575 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.575 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.576 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.576 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.576 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.576 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.576 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2023-12-14T14:20:55.576 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.576 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.576 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.577 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-14T14:20:55.577 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-14T14:20:55.577 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.577 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.577 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.577 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.577 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.578 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.578 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.578 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.578 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.578 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.578 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.578 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2023-12-14T14:20:55.579 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-14T14:20:55.579 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.579 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.579 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.579 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.579 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.579 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.580 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.580 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.580 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.580 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.580 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.580 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-14T14:20:55.580 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-14T14:20:55.581 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.581 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.581 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.581 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.581 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.581 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.581 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.582 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.582 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.582 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.582 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.582 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2023-12-14T14:20:55.582 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2023-12-14T14:20:55.582 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.583 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.583 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.583 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.583 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.583 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.583 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.583 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.583 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.583 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.584 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.585 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.585 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.585 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.585 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.585 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.585 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2023-12-14T14:20:55.585 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-14T14:20:55.585 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.586 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.587 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.587 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-14T14:20:55.587 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-14T14:20:55.587 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.587 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.587 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.587 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.587 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.587 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.588 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.588 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.588 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.588 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.588 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.588 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.588 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-14T14:20:55.588 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-14T14:20:55.588 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.589 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.589 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.589 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.589 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.589 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.589 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.589 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.589 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.590 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.590 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.590 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.590 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-14T14:20:55.590 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-14T14:20:55.590 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.590 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.590 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.591 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.591 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.591 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.591 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.591 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.591 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.591 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.591 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.591 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.592 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-14T14:20:55.592 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-14T14:20:55.592 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.592 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.592 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.592 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.592 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.592 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.592 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.593 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.593 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.593 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.593 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.593 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.593 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-14T14:20:55.593 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-14T14:20:55.593 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.594 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.595 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-14T14:20:55.595 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-14T14:20:55.595 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.595 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.595 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.595 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-14T14:20:55.596 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-14T14:20:55.597 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.597 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.597 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.597 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.597 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.597 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.597 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.597 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.598 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2023-12-14T14:20:55.599 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-14T14:20:55.600 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.600 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.600 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.600 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:55.600 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.600 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.600 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.600 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.600 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.601 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.602 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.602 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.602 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.602 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.602 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.602 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.602 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2023-12-14T14:20:55.602 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.603 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.604 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.605 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.605 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.605 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.605 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.605 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.605 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.605 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-14T14:20:55.605 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-14T14:20:55.606 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.606 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.606 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.606 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.606 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.606 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.606 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.606 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.606 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.607 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.607 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.607 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.607 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-14T14:20:55.607 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-14T14:20:55.607 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.607 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.608 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.608 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.608 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.608 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.608 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.608 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.608 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.608 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.609 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.609 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.609 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-14T14:20:55.609 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-14T14:20:55.609 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.609 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.609 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.609 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.610 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.610 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.610 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.610 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.610 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.610 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.610 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.610 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.611 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-14T14:20:55.611 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-14T14:20:55.611 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.611 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.611 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.611 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.611 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.612 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.612 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.612 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.612 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.612 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.612 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.612 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.612 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2023-12-14T14:20:55.612 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-14T14:20:55.613 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.613 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.613 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.613 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.613 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.613 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.613 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.614 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.615 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.616 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.617 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.617 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.617 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.617 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-14T14:20:55.617 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-14T14:20:55.617 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.617 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.617 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.618 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.618 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.618 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.618 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.618 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.618 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.618 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.618 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.619 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.620 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.621 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.621 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.621 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.621 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.621 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.621 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.621 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.621 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.622 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.622 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-14T14:20:55.622 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-14T14:20:55.622 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.622 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.622 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.622 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.622 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.622 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.623 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.623 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.623 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.623 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.623 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.623 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.623 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-14T14:20:55.624 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-14T14:20:55.624 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.624 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.624 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.624 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.624 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.624 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.624 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.625 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.625 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.625 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.625 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.625 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.625 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-14T14:20:55.625 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-14T14:20:55.625 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.625 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.626 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.626 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.626 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.626 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.626 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.626 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.626 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.626 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.627 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.627 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.627 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2023-12-14T14:20:55.627 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-14T14:20:55.627 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.627 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.627 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.627 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.628 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.628 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.628 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.628 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.628 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.628 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.628 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.629 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.629 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-14T14:20:55.629 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-14T14:20:55.629 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.629 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.629 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.629 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-14T14:20:55.629 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.629 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.630 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.630 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.630 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.630 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.630 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.630 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.630 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-14T14:20:55.630 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-14T14:20:55.631 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.631 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.631 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.631 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.631 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.631 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.631 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.631 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.631 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2023-12-14T14:20:55.632 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.633 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.633 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.633 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.633 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.633 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.633 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.633 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.633 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.634 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.635 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.635 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.635 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.635 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2023-12-14T14:20:55.635 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-14T14:20:55.635 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.635 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.635 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.635 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-14T14:20:55.636 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-14T14:20:55.637 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.637 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.637 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.637 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:55.637 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.637 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.637 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.637 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.637 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.638 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.639 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.640 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.640 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.640 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.640 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.640 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.640 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.640 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.640 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.641 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.641 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.641 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-14T14:20:55.641 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-14T14:20:55.641 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.641 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.641 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.641 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:55.641 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.642 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.642 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.642 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.642 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.642 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.642 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.643 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.643 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-14T14:20:55.643 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-14T14:20:55.643 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.643 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.643 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.643 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.643 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.643 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.644 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.644 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.644 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.644 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.644 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.644 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.644 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-14T14:20:55.644 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-14T14:20:55.645 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.645 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.645 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.645 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:55.645 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.645 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.645 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.646 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.646 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.646 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.646 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.646 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.646 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2023-12-14T14:20:55.646 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2023-12-14T14:20:55.646 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.647 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.647 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.647 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.647 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.647 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.647 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.647 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.647 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.648 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.649 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.649 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.649 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.649 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.649 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.649 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.649 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.649 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2023-12-14T14:20:55.649 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.650 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.651 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.652 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.652 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.652 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.652 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.652 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.652 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.652 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T14:20:55.652 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T14:20:55.653 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.653 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.653 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.653 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.653 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.653 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.653 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.654 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.654 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.654 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.654 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.654 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.654 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.654 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.654 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.655 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.655 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.655 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.655 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.655 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.655 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.655 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.656 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.656 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.656 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.656 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.656 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.656 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.656 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.656 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.656 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.657 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.657 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.657 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.657 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.657 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.657 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.657 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.658 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.658 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.658 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.658 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.658 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.658 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.658 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.658 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.659 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.660 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.660 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.660 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.660 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.660 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.660 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.660 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.660 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.661 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.662 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.662 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.662 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.662 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.662 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.662 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.662 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.662 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.662 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2023-12-14T14:20:55.663 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.664 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T14:20:55.665 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.666 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.667 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.668 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.669 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2023-12-14T14:20:55.670 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2023-12-14T14:20:55.670 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.670 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.670 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.670 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2023-12-14T14:20:55.670 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.670 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.671 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.671 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.671 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.671 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.671 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.671 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.671 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T14:20:55.671 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T14:20:55.671 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.672 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.672 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.672 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2023-12-14T14:20:55.672 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.672 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.672 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.672 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.672 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2023-12-14T14:20:55.673 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.673 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.673 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.673 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.673 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.673 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.673 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T14:20:55.673 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T14:20:55.673 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.674 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.674 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.674 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T14:20:55.674 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T14:20:55.674 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T14:20:55.674 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.675 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.675 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.675 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.675 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.675 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2023-12-14T14:20:55.675 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2023-12-14T14:20:55.675 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.676 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.676 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.676 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.676 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.676 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.676 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.676 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.676 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.677 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.677 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.677 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.677 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.677 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.677 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.677 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-12-14T14:20:55.678 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.678 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.678 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.678 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2023-12-14T14:20:55.678 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2023-12-14T14:20:55.678 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.678 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.678 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.678 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.679 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.680 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.681 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.681 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.681 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.681 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.681 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.681 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.681 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.681 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.681 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.682 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.683 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.684 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.684 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.684 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.684 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.684 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.684 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.684 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.684 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.684 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.685 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.685 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.685 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.685 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.685 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.685 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.685 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.685 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.685 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.686 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.686 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.686 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.686 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.686 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.686 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.686 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.687 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.687 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.687 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.687 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.687 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2023-12-14T14:20:55.687 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2023-12-14T14:20:55.687 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.687 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.687 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.688 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2023-12-14T14:20:55.688 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.688 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.688 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.688 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-14T14:20:55.688 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.688 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.688 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.688 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.689 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2023-12-14T14:20:55.689 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2023-12-14T14:20:55.689 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.689 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.689 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.689 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2023-12-14T14:20:55.689 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.689 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.690 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.691 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.691 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2023-12-14T14:20:55.691 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.691 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.691 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.691 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2023-12-14T14:20:55.691 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.692 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.692 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.692 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2023-12-14T14:20:55.692 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2023-12-14T14:20:55.692 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.692 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.692 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.693 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T14:20:55.693 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.693 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.693 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.693 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-14T14:20:55.693 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.693 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.693 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.694 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2023-12-14T14:20:55.694 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2023-12-14T14:20:55.694 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.694 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.694 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.694 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.694 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:55.695 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.696 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.697 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.697 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2023-12-14T14:20:55.697 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2023-12-14T14:20:55.697 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.697 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.697 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.697 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2023-12-14T14:20:55.697 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.697 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.698 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2023-12-14T14:20:55.699 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.699 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.699 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.699 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.699 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.699 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.699 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.699 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.699 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.700 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.701 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.702 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.703 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.703 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.703 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.703 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.703 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.703 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.703 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.703 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.704 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.704 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.704 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.704 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.704 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.704 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.704 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.704 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.704 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.705 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.705 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.705 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.705 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.705 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.705 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.705 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.705 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.706 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.706 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.706 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.706 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.706 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.706 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.706 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.706 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.707 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.707 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2023-12-14T14:20:55.707 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2023-12-14T14:20:55.707 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.707 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.707 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.707 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T14:20:55.707 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.708 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.708 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.708 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.708 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.708 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.708 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.708 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.709 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2023-12-14T14:20:55.709 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2023-12-14T14:20:55.709 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.709 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.709 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.709 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2023-12-14T14:20:55.709 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.710 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.710 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.710 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.710 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.710 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.710 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.710 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.710 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:55.711 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:55.711 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.711 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.711 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.711 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:55.711 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.711 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.711 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.711 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.712 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.712 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.712 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.712 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.712 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.712 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.712 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.712 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2023-12-14T14:20:55.712 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2023-12-14T14:20:55.713 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2023-12-14T14:20:55.713 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.713 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2023-12-14T14:20:55.713 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2023-12-14T14:20:55.713 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.713 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.713 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.713 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2023-12-14T14:20:55.713 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2023-12-14T14:20:55.714 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2023-12-14T14:20:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-14T14:20:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.715 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.716 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.716 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.716 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2023-12-14T14:20:55.716 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2023-12-14T14:20:55.716 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.716 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.716 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.716 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.716 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.717 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.717 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.717 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2023-12-14T14:20:55.717 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.717 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.717 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.717 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.717 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:55.718 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:55.718 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.718 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.718 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.718 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2023-12-14T14:20:55.718 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2023-12-14T14:20:55.718 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.718 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.719 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-14T14:20:55.719 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.719 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.719 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.719 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.719 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.719 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.719 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.719 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.720 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.720 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.720 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.720 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.720 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.720 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.720 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.720 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.721 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.721 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.721 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.721 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.721 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.721 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.721 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.721 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.721 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.722 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.722 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.722 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.722 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.722 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.722 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.722 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.723 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.723 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.723 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.723 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.723 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.723 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.723 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.723 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.723 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.724 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.724 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.724 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.724 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.724 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.724 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.724 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.724 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.724 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.725 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.725 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.725 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.725 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.725 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.725 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.725 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.725 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.725 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.726 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.726 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.726 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.726 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.726 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.726 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.726 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.726 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.727 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.727 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.727 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.727 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.727 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.727 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.727 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2023-12-14T14:20:55.727 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2023-12-14T14:20:55.727 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.728 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.728 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.728 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.728 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.728 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.728 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.728 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2023-12-14T14:20:55.728 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.728 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.729 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.729 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.729 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2023-12-14T14:20:55.729 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2023-12-14T14:20:55.729 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.729 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.729 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.729 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2023-12-14T14:20:55.729 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T14:20:55.730 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.731 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2023-12-14T14:20:55.732 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.733 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-14T14:20:55.733 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.733 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.733 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.733 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.733 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2023-12-14T14:20:55.733 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2023-12-14T14:20:55.734 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.734 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.734 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.734 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.734 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.734 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.734 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.734 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2023-12-14T14:20:55.734 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.735 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.735 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.735 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.735 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2023-12-14T14:20:55.735 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2023-12-14T14:20:55.735 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.736 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.736 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2023-12-14T14:20:55.736 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.736 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.736 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.736 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T14:20:55.736 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.736 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.737 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.737 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.737 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.737 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.737 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.737 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2023-12-14T14:20:55.738 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.738 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.738 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.738 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.738 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.738 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.738 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.738 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.738 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.739 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.739 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.739 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.739 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.739 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.739 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.739 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.740 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.740 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.740 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.740 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.740 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.740 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.740 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.740 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.741 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.741 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.741 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.741 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.741 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.741 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.741 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.741 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.742 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.742 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.742 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.742 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.742 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.742 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.742 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.742 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.742 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.743 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.744 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.745 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.745 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.745 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.745 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.745 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.745 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.745 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.745 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.745 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.746 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.747 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.748 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.748 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.748 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.748 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.748 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.748 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.748 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.748 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.748 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.749 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.749 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.749 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.749 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.749 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.749 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.749 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.749 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.750 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.750 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.750 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.750 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.750 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.750 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.750 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.750 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.752 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.752 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.752 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.752 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.752 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.752 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.752 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.752 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.753 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.753 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.753 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.753 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.753 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.753 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.753 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.753 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.753 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.754 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.754 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.754 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.754 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.754 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.754 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.754 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.754 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.755 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.755 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.755 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.755 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.755 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2023-12-14T14:20:55.755 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.755 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.756 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.756 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2023-12-14T14:20:55.756 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2023-12-14T14:20:55.756 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.756 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.756 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.756 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2023-12-14T14:20:55.756 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.756 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.757 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.757 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-14T14:20:55.757 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.757 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.757 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.757 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.757 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2023-12-14T14:20:55.757 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2023-12-14T14:20:55.757 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.758 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.758 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.758 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.758 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2023-12-14T14:20:55.758 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.758 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.758 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-14T14:20:55.758 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.759 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.760 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.760 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.760 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.760 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.760 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.760 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.760 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.760 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.760 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.761 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.761 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.761 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.761 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.761 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.761 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.761 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.761 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.762 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.763 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.763 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.763 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.763 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.763 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.763 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.763 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.763 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.763 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.764 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.766 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.766 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.766 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.766 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.766 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.766 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.766 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.767 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.767 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.767 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2023-12-14T14:20:55.767 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.767 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.767 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.767 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2023-12-14T14:20:55.767 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2023-12-14T14:20:55.768 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.768 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.768 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2023-12-14T14:20:55.768 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.768 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.768 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.768 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2023-12-14T14:20:55.769 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-14T14:20:55.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.769 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.769 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.769 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.769 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.769 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.770 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.770 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.770 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.770 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.770 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.770 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.770 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.771 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.771 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.771 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.771 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.771 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.771 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.771 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.771 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.771 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.772 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.772 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.772 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.772 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.772 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.772 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.773 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.773 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.773 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.773 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.773 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.773 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.773 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.773 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.774 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.774 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.774 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.774 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.774 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.774 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.774 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.774 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.775 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.775 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.775 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.775 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.775 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.775 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.775 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.775 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.775 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.776 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.776 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.776 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.776 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.776 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.776 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.776 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.776 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.776 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.777 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.777 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.777 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.777 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.777 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.777 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.777 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.777 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.777 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.778 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.778 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.778 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2023-12-14T14:20:55.778 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2023-12-14T14:20:55.778 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.778 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.778 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.778 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.778 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.779 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.779 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.779 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2023-12-14T14:20:55.779 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-14T14:20:55.779 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.779 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.779 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.779 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2023-12-14T14:20:55.779 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2023-12-14T14:20:55.780 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.780 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.780 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.780 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2023-12-14T14:20:55.780 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.780 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.780 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2023-12-14T14:20:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2023-12-14T14:20:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2023-12-14T14:20:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2023-12-14T14:20:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2023-12-14T14:20:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.783 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.783 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.783 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2023-12-14T14:20:55.783 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2023-12-14T14:20:55.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.783 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.783 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.784 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.784 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.784 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.784 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.784 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2023-12-14T14:20:55.784 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.784 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.784 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.784 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.785 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2023-12-14T14:20:55.785 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2023-12-14T14:20:55.785 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.785 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.785 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.785 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2023-12-14T14:20:55.785 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.785 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.785 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.786 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-14T14:20:55.786 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-14T14:20:55.786 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.786 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.786 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.786 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.786 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.787 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.788 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.788 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.788 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.788 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.788 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.788 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.788 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.788 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.788 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.789 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.789 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.789 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.789 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.789 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.789 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.789 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.789 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.789 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.790 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.790 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.790 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.790 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.790 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.790 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.790 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.790 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.790 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.791 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.791 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.791 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.791 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.791 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.791 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.791 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.791 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.791 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.792 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.793 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.793 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.793 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.793 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.793 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.793 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.793 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.793 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.793 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.794 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.794 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.794 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.794 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.794 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.794 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.794 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.794 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.795 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.795 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.795 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.795 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.795 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.795 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2023-12-14T14:20:55.795 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.796 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.796 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.796 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.796 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.796 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.796 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.796 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.797 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.797 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.797 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.797 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.797 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.797 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.797 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.797 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.797 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.798 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.798 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.798 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.798 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.798 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.798 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.798 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.799 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.799 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.799 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.799 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.799 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.799 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.799 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.799 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.800 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.800 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.800 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.800 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.800 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.800 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.801 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.801 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.801 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.801 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.801 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.801 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.801 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.801 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.802 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.802 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.802 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.802 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.802 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.802 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.802 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.803 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.803 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.803 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.803 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.803 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.803 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.803 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.803 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.804 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.804 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.804 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.804 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.804 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.804 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.804 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.804 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.805 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.805 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.805 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.805 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.805 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.805 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.805 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2023-12-14T14:20:55.805 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.805 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.806 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.806 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.806 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.806 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.806 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.806 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.806 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.806 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.806 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.807 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.808 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.808 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.808 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.808 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.808 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.808 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.808 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.809 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.809 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.809 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.809 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.809 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.809 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.809 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.809 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.809 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.810 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.810 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.810 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.810 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.810 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.810 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.810 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.810 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.811 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.811 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.811 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.811 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.811 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.811 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.811 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.811 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.813 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.813 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.813 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.813 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.813 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.813 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.813 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.813 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.814 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2023-12-14T14:20:55.815 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2023-12-14T14:20:55.815 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.815 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.815 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.815 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.815 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.815 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.816 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-14T14:20:55.816 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.816 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.816 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.816 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.816 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.816 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.816 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.817 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.818 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.818 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.818 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.818 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.818 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.818 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.818 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.818 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.818 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.819 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.820 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.821 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.821 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.821 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.821 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.821 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.821 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.821 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.821 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.821 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.822 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.822 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.822 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.822 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.822 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.822 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.822 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.822 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.822 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.824 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.825 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-12-14T14:20:55.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2023-12-14T14:20:55.825 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2023-12-14T14:20:55.825 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.825 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2023-12-14T14:20:55.825 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.825 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.825 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.825 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.826 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.826 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.826 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.826 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2023-12-14T14:20:55.826 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.826 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.827 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.828 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.828 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.828 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.828 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.828 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.828 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.828 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.828 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.828 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.829 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.829 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.829 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.829 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.829 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.829 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.829 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.829 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.830 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.830 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.830 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.830 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.830 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.830 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.830 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.830 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.831 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.832 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.832 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.832 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.832 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.832 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.832 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.833 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.833 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.833 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.833 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.833 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.833 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.833 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.834 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.834 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.834 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.834 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.834 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.834 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.834 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.834 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.835 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.835 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.835 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.835 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.835 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.835 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.835 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.835 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2023-12-14T14:20:55.836 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.836 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.836 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.836 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.836 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.836 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.836 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.837 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.837 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.837 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.837 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.837 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.837 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.837 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.838 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.839 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.840 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.840 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.840 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.840 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.840 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.840 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.840 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.840 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.840 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.841 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.841 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.841 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.841 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.841 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.841 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.841 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.841 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.841 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.842 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.842 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.842 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.842 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.842 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.842 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.842 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.842 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.843 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.843 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.843 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.843 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.843 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.843 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.843 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.843 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2023-12-14T14:20:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.846 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.846 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.846 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.846 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.846 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.846 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.846 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.846 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.847 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.847 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.847 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.847 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.847 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.847 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.847 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.847 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.848 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.848 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.848 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.848 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.848 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.848 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.848 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.848 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.848 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.849 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.849 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.849 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.849 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.849 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.849 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.849 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.850 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.850 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.850 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.850 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.850 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.850 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.850 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.850 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.850 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.851 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.851 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.851 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.851 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.851 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.851 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.851 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.851 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.851 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.852 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.852 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.852 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.852 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.852 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.852 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.852 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.852 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.852 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.853 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.853 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.853 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.853 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.853 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.853 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.853 INFO:teuthology.orchestra.run.smithi069.stdout: "noautoscale": { 2023-12-14T14:20:55.853 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "noautoscale", 2023-12-14T14:20:55.853 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.854 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.854 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.854 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.854 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.854 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.854 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.854 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "global autoscale flag", 2023-12-14T14:20:55.854 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-12-14T14:20:55.854 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.855 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.855 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.855 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:55.855 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:55.855 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.855 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.855 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.855 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:55.855 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2023-12-14T14:20:55.856 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.857 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.857 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.857 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T14:20:55.857 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2023-12-14T14:20:55.857 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.857 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.857 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2023-12-14T14:20:55.857 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.858 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.859 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2023-12-14T14:20:55.859 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2023-12-14T14:20:55.859 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.859 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.859 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.859 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.859 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.859 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.860 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.860 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-14T14:20:55.860 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.860 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.860 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.860 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.860 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T14:20:55.861 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T14:20:55.861 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.861 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.861 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.861 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.861 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.861 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.861 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.862 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.862 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.862 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.862 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.862 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.862 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.862 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.862 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.863 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.863 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.863 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.863 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.863 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.863 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.863 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.863 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.863 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.864 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.864 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.864 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.864 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.864 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.864 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.864 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.864 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.865 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.865 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.865 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.865 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.865 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.865 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.865 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.866 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.866 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.866 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.866 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.866 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.866 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.866 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.867 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.867 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.867 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.867 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.867 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.867 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.867 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.867 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.867 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.868 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.869 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.869 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.869 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.869 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.869 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.869 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.869 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.869 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.869 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2023-12-14T14:20:55.870 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2023-12-14T14:20:55.871 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.871 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.871 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.871 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2023-12-14T14:20:55.871 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.871 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.871 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.871 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2023-12-14T14:20:55.872 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.872 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.872 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.872 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.872 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:55.872 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:55.872 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:55.872 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.872 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.873 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:55.873 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.873 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.873 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.873 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2023-12-14T14:20:55.873 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.873 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.873 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.874 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.874 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.874 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.874 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.874 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2023-12-14T14:20:55.874 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.874 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.874 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.875 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2023-12-14T14:20:55.875 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2023-12-14T14:20:55.875 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.875 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.875 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.875 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.875 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.875 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.875 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.876 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.876 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.876 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.876 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.876 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.876 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2023-12-14T14:20:55.876 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2023-12-14T14:20:55.876 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.877 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.877 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.877 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.877 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.877 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.877 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.877 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-14T14:20:55.878 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-14T14:20:55.878 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.878 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.878 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.878 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.878 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.878 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.878 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.878 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.879 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.879 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.879 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.879 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.879 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.879 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.879 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.879 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.880 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.880 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.880 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.880 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.880 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.880 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.880 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.880 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.880 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.881 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.881 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.881 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.881 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.881 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.881 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.881 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.881 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.881 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.882 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.882 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.882 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.882 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.882 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.882 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.882 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.882 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.882 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.883 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.884 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.884 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.884 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.884 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.884 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.884 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.884 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.884 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.884 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.885 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.885 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.885 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.885 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.885 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.885 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.885 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.885 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.885 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.886 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.886 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.886 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2023-12-14T14:20:55.886 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2023-12-14T14:20:55.886 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.886 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.886 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.886 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.886 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-14T14:20:55.887 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.888 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.888 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.888 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2023-12-14T14:20:55.888 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.888 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.888 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.888 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.888 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.888 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.889 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.889 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.889 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2023-12-14T14:20:55.889 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2023-12-14T14:20:55.889 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.889 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.889 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.889 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T14:20:55.890 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T14:20:55.891 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.891 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.891 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.891 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T14:20:55.891 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.891 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.891 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.892 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-14T14:20:55.892 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.892 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.892 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.892 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T14:20:55.892 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T14:20:55.892 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.893 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.893 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.893 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2023-12-14T14:20:55.893 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.893 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.893 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.893 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-14T14:20:55.893 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.893 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.894 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.894 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2023-12-14T14:20:55.894 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2023-12-14T14:20:55.894 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.894 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.894 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.894 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2023-12-14T14:20:55.894 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T14:20:55.895 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.896 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.896 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.896 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2023-12-14T14:20:55.896 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.896 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.896 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.896 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2023-12-14T14:20:55.897 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2023-12-14T14:20:55.897 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.897 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.897 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.897 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.897 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.897 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.897 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T14:20:55.898 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T14:20:55.898 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.898 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.898 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.898 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T14:20:55.898 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T14:20:55.898 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T14:20:55.899 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.899 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.899 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.899 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.899 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.899 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.899 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.900 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.900 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.900 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-12-14T14:20:55.900 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.900 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.900 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.900 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.900 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.901 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.902 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.902 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.902 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.902 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.902 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.902 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.902 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.902 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.902 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.903 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.904 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.904 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.904 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.904 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.904 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.904 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.904 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.904 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.905 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.905 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.905 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.905 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.905 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.905 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.905 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.905 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.905 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.906 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.906 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.906 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.906 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.906 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.906 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.906 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.907 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.907 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.907 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.907 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.907 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.907 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.907 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.907 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.908 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.908 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.908 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.908 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.908 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.908 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.908 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2023-12-14T14:20:55.909 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2023-12-14T14:20:55.909 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.909 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.909 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.909 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:55.909 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.909 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.909 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.909 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.910 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.910 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.910 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.910 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.910 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2023-12-14T14:20:55.910 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2023-12-14T14:20:55.910 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.911 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.911 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.911 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.911 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.911 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.911 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.911 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.911 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.911 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.912 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.912 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2023-12-14T14:20:55.912 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2023-12-14T14:20:55.912 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.912 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.912 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.912 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.912 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.913 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.913 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.913 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.913 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.913 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.913 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.913 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.913 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.914 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.916 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T14:20:55.916 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T14:20:55.916 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.916 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.916 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.916 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.916 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.916 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.916 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.917 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.917 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.917 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.917 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.917 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.917 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.917 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.917 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.918 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.919 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.920 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.920 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.920 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.920 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.920 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.920 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.920 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.920 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.920 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.921 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.921 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.921 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.921 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.921 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.921 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.921 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.921 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.921 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.922 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.922 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.922 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.922 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.922 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.922 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.923 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.923 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.923 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.923 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.923 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.923 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.923 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.923 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.923 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.924 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.924 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.924 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.924 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.924 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.924 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.924 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.925 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.925 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.925 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.925 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.925 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.925 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.925 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T14:20:55.925 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T14:20:55.925 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.926 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.926 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.926 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.926 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.926 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.926 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.926 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.927 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.927 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.927 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.927 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.927 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T14:20:55.927 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T14:20:55.927 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.927 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.928 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.928 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.928 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.928 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.928 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.928 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.928 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.929 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.929 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.929 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.929 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.929 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.929 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.929 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2023-12-14T14:20:55.930 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.930 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.930 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.930 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.930 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.930 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.930 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.930 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.930 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.931 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.932 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.933 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.934 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.934 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.934 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.934 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.934 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.934 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.934 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.935 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.936 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.936 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.936 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.936 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.936 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.936 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.936 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.936 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.936 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.937 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.937 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.937 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.937 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.937 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.937 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.937 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.937 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.938 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.938 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.938 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.938 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.938 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.938 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2023-12-14T14:20:55.938 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.938 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.938 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.939 INFO:teuthology.orchestra.run.smithi069.stdout: "drive_group_interval": { 2023-12-14T14:20:55.939 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "drive_group_interval", 2023-12-14T14:20:55.939 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.939 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.939 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.939 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300.0", 2023-12-14T14:20:55.939 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.939 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.940 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.941 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.941 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.941 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.941 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.941 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.941 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.941 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.941 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.942 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.942 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.942 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.942 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.942 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.942 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.942 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.942 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.943 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.944 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.944 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.944 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.944 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.944 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.944 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.944 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.944 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.944 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.945 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.946 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.947 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.947 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.947 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.947 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.947 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.947 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.947 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.947 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.947 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.948 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2023-12-14T14:20:55.949 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.950 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.951 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.951 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.951 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.951 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.951 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.951 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.951 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.951 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.952 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.952 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.952 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.952 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.952 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.952 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.952 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.953 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.953 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.953 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.953 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.953 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.953 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.953 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.953 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.954 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.954 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.954 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.954 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.954 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.954 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.954 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.954 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.955 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.955 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.955 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.955 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.955 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.955 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.955 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.955 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.957 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.957 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.957 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.957 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.957 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.957 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.957 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.958 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.958 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.958 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.958 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.958 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.958 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.958 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.958 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.958 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.959 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.960 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.961 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.961 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.961 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.961 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.961 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.961 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.961 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2023-12-14T14:20:55.961 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2023-12-14T14:20:55.961 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.962 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.962 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.962 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.962 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.962 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.962 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.962 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.962 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.962 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.963 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.963 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.963 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2023-12-14T14:20:55.963 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2023-12-14T14:20:55.963 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.963 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.963 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.963 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.963 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2023-12-14T14:20:55.964 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.965 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.966 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.967 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.967 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.967 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.967 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.967 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.967 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2023-12-14T14:20:55.967 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2023-12-14T14:20:55.967 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.968 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.968 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.968 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.968 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.968 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.968 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.968 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.969 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.969 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.969 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.969 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.969 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2023-12-14T14:20:55.969 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2023-12-14T14:20:55.969 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.969 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.969 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.970 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:55.970 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.970 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.970 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.970 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.970 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.970 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.970 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.971 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.971 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2023-12-14T14:20:55.971 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2023-12-14T14:20:55.971 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:55.971 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.971 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.971 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.971 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2023-12-14T14:20:55.972 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.973 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.973 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.973 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.973 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.973 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.973 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.973 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.974 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.974 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.974 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.974 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.974 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2023-12-14T14:20:55.974 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2023-12-14T14:20:55.974 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.974 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.974 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.975 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.975 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.975 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.975 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.975 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.975 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.975 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.975 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.975 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.976 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2023-12-14T14:20:55.976 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2023-12-14T14:20:55.976 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.976 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.976 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:55.976 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.976 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.976 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.976 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.977 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.977 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.977 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.977 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.977 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.977 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.977 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.977 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.977 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-12-14T14:20:55.978 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.978 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.978 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.978 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2023-12-14T14:20:55.978 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2023-12-14T14:20:55.978 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.978 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.978 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.978 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2023-12-14T14:20:55.979 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.980 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.981 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.981 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.981 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.981 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.981 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.981 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.981 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.981 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.981 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.982 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.983 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.983 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.983 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.983 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.983 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.983 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.983 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.983 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.983 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.984 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.984 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.984 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.984 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.984 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.984 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.984 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.984 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.985 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.985 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.985 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.985 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.985 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.985 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.985 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.985 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.986 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.986 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.986 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.986 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.986 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.986 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.986 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.986 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.987 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.987 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.987 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.987 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.987 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.987 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.987 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.987 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.988 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.988 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.988 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.988 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.988 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.988 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.988 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.989 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.989 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.989 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.989 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.989 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.989 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.989 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.989 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2023-12-14T14:20:55.990 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.990 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.990 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.990 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.990 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.990 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.990 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.990 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.991 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.991 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.991 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.991 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.991 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.991 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.991 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.992 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:55.993 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:55.993 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.993 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.993 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.993 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.993 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.993 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.993 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.993 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.994 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.994 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.994 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.994 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.994 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:55.994 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:55.994 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.994 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.994 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:55.995 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:55.997 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.997 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.997 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:55.997 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.997 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:55.997 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:55.997 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:55.997 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:55.998 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:55.998 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:55.998 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.998 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:55.998 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:55.998 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:55.998 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2023-12-14T14:20:55.998 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:55.999 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.000 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.000 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.000 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.000 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.000 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.000 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.000 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.001 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.001 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.001 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.001 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.001 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.001 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.001 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.001 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.001 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.002 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.002 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.002 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.002 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.002 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.002 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.002 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.002 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.003 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.003 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.003 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.003 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.003 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.003 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.003 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.003 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.003 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.004 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.004 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.004 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.004 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.004 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.004 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.004 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.004 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.004 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.005 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.005 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.005 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.005 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.005 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.005 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.005 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.005 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.006 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.006 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.006 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.006 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.006 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.006 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.006 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.006 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.006 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.007 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.007 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.007 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.007 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.007 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.007 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.007 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2023-12-14T14:20:56.007 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.007 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.008 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.009 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.009 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.009 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.009 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.009 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.009 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:56.009 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:56.009 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.009 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.010 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.011 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.011 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.011 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.011 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.011 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.011 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.011 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.011 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.011 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.012 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.013 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.013 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.013 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.013 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.013 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.013 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.013 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.013 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.013 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.014 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.014 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.014 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.014 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.014 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.014 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.014 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.015 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.015 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.015 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.015 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.015 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.015 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.015 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.015 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.015 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.016 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.016 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.016 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.016 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.016 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.016 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.016 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.017 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.017 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.017 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.017 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.017 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.017 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.017 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.017 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.017 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.018 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.018 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.018 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.018 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.018 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.018 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.019 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.019 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.019 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.019 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.019 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.019 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.019 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.019 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2023-12-14T14:20:56.019 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.020 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.020 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.020 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2023-12-14T14:20:56.020 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2023-12-14T14:20:56.020 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.020 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.020 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.021 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.021 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.021 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.021 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.021 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-14T14:20:56.021 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.021 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.021 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.023 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-14T14:20:56.023 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.023 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.023 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.023 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.023 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2023-12-14T14:20:56.023 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2023-12-14T14:20:56.023 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.023 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.024 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.024 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.024 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.024 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.024 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.024 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-14T14:20:56.024 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.024 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.024 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.025 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.025 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2023-12-14T14:20:56.025 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2023-12-14T14:20:56.025 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.025 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.025 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.025 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.025 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.025 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.026 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.026 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-14T14:20:56.026 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.026 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.026 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.026 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.026 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2023-12-14T14:20:56.026 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2023-12-14T14:20:56.026 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.027 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.028 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.028 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2023-12-14T14:20:56.028 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2023-12-14T14:20:56.028 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.028 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.028 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.028 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.028 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.028 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.029 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.029 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.029 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.029 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.029 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.029 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.029 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2023-12-14T14:20:56.030 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2023-12-14T14:20:56.030 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.030 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.030 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.030 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.030 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.030 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.030 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.031 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.031 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.031 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.031 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.031 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.031 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2023-12-14T14:20:56.031 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2023-12-14T14:20:56.031 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.031 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.032 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.032 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-14T14:20:56.032 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.032 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.032 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.032 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.032 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.033 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.033 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.033 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.033 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T14:20:56.033 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T14:20:56.033 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.033 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.033 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.033 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.034 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.034 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.034 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.034 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.034 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.034 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.034 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.035 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.035 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:56.035 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:56.035 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.035 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.035 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.035 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2023-12-14T14:20:56.035 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2023-12-14T14:20:56.035 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.036 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.036 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.036 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.036 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.036 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.036 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.036 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2023-12-14T14:20:56.037 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2023-12-14T14:20:56.037 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.037 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.037 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.037 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2023-12-14T14:20:56.037 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.037 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.037 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.037 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.038 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.038 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.038 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.038 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.038 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2023-12-14T14:20:56.038 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2023-12-14T14:20:56.038 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.038 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.039 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.040 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.041 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.041 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.041 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.041 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.041 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.041 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.041 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.041 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.042 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.043 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.043 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.043 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.043 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.043 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.043 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.043 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.043 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.043 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.044 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.045 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.046 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.046 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.046 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.046 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.046 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.046 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.046 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.046 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.046 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.047 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.047 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.047 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.047 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.047 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.047 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.047 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.048 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.048 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.048 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.048 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.048 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.048 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.048 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.048 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.048 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.049 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.049 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2023-12-14T14:20:56.049 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2023-12-14T14:20:56.049 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.049 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.049 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.050 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.050 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.050 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.050 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.050 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.050 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.050 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.050 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.051 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2023-12-14T14:20:56.051 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2023-12-14T14:20:56.051 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.051 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.051 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.051 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.051 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.052 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.052 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.052 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.052 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.052 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.052 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.052 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.052 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2023-12-14T14:20:56.053 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2023-12-14T14:20:56.053 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.053 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.053 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.053 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-14T14:20:56.053 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.053 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.054 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.054 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.054 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.054 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.054 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.054 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.054 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.054 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.055 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.056 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.056 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.056 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.056 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.056 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.056 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.056 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.056 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.056 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.057 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.057 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.057 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.057 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.057 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.057 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.057 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.057 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.057 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.058 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.059 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.059 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.059 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.059 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.059 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.059 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.059 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.060 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.060 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.060 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.060 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.060 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.060 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.060 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.060 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.061 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.061 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.061 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.061 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.061 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.061 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.061 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.061 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.061 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.062 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.062 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.062 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.062 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.062 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.062 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.062 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.062 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-12-14T14:20:56.063 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.064 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.064 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.064 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.064 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.064 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.064 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.064 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.065 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.065 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.065 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.065 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.065 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.065 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.065 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.065 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.066 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.066 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.066 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.066 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.066 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.066 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.066 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.066 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.067 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.067 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.067 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.067 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.067 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.067 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.067 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.067 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.067 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.068 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.068 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.068 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.068 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.068 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.068 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.068 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.068 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.069 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.070 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.071 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.072 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.072 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.072 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2023-12-14T14:20:56.072 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2023-12-14T14:20:56.072 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.072 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.072 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.072 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2023-12-14T14:20:56.072 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.073 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.073 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.073 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-14T14:20:56.073 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.073 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.073 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.073 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.073 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2023-12-14T14:20:56.073 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.074 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.075 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2023-12-14T14:20:56.076 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2023-12-14T14:20:56.076 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:56.076 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.076 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.076 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2023-12-14T14:20:56.076 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.076 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.076 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.077 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.077 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.077 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.077 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.077 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.077 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2023-12-14T14:20:56.077 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2023-12-14T14:20:56.077 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.078 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.078 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.078 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.078 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.078 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.078 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.078 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.079 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.079 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.079 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.079 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.079 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:56.079 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:56.079 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.079 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.080 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.080 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:56.080 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.080 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.080 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.080 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.080 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.080 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.081 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.081 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.081 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.081 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.081 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.081 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.081 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.081 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.082 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.082 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.082 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.082 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.082 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.082 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.082 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.083 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.083 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.083 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.083 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.083 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.083 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.083 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.083 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.084 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.084 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.084 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.084 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.084 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.084 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.084 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.084 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.085 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.085 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.085 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.085 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.085 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.085 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.085 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.085 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.085 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.086 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.086 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.086 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.086 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.086 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.086 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.086 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.086 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.086 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.087 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.088 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.089 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.089 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.089 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.089 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2023-12-14T14:20:56.089 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2023-12-14T14:20:56.089 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.089 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.089 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.089 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2023-12-14T14:20:56.090 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2023-12-14T14:20:56.091 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.091 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.091 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.091 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2023-12-14T14:20:56.091 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.091 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.091 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.091 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.091 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.092 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.092 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.092 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.092 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2023-12-14T14:20:56.092 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2023-12-14T14:20:56.092 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.092 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.092 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.092 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-14T14:20:56.093 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.093 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.093 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.093 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.093 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.093 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.093 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: "modules": [ 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: "dashboard", 2023-12-14T14:20:56.094 INFO:teuthology.orchestra.run.smithi069.stdout: "iostat", 2023-12-14T14:20:56.095 INFO:teuthology.orchestra.run.smithi069.stdout: "nfs", 2023-12-14T14:20:56.095 INFO:teuthology.orchestra.run.smithi069.stdout: "restful", 2023-12-14T14:20:56.095 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_schedule" 2023-12-14T14:20:56.095 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.095 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2023-12-14T14:20:56.095 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.095 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2023-12-14T14:20:56.096 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.096 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.096 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.096 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:56.096 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:56.096 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.096 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.096 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.096 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:56.097 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.097 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.097 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.097 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2023-12-14T14:20:56.097 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.097 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.097 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.097 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.098 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.098 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.098 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.098 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.098 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.098 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.098 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.098 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.099 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.100 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.100 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.100 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.100 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.100 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.100 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.100 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.101 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.101 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.101 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.101 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.101 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.101 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.101 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.101 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.101 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.102 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.103 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.103 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.103 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.103 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.103 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.103 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.103 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.103 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.103 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.104 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.104 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.104 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.104 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.104 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.104 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.104 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.104 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.104 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2023-12-14T14:20:56.105 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2023-12-14T14:20:56.106 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.106 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.106 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.106 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.106 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.106 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.106 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.106 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2023-12-14T14:20:56.106 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2023-12-14T14:20:56.107 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.108 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.108 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.108 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2023-12-14T14:20:56.108 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.108 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.108 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.108 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.108 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2023-12-14T14:20:56.108 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2023-12-14T14:20:56.109 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.109 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.109 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.109 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.109 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.109 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.109 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.110 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2023-12-14T14:20:56.110 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.110 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.110 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.110 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.110 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2023-12-14T14:20:56.110 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2023-12-14T14:20:56.110 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.111 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.111 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.111 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.111 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.111 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.111 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.111 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2023-12-14T14:20:56.111 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.112 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.112 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.112 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.112 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2023-12-14T14:20:56.112 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2023-12-14T14:20:56.112 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.112 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.112 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.113 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2023-12-14T14:20:56.113 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.113 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.113 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.113 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2023-12-14T14:20:56.113 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.113 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.114 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.114 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.114 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2023-12-14T14:20:56.114 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2023-12-14T14:20:56.114 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.114 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.114 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.114 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.114 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.115 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.115 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.115 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2023-12-14T14:20:56.115 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.115 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.115 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.116 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.116 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2023-12-14T14:20:56.116 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2023-12-14T14:20:56.116 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.116 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.116 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.116 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.116 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.117 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.117 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.117 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-14T14:20:56.117 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.117 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.117 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.117 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.117 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2023-12-14T14:20:56.118 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.119 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.119 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.119 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.119 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.119 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2023-12-14T14:20:56.119 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.119 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.120 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.120 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2023-12-14T14:20:56.120 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2023-12-14T14:20:56.120 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.120 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.120 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.120 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.120 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.120 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.121 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.121 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2023-12-14T14:20:56.121 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.121 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.121 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.121 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.121 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2023-12-14T14:20:56.121 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2023-12-14T14:20:56.122 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.122 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.122 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.122 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2023-12-14T14:20:56.122 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.122 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.122 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.122 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2023-12-14T14:20:56.122 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T14:20:56.123 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.123 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.123 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.123 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2023-12-14T14:20:56.123 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2023-12-14T14:20:56.123 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:56.123 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.123 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.124 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:56.124 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T14:20:56.124 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T14:20:56.124 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.124 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-14T14:20:56.124 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T14:20:56.124 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.124 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.125 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2023-12-14T14:20:56.125 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2023-12-14T14:20:56.125 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:56.125 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.125 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.125 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2023-12-14T14:20:56.125 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:56.126 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2023-12-14T14:20:56.126 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.126 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-14T14:20:56.126 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.126 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.126 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.126 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.126 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2023-12-14T14:20:56.126 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2023-12-14T14:20:56.127 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.127 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.127 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.127 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2023-12-14T14:20:56.127 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.127 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.127 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.128 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-14T14:20:56.128 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-14T14:20:56.128 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.128 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.128 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.128 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2023-12-14T14:20:56.128 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2023-12-14T14:20:56.128 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:56.129 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.129 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.129 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2023-12-14T14:20:56.129 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2023-12-14T14:20:56.129 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2023-12-14T14:20:56.129 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.129 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2023-12-14T14:20:56.129 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-14T14:20:56.130 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.130 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.130 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.130 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2023-12-14T14:20:56.130 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2023-12-14T14:20:56.130 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.130 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.130 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.130 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2023-12-14T14:20:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2023-12-14T14:20:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T14:20:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2023-12-14T14:20:56.132 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2023-12-14T14:20:56.132 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:56.132 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.132 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.132 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:56.132 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T14:20:56.132 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T14:20:56.132 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.132 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-14T14:20:56.133 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T14:20:56.133 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.133 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.133 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.133 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.133 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.133 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.133 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.133 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.134 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.134 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.134 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.134 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.134 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.134 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.134 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.134 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.135 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.136 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.137 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.137 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.137 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.137 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.137 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.137 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.137 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.137 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.137 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.138 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.138 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.138 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.138 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.138 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.138 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.138 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.138 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.139 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.139 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.139 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.139 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.139 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.139 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.139 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.139 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.139 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.140 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.140 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.140 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.140 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.140 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.140 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.140 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.140 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.140 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.141 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.141 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.141 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2023-12-14T14:20:56.141 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2023-12-14T14:20:56.141 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:56.141 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.141 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.142 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:56.142 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.142 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.142 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.142 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-14T14:20:56.142 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.142 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.142 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.142 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.143 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T14:20:56.143 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T14:20:56.143 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.143 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.143 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.143 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2023-12-14T14:20:56.143 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.144 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.144 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.144 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2023-12-14T14:20:56.144 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2023-12-14T14:20:56.144 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap" 2023-12-14T14:20:56.144 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.144 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2023-12-14T14:20:56.144 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.145 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.145 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.145 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.145 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2023-12-14T14:20:56.145 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2023-12-14T14:20:56.145 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.145 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.146 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.146 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.146 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.146 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.146 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.146 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-14T14:20:56.146 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.146 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.147 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.147 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.147 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:56.147 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:56.147 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.147 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.147 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.147 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:56.147 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-14T14:20:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2023-12-14T14:20:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-14T14:20:56.149 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2023-12-14T14:20:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2023-12-14T14:20:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.151 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.152 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T14:20:56.153 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.153 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.153 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.153 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-14T14:20:56.153 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.153 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.153 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.153 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.153 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2023-12-14T14:20:56.154 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2023-12-14T14:20:56.154 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.154 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.154 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.154 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2023-12-14T14:20:56.154 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.154 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.154 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.155 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-14T14:20:56.155 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.155 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.155 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.155 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.155 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2023-12-14T14:20:56.155 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2023-12-14T14:20:56.155 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.156 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.156 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.156 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2023-12-14T14:20:56.156 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.156 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.156 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.156 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-14T14:20:56.156 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.156 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.157 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.157 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.157 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_password": { 2023-12-14T14:20:56.157 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_password", 2023-12-14T14:20:56.157 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.157 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.157 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.157 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:56.157 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.158 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.158 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.158 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web password", 2023-12-14T14:20:56.158 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.158 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.158 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.158 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.158 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_user": { 2023-12-14T14:20:56.159 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_user", 2023-12-14T14:20:56.159 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.159 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.159 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.159 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:56.159 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.159 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.159 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.159 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web user", 2023-12-14T14:20:56.160 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.160 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.160 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.160 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.160 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2023-12-14T14:20:56.160 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2023-12-14T14:20:56.160 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.160 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.161 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.161 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.161 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.161 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.161 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.161 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-14T14:20:56.161 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-14T14:20:56.161 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.162 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.163 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.163 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-14T14:20:56.163 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.163 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.163 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.163 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.163 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2023-12-14T14:20:56.163 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.164 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.165 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.165 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.165 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2023-12-14T14:20:56.165 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2023-12-14T14:20:56.165 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.165 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.165 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.165 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.165 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.166 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.167 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.167 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.167 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.167 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.167 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.167 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-14T14:20:56.167 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.167 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.167 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.168 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.169 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.170 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2023-12-14T14:20:56.171 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2023-12-14T14:20:56.171 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.171 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.171 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.171 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-14T14:20:56.171 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.171 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.171 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.171 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2023-12-14T14:20:56.172 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.172 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.172 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.172 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.172 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2023-12-14T14:20:56.172 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2023-12-14T14:20:56.172 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.173 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.173 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.173 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-14T14:20:56.173 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.173 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.173 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.173 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2023-12-14T14:20:56.173 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.173 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.174 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.174 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.174 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2023-12-14T14:20:56.174 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2023-12-14T14:20:56.174 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.174 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.175 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.175 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-14T14:20:56.175 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.175 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.175 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.175 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:56.175 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.175 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.175 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.176 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.176 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2023-12-14T14:20:56.176 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2023-12-14T14:20:56.176 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.176 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.176 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.176 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-14T14:20:56.177 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.177 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.177 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.177 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2023-12-14T14:20:56.177 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.177 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.177 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.178 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.178 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2023-12-14T14:20:56.178 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2023-12-14T14:20:56.178 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.178 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.178 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.178 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-14T14:20:56.178 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.179 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.179 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.179 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2023-12-14T14:20:56.179 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.179 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.179 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.179 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.179 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2023-12-14T14:20:56.179 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2023-12-14T14:20:56.180 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.180 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.180 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.180 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-14T14:20:56.180 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.180 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.180 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.180 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2023-12-14T14:20:56.180 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-14T14:20:56.181 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2023-12-14T14:20:56.182 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.183 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.183 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.183 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-14T14:20:56.183 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.183 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.183 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.183 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2023-12-14T14:20:56.183 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.183 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.184 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.184 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.184 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2023-12-14T14:20:56.184 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2023-12-14T14:20:56.184 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.184 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.184 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.185 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-14T14:20:56.185 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.185 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.185 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.185 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2023-12-14T14:20:56.185 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.185 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.185 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.186 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.186 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2023-12-14T14:20:56.186 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2023-12-14T14:20:56.186 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.186 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.186 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.186 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-14T14:20:56.186 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.187 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.187 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.187 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:56.187 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.187 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.187 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.187 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.187 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2023-12-14T14:20:56.187 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2023-12-14T14:20:56.188 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.188 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.188 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.188 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-14T14:20:56.188 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.188 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.188 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.188 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T14:20:56.189 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.189 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.189 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.189 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.189 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2023-12-14T14:20:56.189 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2023-12-14T14:20:56.189 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.189 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.190 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.191 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2023-12-14T14:20:56.191 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2023-12-14T14:20:56.191 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.191 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.191 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.191 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-14T14:20:56.191 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2023-12-14T14:20:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2023-12-14T14:20:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2023-12-14T14:20:56.193 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.193 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.193 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.193 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.193 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.193 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.193 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.193 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2023-12-14T14:20:56.193 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:56.194 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2023-12-14T14:20:56.195 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.196 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.196 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.196 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2023-12-14T14:20:56.196 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.196 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.196 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.196 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-14T14:20:56.196 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.196 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.197 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.198 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.198 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-14T14:20:56.198 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.198 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.198 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.198 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.198 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2023-12-14T14:20:56.198 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2023-12-14T14:20:56.198 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.199 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.200 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-14T14:20:56.201 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.201 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.201 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.201 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.201 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2023-12-14T14:20:56.201 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2023-12-14T14:20:56.201 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.201 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.202 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.202 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:56.202 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.202 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.202 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.202 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2023-12-14T14:20:56.202 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.203 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.203 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.203 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.203 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2023-12-14T14:20:56.203 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2023-12-14T14:20:56.203 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.203 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.203 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.203 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:56.204 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.204 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.204 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.204 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2023-12-14T14:20:56.204 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.204 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.204 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.205 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.205 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.205 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.205 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.205 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.205 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.205 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.205 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.206 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.206 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.206 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.206 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.206 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.206 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.206 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.206 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.207 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.207 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.207 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.207 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.207 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.207 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.207 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2023-12-14T14:20:56.208 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2023-12-14T14:20:56.208 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.208 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.208 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.208 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.208 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.208 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.208 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.209 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-14T14:20:56.209 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.209 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.209 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.209 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.209 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.209 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.210 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.210 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.210 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.210 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.210 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.210 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.210 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.210 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-14T14:20:56.210 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.211 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.212 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.213 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.213 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.213 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.213 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.213 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.213 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.213 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.213 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.214 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.214 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.214 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.214 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.214 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.214 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.214 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.214 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.214 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.215 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.215 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-14T14:20:56.215 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-14T14:20:56.215 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.215 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.215 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.215 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.216 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.216 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.216 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.216 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-14T14:20:56.216 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.216 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.216 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.216 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.217 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-14T14:20:56.217 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-14T14:20:56.217 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.217 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.217 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.217 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2023-12-14T14:20:56.217 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.217 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.217 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.218 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-14T14:20:56.218 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.218 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.218 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.218 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.218 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2023-12-14T14:20:56.218 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2023-12-14T14:20:56.218 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.219 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.219 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.219 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:56.219 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.219 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.219 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.219 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2023-12-14T14:20:56.219 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.220 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.220 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.220 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.220 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2023-12-14T14:20:56.220 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2023-12-14T14:20:56.220 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.220 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.220 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.221 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:56.221 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.221 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.221 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.221 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-14T14:20:56.221 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.221 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.221 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.222 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.223 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2023-12-14T14:20:56.223 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.223 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.223 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.223 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.223 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T14:20:56.223 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T14:20:56.223 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.223 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.224 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.224 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2023-12-14T14:20:56.224 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.224 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.224 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.224 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2023-12-14T14:20:56.224 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2023-12-14T14:20:56.224 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.224 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.225 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-14T14:20:56.226 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.226 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.226 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.226 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-14T14:20:56.226 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.226 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.226 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_password": { 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_password", 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.227 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.228 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web password", 2023-12-14T14:20:56.228 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.228 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.228 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.228 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.228 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_user": { 2023-12-14T14:20:56.228 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_user", 2023-12-14T14:20:56.228 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.228 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web user", 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.229 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-14T14:20:56.230 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.231 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.231 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.231 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.231 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2023-12-14T14:20:56.231 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2023-12-14T14:20:56.231 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.231 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.232 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.232 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.232 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.232 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.232 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.232 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-14T14:20:56.232 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.232 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.233 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.233 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.233 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2023-12-14T14:20:56.233 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2023-12-14T14:20:56.233 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.233 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.233 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.233 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.233 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.234 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.234 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.234 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-14T14:20:56.234 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.234 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.234 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.234 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.234 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2023-12-14T14:20:56.234 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.235 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.236 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.236 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.236 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2023-12-14T14:20:56.236 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2023-12-14T14:20:56.236 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.236 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.236 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.236 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.237 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.237 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.237 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.237 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-14T14:20:56.237 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.237 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.238 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.238 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.238 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2023-12-14T14:20:56.238 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2023-12-14T14:20:56.238 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.238 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.238 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.239 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2023-12-14T14:20:56.239 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.239 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.239 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.239 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2023-12-14T14:20:56.239 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.239 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.239 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.239 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.240 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2023-12-14T14:20:56.240 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2023-12-14T14:20:56.240 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.240 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.240 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.240 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.240 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.241 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.241 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.241 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-14T14:20:56.241 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.241 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.241 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.241 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.241 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2023-12-14T14:20:56.242 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2023-12-14T14:20:56.242 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.242 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.242 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.242 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.242 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.242 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.242 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.242 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-14T14:20:56.243 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.243 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.243 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.243 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.243 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2023-12-14T14:20:56.243 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2023-12-14T14:20:56.243 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.243 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.243 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.244 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2023-12-14T14:20:56.245 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2023-12-14T14:20:56.245 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.245 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.245 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.245 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.245 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.245 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.245 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.245 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2023-12-14T14:20:56.246 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.246 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.246 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.246 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.246 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2023-12-14T14:20:56.246 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2023-12-14T14:20:56.246 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.246 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.247 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.247 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.247 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.247 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.247 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.247 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-14T14:20:56.247 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.247 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.247 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.248 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.248 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2023-12-14T14:20:56.248 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2023-12-14T14:20:56.248 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.248 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.248 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.248 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.248 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.249 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.249 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.249 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-14T14:20:56.249 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.249 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.249 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.249 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.249 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.250 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.250 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.250 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2023-12-14T14:20:56.250 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.250 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.250 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.250 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.250 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.251 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.251 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.251 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.251 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.251 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.251 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.251 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.251 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.251 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.252 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.252 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.252 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.252 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.252 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.252 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.252 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.252 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.252 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.253 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.253 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.253 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.253 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.253 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.253 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.253 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.253 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.254 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.254 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.254 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.254 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.254 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.254 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.254 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.255 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.255 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.255 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.255 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.255 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.255 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.255 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.255 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.255 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.256 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.256 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.256 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.256 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.256 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.256 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.256 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.256 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.256 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.257 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.257 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.257 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.257 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.257 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.257 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.257 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.257 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.257 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.258 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.258 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.258 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.258 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.258 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.258 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.258 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.258 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.258 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-14T14:20:56.259 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.260 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.260 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.260 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.260 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2023-12-14T14:20:56.260 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2023-12-14T14:20:56.260 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.260 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.260 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.260 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.261 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.262 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.262 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2023-12-14T14:20:56.262 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.262 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.262 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.262 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-14T14:20:56.262 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-14T14:20:56.262 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.262 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.263 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.264 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2023-12-14T14:20:56.264 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-14T14:20:56.264 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.264 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.264 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.264 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.264 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.265 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.265 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.265 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.265 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.265 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.265 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.265 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.265 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-14T14:20:56.265 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-14T14:20:56.266 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.266 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.266 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.266 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.266 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.266 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.267 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.267 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.267 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.267 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.267 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.267 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.267 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2023-12-14T14:20:56.267 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2023-12-14T14:20:56.267 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.268 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.268 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.268 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.268 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.268 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.268 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.268 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.269 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.269 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.269 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.269 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.269 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-14T14:20:56.269 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-14T14:20:56.269 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.270 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.270 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.270 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.270 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.270 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.270 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.270 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.270 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.271 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.271 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.271 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.271 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2023-12-14T14:20:56.271 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-14T14:20:56.271 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.271 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.272 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.272 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.272 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.272 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.272 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.272 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.272 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.272 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.272 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.273 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.273 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-14T14:20:56.273 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-14T14:20:56.273 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.273 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.273 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.273 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.273 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.273 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.274 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.274 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.274 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.274 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.274 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.274 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.274 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-14T14:20:56.274 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-14T14:20:56.274 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.275 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.275 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.275 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.275 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.275 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.275 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.275 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.275 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.275 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.276 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.276 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.276 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-14T14:20:56.276 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-14T14:20:56.276 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.276 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.276 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.276 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.277 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.277 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.277 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.277 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.277 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.277 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.277 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.278 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.278 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-14T14:20:56.278 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-14T14:20:56.278 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.278 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.278 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.278 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.278 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.278 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.279 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.279 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.279 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.279 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.279 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.279 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.279 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-14T14:20:56.279 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-14T14:20:56.280 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.280 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.280 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.280 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.280 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.280 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.280 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.280 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.280 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.281 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.281 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.281 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.281 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-14T14:20:56.281 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-14T14:20:56.281 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.281 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.281 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.282 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.282 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.282 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.282 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.282 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.282 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.282 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.282 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.283 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.283 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-14T14:20:56.283 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-14T14:20:56.283 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.283 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.283 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.283 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.283 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-14T14:20:56.284 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.285 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.285 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.285 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.285 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.285 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.285 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.285 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.285 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:56.286 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.287 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.287 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.287 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.287 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.287 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.287 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.287 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.287 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-14T14:20:56.287 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.288 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.289 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.289 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.289 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2023-12-14T14:20:56.289 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2023-12-14T14:20:56.289 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.289 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.289 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.289 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.289 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.290 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.290 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.290 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.290 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.290 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.290 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.290 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.290 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2023-12-14T14:20:56.290 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.291 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.292 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.293 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.293 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.293 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.293 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.293 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.293 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.293 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-14T14:20:56.294 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-14T14:20:56.294 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.294 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.294 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.294 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.294 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.294 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.294 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.295 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.295 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.295 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.295 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.295 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.295 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-14T14:20:56.295 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-14T14:20:56.295 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.296 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.296 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.296 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.296 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.296 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.296 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.296 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.296 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.297 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.297 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.297 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.297 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-14T14:20:56.297 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-14T14:20:56.297 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.297 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.297 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.297 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2023-12-14T14:20:56.298 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-14T14:20:56.299 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.299 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.299 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.299 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.299 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.299 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.299 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.299 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.300 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.300 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.300 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.300 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.300 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-14T14:20:56.300 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-14T14:20:56.300 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.300 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.301 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.301 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.301 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.301 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.301 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.301 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.301 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.301 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.302 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.302 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.302 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-14T14:20:56.302 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-14T14:20:56.302 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.302 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.302 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.303 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.303 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.303 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.303 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.303 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.303 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.303 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.304 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.304 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.304 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-14T14:20:56.304 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-14T14:20:56.304 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.304 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.304 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.304 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.304 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.305 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.305 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.305 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.305 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.305 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.305 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.305 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.305 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-14T14:20:56.305 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-14T14:20:56.306 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.306 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.306 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.306 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.306 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.306 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.306 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.306 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.306 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.307 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.308 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.308 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.308 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.308 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.308 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.308 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.308 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.308 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-14T14:20:56.309 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-14T14:20:56.309 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.309 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.309 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.309 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.309 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.309 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.309 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.309 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.310 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.310 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.310 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.310 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.310 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-14T14:20:56.310 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-14T14:20:56.310 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.310 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.311 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.311 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.311 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.311 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.311 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.311 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.311 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.311 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.311 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.312 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.312 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-14T14:20:56.312 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-14T14:20:56.312 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.312 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.312 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.312 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.313 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.313 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.313 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.313 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.313 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.313 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.313 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.313 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.314 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2023-12-14T14:20:56.314 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-14T14:20:56.314 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.314 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.314 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.314 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.315 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.315 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.315 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.315 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.316 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.316 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.316 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.316 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.316 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-14T14:20:56.316 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-14T14:20:56.317 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.317 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.317 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.317 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-14T14:20:56.317 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.317 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.317 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.318 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.318 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.318 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.318 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.318 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.318 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-14T14:20:56.318 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-14T14:20:56.318 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.319 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.319 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.319 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:56.319 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.320 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.320 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.320 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.320 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.320 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.321 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.321 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.321 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-14T14:20:56.321 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-14T14:20:56.321 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.322 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.322 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.322 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2023-12-14T14:20:56.322 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.322 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.322 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.322 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.323 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.323 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.323 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.323 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.323 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-14T14:20:56.323 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-14T14:20:56.323 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.324 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.325 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.325 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2023-12-14T14:20:56.325 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-14T14:20:56.325 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.325 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.325 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.325 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.325 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.326 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.326 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.326 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.326 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.326 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.326 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.326 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.326 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-14T14:20:56.326 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-14T14:20:56.327 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.327 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.327 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.327 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T14:20:56.327 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.327 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.327 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.327 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.327 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.328 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.328 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.328 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.328 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2023-12-14T14:20:56.328 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-14T14:20:56.328 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.328 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.329 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.329 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.329 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.329 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.329 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.329 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.329 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.329 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.330 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.330 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.330 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2023-12-14T14:20:56.330 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-14T14:20:56.330 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.330 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.331 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.331 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.331 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.331 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.331 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.331 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.331 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.331 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.332 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.332 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.332 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-14T14:20:56.332 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-14T14:20:56.333 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.333 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.333 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.333 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:56.334 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.334 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.334 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.334 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.335 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.335 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.335 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.335 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.335 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-14T14:20:56.335 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.336 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.337 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.337 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.337 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-14T14:20:56.337 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-14T14:20:56.337 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.337 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.337 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.337 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:56.338 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.338 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.338 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.338 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.338 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.338 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.338 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.338 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.338 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2023-12-14T14:20:56.339 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2023-12-14T14:20:56.339 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.339 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.339 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.339 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.339 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.339 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.339 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.339 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.340 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.340 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.340 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.340 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.340 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2023-12-14T14:20:56.340 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2023-12-14T14:20:56.340 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.341 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.341 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.341 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.341 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.341 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.341 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.341 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.341 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.342 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.342 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.342 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.342 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2023-12-14T14:20:56.342 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2023-12-14T14:20:56.342 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.342 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.342 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.343 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.343 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.343 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.343 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.343 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2023-12-14T14:20:56.343 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.343 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.343 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.344 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.344 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2023-12-14T14:20:56.344 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2023-12-14T14:20:56.344 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.344 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.344 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.344 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2023-12-14T14:20:56.344 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.345 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.345 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.345 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.345 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.345 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.345 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.345 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.345 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T14:20:56.346 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T14:20:56.346 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.346 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.346 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.346 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.346 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.346 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.346 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.347 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.347 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.347 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.347 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.347 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.347 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.347 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.348 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.348 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.348 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.348 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.348 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.348 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.348 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.348 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.348 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.349 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.349 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.349 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.349 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.349 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.349 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.349 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.349 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.350 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.350 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.350 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.350 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.350 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.350 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.350 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.350 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.351 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.351 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.351 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.351 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.351 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.351 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.351 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.351 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.351 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.352 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.353 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.353 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.353 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.353 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.353 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.353 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.353 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.354 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.354 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.354 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.354 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.354 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.354 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.354 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.354 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.354 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.355 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.355 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.355 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.355 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.355 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.355 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.355 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.355 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2023-12-14T14:20:56.355 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.356 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.357 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.357 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.357 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2023-12-14T14:20:56.357 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2023-12-14T14:20:56.357 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.357 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.357 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.357 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.358 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.358 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.358 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.358 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.358 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.358 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T14:20:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T14:20:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2023-12-14T14:20:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T14:20:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T14:20:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2023-12-14T14:20:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2023-12-14T14:20:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2023-12-14T14:20:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2023-12-14T14:20:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2023-12-14T14:20:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T14:20:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T14:20:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T14:20:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T14:20:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T14:20:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2023-12-14T14:20:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2023-12-14T14:20:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2023-12-14T14:20:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2023-12-14T14:20:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2023-12-14T14:20:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.375 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.375 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.375 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.375 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.375 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.375 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.375 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.376 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.376 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.376 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.376 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.376 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.376 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.376 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.376 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.377 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.377 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.377 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.377 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.377 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.377 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.377 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.377 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.377 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.378 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.378 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.378 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.378 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.378 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.378 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.378 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.379 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.379 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.379 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.379 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.379 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.379 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.379 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.379 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.381 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.381 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.381 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.381 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.381 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.381 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.381 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.381 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.382 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.382 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.382 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.382 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2023-12-14T14:20:56.382 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2023-12-14T14:20:56.382 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.382 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.382 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.382 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2023-12-14T14:20:56.383 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.383 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.383 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.383 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-14T14:20:56.383 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.383 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.383 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.383 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.383 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2023-12-14T14:20:56.384 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2023-12-14T14:20:56.384 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.384 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.384 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.384 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2023-12-14T14:20:56.384 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.384 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.384 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.384 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.385 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2023-12-14T14:20:56.386 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.386 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.386 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.386 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2023-12-14T14:20:56.386 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.386 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.386 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.386 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.386 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2023-12-14T14:20:56.387 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2023-12-14T14:20:56.387 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.387 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.387 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.387 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T14:20:56.387 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.387 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.387 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.387 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-14T14:20:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2023-12-14T14:20:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2023-12-14T14:20:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.389 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.389 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.389 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.389 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.389 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-14T14:20:56.389 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.389 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.389 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.389 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.390 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2023-12-14T14:20:56.391 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.391 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.391 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.391 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.391 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2023-12-14T14:20:56.391 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2023-12-14T14:20:56.391 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.391 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.392 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.392 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2023-12-14T14:20:56.392 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.392 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.392 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.392 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-14T14:20:56.392 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.392 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.392 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.393 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.393 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.393 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.393 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.393 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2023-12-14T14:20:56.393 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.393 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.394 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.394 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.394 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.394 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.394 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.394 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.394 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.394 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.394 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.395 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.395 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.395 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.395 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.395 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.395 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.395 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.396 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.396 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.396 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.396 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.396 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.396 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.396 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.396 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.397 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.397 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.397 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.397 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.397 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.397 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.397 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.398 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.398 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.398 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.398 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.398 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.398 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.398 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.398 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.399 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.399 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.399 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.399 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.399 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.399 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.399 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.399 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.399 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.400 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.400 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.400 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.400 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.400 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.400 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.400 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.400 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.400 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.401 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.401 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.401 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.401 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.401 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.401 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.401 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.401 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.401 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.402 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.403 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T14:20:56.403 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.403 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.403 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.403 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.403 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.403 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.403 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.404 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.404 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2023-12-14T14:20:56.404 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2023-12-14T14:20:56.404 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.404 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.404 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.404 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2023-12-14T14:20:56.404 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.405 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.405 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.405 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.405 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.405 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.405 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.405 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.405 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:56.405 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:56.406 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.406 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.406 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.406 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T14:20:56.406 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.406 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.406 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.406 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.407 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.407 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.407 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.407 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.407 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.407 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.407 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.407 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2023-12-14T14:20:56.408 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2023-12-14T14:20:56.408 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2023-12-14T14:20:56.408 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.408 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2023-12-14T14:20:56.408 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2023-12-14T14:20:56.408 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.408 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.408 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.409 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2023-12-14T14:20:56.409 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.409 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.409 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.409 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-14T14:20:56.409 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.409 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.409 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.409 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.410 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2023-12-14T14:20:56.410 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2023-12-14T14:20:56.410 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.410 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.410 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.410 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2023-12-14T14:20:56.410 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.410 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.411 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.412 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.412 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.412 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.412 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.412 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.412 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2023-12-14T14:20:56.412 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.412 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2023-12-14T14:20:56.413 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.414 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.415 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.416 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.416 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.416 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.416 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.416 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.416 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.416 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.416 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.416 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.417 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.417 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.417 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.417 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.417 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.417 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.417 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.417 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.417 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.418 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.419 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.420 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.420 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.420 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.420 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.420 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.420 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.420 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.420 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.420 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.421 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.421 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.421 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.421 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.421 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.421 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.421 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.422 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.422 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.422 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2023-12-14T14:20:56.422 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2023-12-14T14:20:56.422 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.422 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.422 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.422 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.422 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.423 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.423 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.423 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2023-12-14T14:20:56.423 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.423 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.423 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.423 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.424 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2023-12-14T14:20:56.424 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2023-12-14T14:20:56.424 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.424 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.424 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.424 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2023-12-14T14:20:56.424 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.425 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.425 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.425 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2023-12-14T14:20:56.425 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.425 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.425 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.426 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.426 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T14:20:56.426 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T14:20:56.426 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.426 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.426 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.426 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2023-12-14T14:20:56.427 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.427 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.427 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.427 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T14:20:56.427 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.427 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.427 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.427 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.428 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2023-12-14T14:20:56.428 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2023-12-14T14:20:56.428 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.428 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.428 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.428 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:56.428 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:56.428 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2023-12-14T14:20:56.429 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.429 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-14T14:20:56.429 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.429 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.429 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.429 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.429 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2023-12-14T14:20:56.429 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2023-12-14T14:20:56.429 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.430 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.430 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.430 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.430 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.430 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.430 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2023-12-14T14:20:56.430 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.430 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.431 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.431 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.431 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2023-12-14T14:20:56.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2023-12-14T14:20:56.431 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.431 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.431 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.431 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2023-12-14T14:20:56.431 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.432 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.432 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.432 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T14:20:56.432 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.432 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.432 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.432 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.432 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.432 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.433 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.433 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2023-12-14T14:20:56.433 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.433 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.433 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.433 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.433 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.433 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.433 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.434 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.434 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.434 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.434 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.434 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.434 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.434 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.434 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.434 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.435 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.435 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.435 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.435 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.435 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.435 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.435 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.435 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.435 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.436 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.436 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.436 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.436 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.436 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.436 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.436 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.437 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.437 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.437 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.437 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.437 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.437 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.437 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.437 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.438 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.438 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.438 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.438 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.438 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.438 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.438 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.438 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.439 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.439 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.439 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.439 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.439 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.439 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.439 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.439 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.439 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.440 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.440 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.440 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.440 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.440 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.440 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.440 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.441 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.441 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.441 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.441 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.441 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.441 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.441 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.441 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.442 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.442 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.442 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.442 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.442 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2023-12-14T14:20:56.442 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.442 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.442 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.442 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.443 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.443 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.443 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.443 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.443 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.443 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.443 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.443 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.444 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.445 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.445 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.445 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.445 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.445 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.445 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.445 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.445 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.446 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.447 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.447 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.447 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.447 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.447 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.447 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.447 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.447 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.447 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.448 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.449 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.449 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.449 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.449 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.449 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.449 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.449 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.449 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.449 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2023-12-14T14:20:56.450 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.451 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.452 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.453 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.453 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:56.453 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2023-12-14T14:20:56.453 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.453 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.453 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-14T14:20:56.453 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.454 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.454 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.454 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.454 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.454 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.454 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.454 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.454 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.455 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.455 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.455 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.455 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.455 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.455 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.455 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.455 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.456 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.456 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.456 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.456 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.456 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.456 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.456 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.457 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.457 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.457 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.457 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.457 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.457 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.457 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.458 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.458 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.458 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.458 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.458 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.458 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.458 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.458 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.458 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.459 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.459 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.459 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.459 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.459 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.459 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.459 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.460 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.460 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.460 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.460 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.460 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.460 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.460 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.460 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.461 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.461 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.461 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.461 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.461 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.461 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.461 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.461 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.461 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.462 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.462 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.462 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.462 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.462 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.462 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.462 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.462 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.462 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.463 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.463 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.463 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.463 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.463 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2023-12-14T14:20:56.463 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.463 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.463 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.463 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2023-12-14T14:20:56.464 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2023-12-14T14:20:56.464 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.464 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.464 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.464 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2023-12-14T14:20:56.464 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.464 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.464 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.464 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2023-12-14T14:20:56.465 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-14T14:20:56.465 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.465 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.465 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.465 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.465 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.465 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.465 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.466 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.466 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.466 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.466 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.466 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.466 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.466 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.466 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.466 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.467 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.467 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.467 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.467 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.467 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.467 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.467 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.468 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.468 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.468 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.468 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.468 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.468 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.468 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.468 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.469 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.469 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.469 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.469 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.469 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.469 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.469 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.470 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.470 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.470 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.470 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.470 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.470 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.470 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.470 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.471 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.471 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.471 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.471 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.471 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.471 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.471 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.471 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.472 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.472 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.472 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.472 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.472 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.472 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.472 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.472 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.473 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.473 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.473 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.473 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.473 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.473 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.473 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.473 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.474 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.474 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.474 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.474 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2023-12-14T14:20:56.474 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2023-12-14T14:20:56.474 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.474 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.474 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.475 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.475 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.475 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.475 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.475 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2023-12-14T14:20:56.475 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-14T14:20:56.475 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.475 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.475 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.476 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2023-12-14T14:20:56.476 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2023-12-14T14:20:56.476 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.476 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.476 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.476 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2023-12-14T14:20:56.476 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.476 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.476 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.477 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2023-12-14T14:20:56.477 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.477 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.477 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.477 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.477 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2023-12-14T14:20:56.477 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2023-12-14T14:20:56.477 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.477 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.478 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.478 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2023-12-14T14:20:56.478 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.478 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.478 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.478 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2023-12-14T14:20:56.478 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.478 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.478 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.479 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.481 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2023-12-14T14:20:56.481 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.481 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.481 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.481 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-14T14:20:56.481 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-14T14:20:56.481 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.481 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.481 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.482 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.483 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.483 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.483 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.483 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.483 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.483 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.483 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.483 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.484 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.484 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.484 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.484 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.484 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.484 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.484 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.485 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.485 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.485 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.485 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.485 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.485 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.485 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.486 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.486 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.486 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.486 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.486 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.486 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.486 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.486 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.486 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.487 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.487 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.487 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.487 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.487 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.487 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.487 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.488 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.489 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.489 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.489 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.489 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.489 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.489 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.490 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.490 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.490 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.490 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.490 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.490 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.490 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.490 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2023-12-14T14:20:56.491 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.492 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.493 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.493 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.493 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.493 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.493 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.493 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.493 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.493 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.493 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.494 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.495 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.496 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.497 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.497 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.497 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.497 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.497 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.497 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.497 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.497 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.497 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.498 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.498 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.498 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.498 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.498 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.498 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.498 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.498 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.499 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.499 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.499 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.499 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.499 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.499 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.499 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.499 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.499 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.500 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2023-12-14T14:20:56.500 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.500 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.500 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.500 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.500 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.500 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.500 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.500 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.501 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.501 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.501 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.501 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.501 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.501 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.501 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.501 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.502 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.502 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.502 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.502 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.502 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.502 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.502 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.502 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.502 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.503 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.503 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.503 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.503 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.503 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.503 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.503 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.504 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.505 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.505 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.505 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.505 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.505 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.505 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.505 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.506 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.506 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.506 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.506 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.506 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.506 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.506 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.506 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.506 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.507 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.507 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.507 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.507 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.507 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.507 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.507 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.507 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.508 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.508 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.508 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.508 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.508 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.508 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.508 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.508 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.508 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.509 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.509 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T14:20:56.509 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.509 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.509 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.509 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2023-12-14T14:20:56.509 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2023-12-14T14:20:56.509 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.509 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.510 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.511 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.512 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.513 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.513 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.513 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.513 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.513 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.513 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.513 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.513 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.513 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.514 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.515 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.516 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.516 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.516 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.516 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.516 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.516 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.516 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.516 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.516 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.517 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.517 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.517 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.517 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.517 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.517 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.517 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.518 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.518 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.518 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.518 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.518 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.518 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2023-12-14T14:20:56.518 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T14:20:56.519 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.519 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.519 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.519 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.519 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.519 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.519 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.519 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-12-14T14:20:56.520 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2023-12-14T14:20:56.520 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2023-12-14T14:20:56.520 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.520 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2023-12-14T14:20:56.520 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.520 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.520 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.520 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.521 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.521 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.521 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.521 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2023-12-14T14:20:56.521 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.521 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.521 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.521 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.522 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.522 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.522 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.522 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.522 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.522 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.522 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.523 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.523 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.523 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.523 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.523 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.523 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.523 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.523 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.524 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.524 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.524 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.524 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.524 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.524 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.524 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.524 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.524 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.525 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.525 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.525 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.525 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.525 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.525 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.525 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.525 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.525 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.526 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.527 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.528 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.528 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.528 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.528 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.528 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.528 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.528 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.528 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.528 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.530 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.530 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2023-12-14T14:20:56.530 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.530 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.530 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.530 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.530 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.530 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.531 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.531 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.531 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.531 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.531 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.531 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.531 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.531 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.532 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.532 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.532 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.532 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.532 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.532 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.532 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.532 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.533 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.533 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.533 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.533 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.533 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.533 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.533 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.534 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.534 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.534 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.534 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.534 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.534 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.534 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.534 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.534 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.535 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.535 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.535 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.535 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.535 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.535 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.535 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.536 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.536 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.536 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.536 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.536 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.536 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.536 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.536 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.537 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.537 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.537 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.537 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.537 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.537 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.537 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.537 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.538 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.538 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.538 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.538 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.538 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.538 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.538 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.538 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.538 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.539 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.540 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.541 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.541 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.541 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.541 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.541 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.541 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.541 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.541 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.541 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.542 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.543 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.544 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.545 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.545 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.545 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.545 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.545 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.545 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.545 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.545 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.545 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.546 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.546 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.546 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.546 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.546 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.546 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.546 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.547 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.547 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.547 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.547 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.547 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.547 INFO:teuthology.orchestra.run.smithi069.stdout: "noautoscale": { 2023-12-14T14:20:56.547 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "noautoscale", 2023-12-14T14:20:56.547 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.547 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.548 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.548 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.548 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.548 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.548 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.548 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "global autoscale flag", 2023-12-14T14:20:56.548 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-12-14T14:20:56.549 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.549 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.549 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.549 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:56.549 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:56.549 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.549 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.549 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.549 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:56.550 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.550 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.550 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.550 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.550 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.550 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.550 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.551 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2023-12-14T14:20:56.551 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2023-12-14T14:20:56.551 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:56.551 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.551 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.551 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T14:20:56.551 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2023-12-14T14:20:56.551 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.552 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.552 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2023-12-14T14:20:56.552 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-14T14:20:56.552 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.552 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.552 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.552 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.553 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.553 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2023-12-14T14:20:56.553 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.553 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.553 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.553 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2023-12-14T14:20:56.553 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2023-12-14T14:20:56.554 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.554 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.554 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.554 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.554 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.554 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.554 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.554 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-14T14:20:56.555 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.555 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.555 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.555 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T14:20:56.555 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T14:20:56.555 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.555 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.555 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.556 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.557 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.557 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.557 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.557 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.557 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.557 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.557 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.557 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.557 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.558 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.559 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.560 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.561 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.561 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.561 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.561 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.561 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.561 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.561 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.561 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.561 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.562 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.562 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.562 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.562 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.562 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.562 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.562 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.562 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.563 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.563 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.563 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.563 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.563 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.563 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.563 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.563 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.564 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2023-12-14T14:20:56.565 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.565 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.565 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.565 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2023-12-14T14:20:56.565 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.565 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.565 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.566 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T14:20:56.566 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T14:20:56.566 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.566 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.566 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.566 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T14:20:56.566 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.567 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.567 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.567 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2023-12-14T14:20:56.567 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.567 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.567 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.567 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.567 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.568 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.568 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2023-12-14T14:20:56.568 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.568 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.568 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.568 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2023-12-14T14:20:56.568 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2023-12-14T14:20:56.568 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.569 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.569 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.569 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.569 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.569 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.569 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.569 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.569 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.570 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.570 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.570 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.570 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2023-12-14T14:20:56.570 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2023-12-14T14:20:56.570 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.570 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.570 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.570 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.571 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.572 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.572 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.572 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.572 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.572 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.572 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.572 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.572 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.573 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.573 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.573 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.573 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.573 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.573 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.573 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.573 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.573 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.574 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.575 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.575 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.575 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.575 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.575 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.575 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.575 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.575 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.576 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.577 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.577 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.577 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.577 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.577 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.577 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.577 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.577 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.577 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.578 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.578 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.578 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.578 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.578 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.578 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.578 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.578 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.579 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.579 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.579 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.579 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.579 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2023-12-14T14:20:56.579 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2023-12-14T14:20:56.580 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.580 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.580 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.580 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.580 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.580 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.580 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.580 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.580 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.581 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.581 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.581 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.581 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-14T14:20:56.581 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-14T14:20:56.581 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.582 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.582 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.582 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2023-12-14T14:20:56.582 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.582 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.582 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.582 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.582 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.582 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.583 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.583 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.583 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2023-12-14T14:20:56.583 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2023-12-14T14:20:56.583 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:56.583 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.584 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.584 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2023-12-14T14:20:56.584 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.584 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.584 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.584 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.584 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.584 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.584 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.585 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T14:20:56.585 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T14:20:56.585 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.585 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.585 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.586 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T14:20:56.586 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.586 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.586 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.586 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-14T14:20:56.586 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.586 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.586 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.587 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.588 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-14T14:20:56.588 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.588 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.588 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.588 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.588 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2023-12-14T14:20:56.588 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2023-12-14T14:20:56.588 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.588 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.589 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.589 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2023-12-14T14:20:56.589 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.589 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.589 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.589 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.589 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.589 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.589 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.590 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.591 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2023-12-14T14:20:56.591 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2023-12-14T14:20:56.591 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.591 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.591 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.591 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.591 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.591 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.592 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T14:20:56.592 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T14:20:56.592 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.592 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.592 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.592 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T14:20:56.592 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T14:20:56.592 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T14:20:56.592 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.593 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.593 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.593 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.593 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.593 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.593 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.593 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.593 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.593 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-12-14T14:20:56.594 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.594 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.594 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.594 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.594 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.594 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.594 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.594 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.595 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.595 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.595 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.595 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.595 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.595 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.595 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.595 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.595 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.596 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.596 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.596 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.596 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.596 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.596 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.596 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.596 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.597 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.597 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.597 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.597 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.597 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.597 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.597 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.597 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.598 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.599 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.599 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.599 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.599 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.599 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.599 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.599 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.600 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.601 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T14:20:56.602 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2023-12-14T14:20:56.603 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.604 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.604 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.604 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.604 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.604 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.604 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.604 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.604 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.604 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.605 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.606 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.607 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.608 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.608 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.608 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.608 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.608 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.608 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.608 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.608 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T14:20:56.609 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T14:20:56.609 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.609 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.609 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.609 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.609 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.609 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.610 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.610 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.610 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.610 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.610 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.610 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.610 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.610 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.611 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.611 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.611 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.611 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.611 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.611 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.611 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.611 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.612 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.612 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.612 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.612 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.612 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.612 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.612 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.612 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.613 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.613 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.613 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.613 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.613 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.613 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.613 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.613 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.614 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.614 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.614 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.614 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.614 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.614 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.614 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.614 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.615 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.615 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.615 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.615 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.615 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.615 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.615 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.616 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.616 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.616 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.616 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.616 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.616 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.616 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.616 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.616 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.617 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.617 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.617 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.617 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.617 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.617 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.617 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.617 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.618 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.619 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.619 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.619 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T14:20:56.619 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T14:20:56.619 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.619 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.619 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.619 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.619 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.620 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.620 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.620 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.620 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.620 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.620 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.620 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.620 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T14:20:56.620 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T14:20:56.621 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.621 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.621 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.621 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.621 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.621 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.621 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.621 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.621 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.622 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.622 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.622 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.622 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.622 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.622 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.622 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.623 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.624 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.624 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.624 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.624 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.624 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.624 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.624 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.625 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.625 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.625 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.625 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.625 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.625 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.625 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.625 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.626 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.626 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.626 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.626 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.626 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.626 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.626 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.626 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.626 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.627 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.627 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.627 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.627 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.627 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.627 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.627 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.627 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.628 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.628 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.628 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.628 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.628 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.628 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.628 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.628 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.629 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.629 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.629 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.629 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.629 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.629 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.629 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.629 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.630 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.631 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.631 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.631 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.631 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.631 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.631 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.631 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.631 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.631 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "drive_group_interval": { 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "drive_group_interval", 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300.0", 2023-12-14T14:20:56.632 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.633 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.633 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.633 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-14T14:20:56.633 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.633 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.633 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.633 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.633 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.633 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.634 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.635 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.635 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.635 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.635 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.635 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.635 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.635 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.635 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.635 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.636 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.637 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.637 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.637 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.637 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.637 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.637 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.637 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.637 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.638 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.638 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.638 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.638 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.638 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.638 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.638 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.638 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.638 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.639 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.639 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.639 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.639 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.639 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.639 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.639 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.639 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.639 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.640 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.641 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.641 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.641 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.641 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2023-12-14T14:20:56.641 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2023-12-14T14:20:56.641 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.641 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.641 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.641 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.642 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.643 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.643 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2023-12-14T14:20:56.643 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.643 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.643 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.643 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.643 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.643 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.644 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.644 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.644 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.644 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.644 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.644 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.644 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.645 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.645 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.645 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.645 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.645 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.645 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.645 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.645 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.646 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.646 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.646 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.646 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.646 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.646 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.646 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.646 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.647 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.647 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.647 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.647 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.647 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.647 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.648 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.648 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.648 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.648 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.648 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.648 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.648 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.648 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.649 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.649 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.649 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.649 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.649 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.649 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.649 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.649 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.649 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.650 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.650 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.650 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.650 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.650 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.650 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.650 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.650 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.650 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.651 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.652 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.653 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.653 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.653 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.653 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.653 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.653 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.653 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2023-12-14T14:20:56.653 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2023-12-14T14:20:56.654 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.654 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.654 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.654 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2023-12-14T14:20:56.654 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.654 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.654 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.655 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.655 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.655 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.655 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.655 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.655 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2023-12-14T14:20:56.655 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2023-12-14T14:20:56.655 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.655 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.656 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.656 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.656 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.656 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.656 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.656 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.656 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.656 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.657 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.657 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.657 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2023-12-14T14:20:56.657 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2023-12-14T14:20:56.657 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.657 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.657 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.658 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.658 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.658 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.658 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.658 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.658 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.658 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.658 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.659 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.659 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2023-12-14T14:20:56.659 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2023-12-14T14:20:56.659 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T14:20:56.659 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.659 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.659 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.659 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.659 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.660 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.660 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.660 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.660 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.660 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.660 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.660 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2023-12-14T14:20:56.660 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.661 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.662 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.662 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.662 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2023-12-14T14:20:56.662 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2023-12-14T14:20:56.662 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.662 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.662 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.662 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.663 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.663 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.663 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.663 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.663 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.663 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.663 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.663 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.663 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2023-12-14T14:20:56.664 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2023-12-14T14:20:56.664 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.664 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.664 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.664 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.664 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.664 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.664 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.664 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.665 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.666 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T14:20:56.666 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2023-12-14T14:20:56.666 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.666 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.666 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.666 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.666 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.666 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.666 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.667 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.668 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.668 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.668 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.668 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2023-12-14T14:20:56.668 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2023-12-14T14:20:56.668 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.668 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.668 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.668 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.669 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.669 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.669 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.669 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.669 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.669 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.669 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.669 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.669 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2023-12-14T14:20:56.670 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2023-12-14T14:20:56.670 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.670 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.670 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.670 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.670 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.670 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.670 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.670 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.671 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.671 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.671 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.671 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.671 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.671 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.672 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.672 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-12-14T14:20:56.672 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.672 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.672 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.672 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2023-12-14T14:20:56.672 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2023-12-14T14:20:56.672 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.672 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.673 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.673 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.673 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.673 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.673 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.673 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2023-12-14T14:20:56.673 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.674 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.674 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.674 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.674 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2023-12-14T14:20:56.674 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2023-12-14T14:20:56.674 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.674 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.674 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.674 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.675 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.675 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.675 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.675 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2023-12-14T14:20:56.675 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.675 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.675 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.676 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.676 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.676 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.676 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.676 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.676 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.676 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.676 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.677 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.677 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.677 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.677 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.677 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.677 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.677 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.678 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.678 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.678 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.678 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.678 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.678 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.678 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.678 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.679 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.679 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.679 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.679 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.679 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.679 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.679 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.679 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.679 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.680 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.681 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.682 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.682 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.682 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.682 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.682 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.682 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.682 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.682 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.682 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.683 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.683 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.683 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.683 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.683 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.683 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.683 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.684 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.684 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.684 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.684 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.684 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.684 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2023-12-14T14:20:56.684 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.685 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.686 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.686 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.686 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.686 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.686 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.686 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.686 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.687 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.687 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.687 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.687 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.687 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.687 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.687 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.687 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.688 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.688 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.688 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.688 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.688 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.688 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.688 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.688 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.688 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.689 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.689 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.689 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.689 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.689 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.689 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.690 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.691 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.691 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.691 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.691 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.691 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.691 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.691 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.691 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.691 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.692 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.692 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.692 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.692 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.692 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.692 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.692 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.692 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.692 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.693 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.693 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.693 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.693 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.693 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.693 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2023-12-14T14:20:56.693 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.693 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.694 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.695 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.696 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.696 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.696 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.696 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.696 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.696 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.696 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.696 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.697 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.699 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.700 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.700 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.700 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.700 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.700 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.700 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.700 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.701 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.701 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.701 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.701 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.701 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.701 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.701 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.701 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2023-12-14T14:20:56.702 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.702 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.702 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.702 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2023-12-14T14:20:56.702 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2023-12-14T14:20:56.702 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.702 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.702 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.703 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-14T14:20:56.703 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.703 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.703 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.703 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.703 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.703 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.703 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.704 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.704 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:56.704 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:56.704 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.704 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.704 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.704 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2023-12-14T14:20:56.704 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.704 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.705 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.706 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.706 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.706 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.706 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.706 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.706 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.706 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.706 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.706 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.707 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.707 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.707 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.707 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.707 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.707 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.707 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.707 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.707 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.708 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.708 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.708 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.708 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.708 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.708 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.709 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.709 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.709 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.709 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.709 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.709 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.709 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.709 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.710 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.710 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.710 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.710 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.710 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.710 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.710 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.710 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.711 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.711 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.711 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.711 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.711 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.711 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.711 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.711 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.712 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.713 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.713 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.713 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.713 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.713 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.713 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.713 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.713 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.713 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.714 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.714 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2023-12-14T14:20:56.714 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.714 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.714 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.714 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2023-12-14T14:20:56.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2023-12-14T14:20:56.714 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.715 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.716 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.716 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2023-12-14T14:20:56.716 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2023-12-14T14:20:56.716 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.716 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.716 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.717 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.717 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.717 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.717 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.717 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-14T14:20:56.717 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.717 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.717 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.718 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.718 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2023-12-14T14:20:56.718 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2023-12-14T14:20:56.718 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.718 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.718 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.718 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T14:20:56.719 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.719 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.719 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.719 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-14T14:20:56.719 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.719 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.719 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.719 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.719 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2023-12-14T14:20:56.720 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2023-12-14T14:20:56.720 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.720 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.720 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.720 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.720 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.720 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.720 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.721 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-14T14:20:56.721 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.721 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.721 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.721 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.721 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2023-12-14T14:20:56.721 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.722 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.723 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.723 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.723 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2023-12-14T14:20:56.723 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2023-12-14T14:20:56.723 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.723 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.723 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.724 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.724 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.724 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.724 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.724 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.724 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.724 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.724 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.724 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.725 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2023-12-14T14:20:56.725 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2023-12-14T14:20:56.725 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.725 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.725 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.725 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.725 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.725 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.726 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.726 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.726 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.726 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.726 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.726 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.726 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2023-12-14T14:20:56.726 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2023-12-14T14:20:56.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-14T14:20:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.728 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.728 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.728 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T14:20:56.728 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T14:20:56.728 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.728 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.728 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.728 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:56.729 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:56.730 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.730 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.730 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.730 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2023-12-14T14:20:56.730 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2023-12-14T14:20:56.730 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.730 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.730 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.730 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2023-12-14T14:20:56.731 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.732 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.732 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.732 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.732 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.732 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.732 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.732 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.732 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2023-12-14T14:20:56.732 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2023-12-14T14:20:56.733 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.733 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.733 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.733 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.733 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.733 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.733 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.733 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.733 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.734 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.734 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.734 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.734 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2023-12-14T14:20:56.734 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2023-12-14T14:20:56.734 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.734 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.735 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.735 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.735 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.735 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.735 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.735 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.735 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.735 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.736 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.736 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.736 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.736 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.736 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.736 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.737 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.737 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.737 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.737 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.737 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.737 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.737 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.737 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.738 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.738 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.738 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.738 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.738 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.738 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.738 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.739 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.739 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.739 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.739 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.739 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.739 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.739 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.740 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.740 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.740 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.740 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.740 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.740 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.740 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.740 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.741 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.741 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.741 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.741 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.741 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.741 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.741 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.741 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.742 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.743 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.743 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.743 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.743 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.743 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.743 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.743 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.743 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.743 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.744 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2023-12-14T14:20:56.745 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2023-12-14T14:20:56.745 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.745 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.745 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.745 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.745 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.745 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.745 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.746 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.746 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.746 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.746 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.746 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.746 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2023-12-14T14:20:56.746 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2023-12-14T14:20:56.746 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.746 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2023-12-14T14:20:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2023-12-14T14:20:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-14T14:20:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.750 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.750 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.750 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2023-12-14T14:20:56.750 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.750 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.750 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.750 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.750 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.751 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.751 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.751 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.751 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.751 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.751 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.751 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.752 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.752 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.752 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.752 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.752 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.752 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.752 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.752 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.752 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.753 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.753 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.753 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.753 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.753 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.753 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.753 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.754 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.754 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.754 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.754 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.754 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.754 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.754 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.754 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.754 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.755 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.756 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.756 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.756 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.756 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.756 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.756 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.756 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.756 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.756 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.757 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.757 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.757 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.757 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.757 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.757 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.757 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.757 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.757 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.758 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.759 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.760 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.762 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.763 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.763 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.763 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.763 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.763 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.763 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.763 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.763 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.764 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.764 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.764 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.764 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.764 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.764 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.764 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.764 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.765 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.765 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.765 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.765 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.765 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.765 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.765 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.765 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.766 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.766 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.766 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.766 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.766 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.766 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.766 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.766 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.767 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.767 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.767 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.767 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2023-12-14T14:20:56.767 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2023-12-14T14:20:56.767 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.767 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.767 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2023-12-14T14:20:56.768 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.768 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.768 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.768 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-14T14:20:56.768 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.768 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.768 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.769 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.769 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2023-12-14T14:20:56.769 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2023-12-14T14:20:56.769 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.769 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.769 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.769 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T14:20:56.770 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.770 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.770 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.770 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-14T14:20:56.770 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.770 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.770 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.770 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.771 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.771 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.771 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.771 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2023-12-14T14:20:56.771 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T14:20:56.771 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T14:20:56.771 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T14:20:56.771 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2023-12-14T14:20:56.771 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.772 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.773 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.773 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.773 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2023-12-14T14:20:56.773 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2023-12-14T14:20:56.773 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.773 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.773 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.773 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.774 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.774 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.774 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.774 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.774 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.774 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.774 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.774 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.774 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T14:20:56.775 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T14:20:56.775 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T14:20:56.775 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.775 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.775 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T14:20:56.775 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.775 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.775 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.775 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.776 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.777 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.777 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.777 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.777 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.777 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.777 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.777 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.777 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.777 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.778 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.778 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.778 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.778 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.778 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.778 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.778 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T14:20:56.778 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T14:20:56.779 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.779 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.779 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.779 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.779 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.779 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.779 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.779 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.780 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.780 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.780 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.780 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.780 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T14:20:56.780 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T14:20:56.780 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.780 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.780 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.781 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T14:20:56.781 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.781 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.781 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T14:20:56.781 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T14:20:56.781 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T14:20:56.781 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T14:20:56.781 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T14:20:56.782 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T14:20:56.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T14:20:56.783 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.783 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T14:20:56.783 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T14:20:56.783 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.783 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.783 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.784 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.784 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.784 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.784 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.784 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.784 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2023-12-14T14:20:56.784 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2023-12-14T14:20:56.784 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.784 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.785 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.785 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T14:20:56.785 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.785 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.785 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.785 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.785 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.785 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.786 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.786 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.786 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2023-12-14T14:20:56.786 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2023-12-14T14:20:56.786 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T14:20:56.786 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.786 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.786 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2023-12-14T14:20:56.787 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2023-12-14T14:20:56.788 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T14:20:56.788 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T14:20:56.788 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T14:20:56.788 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-14T14:20:56.788 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T14:20:56.788 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T14:20:56.788 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T14:20:56.788 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T14:20:56.788 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T14:20:56.789 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T14:20:56.789 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T14:20:56.789 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.789 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.789 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.789 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.789 INFO:teuthology.orchestra.run.smithi069.stdout: "services": { 2023-12-14T14:20:56.789 INFO:teuthology.orchestra.run.smithi069.stdout: "dashboard": "https://172.21.15.69:8443/" 2023-12-14T14:20:56.789 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.790 INFO:teuthology.orchestra.run.smithi069.stdout: "always_on_modules": { 2023-12-14T14:20:56.790 INFO:teuthology.orchestra.run.smithi069.stdout: "octopus": [ 2023-12-14T14:20:56.790 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-12-14T14:20:56.790 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-12-14T14:20:56.790 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-12-14T14:20:56.790 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-12-14T14:20:56.790 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-12-14T14:20:56.790 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-12-14T14:20:56.790 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: "pacific": [ 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-12-14T14:20:56.791 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-12-14T14:20:56.792 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-12-14T14:20:56.792 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-12-14T14:20:56.792 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-12-14T14:20:56.792 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-12-14T14:20:56.792 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-12-14T14:20:56.792 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.792 INFO:teuthology.orchestra.run.smithi069.stdout: "quincy": [ 2023-12-14T14:20:56.792 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-12-14T14:20:56.793 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-12-14T14:20:56.793 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-12-14T14:20:56.793 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-12-14T14:20:56.793 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-12-14T14:20:56.793 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-12-14T14:20:56.793 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-12-14T14:20:56.793 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-12-14T14:20:56.793 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: "reef": [ 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-12-14T14:20:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-12-14T14:20:56.795 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-12-14T14:20:56.795 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-12-14T14:20:56.795 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-12-14T14:20:56.795 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:56.795 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.795 INFO:teuthology.orchestra.run.smithi069.stdout: "last_failure_osd_epoch": 85, 2023-12-14T14:20:56.795 INFO:teuthology.orchestra.run.smithi069.stdout: "active_clients": [ 2023-12-14T14:20:56.795 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.795 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-12-14T14:20:56.796 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T14:20:56.796 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.796 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T14:20:56.796 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T14:20:56.796 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3869134997 2023-12-14T14:20:56.796 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.796 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:56.797 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.797 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.797 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "libcephsqlite", 2023-12-14T14:20:56.797 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T14:20:56.797 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.797 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T14:20:56.797 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T14:20:56.797 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 4487401 2023-12-14T14:20:56.798 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.798 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:56.798 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.798 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.798 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-12-14T14:20:56.798 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 1505504549 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-12-14T14:20:56.799 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T14:20:56.800 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.800 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T14:20:56.800 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T14:20:56.800 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 1874080554 2023-12-14T14:20:56.800 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.800 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:56.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.801 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.801 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-12-14T14:20:56.801 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T14:20:56.801 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.801 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T14:20:56.801 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T14:20:56.801 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 827598999 2023-12-14T14:20:56.801 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.801 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:56.802 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:56.802 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.802 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-12-14T14:20:56.802 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T14:20:56.802 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T14:20:56.802 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T14:20:56.802 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T14:20:56.802 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 1673358815 2023-12-14T14:20:56.803 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.803 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:56.803 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:56.803 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T14:20:56.803 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:20:56.805 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:54 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/749945906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:20:56.805 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:54 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/149157715' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:20:56.805 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:54 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/18165879' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:20:56.805 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:55 smithi119 ceph-mon[43834]: pgmap v319: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-14T14:20:56.805 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:55 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/644455446' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-14T14:20:56.805 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:55 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:20:56.806 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:54 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/749945906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:20:56.806 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:54 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/149157715' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:20:56.806 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:54 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/18165879' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:20:56.806 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:55 smithi081 ceph-mon[43371]: pgmap v319: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-14T14:20:56.806 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:55 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/644455446' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-14T14:20:56.806 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:55 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:20:56.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.701+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd0040a12c0 msgr2=0x7fd0040a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:56.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.701+0000 7fd020ab8700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd0040a12c0 0x7fd0040a3770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd010005950 tx=0x7fd0100058e0 comp rx=0 tx=0).stop 2023-12-14T14:20:56.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.701+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 msgr2=0x7fd01c196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:20:56.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.701+0000 7fd020ab8700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 0x7fd01c196900 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0095c0 tx=0x7fd00c00f710 comp rx=0 tx=0).stop 2023-12-14T14:20:56.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.702+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 shutdown_connections 2023-12-14T14:20:56.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.702+0000 7fd020ab8700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fd0040a12c0 0x7fd0040a3770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:56.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.702+0000 7fd020ab8700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd01c109b20 0x7fd01c19ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:56.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.702+0000 7fd020ab8700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd01c100570 0x7fd01c1963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:56.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.702+0000 7fd020ab8700 1 --2- 172.21.15.69:0/644455446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd01c100e80 0x7fd01c196900 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:20:56.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.702+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 >> 172.21.15.69:0/644455446 conn(0x7fd01c074a50 msgr2=0x7fd01c0fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:20:56.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.702+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 shutdown_connections 2023-12-14T14:20:56.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:20:54.702+0000 7fd020ab8700 1 -- 172.21.15.69:0/644455446 wait complete. 2023-12-14T14:20:56.816 DEBUG:tasks.check_counter:Getting stats from a 2023-12-14T14:20:56.816 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.a perf dump 2023-12-14T14:20:56.817 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:55 smithi069 ceph-mon[42034]: pgmap v319: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-14T14:20:56.817 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:55 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/644455446' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-14T14:20:56.817 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:55 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T14:20:57.173 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:20:57.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: pgmap v320: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:57.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:57.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:57.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:57 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: pgmap v320: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:58.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:58.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:58.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:58.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:58.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:57 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: pgmap v320: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:58.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:58.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:58.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:58.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:58.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.087 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:57 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:20:58.803 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:58 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi081 to 182.5M 2023-12-14T14:20:58.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:58 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi119 to 182.4M 2023-12-14T14:20:58.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:58 smithi069 ceph-mon[42034]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2023-12-14T14:20:58.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:58 smithi069 ceph-mon[42034]: Unable to set osd_memory_target on smithi119 to 191357644: error parsing value: Value '191357644' is below minimum 939524096 2023-12-14T14:20:58.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:58 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi081 to 182.5M 2023-12-14T14:20:58.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:58 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi119 to 182.4M 2023-12-14T14:20:58.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:58 smithi081 ceph-mon[43371]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2023-12-14T14:20:58.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:58 smithi081 ceph-mon[43371]: Unable to set osd_memory_target on smithi119 to 191357644: error parsing value: Value '191357644' is below minimum 939524096 2023-12-14T14:20:59.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:58 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi081 to 182.5M 2023-12-14T14:20:59.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:58 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi119 to 182.4M 2023-12-14T14:20:59.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:58 smithi119 ceph-mon[43834]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2023-12-14T14:20:59.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:58 smithi119 ceph-mon[43834]: Unable to set osd_memory_target on smithi119 to 191357644: error parsing value: Value '191357644' is below minimum 939524096 2023-12-14T14:20:59.099 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:20:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:20:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 0, 2023-12-14T14:20:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 2, 2023-12-14T14:20:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 0, 2023-12-14T14:20:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 0, 2023-12-14T14:20:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2023-12-14T14:20:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2023-12-14T14:20:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.001370213, 2023-12-14T14:20:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000000000, 2023-12-14T14:20:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000347992, 2023-12-14T14:20:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:20:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:20:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:20:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:20:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:20:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:20:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:20:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:20:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:20:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T14:20:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T14:20:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:20:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 6, 2023-12-14T14:20:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 149, 2023-12-14T14:20:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 3312, 2023-12-14T14:20:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 178048, 2023-12-14T14:20:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 5, 2023-12-14T14:20:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2023-12-14T14:20:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.012250945, 2023-12-14T14:20:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.007950095, 2023-12-14T14:20:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.002185073, 2023-12-14T14:20:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:20:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:20:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 147, 2023-12-14T14:20:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.012590441, 2023-12-14T14:20:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000085649 2023-12-14T14:20:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:20:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:20:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:20:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:20:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-12-14T14:20:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 178048 2023-12-14T14:20:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:20:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 201, 2023-12-14T14:20:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 192, 2023-12-14T14:20:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1279888, 2023-12-14T14:20:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 109344, 2023-12-14T14:20:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2023-12-14T14:20:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2023-12-14T14:20:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.033694425, 2023-12-14T14:20:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.011580134, 2023-12-14T14:20:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.024359018, 2023-12-14T14:20:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.003722505, 2023-12-14T14:20:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:20:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 191, 2023-12-14T14:20:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.008570505, 2023-12-14T14:20:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000044871 2023-12-14T14:20:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:20:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:20:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:20:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:20:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1279888, 2023-12-14T14:20:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 109344 2023-12-14T14:20:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2023-12-14T14:20:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2023-12-14T14:20:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2023-12-14T14:20:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2023-12-14T14:20:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:20:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2023-12-14T14:20:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:20:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:20:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:20:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:20:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:20:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:20:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:20:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:20:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:20:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:20:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:20:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:20:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:20:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2023-12-14T14:20:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:20:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2023-12-14T14:20:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:20:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:20:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:20:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:20:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:20:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:20:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:20:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2023-12-14T14:20:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:20:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:20:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:20:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2023-12-14T14:20:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2023-12-14T14:20:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2023-12-14T14:20:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:20:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:20:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:20:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:20:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 148977, 2023-12-14T14:20:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 30, 2023-12-14T14:20:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:20:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2023-12-14T14:20:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2023-12-14T14:20:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2023-12-14T14:20:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:20:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2023-12-14T14:20:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:20:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2023-12-14T14:20:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2023-12-14T14:20:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2023-12-14T14:20:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:20:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:20:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2023-12-14T14:20:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2023-12-14T14:20:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2023-12-14T14:20:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2023-12-14T14:20:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2023-12-14T14:20:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2023-12-14T14:20:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2023-12-14T14:20:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2023-12-14T14:20:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:20:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:20:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-12-14T14:20:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-12-14T14:20:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-12-14T14:20:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 203, 2023-12-14T14:20:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 1251527, 2023-12-14T14:20:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-12-14T14:20:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 203, 2023-12-14T14:20:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-12-14T14:20:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-12-14T14:20:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 203, 2023-12-14T14:20:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 1251527, 2023-12-14T14:20:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-12-14T14:20:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:20:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:20:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:20:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:20:59.121 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:20:59.484 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-12-14T14:20:59.485 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-12-14T14:20:59.485 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2023-12-14T14:20:59.485 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2023-12-14T14:20:59.485 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2023-12-14T14:20:59.485 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2023-12-14T14:20:59.485 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2023-12-14T14:20:59.485 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2023-12-14T14:20:59.485 DEBUG:tasks.check_counter:Getting stats from d 2023-12-14T14:20:59.486 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.d perf dump 2023-12-14T14:20:59.823 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:20:59.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:59 smithi069 ceph-mon[42034]: pgmap v321: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:59.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:59 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:59.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:20:59 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:59 smithi081 ceph-mon[43371]: pgmap v321: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:20:59.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:59 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:20:59.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:20:59 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:21:00.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:59 smithi119 ceph-mon[43834]: pgmap v321: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:21:00.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:59 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:21:00.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:20:59 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:21:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:00 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:00 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:00 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:00.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:00 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:00.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:00 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:21:00.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:00 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:21:00.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:00 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:21:00.915 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:21:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 0, 2023-12-14T14:21:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 2, 2023-12-14T14:21:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 0, 2023-12-14T14:21:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 0, 2023-12-14T14:21:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2023-12-14T14:21:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2023-12-14T14:21:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.001408122, 2023-12-14T14:21:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000000000, 2023-12-14T14:21:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000315015, 2023-12-14T14:21:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 206, 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 197, 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1281872, 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 112048, 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2023-12-14T14:21:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2023-12-14T14:21:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.036084408, 2023-12-14T14:21:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.012231231, 2023-12-14T14:21:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.026685813, 2023-12-14T14:21:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.003874448, 2023-12-14T14:21:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 196, 2023-12-14T14:21:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.011041903, 2023-12-14T14:21:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000056336 2023-12-14T14:21:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1281872, 2023-12-14T14:21:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 112048 2023-12-14T14:21:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 6, 2023-12-14T14:21:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 152, 2023-12-14T14:21:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 3312, 2023-12-14T14:21:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 178576, 2023-12-14T14:21:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 5, 2023-12-14T14:21:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2023-12-14T14:21:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.013033423, 2023-12-14T14:21:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.008449307, 2023-12-14T14:21:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.002443318, 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 150, 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.009550676, 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000063671 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-12-14T14:21:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 178576 2023-12-14T14:21:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2023-12-14T14:21:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2023-12-14T14:21:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2023-12-14T14:21:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2023-12-14T14:21:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2023-12-14T14:21:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 148994, 2023-12-14T14:21:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 31, 2023-12-14T14:21:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2023-12-14T14:21:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2023-12-14T14:21:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2023-12-14T14:21:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2023-12-14T14:21:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2023-12-14T14:21:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2023-12-14T14:21:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-12-14T14:21:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 208, 2023-12-14T14:21:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 1252814, 2023-12-14T14:21:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 208, 2023-12-14T14:21:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-12-14T14:21:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-12-14T14:21:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 208, 2023-12-14T14:21:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 1252814, 2023-12-14T14:21:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-12-14T14:21:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:21:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:21:00.932 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:21:00.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:00 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:00.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:00 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:00.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:00 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:00.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:00 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:00.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:00 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:21:00.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:00 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:21:00.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:00 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:21:01.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:00 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:00 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:00 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:00 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T14:21:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:00 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T14:21:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:00 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T14:21:01.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:00 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' 2023-12-14T14:21:01.286 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-12-14T14:21:01.286 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-12-14T14:21:01.286 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-12-14T14:21:01.287 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-12-14T14:21:01.287 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-12-14T14:21:01.287 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-12-14T14:21:01.287 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-12-14T14:21:01.287 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2023-12-14T14:21:01.287 DEBUG:tasks.check_counter:Getting stats from g 2023-12-14T14:21:01.287 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.g perf dump 2023-12-14T14:21:01.599 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:21:01.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:01 smithi081 ceph-mon[43371]: Adjusting osd_memory_target on smithi069 to 182.4M 2023-12-14T14:21:01.902 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:01 smithi081 ceph-mon[43371]: Unable to set osd_memory_target on smithi069 to 191311769: error parsing value: Value '191311769' is below minimum 939524096 2023-12-14T14:21:01.902 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:01 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:21:01.902 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:01 smithi081 ceph-mon[43371]: Service mds.all has no related daemon already placed. 2023-12-14T14:21:01.903 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:01 smithi081 ceph-mon[43371]: Service mgr has no related daemon already placed. 2023-12-14T14:21:01.903 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:01 smithi081 ceph-mon[43371]: Service mon has no related daemon already placed. 2023-12-14T14:21:01.903 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:01 smithi081 ceph-mon[43371]: pgmap v322: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:21:01.903 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:01 smithi069 ceph-mon[42034]: Adjusting osd_memory_target on smithi069 to 182.4M 2023-12-14T14:21:01.903 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:01 smithi069 ceph-mon[42034]: Unable to set osd_memory_target on smithi069 to 191311769: error parsing value: Value '191311769' is below minimum 939524096 2023-12-14T14:21:01.903 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:01 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:21:01.904 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:01 smithi069 ceph-mon[42034]: Service mds.all has no related daemon already placed. 2023-12-14T14:21:01.904 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:01 smithi069 ceph-mon[42034]: Service mgr has no related daemon already placed. 2023-12-14T14:21:01.904 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:01 smithi069 ceph-mon[42034]: Service mon has no related daemon already placed. 2023-12-14T14:21:01.904 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:01 smithi069 ceph-mon[42034]: pgmap v322: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:21:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:01 smithi119 ceph-mon[43834]: Adjusting osd_memory_target on smithi069 to 182.4M 2023-12-14T14:21:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:01 smithi119 ceph-mon[43834]: Unable to set osd_memory_target on smithi069 to 191311769: error parsing value: Value '191311769' is below minimum 939524096 2023-12-14T14:21:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:01 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:21:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:01 smithi119 ceph-mon[43834]: Service mds.all has no related daemon already placed. 2023-12-14T14:21:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:01 smithi119 ceph-mon[43834]: Service mgr has no related daemon already placed. 2023-12-14T14:21:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:01 smithi119 ceph-mon[43834]: Service mon has no related daemon already placed. 2023-12-14T14:21:02.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:01 smithi119 ceph-mon[43834]: pgmap v322: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T14:21:02.666 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:21:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 0, 2023-12-14T14:21:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 2, 2023-12-14T14:21:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 0, 2023-12-14T14:21:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 0, 2023-12-14T14:21:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2023-12-14T14:21:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2023-12-14T14:21:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.001269855, 2023-12-14T14:21:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000000000, 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000280208, 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T14:21:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T14:21:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 6, 2023-12-14T14:21:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 150, 2023-12-14T14:21:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 3312, 2023-12-14T14:21:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 178224, 2023-12-14T14:21:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 5, 2023-12-14T14:21:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2023-12-14T14:21:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.011247611, 2023-12-14T14:21:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.007357971, 2023-12-14T14:21:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.001953172, 2023-12-14T14:21:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 148, 2023-12-14T14:21:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.009178878, 2023-12-14T14:21:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000062019 2023-12-14T14:21:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-12-14T14:21:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 178224 2023-12-14T14:21:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 204, 2023-12-14T14:21:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 195, 2023-12-14T14:21:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1281328, 2023-12-14T14:21:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 110864, 2023-12-14T14:21:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2023-12-14T14:21:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2023-12-14T14:21:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.034361209, 2023-12-14T14:21:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.011450313, 2023-12-14T14:21:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.026187929, 2023-12-14T14:21:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.003708108, 2023-12-14T14:21:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 194, 2023-12-14T14:21:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.008992956, 2023-12-14T14:21:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000046355 2023-12-14T14:21:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1281328, 2023-12-14T14:21:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 110864 2023-12-14T14:21:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2023-12-14T14:21:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2023-12-14T14:21:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2023-12-14T14:21:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2023-12-14T14:21:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2023-12-14T14:21:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 148977, 2023-12-14T14:21:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 30, 2023-12-14T14:21:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2023-12-14T14:21:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2023-12-14T14:21:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2023-12-14T14:21:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2023-12-14T14:21:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2023-12-14T14:21:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-12-14T14:21:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-12-14T14:21:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-12-14T14:21:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 206, 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 1252554, 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 206, 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 206, 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 1252554, 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:21:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:21:02.684 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:21:03.046 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2023-12-14T14:21:03.046 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2023-12-14T14:21:03.046 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2023-12-14T14:21:03.046 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2023-12-14T14:21:03.046 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2023-12-14T14:21:03.046 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2023-12-14T14:21:03.046 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2023-12-14T14:21:03.047 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2023-12-14T14:21:03.047 DEBUG:tasks.check_counter:Getting stats from j 2023-12-14T14:21:03.047 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.j perf dump 2023-12-14T14:21:03.360 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.a/config 2023-12-14T14:21:03.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:03 smithi069 ceph-mon[42034]: pgmap v323: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:21:03.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:03 smithi081 ceph-mon[43371]: pgmap v323: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:21:04.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:03 smithi119 ceph-mon[43834]: pgmap v323: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T14:21:04.482 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T14:21:04.483 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:04.483 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 207, 2023-12-14T14:21:04.483 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 198, 2023-12-14T14:21:04.483 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1282144, 2023-12-14T14:21:04.483 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 112640, 2023-12-14T14:21:04.483 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2023-12-14T14:21:04.483 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2023-12-14T14:21:04.483 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.036539756, 2023-12-14T14:21:04.483 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.011661014, 2023-12-14T14:21:04.484 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.026945329, 2023-12-14T14:21:04.484 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.004020091, 2023-12-14T14:21:04.484 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:04.484 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 197, 2023-12-14T14:21:04.484 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.008976337, 2023-12-14T14:21:04.484 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000045565 2023-12-14T14:21:04.484 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.484 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:04.484 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:04.485 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:04.485 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:04.485 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.485 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1282144, 2023-12-14T14:21:04.485 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 112640 2023-12-14T14:21:04.485 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.485 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:04.485 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 6, 2023-12-14T14:21:04.486 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 154, 2023-12-14T14:21:04.486 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 3312, 2023-12-14T14:21:04.486 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 178928, 2023-12-14T14:21:04.486 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 5, 2023-12-14T14:21:04.486 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2023-12-14T14:21:04.486 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.011822196, 2023-12-14T14:21:04.486 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.007552007, 2023-12-14T14:21:04.486 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.001989545, 2023-12-14T14:21:04.486 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:04.487 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:04.487 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 152, 2023-12-14T14:21:04.487 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.020600180, 2023-12-14T14:21:04.487 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000135527 2023-12-14T14:21:04.487 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.487 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:04.487 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:04.487 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:04.488 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:04.488 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.488 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-12-14T14:21:04.488 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 178928 2023-12-14T14:21:04.488 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.488 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:04.488 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 0, 2023-12-14T14:21:04.488 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 2, 2023-12-14T14:21:04.488 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 0, 2023-12-14T14:21:04.489 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 0, 2023-12-14T14:21:04.489 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2023-12-14T14:21:04.489 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2023-12-14T14:21:04.489 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.000426500, 2023-12-14T14:21:04.489 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000000000, 2023-12-14T14:21:04.489 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000354672, 2023-12-14T14:21:04.489 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:04.489 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:04.490 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:04.490 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:04.490 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:04.490 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.490 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:04.490 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:04.490 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:04.490 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:04.490 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:04.491 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:04.492 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:04.492 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:04.492 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:04.492 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:04.492 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:04.492 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:04.492 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:04.492 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:04.492 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:04.493 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:04.493 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:04.493 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:04.493 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:04.493 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:04.493 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:04.493 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:04.493 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:04.493 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:04.494 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:04.494 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:04.494 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:04.494 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:04.494 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:04.494 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:04.494 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:04.494 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:04.494 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:04.495 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:04.495 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:04.495 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2023-12-14T14:21:04.495 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:04.495 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:04.495 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:04.495 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:04.495 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 149007, 2023-12-14T14:21:04.495 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 30, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2023-12-14T14:21:04.496 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2023-12-14T14:21:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2023-12-14T14:21:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2023-12-14T14:21:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2023-12-14T14:21:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2023-12-14T14:21:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:04.498 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2023-12-14T14:21:04.498 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T14:21:04.498 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:04.498 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-12-14T14:21:04.498 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-12-14T14:21:04.498 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-12-14T14:21:04.498 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 209, 2023-12-14T14:21:04.498 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 1252944, 2023-12-14T14:21:04.498 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:04.499 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 209, 2023-12-14T14:21:04.499 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-12-14T14:21:04.499 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-12-14T14:21:04.499 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 209, 2023-12-14T14:21:04.499 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 1252944, 2023-12-14T14:21:04.499 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-12-14T14:21:04.499 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T14:21:04.499 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T14:21:04.499 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T14:21:04.500 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:21:04.500 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T14:21:04.500 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T14:21:04.853 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-12-14T14:21:04.853 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-12-14T14:21:04.853 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-12-14T14:21:04.853 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-12-14T14:21:04.853 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-12-14T14:21:04.853 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-12-14T14:21:04.854 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-12-14T14:21:04.854 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-12-14T14:21:04.854 DEBUG:tasks.check_counter:Getting stats from b 2023-12-14T14:21:04.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.b perf dump 2023-12-14T14:21:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:21:05.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:05 smithi081 ceph-mon[43371]: pgmap v324: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:21:06.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:05 smithi119 ceph-mon[43834]: pgmap v324: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:21:06.086 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:05 smithi069 ceph-mon[42034]: pgmap v324: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:21:06.208 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-12-14T14:21:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 7613, 2023-12-14T14:21:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 7379, 2023-12-14T14:21:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2005718, 2023-12-14T14:21:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 73238815, 2023-12-14T14:21:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 128, 2023-12-14T14:21:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2023-12-14T14:21:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.665209126, 2023-12-14T14:21:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.278351278, 2023-12-14T14:21:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.145225148, 2023-12-14T14:21:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.202596702, 2023-12-14T14:21:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 7377, 2023-12-14T14:21:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.997000483, 2023-12-14T14:21:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000270706 2023-12-14T14:21:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 503, 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000068383, 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000135 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 140800, 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 36288 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 185815, 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 174603, 2023-12-14T14:21:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 41550240, 2023-12-14T14:21:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 111787590, 2023-12-14T14:21:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 10, 2023-12-14T14:21:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 7, 2023-12-14T14:21:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 6.869992840, 2023-12-14T14:21:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 2.889849329, 2023-12-14T14:21:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 4.651416668, 2023-12-14T14:21:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.271065056, 2023-12-14T14:21:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 174601, 2023-12-14T14:21:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 3.801818479, 2023-12-14T14:21:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000021774 2023-12-14T14:21:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 338507, 2023-12-14T14:21:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.030977231, 2023-12-14T14:21:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000091 2023-12-14T14:21:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 423728 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 89975, 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 158711, 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 182625183, 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 110592951, 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 12, 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 7, 2023-12-14T14:21:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 4.481528250, 2023-12-14T14:21:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 2.189903956, 2023-12-14T14:21:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 7.754561183, 2023-12-14T14:21:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.197750402, 2023-12-14T14:21:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 158710, 2023-12-14T14:21:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 4.993021286, 2023-12-14T14:21:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000031460 2023-12-14T14:21:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 152177, 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.031105359, 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000204 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1688688, 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 234704 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2023-12-14T14:21:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2023-12-14T14:21:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2023-12-14T14:21:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2023-12-14T14:21:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2023-12-14T14:21:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 8744, 2023-12-14T14:21:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 40.485811599, 2023-12-14T14:21:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.004630124 2023-12-14T14:21:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 13140, 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2.956928187, 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000225032 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2023-12-14T14:21:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 52855, 2023-12-14T14:21:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 41154, 2023-12-14T14:21:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2023-12-14T14:21:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 41154, 2023-12-14T14:21:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1981.051206261, 2023-12-14T14:21:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.048137512 2023-12-14T14:21:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2023-12-14T14:21:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 11701, 2023-12-14T14:21:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 1, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 900, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 110, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 3, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 23054, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 2, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 57, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 22995, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 23051, 2023-12-14T14:21:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 34331, 2023-12-14T14:21:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 7, 2023-12-14T14:21:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 7, 2023-12-14T14:21:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 5, 2023-12-14T14:21:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 62499, 2023-12-14T14:21:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 50513, 2023-12-14T14:21:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 11624, 2023-12-14T14:21:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 1, 2023-12-14T14:21:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 1, 2023-12-14T14:21:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2023-12-14T14:21:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2023-12-14T14:21:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2023-12-14T14:21:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2023-12-14T14:21:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 398, 2023-12-14T14:21:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 31440, 2023-12-14T14:21:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 393, 2023-12-14T14:21:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2023-12-14T14:21:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2023-12-14T14:21:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 8883, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 7, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 246, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 6, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 8883, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 126, 2023-12-14T14:21:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 13, 2023-12-14T14:21:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 113, 2023-12-14T14:21:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 8757, 2023-12-14T14:21:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 4, 2023-12-14T14:21:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 559, 2023-12-14T14:21:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 30533, 2023-12-14T14:21:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 1, 2023-12-14T14:21:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 574, 2023-12-14T14:21:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T14:21:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 18415, 2023-12-14T14:21:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 17853, 2023-12-14T14:21:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 156, 2023-12-14T14:21:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 19079 2023-12-14T14:21:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2023-12-14T14:21:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 904, 2023-12-14T14:21:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 3, 2023-12-14T14:21:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 2, 2023-12-14T14:21:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 2, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 985, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 9, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 8826, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 8817, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2023-12-14T14:21:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2023-12-14T14:21:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2023-12-14T14:21:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2023-12-14T14:21:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2023-12-14T14:21:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 13, 2023-12-14T14:21:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 398, 2023-12-14T14:21:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2023-12-14T14:21:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 126, 2023-12-14T14:21:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2023-12-14T14:21:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 58381, 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 58381, 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 76, 2023-12-14T14:21:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2023-12-14T14:21:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2023-12-14T14:21:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 76, 2023-12-14T14:21:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2023-12-14T14:21:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2023-12-14T14:21:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2023-12-14T14:21:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 182815653, 2023-12-14T14:21:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2023-12-14T14:21:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2023-12-14T14:21:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1597, 2023-12-14T14:21:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 44.820371203, 2023-12-14T14:21:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.028065354 2023-12-14T14:21:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2023-12-14T14:21:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2023-12-14T14:21:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 13833, 2023-12-14T14:21:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 47802, 2023-12-14T14:21:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 33969, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 507, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 3124, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 2617, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 23054, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 65791, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 42737, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 7, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 29558, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 29551, 2023-12-14T14:21:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 224976, 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 207156 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 53218, 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 34, 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 52855, 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 100, 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 76, 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2023-12-14T14:21:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 21092, 2023-12-14T14:21:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1922.098972031, 2023-12-14T14:21:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.091129289 2023-12-14T14:21:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2023-12-14T14:21:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 387, 2023-12-14T14:21:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.464127866, 2023-12-14T14:21:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001199296 2023-12-14T14:21:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2023-12-14T14:21:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2023-12-14T14:21:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2023-12-14T14:21:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 9209, 2023-12-14T14:21:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 16.573439289, 2023-12-14T14:21:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001799700 2023-12-14T14:21:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2023-12-14T14:21:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2023-12-14T14:21:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2023-12-14T14:21:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2023-12-14T14:21:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 11, 2023-12-14T14:21:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001612005, 2023-12-14T14:21:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000146545 2023-12-14T14:21:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2023-12-14T14:21:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 129, 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.124663249, 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000966381 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2023-12-14T14:21:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 11, 2023-12-14T14:21:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 5.100931494, 2023-12-14T14:21:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.463721044 2023-12-14T14:21:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2023-12-14T14:21:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2023-12-14T14:21:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1401, 2023-12-14T14:21:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.182803446, 2023-12-14T14:21:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000844256 2023-12-14T14:21:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2023-12-14T14:21:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4, 2023-12-14T14:21:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.008517322, 2023-12-14T14:21:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002129330 2023-12-14T14:21:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2023-12-14T14:21:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 116, 2023-12-14T14:21:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.364153481, 2023-12-14T14:21:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.003139254 2023-12-14T14:21:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2023-12-14T14:21:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 5, 2023-12-14T14:21:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.034400838, 2023-12-14T14:21:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.006880167 2023-12-14T14:21:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2023-12-14T14:21:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 21, 2023-12-14T14:21:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.029634654, 2023-12-14T14:21:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001411174 2023-12-14T14:21:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2023-12-14T14:21:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4, 2023-12-14T14:21:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.014717276, 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.003679319 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 22, 2023-12-14T14:21:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 10.017283764, 2023-12-14T14:21:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.455331080 2023-12-14T14:21:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2023-12-14T14:21:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 33, 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.091843341, 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002783131 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2023-12-14T14:21:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 8709, 2023-12-14T14:21:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 24.944106205, 2023-12-14T14:21:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002864175 2023-12-14T14:21:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2023-12-14T14:21:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2023-12-14T14:21:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2023-12-14T14:21:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2023-12-14T14:21:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 2, 2023-12-14T14:21:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 5, 2023-12-14T14:21:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 3, 2023-12-14T14:21:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 2, 2023-12-14T14:21:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 482, 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 241, 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 622 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2023-12-14T14:21:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 702380, 2023-12-14T14:21:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 9394, 2023-12-14T14:21:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 88, 2023-12-14T14:21:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 1, 2023-12-14T14:21:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2023-12-14T14:21:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8064, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 184, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2023-12-14T14:21:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 47345867, 2023-12-14T14:21:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 398516, 2023-12-14T14:21:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2023-12-14T14:21:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2023-12-14T14:21:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2023-12-14T14:21:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2023-12-14T14:21:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2023-12-14T14:21:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 21418, 2023-12-14T14:21:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 191911155, 2023-12-14T14:21:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 31, 2023-12-14T14:21:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 21418, 2023-12-14T14:21:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2023-12-14T14:21:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 21418, 2023-12-14T14:21:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 58.668873754, 2023-12-14T14:21:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002739232 2023-12-14T14:21:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2023-12-14T14:21:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2023-12-14T14:21:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 21418, 2023-12-14T14:21:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 22426 2023-12-14T14:21:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 21418, 2023-12-14T14:21:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 9062, 2023-12-14T14:21:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 12356, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 0, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 11, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 164, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 1748, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 101, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2023-12-14T14:21:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2023-12-14T14:21:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 7, 2023-12-14T14:21:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 9522, 2023-12-14T14:21:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2023-12-14T14:21:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2023-12-14T14:21:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2023-12-14T14:21:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 8896, 2023-12-14T14:21:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 22, 2023-12-14T14:21:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2023-12-14T14:21:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2023-12-14T14:21:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2023-12-14T14:21:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2023-12-14T14:21:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2023-12-14T14:21:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2023-12-14T14:21:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T14:21:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2023-12-14T14:21:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2023-12-14T14:21:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 1, 2023-12-14T14:21:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2023-12-14T14:21:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2023-12-14T14:21:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2023-12-14T14:21:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2023-12-14T14:21:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2023-12-14T14:21:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2023-12-14T14:21:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2023-12-14T14:21:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 93, 2023-12-14T14:21:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2023-12-14T14:21:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 12, 2023-12-14T14:21:06.264 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2023-12-14T14:21:06.264 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2023-12-14T14:21:06.264 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2023-12-14T14:21:06.264 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2023-12-14T14:21:06.264 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 1905, 2023-12-14T14:21:06.264 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 3, 2023-12-14T14:21:06.264 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 46 2023-12-14T14:21:06.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.264 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 53446 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2023-12-14T14:21:06.265 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2023-12-14T14:21:06.266 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 10, 2023-12-14T14:21:06.266 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2023-12-14T14:21:06.266 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 10, 2023-12-14T14:21:06.266 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 8817, 2023-12-14T14:21:06.266 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2023-12-14T14:21:06.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.266 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:06.266 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:06.266 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2023-12-14T14:21:06.267 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:06.267 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 283399, 2023-12-14T14:21:06.267 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 201767573, 2023-12-14T14:21:06.267 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:06.267 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 283399, 2023-12-14T14:21:06.267 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:06.267 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:06.267 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 283399, 2023-12-14T14:21:06.267 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 201767573, 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2023-12-14T14:21:06.268 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:06.269 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2023-12-14T14:21:06.269 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2023-12-14T14:21:06.269 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:06.269 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:06.269 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 21418, 2023-12-14T14:21:06.269 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 192907027, 2023-12-14T14:21:06.269 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 21418, 2023-12-14T14:21:06.269 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 192907027, 2023-12-14T14:21:06.269 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:06.270 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.270 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.270 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:06.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.270 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2023-12-14T14:21:06.270 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:06.270 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2023-12-14T14:21:06.270 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:06.271 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2023-12-14T14:21:06.271 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2023-12-14T14:21:06.271 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:06.271 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:06.271 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 21418, 2023-12-14T14:21:06.271 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 21418, 2023-12-14T14:21:06.271 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 21418, 2023-12-14T14:21:06.271 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 21418, 2023-12-14T14:21:06.271 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:06.272 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 8817, 2023-12-14T14:21:06.273 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 995917, 2023-12-14T14:21:06.273 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:06.273 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 8817, 2023-12-14T14:21:06.273 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:06.273 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:06.273 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 151, 2023-12-14T14:21:06.273 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 995917, 2023-12-14T14:21:06.273 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:06.273 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.274 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.274 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:06.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:06.274 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x5652f16780a0": { 2023-12-14T14:21:06.274 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 60, 2023-12-14T14:21:06.274 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2023-12-14T14:21:06.275 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:06.275 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 58381, 2023-12-14T14:21:06.275 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 178621349, 2023-12-14T14:21:06.275 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:06.275 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 58381, 2023-12-14T14:21:06.275 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:06.275 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:06.275 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1597, 2023-12-14T14:21:06.276 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 178621289, 2023-12-14T14:21:06.276 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:06.276 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:06.276 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:06.276 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:06.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:06.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:06.276 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-12-14T14:21:06.571 INFO:tasks.check_counter:Daemon mds.b mds.exported=398 2023-12-14T14:21:06.571 INFO:tasks.check_counter:Daemon mds.b mds.imported=393 2023-12-14T14:21:06.571 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=904 2023-12-14T14:21:06.571 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=3 2023-12-14T14:21:06.571 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2023-12-14T14:21:06.571 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2023-12-14T14:21:06.571 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2023-12-14T14:21:06.571 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=110 2023-12-14T14:21:06.572 DEBUG:tasks.check_counter:Getting stats from e 2023-12-14T14:21:06.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.e perf dump 2023-12-14T14:21:06.880 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:21:07.648 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:07 smithi081 ceph-mon[43371]: pgmap v325: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:21:07.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:07 smithi119 ceph-mon[43834]: pgmap v325: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:21:07.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:07 smithi069 ceph-mon[42034]: pgmap v325: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:21:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-12-14T14:21:07.873 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:07.874 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 531, 2023-12-14T14:21:07.874 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 533, 2023-12-14T14:21:07.874 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 71446683, 2023-12-14T14:21:07.874 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 165205, 2023-12-14T14:21:07.874 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 8, 2023-12-14T14:21:07.874 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2023-12-14T14:21:07.874 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.078465607, 2023-12-14T14:21:07.874 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.013417434, 2023-12-14T14:21:07.874 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.047958817, 2023-12-14T14:21:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.011889015, 2023-12-14T14:21:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 531, 2023-12-14T14:21:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.021685968, 2023-12-14T14:21:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000040839 2023-12-14T14:21:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 651, 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 798, 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 54693173, 2023-12-14T14:21:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 615784, 2023-12-14T14:21:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 8, 2023-12-14T14:21:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2023-12-14T14:21:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.090826964, 2023-12-14T14:21:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.021557993, 2023-12-14T14:21:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.041750029, 2023-12-14T14:21:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.019812440, 2023-12-14T14:21:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 796, 2023-12-14T14:21:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.037554481, 2023-12-14T14:21:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000047178 2023-12-14T14:21:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-12-14T14:21:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 415184 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1512, 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1492, 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 79081542, 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 512866, 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.202361141, 2023-12-14T14:21:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.049750055, 2023-12-14T14:21:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.104540775, 2023-12-14T14:21:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.043512687, 2023-12-14T14:21:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1491, 2023-12-14T14:21:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.075233166, 2023-12-14T14:21:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000050458 2023-12-14T14:21:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1346368, 2023-12-14T14:21:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 115408 2023-12-14T14:21:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2023-12-14T14:21:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2023-12-14T14:21:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3951, 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.111779409, 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000028291 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2023-12-14T14:21:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2023-12-14T14:21:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2023-12-14T14:21:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2023-12-14T14:21:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2023-12-14T14:21:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2023-12-14T14:21:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2023-12-14T14:21:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2023-12-14T14:21:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2023-12-14T14:21:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 39728, 2023-12-14T14:21:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 7, 2023-12-14T14:21:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 31, 2023-12-14T14:21:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 39690, 2023-12-14T14:21:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 39718, 2023-12-14T14:21:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2023-12-14T14:21:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2023-12-14T14:21:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2023-12-14T14:21:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 1, 2023-12-14T14:21:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2023-12-14T14:21:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2023-12-14T14:21:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2023-12-14T14:21:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2023-12-14T14:21:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2023-12-14T14:21:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2023-12-14T14:21:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2023-12-14T14:21:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2023-12-14T14:21:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2023-12-14T14:21:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2023-12-14T14:21:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2023-12-14T14:21:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2023-12-14T14:21:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T14:21:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2023-12-14T14:21:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2023-12-14T14:21:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T14:21:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2023-12-14T14:21:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2023-12-14T14:21:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2023-12-14T14:21:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2023-12-14T14:21:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2023-12-14T14:21:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2023-12-14T14:21:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2023-12-14T14:21:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2023-12-14T14:21:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2023-12-14T14:21:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2023-12-14T14:21:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2023-12-14T14:21:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2023-12-14T14:21:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2023-12-14T14:21:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2023-12-14T14:21:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2023-12-14T14:21:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2023-12-14T14:21:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2023-12-14T14:21:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2023-12-14T14:21:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2023-12-14T14:21:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2023-12-14T14:21:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2023-12-14T14:21:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2023-12-14T14:21:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2023-12-14T14:21:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 0, 2023-12-14T14:21:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2023-12-14T14:21:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2023-12-14T14:21:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2023-12-14T14:21:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2023-12-14T14:21:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2023-12-14T14:21:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 86, 2023-12-14T14:21:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2023-12-14T14:21:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2023-12-14T14:21:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2023-12-14T14:21:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 0, 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 207185855, 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 60514 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2023-12-14T14:21:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 14646, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 54981, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 40335, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 497, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 1364, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 867, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 39728, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 79369, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 39641, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2023-12-14T14:21:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2023-12-14T14:21:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2023-12-14T14:21:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 143628, 2023-12-14T14:21:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 207156 2023-12-14T14:21:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2023-12-14T14:21:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2023-12-14T14:21:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2023-12-14T14:21:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2023-12-14T14:21:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2023-12-14T14:21:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2023-12-14T14:21:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2023-12-14T14:21:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2023-12-14T14:21:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2023-12-14T14:21:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2023-12-14T14:21:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2023-12-14T14:21:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2023-12-14T14:21:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2023-12-14T14:21:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2023-12-14T14:21:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.905 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2023-12-14T14:21:07.905 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.905 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.905 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.905 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2023-12-14T14:21:07.905 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.905 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.906 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.907 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.907 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2023-12-14T14:21:07.907 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.907 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.907 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.907 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2023-12-14T14:21:07.907 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.908 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.908 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.908 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2023-12-14T14:21:07.908 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.908 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.908 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.908 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2023-12-14T14:21:07.909 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.909 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.909 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.909 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2023-12-14T14:21:07.909 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.909 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.909 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.910 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2023-12-14T14:21:07.910 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.910 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.910 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.910 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2023-12-14T14:21:07.910 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.910 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.910 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.911 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2023-12-14T14:21:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2023-12-14T14:21:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2023-12-14T14:21:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2023-12-14T14:21:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2023-12-14T14:21:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2023-12-14T14:21:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2023-12-14T14:21:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2023-12-14T14:21:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 4, 2023-12-14T14:21:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 3, 2023-12-14T14:21:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 3, 2023-12-14T14:21:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2023-12-14T14:21:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2023-12-14T14:21:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2023-12-14T14:21:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 4175 2023-12-14T14:21:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2023-12-14T14:21:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2023-12-14T14:21:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 729025, 2023-12-14T14:21:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 14712, 2023-12-14T14:21:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2023-12-14T14:21:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2023-12-14T14:21:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8064, 2023-12-14T14:21:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 184, 2023-12-14T14:21:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2023-12-14T14:21:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 61075135, 2023-12-14T14:21:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 483891, 2023-12-14T14:21:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2023-12-14T14:21:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2023-12-14T14:21:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2023-12-14T14:21:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2023-12-14T14:21:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2023-12-14T14:21:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 2454, 2023-12-14T14:21:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 2454, 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2454, 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.978962013, 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000806422 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2023-12-14T14:21:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2454, 2023-12-14T14:21:07.924 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2455 2023-12-14T14:21:07.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.924 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 2454, 2023-12-14T14:21:07.924 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2454, 2023-12-14T14:21:07.924 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2023-12-14T14:21:07.924 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2023-12-14T14:21:07.924 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2023-12-14T14:21:07.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1567, 2023-12-14T14:21:07.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2023-12-14T14:21:07.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 885, 2023-12-14T14:21:07.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2023-12-14T14:21:07.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2023-12-14T14:21:07.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2023-12-14T14:21:07.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2023-12-14T14:21:07.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2023-12-14T14:21:07.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2023-12-14T14:21:07.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2023-12-14T14:21:07.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2023-12-14T14:21:07.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2023-12-14T14:21:07.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2023-12-14T14:21:07.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2023-12-14T14:21:07.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2023-12-14T14:21:07.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2023-12-14T14:21:07.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2023-12-14T14:21:07.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2023-12-14T14:21:07.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2023-12-14T14:21:07.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2023-12-14T14:21:07.927 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2023-12-14T14:21:07.928 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2023-12-14T14:21:07.928 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2023-12-14T14:21:07.928 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2023-12-14T14:21:07.928 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2023-12-14T14:21:07.928 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2023-12-14T14:21:07.928 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2023-12-14T14:21:07.928 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2023-12-14T14:21:07.928 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2023-12-14T14:21:07.928 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2023-12-14T14:21:07.929 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2023-12-14T14:21:07.929 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2023-12-14T14:21:07.929 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 93, 2023-12-14T14:21:07.929 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2023-12-14T14:21:07.929 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 11, 2023-12-14T14:21:07.929 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 10, 2023-12-14T14:21:07.929 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 10, 2023-12-14T14:21:07.929 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2023-12-14T14:21:07.929 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2023-12-14T14:21:07.930 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2023-12-14T14:21:07.930 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2023-12-14T14:21:07.930 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2023-12-14T14:21:07.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.930 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2023-12-14T14:21:07.930 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2023-12-14T14:21:07.930 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2023-12-14T14:21:07.930 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2023-12-14T14:21:07.930 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2023-12-14T14:21:07.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 2690, 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 204964352, 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:07.932 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 2690, 2023-12-14T14:21:07.933 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:07.933 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:07.933 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2690, 2023-12-14T14:21:07.933 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 204964352, 2023-12-14T14:21:07.933 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:07.933 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.933 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.933 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:07.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.934 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2023-12-14T14:21:07.934 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:07.934 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2023-12-14T14:21:07.934 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:07.934 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2023-12-14T14:21:07.934 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2023-12-14T14:21:07.934 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:07.934 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2454, 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 203186810, 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2454, 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 203186810, 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:07.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2454, 2023-12-14T14:21:07.936 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 2454, 2023-12-14T14:21:07.937 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2454, 2023-12-14T14:21:07.937 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2454, 2023-12-14T14:21:07.937 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:07.937 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.937 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.937 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:07.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.937 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2023-12-14T14:21:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2023-12-14T14:21:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2023-12-14T14:21:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2023-12-14T14:21:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x564b63afc460": { 2023-12-14T14:21:07.939 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:07.940 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2023-12-14T14:21:07.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:07.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2023-12-14T14:21:07.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2023-12-14T14:21:07.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:07.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:07.940 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:07.940 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:07.940 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2023-12-14T14:21:07.941 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2023-12-14T14:21:07.941 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:07.941 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:07.941 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:07.941 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:07.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:07.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:07.941 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-12-14T14:21:08.244 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-12-14T14:21:08.245 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-12-14T14:21:08.245 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-12-14T14:21:08.245 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-12-14T14:21:08.245 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2023-12-14T14:21:08.245 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-12-14T14:21:08.245 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-12-14T14:21:08.245 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2023-12-14T14:21:08.245 DEBUG:tasks.check_counter:Getting stats from h 2023-12-14T14:21:08.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.h perf dump 2023-12-14T14:21:08.554 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:21:09.651 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-12-14T14:21:09.651 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:09.651 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 71439, 2023-12-14T14:21:09.651 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 121825, 2023-12-14T14:21:09.651 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 21459092, 2023-12-14T14:21:09.652 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 119183312, 2023-12-14T14:21:09.652 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 28, 2023-12-14T14:21:09.652 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 7, 2023-12-14T14:21:09.652 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 3.369286674, 2023-12-14T14:21:09.652 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 1.765559417, 2023-12-14T14:21:09.652 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 13.521187110, 2023-12-14T14:21:09.652 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.182168556, 2023-12-14T14:21:09.652 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:09.652 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 121821, 2023-12-14T14:21:09.653 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 5.725985279, 2023-12-14T14:21:09.653 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000047003 2023-12-14T14:21:09.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.653 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:09.653 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 93426, 2023-12-14T14:21:09.653 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.020978871, 2023-12-14T14:21:09.653 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000224 2023-12-14T14:21:09.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.653 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 2624, 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 2544 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 176360, 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 187738, 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 39590412, 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 147217966, 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 21, 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 5, 2023-12-14T14:21:09.654 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 7.352539078, 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 3.071500794, 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 4.746882437, 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.431697750, 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 187738, 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 3.678113538, 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000019591 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:09.655 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 337813, 2023-12-14T14:21:09.656 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.031796789, 2023-12-14T14:21:09.656 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000094 2023-12-14T14:21:09.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.656 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 4064, 2023-12-14T14:21:09.656 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 113344 2023-12-14T14:21:09.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.656 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:09.656 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 60101, 2023-12-14T14:21:09.656 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 56735, 2023-12-14T14:21:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 184745575, 2023-12-14T14:21:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 63630664, 2023-12-14T14:21:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 11, 2023-12-14T14:21:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2023-12-14T14:21:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 3.231329826, 2023-12-14T14:21:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 1.152636262, 2023-12-14T14:21:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 2.457980421, 2023-12-14T14:21:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.199061692, 2023-12-14T14:21:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 56734, 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2.104298216, 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000037090 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 98925, 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.013247988, 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000133 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1356288, 2023-12-14T14:21:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 429824 2023-12-14T14:21:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2023-12-14T14:21:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2023-12-14T14:21:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2023-12-14T14:21:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2023-12-14T14:21:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2023-12-14T14:21:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 8811, 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 42.519912116, 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.004825775 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 22747, 2023-12-14T14:21:09.660 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 6.760514612, 2023-12-14T14:21:09.661 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000297204 2023-12-14T14:21:09.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:09.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.661 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2023-12-14T14:21:09.661 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 44380, 2023-12-14T14:21:09.661 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 35595, 2023-12-14T14:21:09.661 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2023-12-14T14:21:09.661 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 35595, 2023-12-14T14:21:09.661 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 85.358141417, 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002398037 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 8785, 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 6, 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 538, 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 65, 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 7, 2023-12-14T14:21:09.662 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 24033, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 2, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 6, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 24025, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 24030, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 39837, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 1, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 1, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 4, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 63356, 2023-12-14T14:21:09.663 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 53232, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 8665, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 24, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 6, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 732, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 38086, 2023-12-14T14:21:09.664 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 750, 2023-12-14T14:21:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2023-12-14T14:21:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2023-12-14T14:21:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 8076, 2023-12-14T14:21:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2023-12-14T14:21:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 7, 2023-12-14T14:21:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 246, 2023-12-14T14:21:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 6, 2023-12-14T14:21:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 8076, 2023-12-14T14:21:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 1, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 1, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 8075, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 6, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 16, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 20831, 2023-12-14T14:21:09.666 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 583, 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 19298, 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 19208, 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 554, 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 30446 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 559, 2023-12-14T14:21:09.667 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 6575, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 3294, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 3303, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 559, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 1, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 15084, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 15083, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2023-12-14T14:21:09.668 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 733, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 72, 2023-12-14T14:21:09.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 60514, 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 60514, 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2023-12-14T14:21:09.670 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 86, 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 86, 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 207356629, 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2023-12-14T14:21:09.671 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2587, 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 174.595458615, 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.067489547 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 14646, 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 55195, 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 40549, 2023-12-14T14:21:09.672 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 508, 2023-12-14T14:21:09.673 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 4000, 2023-12-14T14:21:09.673 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 3492, 2023-12-14T14:21:09.673 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 24033, 2023-12-14T14:21:09.673 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 78365, 2023-12-14T14:21:09.673 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 54332, 2023-12-14T14:21:09.673 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 1, 2023-12-14T14:21:09.673 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 28930, 2023-12-14T14:21:09.673 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 28929, 2023-12-14T14:21:09.673 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 193696, 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 198964 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 49785, 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 10, 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 44380, 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 20, 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 81, 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2023-12-14T14:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 5157, 2023-12-14T14:21:09.675 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 7.434685703, 2023-12-14T14:21:09.675 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001441668 2023-12-14T14:21:09.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.675 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2023-12-14T14:21:09.675 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2, 2023-12-14T14:21:09.675 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.033261425, 2023-12-14T14:21:09.675 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.016630712 2023-12-14T14:21:09.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.675 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.676 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2023-12-14T14:21:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 14288, 2023-12-14T14:21:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 19.881551977, 2023-12-14T14:21:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001391486 2023-12-14T14:21:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2023-12-14T14:21:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.678 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2023-12-14T14:21:09.678 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1, 2023-12-14T14:21:09.678 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000081112, 2023-12-14T14:21:09.678 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000081112 2023-12-14T14:21:09.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.678 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2023-12-14T14:21:09.678 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.678 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.678 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.679 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2023-12-14T14:21:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2023-12-14T14:21:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2023-12-14T14:21:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2023-12-14T14:21:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2023-12-14T14:21:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1063, 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.919596427, 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000865095 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.684 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2023-12-14T14:21:09.685 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1, 2023-12-14T14:21:09.685 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.076124880, 2023-12-14T14:21:09.685 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.076124880 2023-12-14T14:21:09.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.685 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2023-12-14T14:21:09.685 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.685 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.685 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.689 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2023-12-14T14:21:09.689 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.689 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.689 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.689 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2023-12-14T14:21:09.689 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 15083, 2023-12-14T14:21:09.689 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 57.012839893, 2023-12-14T14:21:09.689 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.003779940 2023-12-14T14:21:09.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.690 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2023-12-14T14:21:09.690 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2023-12-14T14:21:09.690 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2023-12-14T14:21:09.690 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.690 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.690 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:09.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.691 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2023-12-14T14:21:09.691 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2023-12-14T14:21:09.691 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 4, 2023-12-14T14:21:09.691 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 3, 2023-12-14T14:21:09.691 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2023-12-14T14:21:09.691 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2023-12-14T14:21:09.691 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 16351, 2023-12-14T14:21:09.691 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 16351, 2023-12-14T14:21:09.691 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 627 2023-12-14T14:21:09.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.692 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2023-12-14T14:21:09.692 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:09.692 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:09.692 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:09.692 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:09.692 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:09.692 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:09.692 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:09.693 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:09.693 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:09.693 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:09.693 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:09.693 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:09.693 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:09.693 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:09.693 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:09.693 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:09.694 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:09.694 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:09.694 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:09.694 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:09.694 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:09.694 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:09.694 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:09.694 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:09.694 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:09.695 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:09.695 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:09.695 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:09.695 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:09.695 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:09.695 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:09.695 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2023-12-14T14:21:09.695 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:09.695 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:09.696 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:09.696 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:09.696 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 602379, 2023-12-14T14:21:09.696 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 9512, 2023-12-14T14:21:09.696 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:09.696 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:09.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2023-12-14T14:21:09.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2023-12-14T14:21:09.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:09.697 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:09.697 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:09.697 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:09.697 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8064, 2023-12-14T14:21:09.697 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 184, 2023-12-14T14:21:09.697 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:09.697 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:09.697 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:09.697 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2023-12-14T14:21:09.698 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 49770878, 2023-12-14T14:21:09.698 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 420374, 2023-12-14T14:21:09.698 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:09.698 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2023-12-14T14:21:09.698 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:09.698 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2023-12-14T14:21:09.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.698 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2023-12-14T14:21:09.698 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 27431, 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 211576442, 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 27, 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 27431, 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 27431, 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 71.472619670, 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002605541 2023-12-14T14:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.700 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2023-12-14T14:21:09.700 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2023-12-14T14:21:09.700 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 27431, 2023-12-14T14:21:09.700 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 28036 2023-12-14T14:21:09.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.700 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 27431, 2023-12-14T14:21:09.700 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 8466, 2023-12-14T14:21:09.700 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 18965, 2023-12-14T14:21:09.700 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2023-12-14T14:21:09.701 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2023-12-14T14:21:09.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 0, 2023-12-14T14:21:09.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 10, 2023-12-14T14:21:09.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 366, 2023-12-14T14:21:09.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 2953, 2023-12-14T14:21:09.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 164, 2023-12-14T14:21:09.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2023-12-14T14:21:09.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2023-12-14T14:21:09.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2023-12-14T14:21:09.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 2, 2023-12-14T14:21:09.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 15260, 2023-12-14T14:21:09.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2023-12-14T14:21:09.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2023-12-14T14:21:09.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2023-12-14T14:21:09.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 8076, 2023-12-14T14:21:09.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 20, 2023-12-14T14:21:09.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2023-12-14T14:21:09.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2023-12-14T14:21:09.703 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2023-12-14T14:21:09.703 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2023-12-14T14:21:09.703 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2023-12-14T14:21:09.703 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2023-12-14T14:21:09.703 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T14:21:09.703 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2023-12-14T14:21:09.703 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2023-12-14T14:21:09.703 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2023-12-14T14:21:09.703 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2023-12-14T14:21:09.704 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2023-12-14T14:21:09.704 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2023-12-14T14:21:09.704 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2023-12-14T14:21:09.704 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2023-12-14T14:21:09.704 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2023-12-14T14:21:09.704 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2023-12-14T14:21:09.704 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2023-12-14T14:21:09.704 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2023-12-14T14:21:09.704 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2023-12-14T14:21:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2023-12-14T14:21:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2023-12-14T14:21:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2023-12-14T14:21:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2023-12-14T14:21:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2023-12-14T14:21:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2023-12-14T14:21:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 93, 2023-12-14T14:21:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2023-12-14T14:21:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 11, 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 1131, 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 30, 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 24 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2023-12-14T14:21:09.706 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2023-12-14T14:21:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2023-12-14T14:21:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2023-12-14T14:21:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2023-12-14T14:21:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2023-12-14T14:21:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 45204 2023-12-14T14:21:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2023-12-14T14:21:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2023-12-14T14:21:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 10, 2023-12-14T14:21:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2023-12-14T14:21:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 10, 2023-12-14T14:21:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 15083, 2023-12-14T14:21:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2023-12-14T14:21:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2023-12-14T14:21:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 307896, 2023-12-14T14:21:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 219098396, 2023-12-14T14:21:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 307896, 2023-12-14T14:21:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 307896, 2023-12-14T14:21:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 219098396, 2023-12-14T14:21:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2023-12-14T14:21:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2023-12-14T14:21:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2023-12-14T14:21:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2023-12-14T14:21:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 27431, 2023-12-14T14:21:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 213324091, 2023-12-14T14:21:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 27431, 2023-12-14T14:21:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 213324091, 2023-12-14T14:21:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2023-12-14T14:21:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2023-12-14T14:21:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2023-12-14T14:21:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2023-12-14T14:21:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 27431, 2023-12-14T14:21:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 27431, 2023-12-14T14:21:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 27431, 2023-12-14T14:21:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 27431, 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2023-12-14T14:21:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 15083, 2023-12-14T14:21:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1748247, 2023-12-14T14:21:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 15083, 2023-12-14T14:21:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 366, 2023-12-14T14:21:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1748247, 2023-12-14T14:21:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x562313a380a0": { 2023-12-14T14:21:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2023-12-14T14:21:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 60514, 2023-12-14T14:21:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 203162325, 2023-12-14T14:21:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 60514, 2023-12-14T14:21:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2587, 2023-12-14T14:21:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 203162325, 2023-12-14T14:21:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:09.718 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-12-14T14:21:09.833 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:09 smithi081 ceph-mon[43371]: pgmap v326: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:21:09.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:09 smithi069 ceph-mon[42034]: pgmap v326: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:21:10.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:09 smithi119 ceph-mon[43834]: pgmap v326: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-12-14T14:21:10.045 INFO:tasks.check_counter:Daemon mds.h mds.exported=732 2023-12-14T14:21:10.045 INFO:tasks.check_counter:Daemon mds.h mds.imported=750 2023-12-14T14:21:10.045 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=559 2023-12-14T14:21:10.046 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=6575 2023-12-14T14:21:10.046 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2023-12-14T14:21:10.046 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-12-14T14:21:10.046 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-12-14T14:21:10.046 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=65 2023-12-14T14:21:10.046 DEBUG:tasks.check_counter:Getting stats from k 2023-12-14T14:21:10.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.k perf dump 2023-12-14T14:21:10.357 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.b/config 2023-12-14T14:21:11.611 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-12-14T14:21:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 4, 2023-12-14T14:21:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 4, 2023-12-14T14:21:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2992, 2023-12-14T14:21:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 448, 2023-12-14T14:21:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2023-12-14T14:21:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2023-12-14T14:21:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001619660, 2023-12-14T14:21:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000045569, 2023-12-14T14:21:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000722860, 2023-12-14T14:21:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3, 2023-12-14T14:21:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000723072, 2023-12-14T14:21:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000241024 2023-12-14T14:21:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-12-14T14:21:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2023-12-14T14:21:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 2, 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 153, 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 320, 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 178656, 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.010014905, 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.006304218, 2023-12-14T14:21:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001589766, 2023-12-14T14:21:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 150, 2023-12-14T14:21:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.010157588, 2023-12-14T14:21:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000067717 2023-12-14T14:21:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-14T14:21:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 178656 2023-12-14T14:21:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 209, 2023-12-14T14:21:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 200, 2023-12-14T14:21:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1282688, 2023-12-14T14:21:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 113824, 2023-12-14T14:21:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2023-12-14T14:21:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2023-12-14T14:21:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.038101299, 2023-12-14T14:21:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.011700963, 2023-12-14T14:21:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.028300989, 2023-12-14T14:21:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.004869984, 2023-12-14T14:21:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 199, 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.011281276, 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000056689 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1282688, 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 113824 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148967, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 29, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2023-12-14T14:21:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2023-12-14T14:21:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2023-12-14T14:21:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2023-12-14T14:21:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2023-12-14T14:21:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 928, 2023-12-14T14:21:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2023-12-14T14:21:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2023-12-14T14:21:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2023-12-14T14:21:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-12-14T14:21:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2023-12-14T14:21:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2023-12-14T14:21:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2023-12-14T14:21:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 211, 2023-12-14T14:21:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1253204, 2023-12-14T14:21:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 211, 2023-12-14T14:21:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2023-12-14T14:21:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2023-12-14T14:21:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 211, 2023-12-14T14:21:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1253204, 2023-12-14T14:21:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2023-12-14T14:21:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2023-12-14T14:21:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2023-12-14T14:21:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2023-12-14T14:21:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-12-14T14:21:11.628 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-12-14T14:21:11.635 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:11 smithi081 ceph-mon[43371]: pgmap v327: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:21:11.635 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:11 smithi081 ceph-mon[43371]: osdmap e94: 12 total, 12 up, 12 in 2023-12-14T14:21:11.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:11 smithi069 ceph-mon[42034]: pgmap v327: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:21:11.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:11 smithi069 ceph-mon[42034]: osdmap e94: 12 total, 12 up, 12 in 2023-12-14T14:21:11.996 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-12-14T14:21:11.996 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-12-14T14:21:11.996 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2023-12-14T14:21:11.996 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2023-12-14T14:21:11.997 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2023-12-14T14:21:11.997 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2023-12-14T14:21:11.997 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2023-12-14T14:21:11.997 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2023-12-14T14:21:11.997 DEBUG:tasks.check_counter:Getting stats from c 2023-12-14T14:21:11.997 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.c perf dump 2023-12-14T14:21:12.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:11 smithi119 ceph-mon[43834]: pgmap v327: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-12-14T14:21:12.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:11 smithi119 ceph-mon[43834]: osdmap e94: 12 total, 12 up, 12 in 2023-12-14T14:21:12.529 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:21:13.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:13 smithi119 ceph-mon[43834]: pgmap v329: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-12-14T14:21:13.795 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T14:21:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1405, 2023-12-14T14:21:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1383, 2023-12-14T14:21:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 47868894, 2023-12-14T14:21:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 478792, 2023-12-14T14:21:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 7, 2023-12-14T14:21:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2023-12-14T14:21:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.174285498, 2023-12-14T14:21:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.045556627, 2023-12-14T14:21:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.080891550, 2023-12-14T14:21:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.041956719, 2023-12-14T14:21:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1383, 2023-12-14T14:21:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.060570892, 2023-12-14T14:21:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000043796 2023-12-14T14:21:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1350832, 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 116784 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 652, 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 802, 2023-12-14T14:21:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 79897572, 2023-12-14T14:21:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 620232, 2023-12-14T14:21:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 9, 2023-12-14T14:21:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 7, 2023-12-14T14:21:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.099857894, 2023-12-14T14:21:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.022366850, 2023-12-14T14:21:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.053586563, 2023-12-14T14:21:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.017232765, 2023-12-14T14:21:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 799, 2023-12-14T14:21:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.039230038, 2023-12-14T14:21:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000049098 2023-12-14T14:21:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 418016 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 758, 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 760, 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 53000955, 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 235745, 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 6, 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 5, 2023-12-14T14:21:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.090291751, 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.023512559, 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.041112131, 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.018987066, 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 758, 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.037020375, 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000048839 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T14:21:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T14:21:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2023-12-14T14:21:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 4114, 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.112666567, 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000027386 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2023-12-14T14:21:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T14:21:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T14:21:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2023-12-14T14:21:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2023-12-14T14:21:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2023-12-14T14:21:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2023-12-14T14:21:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2023-12-14T14:21:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2023-12-14T14:21:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 32530, 2023-12-14T14:21:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2023-12-14T14:21:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 0, 2023-12-14T14:21:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 32530, 2023-12-14T14:21:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 32530, 2023-12-14T14:21:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 130, 2023-12-14T14:21:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2023-12-14T14:21:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2023-12-14T14:21:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 3, 2023-12-14T14:21:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2023-12-14T14:21:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2023-12-14T14:21:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2023-12-14T14:21:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2023-12-14T14:21:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2023-12-14T14:21:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2023-12-14T14:21:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2023-12-14T14:21:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2023-12-14T14:21:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2023-12-14T14:21:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 7, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 246, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 6, 2023-12-14T14:21:13.810 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2023-12-14T14:21:13.811 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2023-12-14T14:21:13.811 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T14:21:13.811 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2023-12-14T14:21:13.811 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2023-12-14T14:21:13.811 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T14:21:13.811 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2023-12-14T14:21:13.811 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2023-12-14T14:21:13.811 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2023-12-14T14:21:13.812 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2023-12-14T14:21:13.812 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2023-12-14T14:21:13.812 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T14:21:13.812 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T14:21:13.812 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T14:21:13.812 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2023-12-14T14:21:13.812 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2023-12-14T14:21:13.812 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2023-12-14T14:21:13.812 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2023-12-14T14:21:13.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.813 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2023-12-14T14:21:13.813 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2023-12-14T14:21:13.813 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2023-12-14T14:21:13.813 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2023-12-14T14:21:13.813 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2023-12-14T14:21:13.813 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2023-12-14T14:21:13.813 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2023-12-14T14:21:13.813 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2023-12-14T14:21:13.814 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2023-12-14T14:21:13.814 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2023-12-14T14:21:13.814 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2023-12-14T14:21:13.814 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2023-12-14T14:21:13.814 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2023-12-14T14:21:13.814 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2023-12-14T14:21:13.814 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2023-12-14T14:21:13.814 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2023-12-14T14:21:13.814 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2023-12-14T14:21:13.815 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2023-12-14T14:21:13.815 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T14:21:13.815 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2023-12-14T14:21:13.815 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2023-12-14T14:21:13.815 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2023-12-14T14:21:13.815 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2023-12-14T14:21:13.815 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2023-12-14T14:21:13.815 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.815 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 0, 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2023-12-14T14:21:13.816 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 76, 2023-12-14T14:21:13.817 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2023-12-14T14:21:13.817 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2023-12-14T14:21:13.817 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2023-12-14T14:21:13.817 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 0, 2023-12-14T14:21:13.817 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 182815593, 2023-12-14T14:21:13.817 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2023-12-14T14:21:13.817 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.817 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.817 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.818 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.818 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 58381 2023-12-14T14:21:13.818 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.818 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2023-12-14T14:21:13.818 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 13829, 2023-12-14T14:21:13.818 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 47782, 2023-12-14T14:21:13.818 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 33953, 2023-12-14T14:21:13.818 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 503, 2023-12-14T14:21:13.818 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 1368, 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 865, 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 32530, 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 64473, 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 31943, 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 127532, 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 207156 2023-12-14T14:21:13.819 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.820 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2023-12-14T14:21:13.820 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2023-12-14T14:21:13.820 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2023-12-14T14:21:13.820 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2023-12-14T14:21:13.820 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2023-12-14T14:21:13.820 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2023-12-14T14:21:13.820 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2023-12-14T14:21:13.820 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.820 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.821 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.821 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.821 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2023-12-14T14:21:13.821 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.821 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.821 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.821 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.821 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2023-12-14T14:21:13.821 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.822 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.822 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.822 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.822 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2023-12-14T14:21:13.822 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.822 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.822 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.822 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.822 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.823 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2023-12-14T14:21:13.824 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.824 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.824 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.824 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.824 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2023-12-14T14:21:13.824 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.824 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.824 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.825 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2023-12-14T14:21:13.825 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.825 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.825 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.825 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2023-12-14T14:21:13.825 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.825 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.826 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.827 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.827 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2023-12-14T14:21:13.827 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.827 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.827 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.827 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2023-12-14T14:21:13.828 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.828 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.828 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.828 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2023-12-14T14:21:13.828 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.828 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.828 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.829 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2023-12-14T14:21:13.829 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.829 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.829 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.829 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2023-12-14T14:21:13.829 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.829 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.829 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.830 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.830 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2023-12-14T14:21:13.830 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.830 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.830 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.830 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.830 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2023-12-14T14:21:13.830 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.830 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.831 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.831 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2023-12-14T14:21:13.831 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.831 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.831 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.831 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2023-12-14T14:21:13.831 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.832 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.832 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.832 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.832 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2023-12-14T14:21:13.832 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.832 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.832 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.832 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.832 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2023-12-14T14:21:13.833 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.833 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.833 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.833 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2023-12-14T14:21:13.833 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.833 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.833 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.834 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2023-12-14T14:21:13.834 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.834 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.834 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.834 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.834 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2023-12-14T14:21:13.834 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.834 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.834 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.835 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.835 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2023-12-14T14:21:13.835 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.835 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.835 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.835 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.835 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2023-12-14T14:21:13.835 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.835 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.836 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.836 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2023-12-14T14:21:13.836 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.836 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.836 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.836 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2023-12-14T14:21:13.836 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 2, 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 5, 2023-12-14T14:21:13.837 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 3, 2023-12-14T14:21:13.838 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 4, 2023-12-14T14:21:13.838 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2023-12-14T14:21:13.838 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2023-12-14T14:21:13.838 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2023-12-14T14:21:13.838 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 5241 2023-12-14T14:21:13.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.838 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2023-12-14T14:21:13.838 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:13.838 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:13.839 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:13.839 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:13.839 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:13.839 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:13.839 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:13.839 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:13.839 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:13.839 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:13.839 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:13.840 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:13.840 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:13.840 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:13.840 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:13.840 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:13.840 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:13.840 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:13.840 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:13.840 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:13.841 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:13.841 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:13.841 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:13.841 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:13.841 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:13.841 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:13.841 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:13.841 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:13.841 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:13.842 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:13.842 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:13.842 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2023-12-14T14:21:13.842 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:13.842 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:13.842 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:13.842 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:13.842 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 709993, 2023-12-14T14:21:13.842 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 13917, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8184, 2023-12-14T14:21:13.843 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 187, 2023-12-14T14:21:13.844 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:13.844 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:13.844 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:13.844 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2023-12-14T14:21:13.844 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 54255854, 2023-12-14T14:21:13.844 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 437323, 2023-12-14T14:21:13.844 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:13.844 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2023-12-14T14:21:13.844 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:13.845 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2023-12-14T14:21:13.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.845 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2023-12-14T14:21:13.845 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2023-12-14T14:21:13.845 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2023-12-14T14:21:13.845 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 2572, 2023-12-14T14:21:13.845 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 26, 2023-12-14T14:21:13.845 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 4, 2023-12-14T14:21:13.845 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 2572, 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2572, 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.864953751, 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000725098 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2572, 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2573 2023-12-14T14:21:13.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 2572, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 2572, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 1624, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 945, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2023-12-14T14:21:13.847 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 2, 2023-12-14T14:21:13.848 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2023-12-14T14:21:13.849 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2023-12-14T14:21:13.850 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2023-12-14T14:21:13.850 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2023-12-14T14:21:13.850 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2023-12-14T14:21:13.850 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2023-12-14T14:21:13.850 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2023-12-14T14:21:13.850 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2023-12-14T14:21:13.850 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2023-12-14T14:21:13.850 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2023-12-14T14:21:13.850 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2023-12-14T14:21:13.851 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2023-12-14T14:21:13.851 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2023-12-14T14:21:13.851 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2023-12-14T14:21:13.851 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2023-12-14T14:21:13.851 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2023-12-14T14:21:13.851 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2023-12-14T14:21:13.851 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2023-12-14T14:21:13.851 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 94, 2023-12-14T14:21:13.851 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 12, 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 11, 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 11, 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.852 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2023-12-14T14:21:13.853 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2023-12-14T14:21:13.853 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2023-12-14T14:21:13.853 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2023-12-14T14:21:13.853 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2023-12-14T14:21:13.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.853 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2023-12-14T14:21:13.853 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2023-12-14T14:21:13.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:13.854 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:13.855 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T14:21:13.855 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:13.855 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 2811, 2023-12-14T14:21:13.855 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 180499334, 2023-12-14T14:21:13.855 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:13.855 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 2811, 2023-12-14T14:21:13.855 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:13.855 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:13.855 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2811, 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 180499334, 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:13.856 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T14:21:13.857 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:13.857 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:13.857 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:13.857 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:13.857 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:13.857 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 2572, 2023-12-14T14:21:13.857 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 178701689, 2023-12-14T14:21:13.857 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2572, 2023-12-14T14:21:13.858 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 178701689, 2023-12-14T14:21:13.858 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:13.858 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.858 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.858 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.858 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:13.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.858 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2023-12-14T14:21:13.858 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:13.859 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2023-12-14T14:21:13.859 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:13.859 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:13.859 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:13.859 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:13.859 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:13.859 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 2572, 2023-12-14T14:21:13.859 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 2572, 2023-12-14T14:21:13.859 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2572, 2023-12-14T14:21:13.860 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 2572, 2023-12-14T14:21:13.860 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:13.860 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.860 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.860 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.860 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:13.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.860 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2023-12-14T14:21:13.860 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T14:21:13.861 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T14:21:13.862 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:13.862 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.862 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.862 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.862 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:13.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:13.862 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x5654da368460": { 2023-12-14T14:21:13.862 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:13.862 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T14:21:13.863 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:13.863 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:13.863 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:13.863 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:13.863 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:13.863 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:13.863 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:13.863 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T14:21:13.863 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T14:21:13.864 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:13.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:13.864 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:13.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:13.864 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:13.864 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:13.864 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T14:21:13.865 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:13 smithi069 ceph-mon[42034]: pgmap v329: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-12-14T14:21:13.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:13 smithi081 ceph-mon[43371]: pgmap v329: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-12-14T14:21:14.178 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-12-14T14:21:14.178 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-12-14T14:21:14.178 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-12-14T14:21:14.179 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-12-14T14:21:14.179 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2023-12-14T14:21:14.179 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-12-14T14:21:14.179 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-12-14T14:21:14.179 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2023-12-14T14:21:14.179 DEBUG:tasks.check_counter:Getting stats from f 2023-12-14T14:21:14.179 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.f perf dump 2023-12-14T14:21:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:21:15.698 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:15 smithi119 ceph-mon[43834]: pgmap v330: 97 pgs: 22 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 65 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:15.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:15 smithi069 ceph-mon[42034]: pgmap v330: 97 pgs: 22 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 65 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:15.863 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T14:21:15.863 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:15.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1863, 2023-12-14T14:21:15.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1863, 2023-12-14T14:21:15.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 173926091, 2023-12-14T14:21:15.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 578604, 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 8, 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.234960625, 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.047879390, 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.116498929, 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.055605455, 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1862, 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.076270609, 2023-12-14T14:21:15.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000040961 2023-12-14T14:21:15.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.865 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:15.865 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.865 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.865 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.865 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-12-14T14:21:15.865 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 448 2023-12-14T14:21:15.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.866 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:15.866 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 325, 2023-12-14T14:21:15.866 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 476, 2023-12-14T14:21:15.866 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 130148779, 2023-12-14T14:21:15.866 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 518707, 2023-12-14T14:21:15.866 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 9, 2023-12-14T14:21:15.866 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 7, 2023-12-14T14:21:15.866 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.104736114, 2023-12-14T14:21:15.866 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.010423978, 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.068363976, 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.022057285, 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 473, 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.018152022, 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000038376 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.867 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 418192 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 859, 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 839, 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 153125020, 2023-12-14T14:21:15.868 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 310210, 2023-12-14T14:21:15.869 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 5, 2023-12-14T14:21:15.869 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2023-12-14T14:21:15.869 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.161531250, 2023-12-14T14:21:15.869 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.025913080, 2023-12-14T14:21:15.869 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.112593059, 2023-12-14T14:21:15.869 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.024458991, 2023-12-14T14:21:15.869 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:15.869 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 838, 2023-12-14T14:21:15.869 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.047453852, 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000056627 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1347952, 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 116768 2023-12-14T14:21:15.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2023-12-14T14:21:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2023-12-14T14:21:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2023-12-14T14:21:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2023-12-14T14:21:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T14:21:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T14:21:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 4327, 2023-12-14T14:21:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.140898158, 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000032562 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.872 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:15.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.873 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2023-12-14T14:21:15.873 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2023-12-14T14:21:15.873 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2023-12-14T14:21:15.873 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2023-12-14T14:21:15.873 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.873 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.873 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.874 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2023-12-14T14:21:15.874 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2023-12-14T14:21:15.874 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2023-12-14T14:21:15.874 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2023-12-14T14:21:15.874 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2023-12-14T14:21:15.874 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2023-12-14T14:21:15.874 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2023-12-14T14:21:15.874 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 105950, 2023-12-14T14:21:15.874 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 249, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 18477, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 87224, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 105593, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 3, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2023-12-14T14:21:15.875 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2023-12-14T14:21:15.876 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2023-12-14T14:21:15.876 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2023-12-14T14:21:15.876 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2023-12-14T14:21:15.876 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2023-12-14T14:21:15.876 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2023-12-14T14:21:15.876 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2023-12-14T14:21:15.876 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2023-12-14T14:21:15.876 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2023-12-14T14:21:15.876 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2023-12-14T14:21:15.877 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2023-12-14T14:21:15.877 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2023-12-14T14:21:15.877 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2023-12-14T14:21:15.877 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2023-12-14T14:21:15.877 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 0, 2023-12-14T14:21:15.877 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 0, 2023-12-14T14:21:15.877 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2023-12-14T14:21:15.877 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2023-12-14T14:21:15.877 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2023-12-14T14:21:15.878 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T14:21:15.878 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2023-12-14T14:21:15.878 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2023-12-14T14:21:15.878 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T14:21:15.878 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2023-12-14T14:21:15.878 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2023-12-14T14:21:15.878 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2023-12-14T14:21:15.878 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2023-12-14T14:21:15.878 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2023-12-14T14:21:15.879 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2023-12-14T14:21:15.880 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2023-12-14T14:21:15.880 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2023-12-14T14:21:15.880 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2023-12-14T14:21:15.880 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2023-12-14T14:21:15.880 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2023-12-14T14:21:15.880 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2023-12-14T14:21:15.880 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2023-12-14T14:21:15.880 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2023-12-14T14:21:15.880 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2023-12-14T14:21:15.881 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2023-12-14T14:21:15.881 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2023-12-14T14:21:15.881 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2023-12-14T14:21:15.881 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2023-12-14T14:21:15.881 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2023-12-14T14:21:15.881 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2023-12-14T14:21:15.881 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2023-12-14T14:21:15.881 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T14:21:15.881 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2023-12-14T14:21:15.882 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2023-12-14T14:21:15.882 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2023-12-14T14:21:15.882 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2023-12-14T14:21:15.882 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2023-12-14T14:21:15.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.882 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2023-12-14T14:21:15.882 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2023-12-14T14:21:15.882 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2023-12-14T14:21:15.882 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2023-12-14T14:21:15.883 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 0, 2023-12-14T14:21:15.883 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2023-12-14T14:21:15.883 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2023-12-14T14:21:15.883 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2023-12-14T14:21:15.883 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2023-12-14T14:21:15.883 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2023-12-14T14:21:15.883 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 131, 2023-12-14T14:21:15.883 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2023-12-14T14:21:15.883 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 128552254, 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 0, 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 458545080, 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 135828 2023-12-14T14:21:15.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 49726, 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 112896, 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 63170, 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 1555, 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 1784, 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 229, 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 105950, 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 158780, 2023-12-14T14:21:15.885 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 52830, 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 288956, 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 207156 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2023-12-14T14:21:15.886 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2023-12-14T14:21:15.887 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2023-12-14T14:21:15.887 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2023-12-14T14:21:15.887 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2023-12-14T14:21:15.887 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.887 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.887 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.887 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2023-12-14T14:21:15.887 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2023-12-14T14:21:15.888 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.889 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.889 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.889 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2023-12-14T14:21:15.889 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.889 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.889 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.889 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.890 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2023-12-14T14:21:15.891 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.891 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.891 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.891 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2023-12-14T14:21:15.891 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.891 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.891 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.893 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2023-12-14T14:21:15.893 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.893 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.893 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.893 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2023-12-14T14:21:15.893 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.893 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.893 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.894 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2023-12-14T14:21:15.894 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.894 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.894 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.894 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2023-12-14T14:21:15.894 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.894 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.895 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.896 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.896 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2023-12-14T14:21:15.896 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.896 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.896 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.896 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2023-12-14T14:21:15.896 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.897 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.897 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.897 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2023-12-14T14:21:15.897 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.897 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.897 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.897 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.898 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.899 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.900 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2023-12-14T14:21:15.901 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.901 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.901 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.901 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2023-12-14T14:21:15.901 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.901 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.901 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.902 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2023-12-14T14:21:15.902 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.902 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.902 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.902 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2023-12-14T14:21:15.902 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2023-12-14T14:21:15.902 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2023-12-14T14:21:15.902 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.903 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.903 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.903 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:15.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.903 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2023-12-14T14:21:15.903 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2023-12-14T14:21:15.903 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 4, 2023-12-14T14:21:15.903 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 3, 2023-12-14T14:21:15.903 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 3, 2023-12-14T14:21:15.904 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2023-12-14T14:21:15.904 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2023-12-14T14:21:15.904 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2023-12-14T14:21:15.904 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 4215 2023-12-14T14:21:15.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.904 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2023-12-14T14:21:15.904 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:15.904 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:15.904 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:15.905 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:15.905 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:15.905 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:15.905 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:15.905 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:15.905 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:15.905 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:15.905 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:15.905 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:15.906 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 1929103, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 49796, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:15.908 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2023-12-14T14:21:15.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2023-12-14T14:21:15.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:15.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:15.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:15.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:15.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8184, 2023-12-14T14:21:15.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 187, 2023-12-14T14:21:15.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:15.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 186602827, 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 1515079, 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.910 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2023-12-14T14:21:15.911 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2023-12-14T14:21:15.911 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2023-12-14T14:21:15.911 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 2804, 2023-12-14T14:21:15.911 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 21, 2023-12-14T14:21:15.911 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 3, 2023-12-14T14:21:15.911 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 2804, 2023-12-14T14:21:15.911 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2023-12-14T14:21:15.911 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2804, 2023-12-14T14:21:15.911 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2.756931525, 2023-12-14T14:21:15.912 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000983213 2023-12-14T14:21:15.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.912 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2023-12-14T14:21:15.912 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2023-12-14T14:21:15.912 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2804, 2023-12-14T14:21:15.912 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2805 2023-12-14T14:21:15.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.912 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 2804, 2023-12-14T14:21:15.912 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 2804, 2023-12-14T14:21:15.913 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2023-12-14T14:21:15.913 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2023-12-14T14:21:15.913 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2023-12-14T14:21:15.913 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 1831, 2023-12-14T14:21:15.913 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2023-12-14T14:21:15.913 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 971, 2023-12-14T14:21:15.913 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2023-12-14T14:21:15.913 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2023-12-14T14:21:15.913 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 1, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2023-12-14T14:21:15.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2023-12-14T14:21:15.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2023-12-14T14:21:15.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2023-12-14T14:21:15.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2023-12-14T14:21:15.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2023-12-14T14:21:15.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2023-12-14T14:21:15.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T14:21:15.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2023-12-14T14:21:15.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2023-12-14T14:21:15.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2023-12-14T14:21:15.916 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 94, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 12, 2023-12-14T14:21:15.917 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 11, 2023-12-14T14:21:15.918 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 11, 2023-12-14T14:21:15.918 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2023-12-14T14:21:15.918 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2023-12-14T14:21:15.918 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2023-12-14T14:21:15.918 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2023-12-14T14:21:15.918 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2023-12-14T14:21:15.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.918 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2023-12-14T14:21:15.918 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2023-12-14T14:21:15.919 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2023-12-14T14:21:15.919 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2023-12-14T14:21:15.919 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2023-12-14T14:21:15.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.919 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2023-12-14T14:21:15.919 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2023-12-14T14:21:15.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.919 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2023-12-14T14:21:15.919 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T14:21:15.920 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:15.921 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 3043, 2023-12-14T14:21:15.921 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 456910917, 2023-12-14T14:21:15.921 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:15.921 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 3043, 2023-12-14T14:21:15.921 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:15.921 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:15.921 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3043, 2023-12-14T14:21:15.921 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 456910917, 2023-12-14T14:21:15.921 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:15.922 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.922 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.922 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.922 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:15.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.922 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2023-12-14T14:21:15.922 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:15.922 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T14:21:15.922 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:15.923 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:15.924 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:15.924 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:15.924 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:15.924 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 2804, 2023-12-14T14:21:15.924 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 455074444, 2023-12-14T14:21:15.925 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2804, 2023-12-14T14:21:15.925 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 455074444, 2023-12-14T14:21:15.925 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:15.925 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.925 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.925 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.925 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:15.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.925 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 2804, 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 2804, 2023-12-14T14:21:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2804, 2023-12-14T14:21:15.927 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 2804, 2023-12-14T14:21:15.927 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:15.927 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.927 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.927 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.927 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:15.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.927 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2023-12-14T14:21:15.927 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T14:21:15.928 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T14:21:15.929 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:15.929 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.929 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.929 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.929 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:15.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:15.929 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x55de0608e460": { 2023-12-14T14:21:15.929 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:15.929 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T14:21:15.930 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:15.931 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:15.931 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:15.931 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:15.931 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:15.931 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:15.931 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T14:21:15.931 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:15 smithi081 ceph-mon[43371]: pgmap v330: 97 pgs: 22 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 65 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:16.249 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-12-14T14:21:16.249 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-12-14T14:21:16.250 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2023-12-14T14:21:16.250 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2023-12-14T14:21:16.250 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2023-12-14T14:21:16.250 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-12-14T14:21:16.250 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-12-14T14:21:16.250 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2023-12-14T14:21:16.250 DEBUG:tasks.check_counter:Getting stats from i 2023-12-14T14:21:16.250 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.i perf dump 2023-12-14T14:21:16.560 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:21:17.618 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T14:21:17.618 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:17.618 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 66305, 2023-12-14T14:21:17.618 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 69912, 2023-12-14T14:21:17.619 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 41238997, 2023-12-14T14:21:17.619 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 326400861, 2023-12-14T14:21:17.619 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 30, 2023-12-14T14:21:17.619 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 7, 2023-12-14T14:21:17.619 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 3.670640560, 2023-12-14T14:21:17.619 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 1.557193148, 2023-12-14T14:21:17.619 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 1.808529224, 2023-12-14T14:21:17.619 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.483337525, 2023-12-14T14:21:17.619 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:17.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 69908, 2023-12-14T14:21:17.620 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 25.788174673, 2023-12-14T14:21:17.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000368887 2023-12-14T14:21:17.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.620 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:17.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 99238, 2023-12-14T14:21:17.620 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.013678905, 2023-12-14T14:21:17.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000137 2023-12-14T14:21:17.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.621 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T14:21:17.621 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 307824 2023-12-14T14:21:17.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.621 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:17.621 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 171433, 2023-12-14T14:21:17.621 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 284337, 2023-12-14T14:21:17.621 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 75586574, 2023-12-14T14:21:17.621 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 388789047, 2023-12-14T14:21:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 7, 2023-12-14T14:21:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 5, 2023-12-14T14:21:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 7.418386086, 2023-12-14T14:21:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 3.839472863, 2023-12-14T14:21:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 13.951942293, 2023-12-14T14:21:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.486059227, 2023-12-14T14:21:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 284339, 2023-12-14T14:21:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 21.952535542, 2023-12-14T14:21:17.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000077205 2023-12-14T14:21:17.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.623 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:17.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 242795, 2023-12-14T14:21:17.623 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.044583288, 2023-12-14T14:21:17.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000183 2023-12-14T14:21:17.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.623 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1365424, 2023-12-14T14:21:17.624 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 127968 2023-12-14T14:21:17.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.624 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:17.624 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 32815, 2023-12-14T14:21:17.624 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 32843, 2023-12-14T14:21:17.624 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 17564143, 2023-12-14T14:21:17.624 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 238077645, 2023-12-14T14:21:17.624 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 23, 2023-12-14T14:21:17.624 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 6, 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 2.367808884, 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.971225370, 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.374677945, 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.915428375, 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 32840, 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 27.427603546, 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000835188 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:17.626 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 40, 2023-12-14T14:21:17.626 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000004820, 2023-12-14T14:21:17.626 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000120 2023-12-14T14:21:17.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.626 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 3632, 2023-12-14T14:21:17.626 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 118272 2023-12-14T14:21:17.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.626 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2023-12-14T14:21:17.627 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2023-12-14T14:21:17.627 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2023-12-14T14:21:17.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.627 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2023-12-14T14:21:17.627 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T14:21:17.627 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T14:21:17.627 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 14515, 2023-12-14T14:21:17.627 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 119.807457726, 2023-12-14T14:21:17.627 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.008254044 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 37879, 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 25.452524171, 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000671942 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:17.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.629 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2023-12-14T14:21:17.629 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 86221, 2023-12-14T14:21:17.629 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 79002, 2023-12-14T14:21:17.629 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2023-12-14T14:21:17.629 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 79002, 2023-12-14T14:21:17.629 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 435.434260546, 2023-12-14T14:21:17.629 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.005511686 2023-12-14T14:21:17.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.629 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 7219, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 707, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 1963, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 194, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 78574, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 2807, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 7723, 2023-12-14T14:21:17.630 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 68044, 2023-12-14T14:21:17.631 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 74565, 2023-12-14T14:21:17.631 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 53589, 2023-12-14T14:21:17.631 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 1, 2023-12-14T14:21:17.631 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 1, 2023-12-14T14:21:17.631 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 5, 2023-12-14T14:21:17.631 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 114292, 2023-12-14T14:21:17.631 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 106456, 2023-12-14T14:21:17.631 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 7209, 2023-12-14T14:21:17.631 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 8, 2023-12-14T14:21:17.632 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 477, 2023-12-14T14:21:17.632 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2023-12-14T14:21:17.632 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2023-12-14T14:21:17.632 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2023-12-14T14:21:17.632 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2023-12-14T14:21:17.632 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 1011, 2023-12-14T14:21:17.632 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 52814, 2023-12-14T14:21:17.632 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 998, 2023-12-14T14:21:17.632 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 20864, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 7, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 246, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 6, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 20864, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T14:21:17.633 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2023-12-14T14:21:17.634 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 3, 2023-12-14T14:21:17.634 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T14:21:17.634 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 3, 2023-12-14T14:21:17.634 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 20861, 2023-12-14T14:21:17.634 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 10, 2023-12-14T14:21:17.634 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 317, 2023-12-14T14:21:17.634 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 50239, 2023-12-14T14:21:17.634 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T14:21:17.634 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T14:21:17.635 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T14:21:17.635 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 55590, 2023-12-14T14:21:17.635 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 55243, 2023-12-14T14:21:17.635 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 368, 2023-12-14T14:21:17.635 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 39322 2023-12-14T14:21:17.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.635 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2023-12-14T14:21:17.635 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 2830, 2023-12-14T14:21:17.635 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 2027, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 1016, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 1082, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 2843, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 3, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 26226, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 26223, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2023-12-14T14:21:17.636 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2023-12-14T14:21:17.637 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2023-12-14T14:21:17.637 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2023-12-14T14:21:17.637 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2023-12-14T14:21:17.637 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2023-12-14T14:21:17.637 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2023-12-14T14:21:17.637 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T14:21:17.637 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 1483, 2023-12-14T14:21:17.637 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2023-12-14T14:21:17.637 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 203, 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 135828, 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 50257, 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 50257, 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 85571, 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2023-12-14T14:21:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 2618, 2023-12-14T14:21:17.639 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 186, 2023-12-14T14:21:17.639 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 58, 2023-12-14T14:21:17.639 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 58, 2023-12-14T14:21:17.639 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 131, 2023-12-14T14:21:17.639 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2023-12-14T14:21:17.639 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 3, 2023-12-14T14:21:17.639 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 128552254, 2023-12-14T14:21:17.639 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 458545654, 2023-12-14T14:21:17.639 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 0, 2023-12-14T14:21:17.640 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2023-12-14T14:21:17.640 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3631, 2023-12-14T14:21:17.640 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 349.699547040, 2023-12-14T14:21:17.640 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.096309431 2023-12-14T14:21:17.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.640 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 0 2023-12-14T14:21:17.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.640 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2023-12-14T14:21:17.640 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 48575, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 123271, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 74696, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 1559, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 2803, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 1244, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 78574, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 158386, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 79812, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 1, 2023-12-14T14:21:17.641 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 57667, 2023-12-14T14:21:17.642 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 57666, 2023-12-14T14:21:17.642 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 389012, 2023-12-14T14:21:17.642 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 198964 2023-12-14T14:21:17.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.642 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2023-12-14T14:21:17.642 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 89706, 2023-12-14T14:21:17.642 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 26, 2023-12-14T14:21:17.642 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 86221, 2023-12-14T14:21:17.642 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 213, 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 56, 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 23774, 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 61.759495173, 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002597774 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 208, 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.525740699, 2023-12-14T14:21:17.643 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002527599 2023-12-14T14:21:17.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.644 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2023-12-14T14:21:17.644 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.644 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.644 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.644 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2023-12-14T14:21:17.644 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.644 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.645 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2023-12-14T14:21:17.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 26225, 2023-12-14T14:21:17.645 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 124.290833610, 2023-12-14T14:21:17.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.004739402 2023-12-14T14:21:17.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.645 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2023-12-14T14:21:17.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.646 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.646 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2023-12-14T14:21:17.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1, 2023-12-14T14:21:17.646 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000097053, 2023-12-14T14:21:17.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000097053 2023-12-14T14:21:17.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.646 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2023-12-14T14:21:17.647 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.647 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.647 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.647 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2023-12-14T14:21:17.647 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.647 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.647 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.648 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2023-12-14T14:21:17.648 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.648 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.648 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.648 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2023-12-14T14:21:17.648 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.648 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.649 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2023-12-14T14:21:17.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.649 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.650 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2023-12-14T14:21:17.650 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.650 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.650 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.650 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2023-12-14T14:21:17.650 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.651 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.651 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2023-12-14T14:21:17.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.651 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.651 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2023-12-14T14:21:17.652 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2568, 2023-12-14T14:21:17.652 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 143.409251200, 2023-12-14T14:21:17.652 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.055844723 2023-12-14T14:21:17.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.652 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2023-12-14T14:21:17.652 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.652 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.653 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2023-12-14T14:21:17.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.653 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.654 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2023-12-14T14:21:17.654 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.654 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.654 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.655 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2023-12-14T14:21:17.655 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3, 2023-12-14T14:21:17.655 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.079418002, 2023-12-14T14:21:17.655 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.026472667 2023-12-14T14:21:17.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.655 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2023-12-14T14:21:17.655 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.656 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.656 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.656 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2023-12-14T14:21:17.656 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.656 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.657 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.657 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2023-12-14T14:21:17.657 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.657 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.657 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.658 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2023-12-14T14:21:17.658 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.658 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.658 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.658 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2023-12-14T14:21:17.659 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.659 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.659 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.659 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2023-12-14T14:21:17.659 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.659 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.659 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.660 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2023-12-14T14:21:17.660 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.660 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.660 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.660 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2023-12-14T14:21:17.660 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.660 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.660 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.661 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2023-12-14T14:21:17.661 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 26223, 2023-12-14T14:21:17.661 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 105.369424809, 2023-12-14T14:21:17.661 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.004018206 2023-12-14T14:21:17.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.661 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2023-12-14T14:21:17.661 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2023-12-14T14:21:17.661 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2023-12-14T14:21:17.662 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.662 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.662 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.662 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:17.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.662 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2023-12-14T14:21:17.662 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2023-12-14T14:21:17.662 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 4, 2023-12-14T14:21:17.662 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 3, 2023-12-14T14:21:17.663 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 1, 2023-12-14T14:21:17.663 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2023-12-14T14:21:17.663 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 32631, 2023-12-14T14:21:17.663 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 32631, 2023-12-14T14:21:17.663 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 633 2023-12-14T14:21:17.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.663 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2023-12-14T14:21:17.663 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:17.663 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:17.664 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:17.665 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:17.665 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:17.665 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:17.665 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:17.665 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:17.665 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:17.665 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:17.665 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:17.665 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:17.666 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:17.666 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:17.666 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:17.666 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:17.666 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:17.666 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:17.667 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:17.667 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:17.667 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:17.667 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:17.667 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:17.667 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2023-12-14T14:21:17.667 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:17.667 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:17.668 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:17.668 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:17.668 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 1714817, 2023-12-14T14:21:17.668 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 41089, 2023-12-14T14:21:17.668 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:17.668 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:17.668 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2023-12-14T14:21:17.669 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2023-12-14T14:21:17.669 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:17.669 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:17.669 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:17.669 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:17.669 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8184, 2023-12-14T14:21:17.669 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 187, 2023-12-14T14:21:17.669 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:17.670 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:17.670 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:17.670 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2023-12-14T14:21:17.670 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 165120792, 2023-12-14T14:21:17.670 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 1472751, 2023-12-14T14:21:17.670 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:17.670 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2023-12-14T14:21:17.671 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:17.671 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2023-12-14T14:21:17.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.671 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2023-12-14T14:21:17.671 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2023-12-14T14:21:17.671 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2023-12-14T14:21:17.671 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 69749, 2023-12-14T14:21:17.671 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 490299626, 2023-12-14T14:21:17.672 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 27, 2023-12-14T14:21:17.672 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 69749, 2023-12-14T14:21:17.672 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2023-12-14T14:21:17.672 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 69749, 2023-12-14T14:21:17.672 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 3104.227662829, 2023-12-14T14:21:17.672 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.044505694 2023-12-14T14:21:17.672 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.673 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2023-12-14T14:21:17.673 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2023-12-14T14:21:17.673 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 69749, 2023-12-14T14:21:17.673 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 99744 2023-12-14T14:21:17.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.673 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 69749, 2023-12-14T14:21:17.673 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 23706, 2023-12-14T14:21:17.674 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 46043, 2023-12-14T14:21:17.674 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2023-12-14T14:21:17.674 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2023-12-14T14:21:17.674 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 400, 2023-12-14T14:21:17.674 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 13434, 2023-12-14T14:21:17.674 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 274, 2023-12-14T14:21:17.674 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 3905, 2023-12-14T14:21:17.674 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 124, 2023-12-14T14:21:17.675 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2023-12-14T14:21:17.675 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2023-12-14T14:21:17.675 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2023-12-14T14:21:17.675 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2023-12-14T14:21:17.675 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 26566, 2023-12-14T14:21:17.675 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2023-12-14T14:21:17.675 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2023-12-14T14:21:17.675 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2023-12-14T14:21:17.675 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 20864, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 26868, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2023-12-14T14:21:17.676 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2023-12-14T14:21:17.677 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2023-12-14T14:21:17.677 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2023-12-14T14:21:17.677 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2023-12-14T14:21:17.677 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2023-12-14T14:21:17.677 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2023-12-14T14:21:17.677 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2023-12-14T14:21:17.677 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2023-12-14T14:21:17.677 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2023-12-14T14:21:17.678 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2023-12-14T14:21:17.678 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2023-12-14T14:21:17.678 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2023-12-14T14:21:17.678 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2023-12-14T14:21:17.678 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2023-12-14T14:21:17.678 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2023-12-14T14:21:17.678 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2023-12-14T14:21:17.678 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2023-12-14T14:21:17.678 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2023-12-14T14:21:17.679 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 94, 2023-12-14T14:21:17.679 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2023-12-14T14:21:17.679 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 12, 2023-12-14T14:21:17.679 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 12, 2023-12-14T14:21:17.679 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 12, 2023-12-14T14:21:17.679 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2023-12-14T14:21:17.680 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2023-12-14T14:21:17.680 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 4002, 2023-12-14T14:21:17.680 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 3275, 2023-12-14T14:21:17.680 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 32 2023-12-14T14:21:17.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.680 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2023-12-14T14:21:17.680 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 1, 2023-12-14T14:21:17.680 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2023-12-14T14:21:17.680 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2023-12-14T14:21:17.681 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2023-12-14T14:21:17.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.681 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2023-12-14T14:21:17.681 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 87933 2023-12-14T14:21:17.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.681 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2023-12-14T14:21:17.681 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2023-12-14T14:21:17.681 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 10, 2023-12-14T14:21:17.682 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2023-12-14T14:21:17.682 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 10, 2023-12-14T14:21:17.682 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 26223, 2023-12-14T14:21:17.682 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2023-12-14T14:21:17.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.682 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:17.682 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:17.682 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T14:21:17.682 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:17.683 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 270549, 2023-12-14T14:21:17.683 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 112300554, 2023-12-14T14:21:17.683 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:17.683 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 270549, 2023-12-14T14:21:17.683 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:17.683 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:17.683 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 270549, 2023-12-14T14:21:17.683 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 112300554, 2023-12-14T14:21:17.684 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:17.684 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.684 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.684 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.684 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:17.684 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.684 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2023-12-14T14:21:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T14:21:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 69749, 2023-12-14T14:21:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 493299159, 2023-12-14T14:21:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 69749, 2023-12-14T14:21:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 493299159, 2023-12-14T14:21:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2023-12-14T14:21:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2023-12-14T14:21:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T14:21:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T14:21:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T14:21:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 69749, 2023-12-14T14:21:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 69749, 2023-12-14T14:21:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 69749, 2023-12-14T14:21:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 69749, 2023-12-14T14:21:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2023-12-14T14:21:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T14:21:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 26223, 2023-12-14T14:21:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 3061987, 2023-12-14T14:21:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 26223, 2023-12-14T14:21:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 274, 2023-12-14T14:21:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 3061987, 2023-12-14T14:21:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x55d5992e80a0": { 2023-12-14T14:21:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T14:21:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 135828, 2023-12-14T14:21:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 454351350, 2023-12-14T14:21:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 135828, 2023-12-14T14:21:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3631, 2023-12-14T14:21:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 454351350, 2023-12-14T14:21:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:17.695 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T14:21:17.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:17 smithi119 ceph-mon[43834]: pgmap v331: 97 pgs: 22 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 65 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:17.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:17 smithi069 ceph-mon[42034]: pgmap v331: 97 pgs: 22 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 65 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:17.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:17 smithi081 ceph-mon[43371]: pgmap v331: 97 pgs: 22 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 65 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:17.974 INFO:tasks.check_counter:Daemon mds.i mds.exported=1011 2023-12-14T14:21:17.975 INFO:tasks.check_counter:Daemon mds.i mds.imported=998 2023-12-14T14:21:17.975 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=2830 2023-12-14T14:21:17.975 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=2027 2023-12-14T14:21:17.975 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2023-12-14T14:21:17.975 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-12-14T14:21:17.975 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-12-14T14:21:17.975 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=194 2023-12-14T14:21:17.975 DEBUG:tasks.check_counter:Getting stats from l 2023-12-14T14:21:17.976 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 -- ceph daemon mds.l perf dump 2023-12-14T14:21:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/mon.c/config 2023-12-14T14:21:19.285 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T14:21:19.285 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T14:21:19.285 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 0, 2023-12-14T14:21:19.285 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2, 2023-12-14T14:21:19.285 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 0, 2023-12-14T14:21:19.286 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 0, 2023-12-14T14:21:19.286 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2023-12-14T14:21:19.286 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 0, 2023-12-14T14:21:19.286 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.001147022, 2023-12-14T14:21:19.286 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.000000000, 2023-12-14T14:21:19.286 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.000308426, 2023-12-14T14:21:19.286 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:19.286 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:19.286 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:19.287 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:19.287 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:19.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.287 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:19.287 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:19.287 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:19.287 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:19.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.287 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T14:21:19.288 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T14:21:19.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.288 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T14:21:19.288 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 6, 2023-12-14T14:21:19.288 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 157, 2023-12-14T14:21:19.288 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 3312, 2023-12-14T14:21:19.288 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 179456, 2023-12-14T14:21:19.288 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 5, 2023-12-14T14:21:19.288 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2023-12-14T14:21:19.289 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.010827220, 2023-12-14T14:21:19.289 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.006258256, 2023-12-14T14:21:19.289 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.002414792, 2023-12-14T14:21:19.289 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T14:21:19.289 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:19.289 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 155, 2023-12-14T14:21:19.289 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.014705100, 2023-12-14T14:21:19.289 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000094871 2023-12-14T14:21:19.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.290 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:19.290 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:19.290 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:19.290 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:19.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.290 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-12-14T14:21:19.290 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 179456 2023-12-14T14:21:19.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.291 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T14:21:19.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 212, 2023-12-14T14:21:19.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 203, 2023-12-14T14:21:19.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1283504, 2023-12-14T14:21:19.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 115600, 2023-12-14T14:21:19.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 2, 2023-12-14T14:21:19.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2023-12-14T14:21:19.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.037698175, 2023-12-14T14:21:19.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.011262609, 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.028507099, 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.004769626, 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 202, 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.010706617, 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000053003 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:19.292 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1283504, 2023-12-14T14:21:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 115600 2023-12-14T14:21:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2023-12-14T14:21:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 0, 2023-12-14T14:21:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2023-12-14T14:21:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2023-12-14T14:21:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2023-12-14T14:21:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2023-12-14T14:21:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T14:21:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2023-12-14T14:21:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T14:21:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2023-12-14T14:21:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T14:21:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T14:21:19.295 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T14:21:19.295 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T14:21:19.295 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T14:21:19.295 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2023-12-14T14:21:19.295 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T14:21:19.295 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T14:21:19.295 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2023-12-14T14:21:19.295 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2023-12-14T14:21:19.295 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2023-12-14T14:21:19.296 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2023-12-14T14:21:19.296 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T14:21:19.296 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T14:21:19.296 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T14:21:19.296 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T14:21:19.296 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T14:21:19.296 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2023-12-14T14:21:19.296 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2023-12-14T14:21:19.296 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2023-12-14T14:21:19.297 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T14:21:19.297 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T14:21:19.297 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2023-12-14T14:21:19.297 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2023-12-14T14:21:19.297 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2023-12-14T14:21:19.297 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2023-12-14T14:21:19.297 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T14:21:19.297 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2023-12-14T14:21:19.297 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T14:21:19.298 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2023-12-14T14:21:19.298 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 149017, 2023-12-14T14:21:19.298 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 31, 2023-12-14T14:21:19.298 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2023-12-14T14:21:19.298 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2023-12-14T14:21:19.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2023-12-14T14:21:19.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2023-12-14T14:21:19.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2023-12-14T14:21:19.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 0, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 0, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 928, 2023-12-14T14:21:19.299 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 2, 2023-12-14T14:21:19.300 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2023-12-14T14:21:19.300 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2023-12-14T14:21:19.300 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2023-12-14T14:21:19.300 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2023-12-14T14:21:19.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T14:21:19.300 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T14:21:19.300 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T14:21:19.300 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T14:21:19.300 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T14:21:19.301 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 214, 2023-12-14T14:21:19.301 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 1253594, 2023-12-14T14:21:19.301 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T14:21:19.301 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 214, 2023-12-14T14:21:19.301 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T14:21:19.301 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T14:21:19.301 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 214, 2023-12-14T14:21:19.301 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1253594, 2023-12-14T14:21:19.301 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T14:21:19.302 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T14:21:19.302 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T14:21:19.302 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T14:21:19.302 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:19.302 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T14:21:19.302 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T14:21:19.666 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2023-12-14T14:21:19.666 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2023-12-14T14:21:19.666 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2023-12-14T14:21:19.666 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2023-12-14T14:21:19.667 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2023-12-14T14:21:19.667 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2023-12-14T14:21:19.667 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2023-12-14T14:21:19.667 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2023-12-14T14:21:19.667 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-14T14:21:19.678 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-14T14:21:19.678 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:21:19.678 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-14T14:21:19.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:19 smithi119 ceph-mon[43834]: pgmap v332: 97 pgs: 22 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 65 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:19.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:19 smithi069 ceph-mon[42034]: pgmap v332: 97 pgs: 22 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 65 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:19.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:19 smithi081 ceph-mon[43371]: pgmap v332: 97 pgs: 22 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 65 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:19.976 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T14:21:19.977 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-14T14:21:20.039 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:21:20.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 -- 172.21.15.69:0/3862340724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01051b0 msgr2=0x7f50c0105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 --2- 172.21.15.69:0/3862340724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01051b0 0x7f50c0105580 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009990 tx=0x7f50b0009ca0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 -- 172.21.15.69:0/3862340724 shutdown_connections 2023-12-14T14:21:20.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 --2- 172.21.15.69:0/3862340724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50c0101390 0x7f50c010d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 --2- 172.21.15.69:0/3862340724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01051b0 0x7f50c0105580 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 --2- 172.21.15.69:0/3862340724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50c01009e0 0x7f50c0100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 -- 172.21.15.69:0/3862340724 >> 172.21.15.69:0/3862340724 conn(0x7f50c0077520 msgr2=0x7f50c0077920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:20.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 -- 172.21.15.69:0/3862340724 shutdown_connections 2023-12-14T14:21:20.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 -- 172.21.15.69:0/3862340724 wait complete. 2023-12-14T14:21:20.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 Processor -- start 2023-12-14T14:21:20.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.216+0000 7f50c63ef700 1 -- start start 2023-12-14T14:21:20.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50c63ef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01009e0 0x7f50c0196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50c63ef700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50c0101390 0x7f50c01968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50c63ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50c01051b0 0x7f50c019ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50c63ef700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019b360 con 0x7f50c01009e0 2023-12-14T14:21:20.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50c63ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019b4d0 con 0x7f50c01051b0 2023-12-14T14:21:20.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50c63ef700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019b690 con 0x7f50c0101390 2023-12-14T14:21:20.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01009e0 0x7f50c0196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01009e0 0x7f50c0196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36532/0 (socket says 172.21.15.69:36532) 2023-12-14T14:21:20.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bffff700 1 -- 172.21.15.69:0/1923674300 learned_addr learned my addr 172.21.15.69:0/1923674300 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:20.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50c498c700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50c01051b0 0x7f50c019ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bf7fe700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50c0101390 0x7f50c01968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bffff700 1 -- 172.21.15.69:0/1923674300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50c0101390 msgr2=0x7f50c01968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bffff700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50c0101390 0x7f50c01968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bffff700 1 -- 172.21.15.69:0/1923674300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50c01051b0 msgr2=0x7f50c019ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bffff700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50c01051b0 0x7f50c019ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bffff700 1 -- 172.21.15.69:0/1923674300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00095f0 con 0x7f50c01009e0 2023-12-14T14:21:20.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.217+0000 7f50bffff700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01009e0 0x7f50c0196380 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f50b00095c0 tx=0x7f50b000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:20.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.218+0000 7f50bd7fa700 1 -- 172.21.15.69:0/1923674300 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b001d070 con 0x7f50c01009e0 2023-12-14T14:21:20.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.218+0000 7f50bd7fa700 1 -- 172.21.15.69:0/1923674300 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50b00054f0 con 0x7f50c01009e0 2023-12-14T14:21:20.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.218+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c0110370 con 0x7f50c01009e0 2023-12-14T14:21:20.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.218+0000 7f50bd7fa700 1 -- 172.21.15.69:0/1923674300 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0004b30 con 0x7f50c01009e0 2023-12-14T14:21:20.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.218+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c01101e0 con 0x7f50c01009e0 2023-12-14T14:21:20.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.219+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c0110500 con 0x7f50c01009e0 2023-12-14T14:21:20.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.220+0000 7f50bd7fa700 1 -- 172.21.15.69:0/1923674300 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f50b000fb80 con 0x7f50c01009e0 2023-12-14T14:21:20.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.220+0000 7f50bd7fa700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50a80a1340 0x7f50a80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.220+0000 7f50bf7fe700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50a80a1340 0x7f50a80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.220+0000 7f50bd7fa700 1 -- 172.21.15.69:0/1923674300 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f50b00cdb30 con 0x7f50c01009e0 2023-12-14T14:21:20.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.221+0000 7f50bf7fe700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50a80a1340 0x7f50a80a37f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f50c0197990 tx=0x7f50b400b5b0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:20.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.224+0000 7f50bd7fa700 1 -- 172.21.15.69:0/1923674300 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f50b0096fc0 con 0x7f50c01009e0 2023-12-14T14:21:20.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.416+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50c01977d0 con 0x7f50c01009e0 2023-12-14T14:21:20.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.418+0000 7f50bd7fa700 1 -- 172.21.15.69:0/1923674300 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+23028 (secure 0 0 0) 0x7f50b009a5e0 con 0x7f50c01009e0 2023-12-14T14:21:20.418 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:21:20.418 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":94,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:21:10.548477+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2692968417":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6801/933503151":"2023-12-15T14:10:38.311291+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3434546944":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/4262786097":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/3288224909":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/933503151":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/590492119":"2023-12-15T14:10:38.311291+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:21:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50a80a1340 msgr2=0x7f50a80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50a80a1340 0x7f50a80a37f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f50c0197990 tx=0x7f50b400b5b0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01009e0 msgr2=0x7f50c0196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01009e0 0x7f50c0196380 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f50b00095c0 tx=0x7f50b000f690 comp rx=0 tx=0).stop 2023-12-14T14:21:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 shutdown_connections 2023-12-14T14:21:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f50a80a1340 0x7f50a80a37f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50c01051b0 0x7f50c019ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50c01009e0 0x7f50c0196380 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 --2- 172.21.15.69:0/1923674300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50c0101390 0x7f50c01968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 >> 172.21.15.69:0/1923674300 conn(0x7f50c0077520 msgr2=0x7f50c00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:20.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 shutdown_connections 2023-12-14T14:21:20.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.420+0000 7f50c63ef700 1 -- 172.21.15.69:0/1923674300 wait complete. 2023-12-14T14:21:20.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T14:05:58.851367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T14:09:08.720147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T14:09:09.776845+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T14:21:20.434 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T14:21:20.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.560+0000 7ff8440fe700 1 -- 172.21.15.69:0/2329550704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 msgr2=0x7ff83c0ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.560+0000 7ff8440fe700 1 --2- 172.21.15.69:0/2329550704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 0x7ff83c0ff760 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff8380099c0 tx=0x7ff838009cd0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.560+0000 7ff8440fe700 1 -- 172.21.15.69:0/2329550704 shutdown_connections 2023-12-14T14:21:20.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.560+0000 7ff8440fe700 1 --2- 172.21.15.69:0/2329550704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c1043d0 0x7ff83c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.560+0000 7ff8440fe700 1 --2- 172.21.15.69:0/2329550704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 0x7ff83c0ff760 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.560+0000 7ff8440fe700 1 --2- 172.21.15.69:0/2329550704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff83c0ffd30 0x7ff83c103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.560+0000 7ff8440fe700 1 -- 172.21.15.69:0/2329550704 >> 172.21.15.69:0/2329550704 conn(0x7ff83c075fd0 msgr2=0x7ff83c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:20.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.560+0000 7ff8440fe700 1 -- 172.21.15.69:0/2329550704 shutdown_connections 2023-12-14T14:21:20.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.560+0000 7ff8440fe700 1 -- 172.21.15.69:0/2329550704 wait complete. 2023-12-14T14:21:20.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff8440fe700 1 Processor -- start 2023-12-14T14:21:20.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff8440fe700 1 -- start start 2023-12-14T14:21:20.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff8440fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 0x7ff83c195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff8440fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff83c0ffd30 0x7ff83c195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff8440fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c1043d0 0x7ff83c199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff8440fe700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c19a2f0 con 0x7ff83c0ff390 2023-12-14T14:21:20.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff8440fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c19a460 con 0x7ff83c1043d0 2023-12-14T14:21:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff8440fe700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c19a620 con 0x7ff83c0ffd30 2023-12-14T14:21:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841e9a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 0x7ff83c195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841e9a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 0x7ff83c195310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36562/0 (socket says 172.21.15.69:36562) 2023-12-14T14:21:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841e9a700 1 -- 172.21.15.69:0/4273804676 learned_addr learned my addr 172.21.15.69:0/4273804676 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841699700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff83c0ffd30 0x7ff83c195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff84269b700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c1043d0 0x7ff83c199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841e9a700 1 -- 172.21.15.69:0/4273804676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff83c0ffd30 msgr2=0x7ff83c195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841e9a700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff83c0ffd30 0x7ff83c195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841e9a700 1 -- 172.21.15.69:0/4273804676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c1043d0 msgr2=0x7ff83c199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841e9a700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c1043d0 0x7ff83c199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841e9a700 1 -- 172.21.15.69:0/4273804676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8380095f0 con 0x7ff83c0ff390 2023-12-14T14:21:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff84269b700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c1043d0 0x7ff83c199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:21:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.561+0000 7ff841e9a700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 0x7ff83c195310 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff838009990 tx=0x7ff83800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.562+0000 7ff832ffd700 1 -- 172.21.15.69:0/4273804676 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83801d070 con 0x7ff83c0ff390 2023-12-14T14:21:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.562+0000 7ff832ffd700 1 -- 172.21.15.69:0/4273804676 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8380054f0 con 0x7ff83c0ff390 2023-12-14T14:21:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.562+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c10f1e0 con 0x7ff83c0ff390 2023-12-14T14:21:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.562+0000 7ff832ffd700 1 -- 172.21.15.69:0/4273804676 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838004ae0 con 0x7ff83c0ff390 2023-12-14T14:21:20.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.562+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c10f050 con 0x7ff83c0ff390 2023-12-14T14:21:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.563+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c10f370 con 0x7ff83c0ff390 2023-12-14T14:21:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.564+0000 7ff832ffd700 1 -- 172.21.15.69:0/4273804676 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff83800fb80 con 0x7ff83c0ff390 2023-12-14T14:21:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.564+0000 7ff832ffd700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff8280a1340 0x7ff8280a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.564+0000 7ff841699700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff8280a1340 0x7ff8280a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.564+0000 7ff832ffd700 1 -- 172.21.15.69:0/4273804676 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8542+0+0 (secure 0 0 0) 0x7ff8380cdf70 con 0x7ff83c0ff390 2023-12-14T14:21:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.565+0000 7ff841699700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff8280a1340 0x7ff8280a37f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff83c196920 tx=0x7ff82c009260 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.568+0000 7ff832ffd700 1 -- 172.21.15.69:0/4273804676 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff8380973a0 con 0x7ff83c0ff390 2023-12-14T14:21:20.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.756+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff83c1a2380 con 0x7ff83c0ff390 2023-12-14T14:21:20.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.756+0000 7ff832ffd700 1 -- 172.21.15.69:0/4273804676 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff83809a9c0 con 0x7ff83c0ff390 2023-12-14T14:21:20.757 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T14:21:20.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff8280a1340 msgr2=0x7ff8280a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff8280a1340 0x7ff8280a37f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff83c196920 tx=0x7ff82c009260 comp rx=0 tx=0).stop 2023-12-14T14:21:20.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 msgr2=0x7ff83c195310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 0x7ff83c195310 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff838009990 tx=0x7ff83800f690 comp rx=0 tx=0).stop 2023-12-14T14:21:20.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 shutdown_connections 2023-12-14T14:21:20.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7ff8280a1340 0x7ff8280a37f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c1043d0 0x7ff83c199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff83c0ff390 0x7ff83c195310 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 --2- 172.21.15.69:0/4273804676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff83c0ffd30 0x7ff83c195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 >> 172.21.15.69:0/4273804676 conn(0x7ff83c075fd0 msgr2=0x7ff83c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:20.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 shutdown_connections 2023-12-14T14:21:20.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.758+0000 7ff8440fe700 1 -- 172.21.15.69:0/4273804676 wait complete. 2023-12-14T14:21:20.769 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:20 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1923674300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:21:20.771 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T14:21:20.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.894+0000 7f136cec9700 1 -- 172.21.15.69:0/1612829318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13681043f0 msgr2=0x7f136810bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 --2- 172.21.15.69:0/1612829318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13681043f0 0x7f136810bfc0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f136000b0d0 tx=0x7f136000b3e0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 -- 172.21.15.69:0/1612829318 shutdown_connections 2023-12-14T14:21:20.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 --2- 172.21.15.69:0/1612829318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13681043f0 0x7f136810bfc0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 --2- 172.21.15.69:0/1612829318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13680ff3b0 0x7f13680ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 --2- 172.21.15.69:0/1612829318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13680ffd50 0x7f1368103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 -- 172.21.15.69:0/1612829318 >> 172.21.15.69:0/1612829318 conn(0x7f1368075f70 msgr2=0x7f1368076370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 -- 172.21.15.69:0/1612829318 shutdown_connections 2023-12-14T14:21:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 -- 172.21.15.69:0/1612829318 wait complete. 2023-12-14T14:21:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 Processor -- start 2023-12-14T14:21:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.895+0000 7f136cec9700 1 -- start start 2023-12-14T14:21:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136cec9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13680ff3b0 0x7f1368197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136cec9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13680ffd50 0x7f1368197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136cec9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13681043f0 0x7f13681a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136cec9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1368198170 con 0x7f13680ff3b0 2023-12-14T14:21:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136cec9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13681a2910 con 0x7f13680ffd50 2023-12-14T14:21:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136cec9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13681a2a50 con 0x7f13681043f0 2023-12-14T14:21:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13680ff3b0 0x7f1368197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13680ff3b0 0x7f1368197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36580/0 (socket says 172.21.15.69:36580) 2023-12-14T14:21:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136659c700 1 -- 172.21.15.69:0/4164730510 learned_addr learned my addr 172.21.15.69:0/4164730510 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f1366d9d700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13681043f0 0x7f13681a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f1365d9b700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13680ffd50 0x7f1368197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136659c700 1 -- 172.21.15.69:0/4164730510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13681043f0 msgr2=0x7f13681a23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136659c700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13681043f0 0x7f13681a23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136659c700 1 -- 172.21.15.69:0/4164730510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13680ffd50 msgr2=0x7f1368197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136659c700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13680ffd50 0x7f1368197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136659c700 1 -- 172.21.15.69:0/4164730510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360009d00 con 0x7f13680ff3b0 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f1365d9b700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13680ffd50 0x7f1368197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136659c700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13680ff3b0 0x7f1368197350 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f135800d950 tx=0x7f135800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f13577fe700 1 -- 172.21.15.69:0/4164730510 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358009940 con 0x7f13680ff3b0 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136810f1c0 con 0x7f13680ff3b0 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f13577fe700 1 -- 172.21.15.69:0/4164730510 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1358010460 con 0x7f13680ff3b0 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f13577fe700 1 -- 172.21.15.69:0/4164730510 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135800f620 con 0x7f13680ff3b0 2023-12-14T14:21:20.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.896+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136810f030 con 0x7f13680ff3b0 2023-12-14T14:21:20.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.897+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1368067e40 con 0x7f13680ff3b0 2023-12-14T14:21:20.902 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:20 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1923674300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:21:20.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.898+0000 7f13577fe700 1 -- 172.21.15.69:0/4164730510 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f13580108d0 con 0x7f13680ff3b0 2023-12-14T14:21:20.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.899+0000 7f13577fe700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13500a12c0 0x7f13500a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:20.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.899+0000 7f1365d9b700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13500a12c0 0x7f13500a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:20.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.899+0000 7f13577fe700 1 -- 172.21.15.69:0/4164730510 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f13580ccb50 con 0x7f13680ff3b0 2023-12-14T14:21:20.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.899+0000 7f1365d9b700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13500a12c0 0x7f13500a3770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f135c005fd0 tx=0x7f135c005d40 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:20.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:20.902+0000 7f13577fe700 1 -- 172.21.15.69:0/4164730510 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1358095f50 con 0x7f13680ff3b0 2023-12-14T14:21:21.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:20 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1923674300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:21:21.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.091+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13680695e0 con 0x7f13680ff3b0 2023-12-14T14:21:21.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.091+0000 7f13577fe700 1 -- 172.21.15.69:0/4164730510 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1358016020 con 0x7f13680ff3b0 2023-12-14T14:21:21.092 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T14:21:21.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13500a12c0 msgr2=0x7f13500a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13500a12c0 0x7f13500a3770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f135c005fd0 tx=0x7f135c005d40 comp rx=0 tx=0).stop 2023-12-14T14:21:21.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13680ff3b0 msgr2=0x7f1368197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13680ff3b0 0x7f1368197350 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f135800d950 tx=0x7f135800dc60 comp rx=0 tx=0).stop 2023-12-14T14:21:21.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 shutdown_connections 2023-12-14T14:21:21.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f13500a12c0 0x7f13500a3770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13681043f0 0x7f13681a23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13680ff3b0 0x7f1368197350 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 --2- 172.21.15.69:0/4164730510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13680ffd50 0x7f1368197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 >> 172.21.15.69:0/4164730510 conn(0x7f1368075f70 msgr2=0x7f13680fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:21.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 shutdown_connections 2023-12-14T14:21:21.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.093+0000 7f136cec9700 1 -- 172.21.15.69:0/4164730510 wait complete. 2023-12-14T14:21:21.106 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T14:21:21.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.230+0000 7f1188b80700 1 -- 172.21.15.69:0/1072776323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 msgr2=0x7f118410d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.230+0000 7f1188b80700 1 --2- 172.21.15.69:0/1072776323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 0x7f118410d0c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f117c00b0d0 tx=0x7f117c00b3e0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.230+0000 7f1188b80700 1 -- 172.21.15.69:0/1072776323 shutdown_connections 2023-12-14T14:21:21.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.230+0000 7f1188b80700 1 --2- 172.21.15.69:0/1072776323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 0x7f118410d0c0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.230+0000 7f1188b80700 1 --2- 172.21.15.69:0/1072776323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11840690f0 0x7f11840694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.230+0000 7f1188b80700 1 --2- 172.21.15.69:0/1072776323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1184069a90 0x7f1184104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.230+0000 7f1188b80700 1 -- 172.21.15.69:0/1072776323 >> 172.21.15.69:0/1072776323 conn(0x7f1184075fa0 msgr2=0x7f11840763a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:21.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.230+0000 7f1188b80700 1 -- 172.21.15.69:0/1072776323 shutdown_connections 2023-12-14T14:21:21.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.230+0000 7f1188b80700 1 -- 172.21.15.69:0/1072776323 wait complete. 2023-12-14T14:21:21.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.231+0000 7f1188b80700 1 Processor -- start 2023-12-14T14:21:21.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.231+0000 7f1188b80700 1 -- start start 2023-12-14T14:21:21.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.231+0000 7f1188b80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11840690f0 0x7f11841964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:21.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.231+0000 7f1188b80700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1184069a90 0x7f1184196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:21.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.231+0000 7f1188b80700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 0x7f118419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:21.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.231+0000 7f1188b80700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118419b4c0 con 0x7f11841054f0 2023-12-14T14:21:21.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.231+0000 7f1188b80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118419b630 con 0x7f11840690f0 2023-12-14T14:21:21.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.231+0000 7f1188b80700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118419b7f0 con 0x7f1184069a90 2023-12-14T14:21:21.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.231+0000 7f1182d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 0x7f118419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:21.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1182d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 0x7f118419ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36586/0 (socket says 172.21.15.69:36586) 2023-12-14T14:21:21.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1182d9d700 1 -- 172.21.15.69:0/3018484611 learned_addr learned my addr 172.21.15.69:0/3018484611 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:21.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f118259c700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11840690f0 0x7f11841964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:21.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1181d9b700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1184069a90 0x7f1184196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:21.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1182d9d700 1 -- 172.21.15.69:0/3018484611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1184069a90 msgr2=0x7f1184196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1182d9d700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1184069a90 0x7f1184196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1182d9d700 1 -- 172.21.15.69:0/3018484611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11840690f0 msgr2=0x7f11841964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1182d9d700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11840690f0 0x7f11841964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1182d9d700 1 -- 172.21.15.69:0/3018484611 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c009d00 con 0x7f11841054f0 2023-12-14T14:21:21.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1182d9d700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 0x7f118419ae80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f117c007820 tx=0x7f117c007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:21.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f11737fe700 1 -- 172.21.15.69:0/3018484611 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c00e040 con 0x7f11841054f0 2023-12-14T14:21:21.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f11737fe700 1 -- 172.21.15.69:0/3018484611 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f117c003e10 con 0x7f11841054f0 2023-12-14T14:21:21.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1184110310 con 0x7f11841054f0 2023-12-14T14:21:21.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f11737fe700 1 -- 172.21.15.69:0/3018484611 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c01b890 con 0x7f11841054f0 2023-12-14T14:21:21.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.232+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1184110180 con 0x7f11841054f0 2023-12-14T14:21:21.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.233+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11841104a0 con 0x7f11841054f0 2023-12-14T14:21:21.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.234+0000 7f11737fe700 1 -- 172.21.15.69:0/3018484611 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f117c024400 con 0x7f11841054f0 2023-12-14T14:21:21.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.235+0000 7f11737fe700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f116c0a1340 0x7f116c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:21.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.235+0000 7f118259c700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f116c0a1340 0x7f116c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:21.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.235+0000 7f11737fe700 1 -- 172.21.15.69:0/3018484611 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8542+0+0 (secure 0 0 0) 0x7f117c0ce2d0 con 0x7f11841054f0 2023-12-14T14:21:21.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.235+0000 7f118259c700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f116c0a1340 0x7f116c0a37f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1174005950 tx=0x7f117400b410 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:21.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.239+0000 7f11737fe700 1 -- 172.21.15.69:0/3018484611 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f117c097700 con 0x7f11841054f0 2023-12-14T14:21:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.429+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11841a3550 con 0x7f11841054f0 2023-12-14T14:21:21.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.429+0000 7f11737fe700 1 -- 172.21.15.69:0/3018484611 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f117c09ad20 con 0x7f11841054f0 2023-12-14T14:21:21.430 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T14:21:21.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f116c0a1340 msgr2=0x7f116c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f116c0a1340 0x7f116c0a37f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1174005950 tx=0x7f117400b410 comp rx=0 tx=0).stop 2023-12-14T14:21:21.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 msgr2=0x7f118419ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 0x7f118419ae80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f117c007820 tx=0x7f117c007850 comp rx=0 tx=0).stop 2023-12-14T14:21:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 shutdown_connections 2023-12-14T14:21:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f116c0a1340 0x7f116c0a37f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11841054f0 0x7f118419ae80 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11840690f0 0x7f11841964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 --2- 172.21.15.69:0/3018484611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1184069a90 0x7f1184196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.431+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 >> 172.21.15.69:0/3018484611 conn(0x7f1184075fa0 msgr2=0x7f11840fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.432+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 shutdown_connections 2023-12-14T14:21:21.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.432+0000 7f1188b80700 1 -- 172.21.15.69:0/3018484611 wait complete. 2023-12-14T14:21:21.444 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-14T14:21:21.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.567+0000 7f6147888700 1 -- 172.21.15.69:0/610815194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 msgr2=0x7f614010bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.567+0000 7f6147888700 1 --2- 172.21.15.69:0/610815194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 0x7f614010bed0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f613800b0a0 tx=0x7f613800b3b0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.567+0000 7f6147888700 1 -- 172.21.15.69:0/610815194 shutdown_connections 2023-12-14T14:21:21.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.567+0000 7f6147888700 1 --2- 172.21.15.69:0/610815194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 0x7f614010bed0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.567+0000 7f6147888700 1 --2- 172.21.15.69:0/610815194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6140100540 0x7f6140100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.567+0000 7f6147888700 1 --2- 172.21.15.69:0/610815194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140100e50 0x7f61401095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.567+0000 7f6147888700 1 -- 172.21.15.69:0/610815194 >> 172.21.15.69:0/610815194 conn(0x7f61400749c0 msgr2=0x7f6140074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.567+0000 7f6147888700 1 -- 172.21.15.69:0/610815194 shutdown_connections 2023-12-14T14:21:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.567+0000 7f6147888700 1 -- 172.21.15.69:0/610815194 wait complete. 2023-12-14T14:21:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6147888700 1 Processor -- start 2023-12-14T14:21:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6147888700 1 -- start start 2023-12-14T14:21:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6147888700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140100540 0x7f6140197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6147888700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6140100e50 0x7f61401977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6147888700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 0x7f61401a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:21.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6147888700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61401a2840 con 0x7f6140109af0 2023-12-14T14:21:21.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6147888700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61401a2980 con 0x7f6140100e50 2023-12-14T14:21:21.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6147888700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61401a2ac0 con 0x7f6140100540 2023-12-14T14:21:21.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6145e25700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 0x7f61401a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:21.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6145e25700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 0x7f61401a2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36604/0 (socket says 172.21.15.69:36604) 2023-12-14T14:21:21.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6145e25700 1 -- 172.21.15.69:0/4145416103 learned_addr learned my addr 172.21.15.69:0/4145416103 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:21.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6144e23700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6140100e50 0x7f61401977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:21.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6145624700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140100540 0x7f6140197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:21.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6145e25700 1 -- 172.21.15.69:0/4145416103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140100540 msgr2=0x7f6140197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6145e25700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140100540 0x7f6140197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6145e25700 1 -- 172.21.15.69:0/4145416103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6140100e50 msgr2=0x7f61401977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6145e25700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6140100e50 0x7f61401977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.568+0000 7f6145e25700 1 -- 172.21.15.69:0/4145416103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138009d00 con 0x7f6140109af0 2023-12-14T14:21:21.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.569+0000 7f6145e25700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 0x7f61401a2300 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6138007990 tx=0x7f61380079c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:21.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.569+0000 7f61327fc700 1 -- 172.21.15.69:0/4145416103 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613800e040 con 0x7f6140109af0 2023-12-14T14:21:21.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.569+0000 7f61327fc700 1 -- 172.21.15.69:0/4145416103 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6138004c50 con 0x7f6140109af0 2023-12-14T14:21:21.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.569+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614010f170 con 0x7f6140109af0 2023-12-14T14:21:21.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.569+0000 7f61327fc700 1 -- 172.21.15.69:0/4145416103 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380052a0 con 0x7f6140109af0 2023-12-14T14:21:21.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.569+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614010efe0 con 0x7f6140109af0 2023-12-14T14:21:21.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.570+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614010f300 con 0x7f6140109af0 2023-12-14T14:21:21.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.571+0000 7f61327fc700 1 -- 172.21.15.69:0/4145416103 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f613801d470 con 0x7f6140109af0 2023-12-14T14:21:21.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.571+0000 7f61327fc700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f612c0a12c0 0x7f612c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:21.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.572+0000 7f61327fc700 1 -- 172.21.15.69:0/4145416103 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f61380ce9c0 con 0x7f6140109af0 2023-12-14T14:21:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.572+0000 7f6145624700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f612c0a12c0 0x7f612c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.572+0000 7f6145624700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f612c0a12c0 0x7f612c0a3770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6134005fd0 tx=0x7f6134005f60 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.575+0000 7f61327fc700 1 -- 172.21.15.69:0/4145416103 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6138097e70 con 0x7f6140109af0 2023-12-14T14:21:21.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.782+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6140067e40 con 0x7f6140109af0 2023-12-14T14:21:21.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.783+0000 7f61327fc700 1 -- 172.21.15.69:0/4145416103 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v95) v1 ==== 81+0+1000 (secure 0 0 0) 0x7f613809b490 con 0x7f6140109af0 2023-12-14T14:21:21.783 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/2692968417 2023-12-15T14:10:38.311291+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/394074805 2023-12-15T14:03:50.725434+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/1599224275 2023-12-15T14:04:10.545422+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1590117205 2023-12-15T14:03:50.725434+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/1599224275 2023-12-15T14:04:10.545422+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/933503151 2023-12-15T14:10:38.311291+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/3548022044 2023-12-15T14:03:50.725434+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/2490315530 2023-12-15T14:03:50.725434+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/3548022044 2023-12-15T14:03:50.725434+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3934974409 2023-12-15T14:04:10.545422+0000 2023-12-14T14:21:21.784 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3434546944 2023-12-15T14:10:38.311291+0000 2023-12-14T14:21:21.785 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1558519947 2023-12-15T14:04:10.545422+0000 2023-12-14T14:21:21.785 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/4262786097 2023-12-15T14:10:38.311291+0000 2023-12-14T14:21:21.785 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3288224909 2023-12-15T14:10:38.311291+0000 2023-12-14T14:21:21.785 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/4026355192 2023-12-15T14:04:10.545422+0000 2023-12-14T14:21:21.785 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/933503151 2023-12-15T14:10:38.311291+0000 2023-12-14T14:21:21.785 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/590492119 2023-12-15T14:10:38.311291+0000 2023-12-14T14:21:21.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f612c0a12c0 msgr2=0x7f612c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f612c0a12c0 0x7f612c0a3770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6134005fd0 tx=0x7f6134005f60 comp rx=0 tx=0).stop 2023-12-14T14:21:21.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 msgr2=0x7f61401a2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:21.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 0x7f61401a2300 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6138007990 tx=0x7f61380079c0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 shutdown_connections 2023-12-14T14:21:21.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f612c0a12c0 0x7f612c0a3770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140109af0 0x7f61401a2300 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140100540 0x7f6140197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 --2- 172.21.15.69:0/4145416103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6140100e50 0x7f61401977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:21.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 >> 172.21.15.69:0/4145416103 conn(0x7f61400749c0 msgr2=0x7f61400fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:21.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 shutdown_connections 2023-12-14T14:21:21.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:21.785+0000 7f6147888700 1 -- 172.21.15.69:0/4145416103 wait complete. 2023-12-14T14:21:21.788 INFO:teuthology.orchestra.run.smithi069.stderr:listed 17 entries 2023-12-14T14:21:21.796 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:21 smithi069 ceph-mon[42034]: pgmap v333: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:21.796 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:21 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4273804676' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:21:21.797 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:21 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4164730510' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:21:21.797 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:21 smithi069 ceph-mon[42034]: osdmap e95: 12 total, 12 up, 12 in 2023-12-14T14:21:21.797 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:21 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3018484611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:21:21.798 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-14T14:21:21.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:21:21.798 DEBUG:teuthology.orchestra.run.smithi069:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-14T14:21:21.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:21 smithi081 ceph-mon[43371]: pgmap v333: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:21.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:21 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4273804676' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:21:21.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:21 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4164730510' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:21:21.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:21 smithi081 ceph-mon[43371]: osdmap e95: 12 total, 12 up, 12 in 2023-12-14T14:21:21.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:21 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3018484611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:21:21.985 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T14:21:21.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:21:21.986 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-14T14:21:22.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:21 smithi119 ceph-mon[43834]: pgmap v333: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:22.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:21 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4273804676' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T14:21:22.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:21 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4164730510' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T14:21:22.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:21 smithi119 ceph-mon[43834]: osdmap e95: 12 total, 12 up, 12 in 2023-12-14T14:21:22.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:21 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3018484611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T14:21:22.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:21:22.066 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-12-14T14:21:22.145 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-14T14:21:22.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:21:22.145 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-14T14:21:22.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T14:21:22.188 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-12-14T14:21:22.295 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-14T14:21:22.319 INFO:tasks.cephadm:Teardown begin 2023-12-14T14:21:22.319 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-14T14:21:22.319 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:21:22.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.443+0000 7fa0acdac700 1 -- 172.21.15.69:0/328216033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101430 msgr2=0x7fa0a8101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:22.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.443+0000 7fa0acdac700 1 --2- 172.21.15.69:0/328216033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101430 0x7fa0a8101800 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009990 tx=0x7fa09c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.443+0000 7fa0acdac700 1 -- 172.21.15.69:0/328216033 shutdown_connections 2023-12-14T14:21:22.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.443+0000 7fa0acdac700 1 --2- 172.21.15.69:0/328216033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a810a770 0x7fa0a810cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.443+0000 7fa0acdac700 1 --2- 172.21.15.69:0/328216033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101430 0x7fa0a8101800 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.444+0000 7fa0acdac700 1 --2- 172.21.15.69:0/328216033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a8101d40 0x7fa0a810a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.444+0000 7fa0acdac700 1 -- 172.21.15.69:0/328216033 >> 172.21.15.69:0/328216033 conn(0x7fa0a8076370 msgr2=0x7fa0a8076770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:22.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.444+0000 7fa0acdac700 1 -- 172.21.15.69:0/328216033 shutdown_connections 2023-12-14T14:21:22.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.444+0000 7fa0acdac700 1 -- 172.21.15.69:0/328216033 wait complete. 2023-12-14T14:21:22.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.444+0000 7fa0acdac700 1 Processor -- start 2023-12-14T14:21:22.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.444+0000 7fa0acdac700 1 -- start start 2023-12-14T14:21:22.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.444+0000 7fa0acdac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a8101430 0x7fa0a8196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:22.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0acdac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101d40 0x7fa0a8196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:22.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0acdac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a810a770 0x7fa0a819adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:22.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0acdac700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a819b3f0 con 0x7fa0a8101d40 2023-12-14T14:21:22.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0acdac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a819b560 con 0x7fa0a810a770 2023-12-14T14:21:22.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0acdac700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a819b720 con 0x7fa0a8101430 2023-12-14T14:21:22.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101d40 0x7fa0a8196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:22.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101d40 0x7fa0a8196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36632/0 (socket says 172.21.15.69:36632) 2023-12-14T14:21:22.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a5d9b700 1 -- 172.21.15.69:0/1821321671 learned_addr learned my addr 172.21.15.69:0/1821321671 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:22.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a659c700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a8101430 0x7fa0a8196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:22.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a6d9d700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a810a770 0x7fa0a819adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:22.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a5d9b700 1 -- 172.21.15.69:0/1821321671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a8101430 msgr2=0x7fa0a8196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:22.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a5d9b700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a8101430 0x7fa0a8196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a5d9b700 1 -- 172.21.15.69:0/1821321671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a810a770 msgr2=0x7fa0a819adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:22.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a5d9b700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a810a770 0x7fa0a819adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a5d9b700 1 -- 172.21.15.69:0/1821321671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0095f0 con 0x7fa0a8101d40 2023-12-14T14:21:22.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a6d9d700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a810a770 0x7fa0a819adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:21:22.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0a5d9b700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101d40 0x7fa0a8196950 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa09800b530 tx=0x7fa09800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:22.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0977fe700 1 -- 172.21.15.69:0/1821321671 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098011830 con 0x7fa0a8101d40 2023-12-14T14:21:22.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0977fe700 1 -- 172.21.15.69:0/1821321671 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa098011e50 con 0x7fa0a8101d40 2023-12-14T14:21:22.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a8110300 con 0x7fa0a8101d40 2023-12-14T14:21:22.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0977fe700 1 -- 172.21.15.69:0/1821321671 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09800f2e0 con 0x7fa0a8101d40 2023-12-14T14:21:22.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.445+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a8110170 con 0x7fa0a8101d40 2023-12-14T14:21:22.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.447+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a8110490 con 0x7fa0a8101d40 2023-12-14T14:21:22.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.448+0000 7fa0977fe700 1 -- 172.21.15.69:0/1821321671 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa098010380 con 0x7fa0a8101d40 2023-12-14T14:21:22.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.448+0000 7fa0977fe700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa0900a12c0 0x7fa0900a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:22.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.448+0000 7fa0977fe700 1 -- 172.21.15.69:0/1821321671 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8498+0+0 (secure 0 0 0) 0x7fa0980cc740 con 0x7fa0a8101d40 2023-12-14T14:21:22.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.448+0000 7fa0a659c700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa0900a12c0 0x7fa0900a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:22.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.449+0000 7fa0a659c700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa0900a12c0 0x7fa0900a3770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00b5c0 tx=0x7fa09c005fb0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:22.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.452+0000 7fa0977fe700 1 -- 172.21.15.69:0/1821321671 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa098095c70 con 0x7fa0a8101d40 2023-12-14T14:21:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.685+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0a80679f0 con 0x7fa0a8101d40 2023-12-14T14:21:22.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.685+0000 7fa0977fe700 1 -- 172.21.15.69:0/1821321671 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+10801 (secure 0 0 0) 0x7fa098099290 con 0x7fa0a8101d40 2023-12-14T14:21:22.687 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:21:22.687 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:19:58.550404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:21:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa0900a12c0 msgr2=0x7fa0900a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa0900a12c0 0x7fa0900a3770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00b5c0 tx=0x7fa09c005fb0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101d40 msgr2=0x7fa0a8196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101d40 0x7fa0a8196950 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa09800b530 tx=0x7fa09800b840 comp rx=0 tx=0).stop 2023-12-14T14:21:22.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 shutdown_connections 2023-12-14T14:21:22.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7fa0900a12c0 0x7fa0900a3770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a810a770 0x7fa0a819adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a8101430 0x7fa0a8196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 --2- 172.21.15.69:0/1821321671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0a8101d40 0x7fa0a8196950 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 >> 172.21.15.69:0/1821321671 conn(0x7fa0a8076370 msgr2=0x7fa0a81021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 shutdown_connections 2023-12-14T14:21:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.687+0000 7fa0acdac700 1 -- 172.21.15.69:0/1821321671 wait complete. 2023-12-14T14:21:22.692 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 33 2023-12-14T14:21:22.701 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T14:21:22.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.824+0000 7f8e01590700 1 -- 172.21.15.69:0/603471251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc10a7e0 msgr2=0x7f8dfc10cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:22.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.824+0000 7f8e01590700 1 --2- 172.21.15.69:0/603471251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc10a7e0 0x7f8dfc10cc40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8df400b0a0 tx=0x7f8df400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.824+0000 7f8e01590700 1 -- 172.21.15.69:0/603471251 shutdown_connections 2023-12-14T14:21:22.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.824+0000 7f8e01590700 1 --2- 172.21.15.69:0/603471251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc10a7e0 0x7f8dfc10cc40 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.824+0000 7f8e01590700 1 --2- 172.21.15.69:0/603471251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc1014a0 0x7f8dfc101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.824+0000 7f8e01590700 1 --2- 172.21.15.69:0/603471251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dfc101db0 0x7f8dfc10a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.824+0000 7f8e01590700 1 -- 172.21.15.69:0/603471251 >> 172.21.15.69:0/603471251 conn(0x7f8dfc0761d0 msgr2=0x7f8dfc0765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:22.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.824+0000 7f8e01590700 1 -- 172.21.15.69:0/603471251 shutdown_connections 2023-12-14T14:21:22.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.824+0000 7f8e01590700 1 -- 172.21.15.69:0/603471251 wait complete. 2023-12-14T14:21:22.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8e01590700 1 Processor -- start 2023-12-14T14:21:22.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8e01590700 1 -- start start 2023-12-14T14:21:22.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8e01590700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc1014a0 0x7f8dfc0ff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:22.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8e01590700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc101db0 0x7f8dfc0ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:22.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8e01590700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dfc10a7e0 0x7f8dfc1a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:22.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8e01590700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0ffe60 con 0x7f8dfc1014a0 2023-12-14T14:21:22.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8e01590700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1a4b60 con 0x7f8dfc101db0 2023-12-14T14:21:22.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8e01590700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1a4ca0 con 0x7f8dfc10a7e0 2023-12-14T14:21:22.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc1014a0 0x7f8dfc0ff0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:22.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc1014a0 0x7f8dfc0ff0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36660/0 (socket says 172.21.15.69:36660) 2023-12-14T14:21:22.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfaffd700 1 -- 172.21.15.69:0/3250566196 learned_addr learned my addr 172.21.15.69:0/3250566196 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:22.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfa7fc700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc101db0 0x7f8dfc0ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:22.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfaffd700 1 -- 172.21.15.69:0/3250566196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dfc10a7e0 msgr2=0x7f8dfc1a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:22.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfb7fe700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dfc10a7e0 0x7f8dfc1a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:22.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfaffd700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dfc10a7e0 0x7f8dfc1a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfaffd700 1 -- 172.21.15.69:0/3250566196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc101db0 msgr2=0x7f8dfc0ff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:22.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfaffd700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc101db0 0x7f8dfc0ff630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:22.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfaffd700 1 -- 172.21.15.69:0/3250566196 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4009d00 con 0x7f8dfc1014a0 2023-12-14T14:21:22.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfa7fc700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc101db0 0x7f8dfc0ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:21:22.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.825+0000 7f8dfb7fe700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dfc10a7e0 0x7f8dfc1a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:21:22.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.826+0000 7f8dfaffd700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc1014a0 0x7f8dfc0ff0f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8df000d980 tx=0x7f8df000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:22.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.826+0000 7f8de3fff700 1 -- 172.21.15.69:0/3250566196 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df000bb60 con 0x7f8dfc1014a0 2023-12-14T14:21:22.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.826+0000 7f8de3fff700 1 -- 172.21.15.69:0/3250566196 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df0007640 con 0x7f8dfc1014a0 2023-12-14T14:21:22.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.826+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc1102a0 con 0x7f8dfc1014a0 2023-12-14T14:21:22.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.826+0000 7f8de3fff700 1 -- 172.21.15.69:0/3250566196 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0004e90 con 0x7f8dfc1014a0 2023-12-14T14:21:22.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.826+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc110110 con 0x7f8dfc1014a0 2023-12-14T14:21:22.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.827+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc110430 con 0x7f8dfc1014a0 2023-12-14T14:21:22.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.828+0000 7f8de3fff700 1 -- 172.21.15.69:0/3250566196 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8df000bcc0 con 0x7f8dfc1014a0 2023-12-14T14:21:22.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.828+0000 7f8de3fff700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8de40a12c0 0x7f8de40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:22.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.828+0000 7f8de3fff700 1 -- 172.21.15.69:0/3250566196 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f8df00ccba0 con 0x7f8dfc1014a0 2023-12-14T14:21:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.828+0000 7f8dfa7fc700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8de40a12c0 0x7f8de40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.829+0000 7f8dfa7fc700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8de40a12c0 0x7f8de40a3770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8dec005e10 tx=0x7f8dec005d80 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:22.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:22.833+0000 7f8de3fff700 1 -- 172.21.15.69:0/3250566196 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8df0099a50 con 0x7f8dfc1014a0 2023-12-14T14:21:22.840 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:22 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/4145416103' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-14T14:21:22.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:22 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/4145416103' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-14T14:21:23.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:22 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/4145416103' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-14T14:21:23.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.063+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dfc067160 con 0x7f8dfc1014a0 2023-12-14T14:21:23.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.064+0000 7f8de3fff700 1 -- 172.21.15.69:0/3250566196 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f8df0016020 con 0x7f8dfc1014a0 2023-12-14T14:21:23.065 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:21:23.065 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4120690062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4120690062},{"type":"v1","addr":"172.21.15.69:6835","nonce":4120690062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/4121849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":4121849780},{"type":"v1","addr":"172.21.15.69:6837","nonce":4121849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3643556663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3643556663},{"type":"v1","addr":"172.21.15.69:6839","nonce":3643556663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2792118918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2792118918},{"type":"v1","addr":"172.21.15.69:6841","nonce":2792118918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3794904365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3794904365},{"type":"v1","addr":"172.21.15.119:6833","nonce":3794904365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2145103323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2145103323},{"type":"v1","addr":"172.21.15.81:6833","nonce":2145103323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T14:09:10.598197+0000","modified":"2023-12-14T14:19:58.550404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24469,"mds_2":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/3775706969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3775706969},{"type":"v1","addr":"172.21.15.81:6835","nonce":3775706969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/594041854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":594041854},{"type":"v1","addr":"172.21.15.119:6835","nonce":594041854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2082956632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2082956632},{"type":"v1","addr":"172.21.15.119:6837","nonce":2082956632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24467":{"gid":24467,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3031029983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3031029983},{"type":"v1","addr":"172.21.15.81:6837","nonce":3031029983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.119:6839/1957200331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1957200331},{"type":"v1","addr":"172.21.15.119:6839","nonce":1957200331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6839/2690299654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":2690299654},{"type":"v1","addr":"172.21.15.81:6839","nonce":2690299654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T14:21:23.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8de40a12c0 msgr2=0x7f8de40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8de40a12c0 0x7f8de40a3770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8dec005e10 tx=0x7f8dec005d80 comp rx=0 tx=0).stop 2023-12-14T14:21:23.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc1014a0 msgr2=0x7f8dfc0ff0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc1014a0 0x7f8dfc0ff0f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8df000d980 tx=0x7f8df000dd40 comp rx=0 tx=0).stop 2023-12-14T14:21:23.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 shutdown_connections 2023-12-14T14:21:23.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f8de40a12c0 0x7f8de40a3770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dfc10a7e0 0x7f8dfc1a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8dfc1014a0 0x7f8dfc0ff0f0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 --2- 172.21.15.69:0/3250566196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc101db0 0x7f8dfc0ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 >> 172.21.15.69:0/3250566196 conn(0x7f8dfc0761d0 msgr2=0x7f8dfc0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:23.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 shutdown_connections 2023-12-14T14:21:23.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.066+0000 7f8e01590700 1 -- 172.21.15.69:0/3250566196 wait complete. 2023-12-14T14:21:23.072 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 33 2023-12-14T14:21:23.079 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T14:21:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.200+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/1061565860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc8101d40 msgr2=0x7f2bc810a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.200+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/1061565860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc8101d40 0x7f2bc810a230 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8009990 tx=0x7f2bb8009ca0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.200+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/1061565860 shutdown_connections 2023-12-14T14:21:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.200+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/1061565860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc810a770 0x7f2bc810cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.200+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/1061565860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101430 0x7f2bc8101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.200+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/1061565860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc8101d40 0x7f2bc810a230 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.200+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/1061565860 >> 172.21.15.69:0/1061565860 conn(0x7f2bc8076370 msgr2=0x7f2bc8076770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:23.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.200+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/1061565860 shutdown_connections 2023-12-14T14:21:23.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.200+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/1061565860 wait complete. 2023-12-14T14:21:23.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bcdfe7700 1 Processor -- start 2023-12-14T14:21:23.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bcdfe7700 1 -- start start 2023-12-14T14:21:23.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bcdfe7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc8101430 0x7f2bc8196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:23.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bcdfe7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101d40 0x7f2bc81968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:23.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bcdfe7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc810a770 0x7f2bc819ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:23.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bcdfe7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc819b360 con 0x7f2bc810a770 2023-12-14T14:21:23.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bcdfe7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc819b4d0 con 0x7f2bc8101d40 2023-12-14T14:21:23.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bcdfe7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc819b690 con 0x7f2bc8101430 2023-12-14T14:21:23.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc810a770 0x7f2bc819ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:23.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc810a770 0x7f2bc819ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36684/0 (socket says 172.21.15.69:36684) 2023-12-14T14:21:23.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101d40 0x7f2bc81968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:23.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc7fff700 1 -- 172.21.15.69:0/306908921 learned_addr learned my addr 172.21.15.69:0/306908921 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:23.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc77fe700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc8101430 0x7f2bc8196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:23.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc7fff700 1 -- 172.21.15.69:0/306908921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc8101430 msgr2=0x7f2bc8196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc7fff700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc8101430 0x7f2bc8196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc7fff700 1 -- 172.21.15.69:0/306908921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101d40 msgr2=0x7f2bc81968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc7fff700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101d40 0x7f2bc81968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.201+0000 7f2bc7fff700 1 -- 172.21.15.69:0/306908921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80095f0 con 0x7f2bc810a770 2023-12-14T14:21:23.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.202+0000 7f2bc7fff700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc810a770 0x7f2bc819ad20 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0007ee0 tx=0x7f2bc000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:23.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.202+0000 7f2bc4ff9700 1 -- 172.21.15.69:0/306908921 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0017070 con 0x7f2bc810a770 2023-12-14T14:21:23.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.202+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc8110290 con 0x7f2bc810a770 2023-12-14T14:21:23.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.202+0000 7f2bc4ff9700 1 -- 172.21.15.69:0/306908921 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bc000f040 con 0x7f2bc810a770 2023-12-14T14:21:23.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.202+0000 7f2bc4ff9700 1 -- 172.21.15.69:0/306908921 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0005580 con 0x7f2bc810a770 2023-12-14T14:21:23.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.202+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc8110100 con 0x7f2bc810a770 2023-12-14T14:21:23.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.203+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc8110420 con 0x7f2bc810a770 2023-12-14T14:21:23.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.204+0000 7f2bc4ff9700 1 -- 172.21.15.69:0/306908921 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2bc000db20 con 0x7f2bc810a770 2023-12-14T14:21:23.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.204+0000 7f2bc4ff9700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2bb00a12c0 0x7f2bb00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:23.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.205+0000 7f2bc77fe700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2bb00a12c0 0x7f2bb00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:23.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.205+0000 7f2bc4ff9700 1 -- 172.21.15.69:0/306908921 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f2bc00cc480 con 0x7f2bc810a770 2023-12-14T14:21:23.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.205+0000 7f2bc77fe700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2bb00a12c0 0x7f2bb00a3770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc007be0 tx=0x7f2bbc0073d0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:23.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.209+0000 7f2bc4ff9700 1 -- 172.21.15.69:0/306908921 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2bc0095840 con 0x7f2bc810a770 2023-12-14T14:21:23.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.399+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bc81976d0 con 0x7f2bc810a770 2023-12-14T14:21:23.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.400+0000 7f2bc4ff9700 1 -- 172.21.15.69:0/306908921 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+22961 (secure 0 0 0) 0x7f2bc0098e60 con 0x7f2bc810a770 2023-12-14T14:21:23.401 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T14:21:23.402 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":95,"fsid":"5d58180a-9a89-11ee-95a3-87774f69a715","created":"2023-12-14T14:03:27.637317+0000","modified":"2023-12-14T14:21:21.425243+0000","last_up_change":"2023-12-14T14:08:37.670103+0000","last_in_change":"2023-12-14T14:08:21.162510+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T14:05:58.851367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T14:09:08.720147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T14:09:09.776845+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626f1f59-a1b9-4b5a-a8ad-3f2866697db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6803","nonce":3233163239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6805","nonce":3233163239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6809","nonce":3233163239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3233163239},{"type":"v1","addr":"172.21.15.69:6807","nonce":3233163239}]},"public_addr":"172.21.15.69:6803/3233163239","cluster_addr":"172.21.15.69:6805/3233163239","heartbeat_back_addr":"172.21.15.69:6809/3233163239","heartbeat_front_addr":"172.21.15.69:6807/3233163239","state":["exists","up"]},{"osd":1,"uuid":"bc3f5476-3f7e-4f95-ba27-a01e51228939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6801","nonce":3099180120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6803","nonce":3099180120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6807","nonce":3099180120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3099180120},{"type":"v1","addr":"172.21.15.81:6805","nonce":3099180120}]},"public_addr":"172.21.15.81:6801/3099180120","cluster_addr":"172.21.15.81:6803/3099180120","heartbeat_back_addr":"172.21.15.81:6807/3099180120","heartbeat_front_addr":"172.21.15.81:6805/3099180120","state":["exists","up"]},{"osd":2,"uuid":"cec31ae4-c25e-460e-9522-7924fed2ec9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6801","nonce":715893428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6803","nonce":715893428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6807","nonce":715893428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":715893428},{"type":"v1","addr":"172.21.15.119:6805","nonce":715893428}]},"public_addr":"172.21.15.119:6801/715893428","cluster_addr":"172.21.15.119:6803/715893428","heartbeat_back_addr":"172.21.15.119:6807/715893428","heartbeat_front_addr":"172.21.15.119:6805/715893428","state":["exists","up"]},{"osd":3,"uuid":"dcee4795-1084-4049-bae8-b982198f8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6811","nonce":3681148736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6813","nonce":3681148736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6817","nonce":3681148736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3681148736},{"type":"v1","addr":"172.21.15.69:6815","nonce":3681148736}]},"public_addr":"172.21.15.69:6811/3681148736","cluster_addr":"172.21.15.69:6813/3681148736","heartbeat_back_addr":"172.21.15.69:6817/3681148736","heartbeat_front_addr":"172.21.15.69:6815/3681148736","state":["exists","up"]},{"osd":4,"uuid":"f27f286d-c5ed-4fed-8624-0ec67bc590fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6809","nonce":2435197817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6811","nonce":2435197817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6815","nonce":2435197817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2435197817},{"type":"v1","addr":"172.21.15.81:6813","nonce":2435197817}]},"public_addr":"172.21.15.81:6809/2435197817","cluster_addr":"172.21.15.81:6811/2435197817","heartbeat_back_addr":"172.21.15.81:6815/2435197817","heartbeat_front_addr":"172.21.15.81:6813/2435197817","state":["exists","up"]},{"osd":5,"uuid":"2e65ea32-885b-41d1-a325-922ff4f66117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6809","nonce":1604753767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6811","nonce":1604753767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6815","nonce":1604753767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1604753767},{"type":"v1","addr":"172.21.15.119:6813","nonce":1604753767}]},"public_addr":"172.21.15.119:6809/1604753767","cluster_addr":"172.21.15.119:6811/1604753767","heartbeat_back_addr":"172.21.15.119:6815/1604753767","heartbeat_front_addr":"172.21.15.119:6813/1604753767","state":["exists","up"]},{"osd":6,"uuid":"edda790d-463a-4082-b2ca-c569272907ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6819","nonce":3585699442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6821","nonce":3585699442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6825","nonce":3585699442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3585699442},{"type":"v1","addr":"172.21.15.69:6823","nonce":3585699442}]},"public_addr":"172.21.15.69:6819/3585699442","cluster_addr":"172.21.15.69:6821/3585699442","heartbeat_back_addr":"172.21.15.69:6825/3585699442","heartbeat_front_addr":"172.21.15.69:6823/3585699442","state":["exists","up"]},{"osd":7,"uuid":"0ef2f893-b375-4221-be5e-25e21d60006e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6817","nonce":3166058431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6819","nonce":3166058431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6823","nonce":3166058431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3166058431},{"type":"v1","addr":"172.21.15.81:6821","nonce":3166058431}]},"public_addr":"172.21.15.81:6817/3166058431","cluster_addr":"172.21.15.81:6819/3166058431","heartbeat_back_addr":"172.21.15.81:6823/3166058431","heartbeat_front_addr":"172.21.15.81:6821/3166058431","state":["exists","up"]},{"osd":8,"uuid":"4d90c4bb-61c8-4b80-b910-afcc2a88230c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6817","nonce":2165709611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6819","nonce":2165709611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6823","nonce":2165709611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2165709611},{"type":"v1","addr":"172.21.15.119:6821","nonce":2165709611}]},"public_addr":"172.21.15.119:6817/2165709611","cluster_addr":"172.21.15.119:6819/2165709611","heartbeat_back_addr":"172.21.15.119:6823/2165709611","heartbeat_front_addr":"172.21.15.119:6821/2165709611","state":["exists","up"]},{"osd":9,"uuid":"d0b1e8ff-4f3c-43b5-88eb-e6da09577292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6827","nonce":1244156926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6829","nonce":1244156926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6833","nonce":1244156926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":1244156926},{"type":"v1","addr":"172.21.15.69:6831","nonce":1244156926}]},"public_addr":"172.21.15.69:6827/1244156926","cluster_addr":"172.21.15.69:6829/1244156926","heartbeat_back_addr":"172.21.15.69:6833/1244156926","heartbeat_front_addr":"172.21.15.69:6831/1244156926","state":["exists","up"]},{"osd":10,"uuid":"3627e9bc-5957-42e7-866f-f085f0b28e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6825","nonce":2804287254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6827","nonce":2804287254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6831","nonce":2804287254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2804287254},{"type":"v1","addr":"172.21.15.81:6829","nonce":2804287254}]},"public_addr":"172.21.15.81:6825/2804287254","cluster_addr":"172.21.15.81:6827/2804287254","heartbeat_back_addr":"172.21.15.81:6831/2804287254","heartbeat_front_addr":"172.21.15.81:6829/2804287254","state":["exists","up"]},{"osd":11,"uuid":"59f201a4-0834-4f62-9904-fc42f0fb70e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6825","nonce":3145725966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6827","nonce":3145725966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6831","nonce":3145725966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3145725966},{"type":"v1","addr":"172.21.15.119:6829","nonce":3145725966}]},"public_addr":"172.21.15.119:6825/3145725966","cluster_addr":"172.21.15.119:6827/3145725966","heartbeat_back_addr":"172.21.15.119:6831/3145725966","heartbeat_front_addr":"172.21.15.119:6829/3145725966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:22.089422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:39.411877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:05:56.666117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:14.511734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:31.813886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:06:49.418992+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:07.135637+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:25.351653+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:07:43.092170+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:00.619674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:18.273834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T14:08:35.811427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2692968417":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/394074805":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/1590117205":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6801/1599224275":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6801/933503151":"2023-12-15T14:10:38.311291+0000","172.21.15.69:6801/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/2490315530":"2023-12-15T14:03:50.725434+0000","172.21.15.69:6800/3548022044":"2023-12-15T14:03:50.725434+0000","172.21.15.69:0/3934974409":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/3434546944":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/1558519947":"2023-12-15T14:04:10.545422+0000","172.21.15.69:0/4262786097":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/3288224909":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/4026355192":"2023-12-15T14:04:10.545422+0000","172.21.15.69:6800/933503151":"2023-12-15T14:10:38.311291+0000","172.21.15.69:0/590492119":"2023-12-15T14:10:38.311291+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T14:21:23.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2bb00a12c0 msgr2=0x7f2bb00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2bb00a12c0 0x7f2bb00a3770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc007be0 tx=0x7f2bbc0073d0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc810a770 msgr2=0x7f2bc819ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc810a770 0x7f2bc819ad20 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0007ee0 tx=0x7f2bc000d3b0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 shutdown_connections 2023-12-14T14:21:23.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2bb00a12c0 0x7f2bb00a3770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc810a770 0x7f2bc819ad20 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc8101430 0x7f2bc8196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 --2- 172.21.15.69:0/306908921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101d40 0x7f2bc81968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 >> 172.21.15.69:0/306908921 conn(0x7f2bc8076370 msgr2=0x7f2bc81021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:23.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 shutdown_connections 2023-12-14T14:21:23.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.402+0000 7f2bcdfe7700 1 -- 172.21.15.69:0/306908921 wait complete. 2023-12-14T14:21:23.417 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-14T14:21:23.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.540+0000 7f2db8fdb700 1 -- 172.21.15.69:0/884818368 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 msgr2=0x7f2db4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.540+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/884818368 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 0x7f2db4103d30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2da40099c0 tx=0x7f2da4009cd0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.540+0000 7f2db8fdb700 1 -- 172.21.15.69:0/884818368 shutdown_connections 2023-12-14T14:21:23.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.540+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/884818368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db4104410 0x7f2db410bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.540+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/884818368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db40ff3d0 0x7f2db40ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.540+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/884818368 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 0x7f2db4103d30 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.540+0000 7f2db8fdb700 1 -- 172.21.15.69:0/884818368 >> 172.21.15.69:0/884818368 conn(0x7f2db4076000 msgr2=0x7f2db4076400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.540+0000 7f2db8fdb700 1 -- 172.21.15.69:0/884818368 shutdown_connections 2023-12-14T14:21:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.540+0000 7f2db8fdb700 1 -- 172.21.15.69:0/884818368 wait complete. 2023-12-14T14:21:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db8fdb700 1 Processor -- start 2023-12-14T14:21:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db8fdb700 1 -- start start 2023-12-14T14:21:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db8fdb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db40ff3d0 0x7f2db4196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db8fdb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 0x7f2db4196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db8fdb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db4104410 0x7f2db419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db8fdb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db419b400 con 0x7f2db40ffd70 2023-12-14T14:21:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db8fdb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db419b570 con 0x7f2db40ff3d0 2023-12-14T14:21:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db8fdb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db419b730 con 0x7f2db4104410 2023-12-14T14:21:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db1d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 0x7f2db4196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db1d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 0x7f2db4196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36698/0 (socket says 172.21.15.69:36698) 2023-12-14T14:21:23.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db1d9b700 1 -- 172.21.15.69:0/555547298 learned_addr learned my addr 172.21.15.69:0/555547298 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:23.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.541+0000 7f2db2d9d700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db4104410 0x7f2db419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:23.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db259c700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db40ff3d0 0x7f2db4196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:23.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db1d9b700 1 -- 172.21.15.69:0/555547298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db4104410 msgr2=0x7f2db419adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db1d9b700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db4104410 0x7f2db419adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db1d9b700 1 -- 172.21.15.69:0/555547298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db40ff3d0 msgr2=0x7f2db4196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:23.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db1d9b700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db40ff3d0 0x7f2db4196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:23.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db1d9b700 1 -- 172.21.15.69:0/555547298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da40095f0 con 0x7f2db40ffd70 2023-12-14T14:21:23.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db259c700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db40ff3d0 0x7f2db4196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:21:23.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db1d9b700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 0x7f2db4196960 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009990 tx=0x7f2da4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:23.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2dab7fe700 1 -- 172.21.15.69:0/555547298 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da401d070 con 0x7f2db40ffd70 2023-12-14T14:21:23.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2dab7fe700 1 -- 172.21.15.69:0/555547298 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2da4003f90 con 0x7f2db40ffd70 2023-12-14T14:21:23.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db410f1e0 con 0x7f2db40ffd70 2023-12-14T14:21:23.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2dab7fe700 1 -- 172.21.15.69:0/555547298 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400fd60 con 0x7f2db40ffd70 2023-12-14T14:21:23.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.542+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db410f050 con 0x7f2db40ffd70 2023-12-14T14:21:23.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.543+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db410f370 con 0x7f2db40ffd70 2023-12-14T14:21:23.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.544+0000 7f2dab7fe700 1 -- 172.21.15.69:0/555547298 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2da400f460 con 0x7f2db40ffd70 2023-12-14T14:21:23.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.544+0000 7f2dab7fe700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2da00a1340 0x7f2da00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:23.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.545+0000 7f2dab7fe700 1 -- 172.21.15.69:0/555547298 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8498+0+0 (secure 0 0 0) 0x7f2da40cdb30 con 0x7f2db40ffd70 2023-12-14T14:21:23.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.545+0000 7f2db259c700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2da00a1340 0x7f2da00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:23.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.545+0000 7f2db259c700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2da00a1340 0x7f2da00a37f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c005fd0 tx=0x7f2d9c005ee0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:23.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.549+0000 7f2dab7fe700 1 -- 172.21.15.69:0/555547298 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2da4096f80 con 0x7f2db40ffd70 2023-12-14T14:21:23.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:23.782+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2db4197770 con 0x7f2db40ffd70 2023-12-14T14:21:23.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:23 smithi069 ceph-mon[42034]: pgmap v335: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:23.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:23 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/1821321671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:21:23.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:23 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3250566196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:21:23.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:23 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/306908921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:21:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:23 smithi081 ceph-mon[43371]: pgmap v335: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:23 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/1821321671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:21:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:23 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3250566196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:21:23.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:23 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/306908921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:21:24.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:23 smithi119 ceph-mon[43834]: pgmap v335: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-12-14T14:21:24.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:23 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/1821321671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:21:24.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:23 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3250566196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T14:21:24.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:23 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/306908921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T14:21:24.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.576+0000 7f2dab7fe700 1 -- 172.21.15.69:0/555547298 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2da409a5a0 con 0x7f2db40ffd70 2023-12-14T14:21:24.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2da00a1340 msgr2=0x7f2da00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:24.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2da00a1340 0x7f2da00a37f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c005fd0 tx=0x7f2d9c005ee0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 msgr2=0x7f2db4196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:24.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 0x7f2db4196960 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009990 tx=0x7f2da4009580 comp rx=0 tx=0).stop 2023-12-14T14:21:24.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 shutdown_connections 2023-12-14T14:21:24.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f2da00a1340 0x7f2da00a37f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db4104410 0x7f2db419adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db40ff3d0 0x7f2db4196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 --2- 172.21.15.69:0/555547298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2db40ffd70 0x7f2db4196960 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 >> 172.21.15.69:0/555547298 conn(0x7f2db4076000 msgr2=0x7f2db4068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:24.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 shutdown_connections 2023-12-14T14:21:24.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.579+0000 7f2db8fdb700 1 -- 172.21.15.69:0/555547298 wait complete. 2023-12-14T14:21:24.582 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-14T14:21:24.594 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-14T14:21:24.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 -- 172.21.15.69:0/2118202655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140104840 msgr2=0x7f6140104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:24.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 --2- 172.21.15.69:0/2118202655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140104840 0x7f6140104c10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f61340099c0 tx=0x7f6134009cd0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 -- 172.21.15.69:0/2118202655 shutdown_connections 2023-12-14T14:21:24.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 --2- 172.21.15.69:0/2118202655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140103c10 0x7f614010b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 --2- 172.21.15.69:0/2118202655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140104840 0x7f6140104c10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 --2- 172.21.15.69:0/2118202655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61401051e0 0x7f61401034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 -- 172.21.15.69:0/2118202655 >> 172.21.15.69:0/2118202655 conn(0x7f61400749c0 msgr2=0x7f6140074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:24.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 -- 172.21.15.69:0/2118202655 shutdown_connections 2023-12-14T14:21:24.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 -- 172.21.15.69:0/2118202655 wait complete. 2023-12-14T14:21:24.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.727+0000 7f6145b8e700 1 Processor -- start 2023-12-14T14:21:24.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f6145b8e700 1 -- start start 2023-12-14T14:21:24.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f6145b8e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140103c10 0x7f61401963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:24.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f6145b8e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140104840 0x7f61401968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:24.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f6145b8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61401051e0 0x7f614019acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:24.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f6145b8e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614019b330 con 0x7f6140103c10 2023-12-14T14:21:24.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f6145b8e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614019b4a0 con 0x7f61401051e0 2023-12-14T14:21:24.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f6145b8e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614019b660 con 0x7f6140104840 2023-12-14T14:21:24.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140103c10 0x7f61401963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:24.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140103c10 0x7f61401963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36710/0 (socket says 172.21.15.69:36710) 2023-12-14T14:21:24.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613f7fe700 1 -- 172.21.15.69:0/3407774694 learned_addr learned my addr 172.21.15.69:0/3407774694 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:24.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613effd700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140104840 0x7f61401968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:24.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613ffff700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61401051e0 0x7f614019acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:24.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613f7fe700 1 -- 172.21.15.69:0/3407774694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140104840 msgr2=0x7f61401968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:24.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613f7fe700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140104840 0x7f61401968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613f7fe700 1 -- 172.21.15.69:0/3407774694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61401051e0 msgr2=0x7f614019acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:24.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613f7fe700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61401051e0 0x7f614019acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:24.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613f7fe700 1 -- 172.21.15.69:0/3407774694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340095f0 con 0x7f6140103c10 2023-12-14T14:21:24.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.728+0000 7f613f7fe700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140103c10 0x7f61401963a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f613400b580 tx=0x7f613400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:24.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.729+0000 7f613cff9700 1 -- 172.21.15.69:0/3407774694 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613401d070 con 0x7f6140103c10 2023-12-14T14:21:24.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.729+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614010e130 con 0x7f6140103c10 2023-12-14T14:21:24.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.729+0000 7f613cff9700 1 -- 172.21.15.69:0/3407774694 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6134005030 con 0x7f6140103c10 2023-12-14T14:21:24.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.729+0000 7f613cff9700 1 -- 172.21.15.69:0/3407774694 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134004ad0 con 0x7f6140103c10 2023-12-14T14:21:24.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.729+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614010dfa0 con 0x7f6140103c10 2023-12-14T14:21:24.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.730+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614010e2c0 con 0x7f6140103c10 2023-12-14T14:21:24.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.731+0000 7f613cff9700 1 -- 172.21.15.69:0/3407774694 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6134005410 con 0x7f6140103c10 2023-12-14T14:21:24.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.731+0000 7f613cff9700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f61280a12c0 0x7f61280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:24.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.731+0000 7f613effd700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f61280a12c0 0x7f61280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:24.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.731+0000 7f613cff9700 1 -- 172.21.15.69:0/3407774694 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8712+0+0 (secure 0 0 0) 0x7f61340cdf10 con 0x7f6140103c10 2023-12-14T14:21:24.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.732+0000 7f613effd700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f61280a12c0 0x7f61280a3770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6140197960 tx=0x7f613000a380 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:24.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.735+0000 7f613cff9700 1 -- 172.21.15.69:0/3407774694 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f61340972d0 con 0x7f6140103c10 2023-12-14T14:21:24.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:24 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/555547298' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-14T14:21:24.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:24 smithi069 ceph-mon[42034]: osdmap e96: 12 total, 12 up, 12 in 2023-12-14T14:21:24.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:24 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-a[42011]: 2023-12-14T14:21:24.565+0000 7fae8b51d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-14T14:21:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/555547298' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-14T14:21:24.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-mon[43371]: osdmap e96: 12 total, 12 up, 12 in 2023-12-14T14:21:24.899 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-b[68177]: ignoring --setuser ceph since I am not root 2023-12-14T14:21:24.899 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-b[68177]: ignoring --setgroup ceph since I am not root 2023-12-14T14:21:24.899 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-mds[68200]: -- 172.21.15.81:0/4267951391 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a5d1f1f520 con 0x55a5d1ef4800 2023-12-14T14:21:24.899 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-b[68177]: starting mds.b at 2023-12-14T14:21:24.899 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-e[67496]: ignoring --setuser ceph since I am not root 2023-12-14T14:21:24.900 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-e[67496]: ignoring --setgroup ceph since I am not root 2023-12-14T14:21:24.900 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-mds[67519]: -- 172.21.15.81:0/3590106448 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5647ad9c3520 con 0x5647ad998c00 2023-12-14T14:21:24.900 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-e[67496]: starting mds.e at 2023-12-14T14:21:24.900 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-h[67837]: ignoring --setuser ceph since I am not root 2023-12-14T14:21:24.900 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-h[67837]: ignoring --setgroup ceph since I am not root 2023-12-14T14:21:24.900 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-mds[67860]: -- 172.21.15.81:0/3229063750 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ea5d0fb520 con 0x55ea5d0d1000 2023-12-14T14:21:24.901 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:21:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-h[67837]: starting mds.h at 2023-12-14T14:21:24.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:24.968+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f61401a33c0 con 0x7f6140103c10 2023-12-14T14:21:25.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/555547298' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-14T14:21:25.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-mon[43834]: osdmap e96: 12 total, 12 up, 12 in 2023-12-14T14:21:25.025 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-c[69468]: ignoring --setuser ceph since I am not root 2023-12-14T14:21:25.026 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-c[69468]: ignoring --setgroup ceph since I am not root 2023-12-14T14:21:25.026 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-mds[69491]: -- 172.21.15.119:0/2897905282 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555de8175520 con 0x555de814a800 2023-12-14T14:21:25.026 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-c[69468]: starting mds.c at 2023-12-14T14:21:25.026 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-f[69124]: ignoring --setuser ceph since I am not root 2023-12-14T14:21:25.026 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-f[69124]: ignoring --setgroup ceph since I am not root 2023-12-14T14:21:25.027 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-mds[69147]: -- 172.21.15.119:0/3360701791 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563eecb83520 con 0x563eecb58800 2023-12-14T14:21:25.027 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-f[69124]: starting mds.f at 2023-12-14T14:21:25.027 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-i[69819]: ignoring --setuser ceph since I am not root 2023-12-14T14:21:25.027 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-i[69819]: ignoring --setgroup ceph since I am not root 2023-12-14T14:21:25.027 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:21:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-i[69819]: starting mds.i at 2023-12-14T14:21:25.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.578+0000 7f613cff9700 1 -- 172.21.15.69:0/3407774694 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f613409a8f0 con 0x7f6140103c10 2023-12-14T14:21:25.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f61280a12c0 msgr2=0x7f61280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:25.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f61280a12c0 0x7f61280a3770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6140197960 tx=0x7f613000a380 comp rx=0 tx=0).stop 2023-12-14T14:21:25.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140103c10 msgr2=0x7f61401963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:25.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140103c10 0x7f61401963a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f613400b580 tx=0x7f613400f690 comp rx=0 tx=0).stop 2023-12-14T14:21:25.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 shutdown_connections 2023-12-14T14:21:25.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f61280a12c0 0x7f61280a3770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61401051e0 0x7f614019acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6140103c10 0x7f61401963a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 --2- 172.21.15.69:0/3407774694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6140104840 0x7f61401968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.580+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 >> 172.21.15.69:0/3407774694 conn(0x7f61400749c0 msgr2=0x7f6140107600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:25.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.581+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 shutdown_connections 2023-12-14T14:21:25.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.581+0000 7f6145b8e700 1 -- 172.21.15.69:0/3407774694 wait complete. 2023-12-14T14:21:25.594 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-14T14:21:25.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.721+0000 7f3336b7f700 1 -- 172.21.15.69:0/466585829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33300ff970 msgr2=0x7f33300ffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:25.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.721+0000 7f3336b7f700 1 --2- 172.21.15.69:0/466585829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33300ff970 0x7f33300ffde0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f331c009990 tx=0x7f331c009ca0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.721+0000 7f3336b7f700 1 -- 172.21.15.69:0/466585829 shutdown_connections 2023-12-14T14:21:25.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.721+0000 7f3336b7f700 1 --2- 172.21.15.69:0/466585829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f333010a840 0x7f333010cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.721+0000 7f3336b7f700 1 --2- 172.21.15.69:0/466585829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3330068b10 0x7f33300ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.721+0000 7f3336b7f700 1 --2- 172.21.15.69:0/466585829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33300ff970 0x7f33300ffde0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.721+0000 7f3336b7f700 1 -- 172.21.15.69:0/466585829 >> 172.21.15.69:0/466585829 conn(0x7f33300749c0 msgr2=0x7f3330074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:25.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.721+0000 7f3336b7f700 1 -- 172.21.15.69:0/466585829 shutdown_connections 2023-12-14T14:21:25.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.722+0000 7f3336b7f700 1 -- 172.21.15.69:0/466585829 wait complete. 2023-12-14T14:21:25.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.722+0000 7f3336b7f700 1 Processor -- start 2023-12-14T14:21:25.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.722+0000 7f3336b7f700 1 -- start start 2023-12-14T14:21:25.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f3336b7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3330068b10 0x7f3330196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:25.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f3336b7f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33300ff970 0x7f33301969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:25.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f3336b7f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f333010a840 0x7f333019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:25.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f3336b7f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333019b420 con 0x7f333010a840 2023-12-14T14:21:25.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f3336b7f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333019b590 con 0x7f3330068b10 2023-12-14T14:21:25.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f3336b7f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333019b750 con 0x7f33300ff970 2023-12-14T14:21:25.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333511c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f333010a840 0x7f333019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:25.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333511c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f333010a840 0x7f333019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36732/0 (socket says 172.21.15.69:36732) 2023-12-14T14:21:25.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333511c700 1 -- 172.21.15.69:0/3930566155 learned_addr learned my addr 172.21.15.69:0/3930566155 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:25.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333491b700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3330068b10 0x7f3330196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:25.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f332ffff700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33300ff970 0x7f33301969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:25.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333511c700 1 -- 172.21.15.69:0/3930566155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33300ff970 msgr2=0x7f33301969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:25.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333511c700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33300ff970 0x7f33301969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333511c700 1 -- 172.21.15.69:0/3930566155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3330068b10 msgr2=0x7f3330196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:25.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333511c700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3330068b10 0x7f3330196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:25.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333511c700 1 -- 172.21.15.69:0/3930566155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c0095f0 con 0x7f333010a840 2023-12-14T14:21:25.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333491b700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3330068b10 0x7f3330196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T14:21:25.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f332ffff700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33300ff970 0x7f33301969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T14:21:25.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f333511c700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f333010a840 0x7f333019ade0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f33280094f0 tx=0x7f3328007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:25.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f332dffb700 1 -- 172.21.15.69:0/3930566155 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328004db0 con 0x7f333010a840 2023-12-14T14:21:25.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f332dffb700 1 -- 172.21.15.69:0/3930566155 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f332800f040 con 0x7f333010a840 2023-12-14T14:21:25.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f332dffb700 1 -- 172.21.15.69:0/3930566155 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280059e0 con 0x7f333010a840 2023-12-14T14:21:25.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.723+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3330110320 con 0x7f333010a840 2023-12-14T14:21:25.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.724+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3330110190 con 0x7f333010a840 2023-12-14T14:21:25.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.724+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33301104b0 con 0x7f333010a840 2023-12-14T14:21:25.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.725+0000 7f332dffb700 1 -- 172.21.15.69:0/3930566155 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f332800db60 con 0x7f333010a840 2023-12-14T14:21:25.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.726+0000 7f332dffb700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f33200a12c0 0x7f33200a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:25.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.726+0000 7f333491b700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f33200a12c0 0x7f33200a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:25.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.726+0000 7f332dffb700 1 -- 172.21.15.69:0/3930566155 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8712+0+0 (secure 0 0 0) 0x7f33280cc7c0 con 0x7f333010a840 2023-12-14T14:21:25.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.726+0000 7f333491b700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f33200a12c0 0x7f33200a3770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f332400bc10 tx=0x7f332400b5f0 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:25.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.730+0000 7f332dffb700 1 -- 172.21.15.69:0/3930566155 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f332804e730 con 0x7f333010a840 2023-12-14T14:21:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:25 smithi069 ceph-mon[42034]: pgmap v337: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-12-14T14:21:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:25 smithi069 ceph-mon[42034]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-14T14:21:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:25 smithi069 ceph-mon[42034]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-14T14:21:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:25 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/555547298' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-14T14:21:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:25 smithi069 ceph-mon[42034]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-12-14T14:21:25.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:25 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3407774694' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T14:21:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:25 smithi081 ceph-mon[43371]: pgmap v337: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-12-14T14:21:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:25 smithi081 ceph-mon[43371]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-14T14:21:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:25 smithi081 ceph-mon[43371]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-14T14:21:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:25 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/555547298' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-14T14:21:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:25 smithi081 ceph-mon[43371]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-12-14T14:21:25.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:25 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3407774694' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T14:21:25.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:25.920+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3330067e70 con 0x7f333010a840 2023-12-14T14:21:26.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:25 smithi119 ceph-mon[43834]: pgmap v337: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-12-14T14:21:26.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:25 smithi119 ceph-mon[43834]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-14T14:21:26.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:25 smithi119 ceph-mon[43834]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-14T14:21:26.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:25 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/555547298' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-14T14:21:26.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:25 smithi119 ceph-mon[43834]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-12-14T14:21:26.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:25 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3407774694' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T14:21:26.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.580+0000 7f332dffb700 1 -- 172.21.15.69:0/3930566155 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3328095b10 con 0x7f333010a840 2023-12-14T14:21:26.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f33200a12c0 msgr2=0x7f33200a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:26.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f33200a12c0 0x7f33200a3770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f332400bc10 tx=0x7f332400b5f0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f333010a840 msgr2=0x7f333019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:26.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f333010a840 0x7f333019ade0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f33280094f0 tx=0x7f3328007f90 comp rx=0 tx=0).stop 2023-12-14T14:21:26.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 shutdown_connections 2023-12-14T14:21:26.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f33200a12c0 0x7f33200a3770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f333010a840 0x7f333019ade0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3330068b10 0x7f3330196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 --2- 172.21.15.69:0/3930566155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33300ff970 0x7f33301969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 >> 172.21.15.69:0/3930566155 conn(0x7f33300749c0 msgr2=0x7f3330102750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:26.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.583+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 shutdown_connections 2023-12-14T14:21:26.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.584+0000 7f3336b7f700 1 -- 172.21.15.69:0/3930566155 wait complete. 2023-12-14T14:21:26.586 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' removed 2023-12-14T14:21:26.601 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-14T14:21:26.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.742+0000 7f89d374b700 1 -- 172.21.15.69:0/2076141522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc10a810 msgr2=0x7f89cc10cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:26.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.742+0000 7f89d374b700 1 --2- 172.21.15.69:0/2076141522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc10a810 0x7f89cc10cc50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f89c400b0a0 tx=0x7f89c400b3b0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.742+0000 7f89d374b700 1 -- 172.21.15.69:0/2076141522 shutdown_connections 2023-12-14T14:21:26.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.742+0000 7f89d374b700 1 --2- 172.21.15.69:0/2076141522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc10a810 0x7f89cc10cc50 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.742+0000 7f89d374b700 1 --2- 172.21.15.69:0/2076141522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89cc1012f0 0x7f89cc1016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.742+0000 7f89d374b700 1 --2- 172.21.15.69:0/2076141522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89cc101c00 0x7f89cc10a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.742+0000 7f89d374b700 1 -- 172.21.15.69:0/2076141522 >> 172.21.15.69:0/2076141522 conn(0x7f89cc076000 msgr2=0x7f89cc076400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.742+0000 7f89d374b700 1 -- 172.21.15.69:0/2076141522 shutdown_connections 2023-12-14T14:21:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.742+0000 7f89d374b700 1 -- 172.21.15.69:0/2076141522 wait complete. 2023-12-14T14:21:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d374b700 1 Processor -- start 2023-12-14T14:21:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d374b700 1 -- start start 2023-12-14T14:21:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d374b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89cc1012f0 0x7f89cc198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d374b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc101c00 0x7f89cc198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d374b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89cc10a810 0x7f89cc19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d374b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc19c5f0 con 0x7f89cc101c00 2023-12-14T14:21:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d374b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc19c760 con 0x7f89cc10a810 2023-12-14T14:21:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d374b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc19c920 con 0x7f89cc1012f0 2023-12-14T14:21:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d0ce6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc101c00 0x7f89cc198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d0ce6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc101c00 0x7f89cc198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33594/0 (socket says 172.21.15.69:33594) 2023-12-14T14:21:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d0ce6700 1 -- 172.21.15.69:0/685512929 learned_addr learned my addr 172.21.15.69:0/685512929 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T14:21:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d14e7700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89cc1012f0 0x7f89cc198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d1ce8700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89cc10a810 0x7f89cc19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d0ce6700 1 -- 172.21.15.69:0/685512929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89cc1012f0 msgr2=0x7f89cc198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d0ce6700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89cc1012f0 0x7f89cc198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d0ce6700 1 -- 172.21.15.69:0/685512929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89cc10a810 msgr2=0x7f89cc19bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:26.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d0ce6700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89cc10a810 0x7f89cc19bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:26.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.743+0000 7f89d0ce6700 1 -- 172.21.15.69:0/685512929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c4009d00 con 0x7f89cc101c00 2023-12-14T14:21:26.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.744+0000 7f89d0ce6700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc101c00 0x7f89cc198c40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c920 tx=0x7f89c800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:26.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.744+0000 7f89be7fc700 1 -- 172.21.15.69:0/685512929 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8004a30 con 0x7f89cc101c00 2023-12-14T14:21:26.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.744+0000 7f89be7fc700 1 -- 172.21.15.69:0/685512929 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89c80054e0 con 0x7f89cc101c00 2023-12-14T14:21:26.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.744+0000 7f89be7fc700 1 -- 172.21.15.69:0/685512929 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8007c10 con 0x7f89cc101c00 2023-12-14T14:21:26.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.744+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc1102c0 con 0x7f89cc101c00 2023-12-14T14:21:26.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.744+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc110130 con 0x7f89cc101c00 2023-12-14T14:21:26.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.745+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc110450 con 0x7f89cc101c00 2023-12-14T14:21:26.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.747+0000 7f89be7fc700 1 -- 172.21.15.69:0/685512929 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f89c8005000 con 0x7f89cc101c00 2023-12-14T14:21:26.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.747+0000 7f89be7fc700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89b80a12c0 0x7f89b80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T14:21:26.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.747+0000 7f89d14e7700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89b80a12c0 0x7f89b80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T14:21:26.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.747+0000 7f89be7fc700 1 -- 172.21.15.69:0/685512929 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8187+0+0 (secure 0 0 0) 0x7f89c80ccaa0 con 0x7f89cc101c00 2023-12-14T14:21:26.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.748+0000 7f89d14e7700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89b80a12c0 0x7f89b80a3770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89c0005950 tx=0x7f89c000a300 comp rx=0 tx=0).ready entity=mgr.15411 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T14:21:26.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.751+0000 7f89be7fc700 1 -- 172.21.15.69:0/685512929 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f89c8096000 con 0x7f89cc101c00 2023-12-14T14:21:26.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-14T14:21:26.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-14T14:21:26.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: Cluster is now healthy 2023-12-14T14:21:26.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.81:6836/4118476295,v1:172.21.15.81:6838/4118476295] up:boot 2023-12-14T14:21:26.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.119:6838/521250028,v1:172.21.15.119:6839/521250028] up:boot 2023-12-14T14:21:26.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.119:6834/2735630755,v1:172.21.15.119:6835/2735630755] up:boot 2023-12-14T14:21:26.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.81:6834/2289795345,v1:172.21.15.81:6835/2289795345] up:boot 2023-12-14T14:21:26.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.119:6836/2268490682,v1:172.21.15.119:6837/2268490682] up:boot 2023-12-14T14:21:26.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: mds.? [v2:172.21.15.81:6837/1904547312,v1:172.21.15.81:6839/1904547312] up:boot 2023-12-14T14:21:26.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3407774694' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-14T14:21:26.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: fsmap 12 up:standby 2023-12-14T14:21:26.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T14:21:26.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T14:21:26.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T14:21:26.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T14:21:26.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T14:21:26.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T14:21:26.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:26 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3930566155' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T14:21:26.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-14T14:21:26.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-14T14:21:26.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: Cluster is now healthy 2023-12-14T14:21:26.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.81:6836/4118476295,v1:172.21.15.81:6838/4118476295] up:boot 2023-12-14T14:21:26.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.119:6838/521250028,v1:172.21.15.119:6839/521250028] up:boot 2023-12-14T14:21:26.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.119:6834/2735630755,v1:172.21.15.119:6835/2735630755] up:boot 2023-12-14T14:21:26.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.81:6834/2289795345,v1:172.21.15.81:6835/2289795345] up:boot 2023-12-14T14:21:26.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.119:6836/2268490682,v1:172.21.15.119:6837/2268490682] up:boot 2023-12-14T14:21:26.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: mds.? [v2:172.21.15.81:6837/1904547312,v1:172.21.15.81:6839/1904547312] up:boot 2023-12-14T14:21:26.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3407774694' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-14T14:21:26.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: fsmap 12 up:standby 2023-12-14T14:21:26.899 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T14:21:26.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T14:21:26.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T14:21:26.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T14:21:26.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T14:21:26.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T14:21:26.900 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:26 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3930566155' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T14:21:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:26.948+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89cc067e40 con 0x7f89cc101c00 2023-12-14T14:21:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-14T14:21:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-14T14:21:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: Cluster is now healthy 2023-12-14T14:21:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.81:6836/4118476295,v1:172.21.15.81:6838/4118476295] up:boot 2023-12-14T14:21:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.119:6838/521250028,v1:172.21.15.119:6839/521250028] up:boot 2023-12-14T14:21:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.119:6834/2735630755,v1:172.21.15.119:6835/2735630755] up:boot 2023-12-14T14:21:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.81:6834/2289795345,v1:172.21.15.81:6835/2289795345] up:boot 2023-12-14T14:21:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.119:6836/2268490682,v1:172.21.15.119:6837/2268490682] up:boot 2023-12-14T14:21:27.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: mds.? [v2:172.21.15.81:6837/1904547312,v1:172.21.15.81:6839/1904547312] up:boot 2023-12-14T14:21:27.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3407774694' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-14T14:21:27.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: fsmap 12 up:standby 2023-12-14T14:21:27.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T14:21:27.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T14:21:27.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T14:21:27.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T14:21:27.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T14:21:27.026 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: from='mgr.15411 172.21.15.69:0/2561343639' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T14:21:27.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:26 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3930566155' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T14:21:27.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.594+0000 7f89be7fc700 1 -- 172.21.15.69:0/685512929 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 169+0+0 (secure 0 0 0) 0x7f89c8099620 con 0x7f89cc101c00 2023-12-14T14:21:27.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89b80a12c0 msgr2=0x7f89b80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:27.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89b80a12c0 0x7f89b80a3770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89c0005950 tx=0x7f89c000a300 comp rx=0 tx=0).stop 2023-12-14T14:21:27.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc101c00 msgr2=0x7f89cc198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T14:21:27.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc101c00 0x7f89cc198c40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c920 tx=0x7f89c800cc30 comp rx=0 tx=0).stop 2023-12-14T14:21:27.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 shutdown_connections 2023-12-14T14:21:27.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:6800/4150820502,v1:172.21.15.69:6801/4150820502] conn(0x7f89b80a12c0 0x7f89b80a3770 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89c0005950 tx=0x7f89c000a300 comp rx=0 tx=0).stop 2023-12-14T14:21:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89cc10a810 0x7f89cc19bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89cc1012f0 0x7f89cc198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 --2- 172.21.15.69:0/685512929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc101c00 0x7f89cc198c40 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T14:21:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 >> 172.21.15.69:0/685512929 conn(0x7f89cc076000 msgr2=0x7f89cc0fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T14:21:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 shutdown_connections 2023-12-14T14:21:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T14:21:27.599+0000 7f89d374b700 1 -- 172.21.15.69:0/685512929 wait complete. 2023-12-14T14:21:27.603 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' removed 2023-12-14T14:21:27.620 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T14:21:27.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T14:21:27.718 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T14:21:27.757 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-14T14:21:27.758 DEBUG:teuthology.orchestra.run.smithi069:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-14T14:21:27.775 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-14T14:21:27.792 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-14T14:21:27.817 INFO:tasks.cephadm:Stopping all daemons... 2023-12-14T14:21:27.817 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-12-14T14:21:27.818 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.a 2023-12-14T14:21:27.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:27 smithi069 ceph-mon[42034]: pgmap v338: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-12-14T14:21:27.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:27 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/3930566155' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-14T14:21:27.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:27 smithi069 ceph-mon[42034]: osdmap e97: 12 total, 12 up, 12 in 2023-12-14T14:21:27.836 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:27 smithi069 ceph-mon[42034]: from='client.? 172.21.15.69:0/685512929' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T14:21:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:27 smithi081 ceph-mon[43371]: pgmap v338: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-12-14T14:21:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:27 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/3930566155' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-14T14:21:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:27 smithi081 ceph-mon[43371]: osdmap e97: 12 total, 12 up, 12 in 2023-12-14T14:21:27.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:27 smithi081 ceph-mon[43371]: from='client.? 172.21.15.69:0/685512929' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T14:21:28.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:27 smithi119 ceph-mon[43834]: pgmap v338: 97 pgs: 97 active+clean; 688 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-12-14T14:21:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:27 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/3930566155' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-14T14:21:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:27 smithi119 ceph-mon[43834]: osdmap e97: 12 total, 12 up, 12 in 2023-12-14T14:21:28.025 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:27 smithi119 ceph-mon[43834]: from='client.? 172.21.15.69:0/685512929' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T14:21:28.123 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:27 smithi069 systemd[1]: Stopping Ceph mon.a for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:28.404 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:28 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-a[42011]: 2023-12-14T14:21:28.123+0000 7fae8e523700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:21:28.404 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:28 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-a[42011]: 2023-12-14T14:21:28.123+0000 7fae8e523700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-12-14T14:21:28.835 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 14:21:28 smithi069 bash[204218]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-a 2023-12-14T14:21:28.888 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.a.service' 2023-12-14T14:21:28.979 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:21:28.979 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-12-14T14:21:28.979 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-12-14T14:21:28.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.b 2023-12-14T14:21:29.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:29 smithi081 systemd[1]: Stopping Ceph mon.b for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:29.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:29 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-b[43348]: 2023-12-14T14:21:29.216+0000 7f3678232700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:21:29.398 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:29 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-b[43348]: 2023-12-14T14:21:29.216+0000 7f3678232700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-12-14T14:21:29.898 INFO:journalctl@ceph.mon.b.smithi081.stdout:Dec 14 14:21:29 smithi081 bash[73927]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-b 2023-12-14T14:21:29.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.b.service' 2023-12-14T14:21:29.954 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:21:29.954 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-12-14T14:21:29.955 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-12-14T14:21:29.955 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.c 2023-12-14T14:21:30.274 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:29 smithi119 systemd[1]: Stopping Ceph mon.c for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:30.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-c[43811]: 2023-12-14T14:21:30.188+0000 7f3d555ee700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:21:30.275 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-c[43811]: 2023-12-14T14:21:30.188+0000 7f3d555ee700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-12-14T14:21:30.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 14:21:30 smithi119 bash[75761]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mon-c 2023-12-14T14:21:30.838 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mon.c.service' 2023-12-14T14:21:30.882 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:21:30.882 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-12-14T14:21:30.882 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-12-14T14:21:30.882 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.x 2023-12-14T14:21:31.245 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:21:30 smithi069 systemd[1]: Stopping Ceph mgr.x for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:31.245 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:21:31 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x[42283]: 2023-12-14T14:21:31.122+0000 7f232e91d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:21:31.585 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 14:21:31 smithi069 bash[204357]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-x 2023-12-14T14:21:31.647 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.x.service' 2023-12-14T14:21:31.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:21:31.687 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-12-14T14:21:31.687 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-12-14T14:21:31.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.y 2023-12-14T14:21:32.046 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:21:31 smithi081 systemd[1]: Stopping Ceph mgr.y for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:32.398 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:21:32 smithi081 bash[74069]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-y 2023-12-14T14:21:32.398 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Dec 14 14:21:32 smithi081 systemd[1]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-12-14T14:21:32.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.y.service' 2023-12-14T14:21:32.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:21:32.440 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-12-14T14:21:32.441 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-12-14T14:21:32.441 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.z 2023-12-14T14:21:32.775 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:21:32 smithi119 systemd[1]: Stopping Ceph mgr.z for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:33.153 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:21:32 smithi119 bash[75900]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mgr-z 2023-12-14T14:21:33.154 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 14:21:33 smithi119 systemd[1]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-12-14T14:21:33.160 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mgr.z.service' 2023-12-14T14:21:33.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:21:33.197 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-12-14T14:21:33.197 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-14T14:21:33.197 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.0 2023-12-14T14:21:33.586 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:21:33 smithi069 systemd[1]: Stopping Ceph osd.0 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:33.586 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:21:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-0[54901]: 2023-12-14T14:21:33.440+0000 7fb885d4f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:21:33.586 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:21:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-0[54901]: 2023-12-14T14:21:33.440+0000 7fb885d4f700 -1 osd.0 98 *** Got signal Terminated *** 2023-12-14T14:21:33.586 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:21:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-0[54901]: 2023-12-14T14:21:33.440+0000 7fb885d4f700 -1 osd.0 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:21:39.336 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 14:21:39 smithi069 bash[204501]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-0 2023-12-14T14:21:41.818 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.0.service' 2023-12-14T14:21:41.860 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:21:41.860 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-14T14:21:41.860 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-14T14:21:41.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.1 2023-12-14T14:21:42.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:21:41 smithi081 systemd[1]: Stopping Ceph osd.1 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:42.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:21:42 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-1[48332]: 2023-12-14T14:21:42.107+0000 7fc4941c1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:21:42.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:21:42 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-1[48332]: 2023-12-14T14:21:42.107+0000 7fc4941c1700 -1 osd.1 98 *** Got signal Terminated *** 2023-12-14T14:21:42.148 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:21:42 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-1[48332]: 2023-12-14T14:21:42.107+0000 7fc4941c1700 -1 osd.1 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:21:47.898 INFO:journalctl@ceph.osd.1.smithi081.stdout:Dec 14 14:21:47 smithi081 bash[74213]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-1 2023-12-14T14:21:48.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.1.service' 2023-12-14T14:21:48.919 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:21:48.919 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-14T14:21:48.920 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-14T14:21:48.920 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.2 2023-12-14T14:21:49.275 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:21:48 smithi119 systemd[1]: Stopping Ceph osd.2 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:49.275 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:21:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-2[49597]: 2023-12-14T14:21:49.144+0000 7f3860806700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:21:49.275 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:21:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-2[49597]: 2023-12-14T14:21:49.144+0000 7f3860806700 -1 osd.2 98 *** Got signal Terminated *** 2023-12-14T14:21:49.275 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:21:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-2[49597]: 2023-12-14T14:21:49.144+0000 7f3860806700 -1 osd.2 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:21:55.275 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 14:21:54 smithi119 bash[76045]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-2 2023-12-14T14:21:56.065 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.2.service' 2023-12-14T14:21:56.106 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:21:56.107 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-14T14:21:56.107 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-14T14:21:56.107 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.3 2023-12-14T14:21:56.395 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 14:21:56 smithi069 systemd[1]: Stopping Ceph osd.3 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:21:56.835 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 14:21:56 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-3[60281]: 2023-12-14T14:21:56.394+0000 7f5fa8cdb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:21:56.836 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 14:21:56 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-3[60281]: 2023-12-14T14:21:56.394+0000 7f5fa8cdb700 -1 osd.3 98 *** Got signal Terminated *** 2023-12-14T14:21:56.836 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 14:21:56 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-3[60281]: 2023-12-14T14:21:56.394+0000 7f5fa8cdb700 -1 osd.3 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:21:59.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:21:59 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:21:59.043+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:21:59.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:21:59 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:21:59.419+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:00.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:21:59 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:21:59.972+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:00.524 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:00 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:00.034+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:00.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:00 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:00.447+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:01.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:01 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:01.019+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:01.524 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:01 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:01.064+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:01.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:01 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:01.456+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:02.336 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 14:22:02 smithi069 bash[204770]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-3 2023-12-14T14:22:02.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:02 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:02.024+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:02.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:02 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:02.115+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:02.759 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:02 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:02.458+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:03.314 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:03 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:03.020+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:03.490 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.3.service' 2023-12-14T14:22:03.524 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:03 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:03.112+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:03.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:22:03.531 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-14T14:22:03.532 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-14T14:22:03.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.4 2023-12-14T14:22:03.586 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:03 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:03.456+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:03.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:03 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:03.630+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:03.899 INFO:journalctl@ceph.osd.4.smithi081.stdout:Dec 14 14:22:03 smithi081 systemd[1]: Stopping Ceph osd.4 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:22:03.899 INFO:journalctl@ceph.osd.4.smithi081.stdout:Dec 14 14:22:03 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-4[53679]: 2023-12-14T14:22:03.779+0000 7f90159ee700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:22:03.899 INFO:journalctl@ceph.osd.4.smithi081.stdout:Dec 14 14:22:03 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-4[53679]: 2023-12-14T14:22:03.779+0000 7f90159ee700 -1 osd.4 98 *** Got signal Terminated *** 2023-12-14T14:22:03.899 INFO:journalctl@ceph.osd.4.smithi081.stdout:Dec 14 14:22:03 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-4[53679]: 2023-12-14T14:22:03.779+0000 7f90159ee700 -1 osd.4 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:22:04.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:04 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:04.055+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:04.524 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:04 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:04.140+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:04.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:04 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:04.456+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:04.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:04 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:04.647+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:05.141 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:04 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:04.787+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:05.464 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:05 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:05.090+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:05.524 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:05 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:05.141+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:05.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:05 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:05.463+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:05.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:05 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:05.634+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:06.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:05 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:05.773+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:06.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:06 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:06.044+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:06.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:06 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:06.177+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:06.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:06 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:06.500+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:06.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:06 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:06.630+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:07.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:06 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:06.774+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:07.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:07 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:07.009+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:07.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:07 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:07.192+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:07.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:07 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:07.516+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:07.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:07 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:07.600+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:08.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:07 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:07.759+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:08.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:08 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:08.003+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:08.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:08 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:08.131+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:08.524 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:08 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:08.156+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:08.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:08 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:08.518+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:08.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:08 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:08.641+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:08.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:08 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:08.641+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:09.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:08 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:08.765+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:09.335 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:09 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:09.001+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:09.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:09 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:09.001+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:09.398 INFO:journalctl@ceph.osd.4.smithi081.stdout:Dec 14 14:22:09 smithi081 bash[74469]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-4 2023-12-14T14:22:09.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:09 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:09.134+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:09.524 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:09 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:09.183+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:09.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:09 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:09.505+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:10.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:09 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:09.757+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:10.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:09 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:09.757+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:10.109 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:09 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:09.690+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:10.109 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:09 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:09.690+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:10.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:09 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:09.965+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:10.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:09 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:09.965+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:10.391 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:10 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:10.109+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:10.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:10 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:10.206+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:10.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:10 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:10.197+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:10.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.4.service' 2023-12-14T14:22:10.591 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:22:10.592 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-14T14:22:10.592 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-14T14:22:10.592 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.5 2023-12-14T14:22:10.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:10 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:10.524+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:10.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:10 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:10.524+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:11.025 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:10 smithi119 systemd[1]: Stopping Ceph osd.5 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:22:11.025 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:10 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:10.873+0000 7fd4d8fc6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:22:11.026 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:10 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:10.873+0000 7fd4d8fc6700 -1 osd.5 98 *** Got signal Terminated *** 2023-12-14T14:22:11.026 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:10 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:10.873+0000 7fd4d8fc6700 -1 osd.5 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:22:11.026 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:10 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:10.770+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:11.026 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:10 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:10.770+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:11.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:10 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:10.680+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:11.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:10 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:10.680+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:11.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:10 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:10.935+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:11.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:10 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:10.935+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:11.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:11 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:11.220+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:11.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:11 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:11.156+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:11.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:11 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:11.156+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.783940+0000 front 2023-12-14T14:21:44.784065+0000 (oldest deadline 2023-12-14T14:22:10.684019+0000) 2023-12-14T14:22:11.643 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:11 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:11.154+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:11.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:11 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:11.523+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:11.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:11 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:11.523+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:11.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:11 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:11.643+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:11.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:11 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:11.643+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:12.191 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:11 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:11.799+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:12.191 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:11 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:11.799+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:12.335 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:11 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:11.954+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:12.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:11 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:11.954+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:12.526 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:12 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:12.250+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:12.526 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:12 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:12.190+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:12.526 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:12 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:12.190+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.783940+0000 front 2023-12-14T14:21:44.784065+0000 (oldest deadline 2023-12-14T14:22:10.684019+0000) 2023-12-14T14:22:12.644 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:12 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:12.200+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:12.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:12 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:12.538+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:12.837 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:12 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:12.538+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:12.899 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:12 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:12.643+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:12.900 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:12 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:12.643+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:13.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:12 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:12.752+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:13.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:12 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:12.752+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:13.337 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:12 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:12.977+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:13.337 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:12 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:12.977+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:13.524 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:13 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:13.216+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:13.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:13 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:13.191+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:13.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:13 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:13.191+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.783940+0000 front 2023-12-14T14:21:44.784065+0000 (oldest deadline 2023-12-14T14:22:10.684019+0000) 2023-12-14T14:22:13.648 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:13 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:13.153+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:13.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:13 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:13.512+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:13.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:13 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:13.512+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:14.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:13 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:13.747+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:14.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:13 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:13.747+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:14.122 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:13 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:13.655+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:14.122 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:13 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:13.655+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:14.335 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:14 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:14.020+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:14.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:14 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:14.020+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:14.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:14 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:14.122+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:14.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:14 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:14.244+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:14.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:14 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:14.198+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:14.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:14 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:14.198+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.783940+0000 front 2023-12-14T14:21:44.784065+0000 (oldest deadline 2023-12-14T14:22:10.684019+0000) 2023-12-14T14:22:14.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:14 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:14.531+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:14.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:14 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:14.531+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:14.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:14 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:14.610+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:14.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:14 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:14.610+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:15.224 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:14 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:14.786+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:15.224 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:14 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:14.786+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:15.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:14 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:14.976+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:15.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:14 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:14.976+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:15.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:15 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:15.144+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:15.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:15 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:15.144+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:15.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:15 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:15.255+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:15.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:15 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:15.225+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:37.882264+0000 front 2023-12-14T14:21:37.882150+0000 (oldest deadline 2023-12-14T14:21:58.982236+0000) 2023-12-14T14:22:15.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:15 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:15.225+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.783940+0000 front 2023-12-14T14:21:44.784065+0000 (oldest deadline 2023-12-14T14:22:10.684019+0000) 2023-12-14T14:22:15.525 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:15 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5[54923]: 2023-12-14T14:22:15.225+0000 7fd4d2db7700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.984918+0000 front 2023-12-14T14:21:52.984967+0000 (oldest deadline 2023-12-14T14:22:14.685054+0000) 2023-12-14T14:22:15.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:15 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:15.496+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:15.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:15 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:15.496+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:15.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:15 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:15.496+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:15.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:15 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:15.629+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:15.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:15 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:15.629+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:16.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:15 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:15.796+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:16.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:15 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:15.796+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:16.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:15 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:15.796+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:16.335 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:16.021+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:16.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:16.021+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:16.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:16 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:16.141+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:16.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:16 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:16.141+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:16.775 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 14:22:16 smithi119 bash[76307]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-5 2023-12-14T14:22:16.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:16 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:16.285+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:16.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:16 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:16.285+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:16.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:16.455+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:16.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:16.455+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:16.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:16 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:16.455+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:16.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:16 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:16.636+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:16.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:16 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:16.636+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:17.076 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:16 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:16.810+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:17.076 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:16 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:16.810+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:17.076 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:16 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:16.810+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:17.335 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:17 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:17.013+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:17.335 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:17 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:17.013+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:17.568 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:17 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:17.276+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:17.568 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:17 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:17.276+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:17.610 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:17 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:17.181+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:17.610 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:17 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:17.181+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:17.760 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.5.service' 2023-12-14T14:22:17.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:22:17.799 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-14T14:22:17.800 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-12-14T14:22:17.800 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.6 2023-12-14T14:22:17.831 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:17 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:17.470+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:17.831 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:17 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:17.470+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:17.831 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:17 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:17.470+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:17.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:17 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:17.610+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:17.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:17 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:17.610+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:18.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:17 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:17.770+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:18.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:17 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:17.770+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:18.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:17 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:17.770+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:18.086 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:17 smithi069 systemd[1]: Stopping Ceph osd.6 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:22:18.086 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:17 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:17.998+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:18.086 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:17 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:17.998+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:18.086 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:18 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:18.050+0000 7f3a0b402700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:22:18.086 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:18 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:18.050+0000 7f3a0b402700 -1 osd.6 98 *** Got signal Terminated *** 2023-12-14T14:22:18.086 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:18 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:18.050+0000 7f3a0b402700 -1 osd.6 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:22:18.642 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:18 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:18.177+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:18.642 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:18 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:18.177+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:18.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:18 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:18.292+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:18.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:18 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:18.292+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:18.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:18 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:18.520+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:18.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:18 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:18.520+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:18.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:18 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:18.520+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:18.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:18 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:18.642+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:18.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:18 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:18.642+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:18.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:18 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:18.642+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:19.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:18 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:18.818+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:19.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:18 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:18.818+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:19.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:18 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:18.818+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:19.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:18 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:18.982+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:19.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:18 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:18.982+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:19.648 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:19 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:19.209+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:19.648 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:19 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:19.209+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:19.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:19 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:19.282+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:19.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:19 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:19.282+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:19.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:19 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:19.540+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:19.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:19 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:19.540+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:19.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:19 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:19.540+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:20.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:19 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:19.687+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:20.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:19 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:19.687+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:20.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:19 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:19.687+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:20.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:19 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:19.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:20.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:19 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:19.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:20.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:19 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:19.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:20.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:19 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:19.953+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:20.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:19 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:19.953+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:20.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:19 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:19.953+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.929623+0000 front 2023-12-14T14:21:53.929592+0000 (oldest deadline 2023-12-14T14:22:19.829540+0000) 2023-12-14T14:22:20.648 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:20 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:20.197+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:20.648 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:20 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:20.197+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:20.766 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:20 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:20.327+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:20.766 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:20 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:20.327+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:20.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:20 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:20.583+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:20.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:20 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:20.583+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:20.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:20 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:20.583+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:21.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:20 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:20.767+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:21.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:20 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:20.767+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:21.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:20 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:20.767+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:21.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:20 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:20.670+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:21.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:20 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:20.670+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:21.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:20 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:20.670+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:21.335 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:20 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:20.906+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:21.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:20 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:20.906+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:21.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:20 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:20.906+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.929623+0000 front 2023-12-14T14:21:53.929592+0000 (oldest deadline 2023-12-14T14:22:19.829540+0000) 2023-12-14T14:22:21.628 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:21 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:21.157+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:21.628 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:21 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:21.157+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:21.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:21 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:21.306+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:21.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:21 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:21.306+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:21.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:21 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:21.628+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:21.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:21 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:21.628+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:21.899 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:21 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:21.628+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:21.941 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:21 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:21.607+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:21.941 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:21 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:21.607+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:21.941 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:21 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:21.607+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:22.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:21 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:21.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:22.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:21 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:21.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:22.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:21 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:21.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:22.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:21 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:21.942+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:22.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:21 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:21.942+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:22.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:21 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:21.942+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.929623+0000 front 2023-12-14T14:21:53.929592+0000 (oldest deadline 2023-12-14T14:22:19.829540+0000) 2023-12-14T14:22:22.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:22 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:22.139+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:22.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:22 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:22.139+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:22.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:22 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:22.139+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.358437+0000 front 2023-12-14T14:22:00.358395+0000 (oldest deadline 2023-12-14T14:22:22.058251+0000) 2023-12-14T14:22:22.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:22 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:22.354+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:22.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:22 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:22.354+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:22.990 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:22 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:22.591+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:22.991 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:22 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:22.591+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:22.991 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:22 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:22.591+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:23.097 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:22 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:22.667+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:23.097 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:22 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:22.667+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:23.097 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:22 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:22.667+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:23.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:22 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:22.806+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:23.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:22 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:22.806+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:23.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:22 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:22.806+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:23.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:22 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:22.990+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:34.626633+0000 front 2023-12-14T14:21:34.626655+0000 (oldest deadline 2023-12-14T14:21:59.926783+0000) 2023-12-14T14:22:23.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:22 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:22.990+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:43.427927+0000 front 2023-12-14T14:21:43.428039+0000 (oldest deadline 2023-12-14T14:22:08.127964+0000) 2023-12-14T14:22:23.336 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:22 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6[65663]: 2023-12-14T14:22:22.990+0000 7f3a059f4700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.929623+0000 front 2023-12-14T14:21:53.929592+0000 (oldest deadline 2023-12-14T14:22:19.829540+0000) 2023-12-14T14:22:23.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:23 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:23.096+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:23.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:23 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:23.096+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:23.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:23 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:23.096+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.358437+0000 front 2023-12-14T14:22:00.358395+0000 (oldest deadline 2023-12-14T14:22:22.058251+0000) 2023-12-14T14:22:23.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:23 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:23.384+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:23.776 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:23 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:23.384+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:24.049 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:23 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:23.665+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:24.050 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:23 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:23.665+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:24.050 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:23 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:23.665+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:24.086 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 14:22:23 smithi069 bash[205027]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-6 2023-12-14T14:22:24.086 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:23 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:23.619+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:24.087 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:23 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:23.619+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:24.087 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:23 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:23.619+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:24.087 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:23 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:23.619+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:24.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:23 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:23.805+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:24.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:23 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:23.805+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:24.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:23 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:23.805+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:24.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:24.049+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:24.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:24.049+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:24.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:24.049+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.358437+0000 front 2023-12-14T14:22:00.358395+0000 (oldest deadline 2023-12-14T14:22:22.058251+0000) 2023-12-14T14:22:24.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:24.362+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:24.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:24.362+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:24.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:24.635+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:24.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:24.635+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:24.898 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:24 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:24.635+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:24.987 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:24 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:24.603+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:24.988 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:24 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:24.603+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:24.988 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:24 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:24.603+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:24.988 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:24 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:24.603+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:24.996 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.6.service' 2023-12-14T14:22:25.077 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:22:25.077 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-12-14T14:22:25.078 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-12-14T14:22:25.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.7 2023-12-14T14:22:25.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:24.796+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:25.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:24.796+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:25.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:24 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:24.796+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:25.336 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:25.012+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:25.336 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:25.012+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:25.336 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:25.012+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.358437+0000 front 2023-12-14T14:22:00.358395+0000 (oldest deadline 2023-12-14T14:22:22.058251+0000) 2023-12-14T14:22:25.336 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:25 smithi081 systemd[1]: Stopping Ceph osd.7 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:22:25.336 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:25.335+0000 7f24f885b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:22:25.336 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:25.335+0000 7f24f885b700 -1 osd.7 98 *** Got signal Terminated *** 2023-12-14T14:22:25.337 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:25.335+0000 7f24f885b700 -1 osd.7 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:22:25.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:25 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:25.322+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:25.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:25 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:25.322+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:25.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:25 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:25.322+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:25.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:25 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:25.576+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:25.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:25 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:25.576+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:25.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:25 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:25.576+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:25.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:25 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:25.576+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:26.009 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:25.680+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:26.009 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:25.680+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:26.009 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:25.680+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:26.009 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:25.680+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:26.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:25 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:25.830+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:26.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:25 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:25.830+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:26.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:25 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:25.830+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:26.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:26 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:26.009+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:26.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:26 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:26.009+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:26.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:26 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:26.009+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.358437+0000 front 2023-12-14T14:22:00.358395+0000 (oldest deadline 2023-12-14T14:22:22.058251+0000) 2023-12-14T14:22:26.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:26 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:26.305+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:26.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:26 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:26.305+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:26.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:26 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:26.305+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:27.029 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:26 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:26.662+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:27.029 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:26 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:26.662+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:27.029 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:26 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:26.662+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:27.029 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:26 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:26.662+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:27.085 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:26 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:26.593+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:27.085 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:26 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:26.593+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:27.086 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:26 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:26.593+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:27.086 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:26 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:26.593+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:27.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:26 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:26.815+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:27.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:26 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:26.815+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:27.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:26 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:26.815+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:27.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:27 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:27.029+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:27.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:27 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:27.029+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:27.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:27 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:27.029+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.358437+0000 front 2023-12-14T14:22:00.358395+0000 (oldest deadline 2023-12-14T14:22:22.058251+0000) 2023-12-14T14:22:27.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:27 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:27.314+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:27.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:27 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:27.314+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:27.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:27 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:27.314+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:27.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:27 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:27.561+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:27.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:27 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:27.561+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:27.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:27 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:27.561+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:27.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:27 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:27.561+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:28.029 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:27 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:27.702+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:28.029 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:27 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:27.702+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:28.029 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:27 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:27.702+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:28.029 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:27 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:27.702+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:28.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:27 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:27.859+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:28.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:27 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:27.859+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:28.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:27 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:27.859+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:28.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:28 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:28.029+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:28.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:28 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:28.029+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:28.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:28 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:28.029+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.358437+0000 front 2023-12-14T14:22:00.358395+0000 (oldest deadline 2023-12-14T14:22:22.058251+0000) 2023-12-14T14:22:28.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:28 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:28.357+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:28.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:28 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:28.357+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:28.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:28 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:28.357+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:28.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:28 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:28.573+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:28.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:28 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:28.573+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:28.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:28 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:28.573+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:28.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:28 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:28.573+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:29.053 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:28 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:28.707+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:29.053 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:28 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:28.707+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:29.054 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:28 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:28.707+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:29.054 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:28 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:28.707+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:29.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:28 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:28.833+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:29.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:28 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:28.833+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:29.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:28 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:28.833+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:29.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:29 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:29.053+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:29.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:29 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:29.053+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:29.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:29 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:29.053+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.358437+0000 front 2023-12-14T14:22:00.358395+0000 (oldest deadline 2023-12-14T14:22:22.058251+0000) 2023-12-14T14:22:29.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:29 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:29.318+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:29.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:29 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:29.318+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:29.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:29 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:29.318+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:29.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:29 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:29.544+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:29.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:29 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:29.544+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:29.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:29 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:29.544+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:29.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:29 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:29.544+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:30.099 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:29 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:29.749+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:30.100 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:29 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:29.749+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:30.100 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:29 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:29.749+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:30.100 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:29 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:29.749+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:30.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:29 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:29.784+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:30.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:29 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:29.784+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:30.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:29 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:29.784+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:30.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:29 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:29.784+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:30.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:30 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:30.100+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.556345+0000 front 2023-12-14T14:21:44.556315+0000 (oldest deadline 2023-12-14T14:22:08.056395+0000) 2023-12-14T14:22:30.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:30 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:30.100+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:52.757574+0000 front 2023-12-14T14:21:52.757401+0000 (oldest deadline 2023-12-14T14:22:15.057278+0000) 2023-12-14T14:22:30.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:30 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:30.100+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.358437+0000 front 2023-12-14T14:22:00.358395+0000 (oldest deadline 2023-12-14T14:22:22.058251+0000) 2023-12-14T14:22:30.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:30 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7[59083]: 2023-12-14T14:22:30.100+0000 7f24f364e700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:07.760493+0000 front 2023-12-14T14:22:07.760521+0000 (oldest deadline 2023-12-14T14:22:29.361282+0000) 2023-12-14T14:22:30.773 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:30.329+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:30.773 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:30.329+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:30.773 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:30.329+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:30.773 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:30.329+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:04.647963+0000 front 2023-12-14T14:22:04.648070+0000 (oldest deadline 2023-12-14T14:22:29.947959+0000) 2023-12-14T14:22:30.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:30 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:30.581+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:30.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:30 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:30.581+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:30.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:30 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:30.581+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:30.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:30 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:30.581+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:31.006 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:30 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:30.736+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:31.006 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:30 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:30.736+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:31.006 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:30 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:30.736+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:31.006 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:30 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:30.736+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:31.024 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:30.772+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:31.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:30.772+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:31.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:30.772+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:31.025 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:30 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:30.772+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:31.398 INFO:journalctl@ceph.osd.7.smithi081.stdout:Dec 14 14:22:31 smithi081 bash[74729]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-7 2023-12-14T14:22:31.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:31.364+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:31.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:31.364+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:31.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:31.364+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:31.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:31.364+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:04.647963+0000 front 2023-12-14T14:22:04.648070+0000 (oldest deadline 2023-12-14T14:22:29.947959+0000) 2023-12-14T14:22:32.085 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:31 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:31.587+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:32.086 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:31 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:31.587+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:32.086 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:31 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:31.587+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:32.086 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:31 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:31.587+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:32.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:31 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:31.729+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:32.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:31 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:31.729+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:32.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:31 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:31.729+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:32.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:31 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:31.729+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:32.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.7.service' 2023-12-14T14:22:32.196 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:22:32.196 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-12-14T14:22:32.196 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-12-14T14:22:32.196 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.8 2023-12-14T14:22:32.225 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:31.799+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:32.226 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:31.799+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:32.226 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:31.799+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:32.226 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:31 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:31.799+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:32.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:32 smithi119 systemd[1]: Stopping Ceph osd.8 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:22:32.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:32.376+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:32.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:32.376+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:32.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:32.376+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:32.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:32.376+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:04.647963+0000 front 2023-12-14T14:22:04.648070+0000 (oldest deadline 2023-12-14T14:22:29.947959+0000) 2023-12-14T14:22:32.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:32.428+0000 7f46b0370700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:22:32.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:32.428+0000 7f46b0370700 -1 osd.8 98 *** Got signal Terminated *** 2023-12-14T14:22:32.525 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:32.428+0000 7f46b0370700 -1 osd.8 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:22:32.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:32.558+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:32.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:32.558+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:32.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:32.558+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:32.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:32 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:32.558+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:33.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:32.779+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:33.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:32.779+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:33.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:32.779+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:33.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:32.779+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:33.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:32 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:32.779+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:33.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:32.811+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:33.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:32.811+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:33.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:32.811+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:33.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:32 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:32.811+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:33.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:33.406+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:33.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:33.406+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:33.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:33.406+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:33.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:33.406+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:04.647963+0000 front 2023-12-14T14:22:04.648070+0000 (oldest deadline 2023-12-14T14:22:29.947959+0000) 2023-12-14T14:22:33.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:33.510+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:33.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:33.510+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:33.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:33.510+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:33.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:33 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:33.510+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:34.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:33.817+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:34.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:33.817+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:34.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:33.817+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:34.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:33.817+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:34.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:33 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:33.817+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:34.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:33.859+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:34.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:33.859+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:34.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:33.859+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:34.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:33.859+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:34.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:34.445+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:34.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:34.445+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:34.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:34.445+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:34.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:34.445+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:04.647963+0000 front 2023-12-14T14:22:04.648070+0000 (oldest deadline 2023-12-14T14:22:29.947959+0000) 2023-12-14T14:22:34.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:34.465+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:34.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:34.465+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:34.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:34.465+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:34.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:34 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:34.465+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:35.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:34 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:34.821+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:35.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:34 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:34.821+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:35.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:34 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:34.821+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:35.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:34 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:34.821+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:35.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:34 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:34.821+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:35.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:34.825+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:35.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:34.825+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:35.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:34.825+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:35.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:34 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:34.825+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:35.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:35.425+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:35.776 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:35.425+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:35.776 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:35.425+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:35.776 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:35.425+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:04.647963+0000 front 2023-12-14T14:22:04.648070+0000 (oldest deadline 2023-12-14T14:22:29.947959+0000) 2023-12-14T14:22:35.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:35.452+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:35.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:35.452+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:35.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:35.452+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:35.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:35 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:35.452+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:36.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:35 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:35.863+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:36.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:35 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:35.863+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:36.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:35 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:35.863+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:36.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:35 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:35.863+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:36.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:35 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:35.863+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:36.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:35.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:36.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:35.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:36.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:35.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:36.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:35 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:35.801+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:36.774 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:36.448+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.445913+0000 front 2023-12-14T14:21:46.445896+0000 (oldest deadline 2023-12-14T14:22:09.945986+0000) 2023-12-14T14:22:36.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:36.448+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.946330+0000 front 2023-12-14T14:21:49.946386+0000 (oldest deadline 2023-12-14T14:22:15.846484+0000) 2023-12-14T14:22:36.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:36.448+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:21:59.347657+0000 front 2023-12-14T14:21:59.347546+0000 (oldest deadline 2023-12-14T14:22:24.647394+0000) 2023-12-14T14:22:36.775 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8[60390]: 2023-12-14T14:22:36.448+0000 7f46aa962700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:04.647963+0000 front 2023-12-14T14:22:04.648070+0000 (oldest deadline 2023-12-14T14:22:29.947959+0000) 2023-12-14T14:22:36.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:36.429+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:36.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:36.429+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:36.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:36.429+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:36.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:36 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:36.429+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:37.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:36 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:36.870+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:37.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:36 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:36.870+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:37.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:36 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:36.870+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:37.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:36 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:36.870+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:37.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:36 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:36.870+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:37.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:36.792+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:37.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:36.792+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:37.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:36.792+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:37.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:36 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:36.792+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:37.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:37 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:37.429+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:37.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:37 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:37.429+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:37.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:37 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:37.429+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:37.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:37 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:37.429+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:38.275 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 14:22:37 smithi119 bash[76564]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-8 2023-12-14T14:22:38.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:37 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:37.835+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:38.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:37 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:37.835+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:38.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:37 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:37.835+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:38.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:37 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:37.835+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:38.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:37 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:37.910+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:38.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:37 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:37.910+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:38.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:37 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:37.910+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:38.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:37 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:37.910+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:38.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:37 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:37.910+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:38.835 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:38.444+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:38.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:38.444+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:38.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:38.444+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:38.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:38 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:38.444+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:39.132 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:38 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:38.866+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:39.132 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:38 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:38.866+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:39.133 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:38 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:38.866+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:39.133 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:38 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:38.866+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:39.140 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.8.service' 2023-12-14T14:22:39.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:38 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:38.897+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:39.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:38 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:38.897+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:39.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:38 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:38.897+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:39.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:38 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:38.897+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:39.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:38 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:38.897+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:39.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:22:39.221 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-12-14T14:22:39.221 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-12-14T14:22:39.221 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.9 2023-12-14T14:22:39.586 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:39 smithi069 systemd[1]: Stopping Ceph osd.9 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:22:39.587 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:39 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:39.466+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:39.587 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:39 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:39.466+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:39.587 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:39 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:39.466+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:39.587 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:39 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:39.466+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:39.587 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:39 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:39.471+0000 7fbd60622700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:22:39.587 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:39 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:39.471+0000 7fbd60622700 -1 osd.9 98 *** Got signal Terminated *** 2023-12-14T14:22:39.587 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:39 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:39.471+0000 7fbd60622700 -1 osd.9 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:22:40.274 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:39 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:39.904+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:40.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:39 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:39.904+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:40.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:39 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:39.904+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:40.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:39 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:39.904+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:40.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:39 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:39.904+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:40.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:39 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:39.924+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:40.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:39 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:39.924+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:40.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:39 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:39.924+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:40.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:39 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:39.924+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:40.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:39 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:39.924+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:40.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:40 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:40.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:40.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:40 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:40.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:40.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:40 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:40.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:40.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:40 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:40.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:40.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:40 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:40.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.310819+0000 front 2023-12-14T14:22:14.310713+0000 (oldest deadline 2023-12-14T14:22:39.610715+0000) 2023-12-14T14:22:41.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:40 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:40.934+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:41.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:40 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:40.934+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:41.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:40 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:40.934+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:41.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:40 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:40.934+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:41.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:40 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:40.934+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:41.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:40 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:40.940+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:41.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:40 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:40.940+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:41.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:40 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:40.940+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:41.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:40 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:40.940+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:41.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:40 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:40.940+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:41.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:40 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:40.940+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:41.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:41 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:41.464+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:41.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:41 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:41.464+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:41.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:41 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:41.464+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:41.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:41 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:41.464+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:41.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:41 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:41.464+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.310819+0000 front 2023-12-14T14:22:14.310713+0000 (oldest deadline 2023-12-14T14:22:39.610715+0000) 2023-12-14T14:22:42.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:41 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:41.896+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:42.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:41 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:41.896+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:42.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:41 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:41.896+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:42.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:41 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:41.896+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:42.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:41 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:41.896+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:42.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:41 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:41.977+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:42.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:41 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:41.977+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:42.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:41 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:41.977+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:42.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:41 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:41.977+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:42.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:41 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:41.977+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:42.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:41 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:41.977+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:42.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:42 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:42.479+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:42.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:42 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:42.479+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:42.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:42 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:42.479+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:42.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:42 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:42.479+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:42.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:42 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:42.479+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.310819+0000 front 2023-12-14T14:22:14.310713+0000 (oldest deadline 2023-12-14T14:22:39.610715+0000) 2023-12-14T14:22:43.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:42 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:42.915+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:43.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:42 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:42.915+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:43.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:42 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:42.915+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:43.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:42 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:42.915+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:43.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:42 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:42.915+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:43.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:42 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:42.941+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:43.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:42 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:42.941+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:43.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:42 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:42.941+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:43.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:42 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:42.941+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:43.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:42 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:42.941+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:43.400 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:42 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:42.941+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:43.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:43 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:43.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:35.101845+0000 front 2023-12-14T14:21:35.101860+0000 (oldest deadline 2023-12-14T14:21:59.202092+0000) 2023-12-14T14:22:43.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:43 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:43.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.604724+0000 front 2023-12-14T14:21:46.604705+0000 (oldest deadline 2023-12-14T14:22:10.104814+0000) 2023-12-14T14:22:43.836 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:43 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:43.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:50.105388+0000 front 2023-12-14T14:21:50.105341+0000 (oldest deadline 2023-12-14T14:22:15.405385+0000) 2023-12-14T14:22:43.837 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:43 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:43.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:01.107289+0000 front 2023-12-14T14:22:01.107266+0000 (oldest deadline 2023-12-14T14:22:22.807361+0000) 2023-12-14T14:22:43.837 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:43 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9[71165]: 2023-12-14T14:22:43.487+0000 7fbd5b415700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.310819+0000 front 2023-12-14T14:22:14.310713+0000 (oldest deadline 2023-12-14T14:22:39.610715+0000) 2023-12-14T14:22:44.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:43 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:43.947+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:44.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:43 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:43.947+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:44.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:43 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:43.947+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:44.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:43 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:43.947+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:44.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:43 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:43.947+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:44.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:43 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:43.986+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:44.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:43 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:43.986+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:44.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:43 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:43.986+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:44.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:43 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:43.986+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:44.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:43 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:43.986+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:44.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:43 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:43.986+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:45.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:44 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:44.973+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:45.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:44 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:44.973+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:45.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:44 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:44.973+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:45.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:44 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:44.973+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:45.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:44 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:44.973+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:45.336 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 14:22:45 smithi069 bash[205284]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-9 2023-12-14T14:22:45.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:44 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:44.965+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:45.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:44 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:44.965+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:45.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:44 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:44.965+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:45.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:44 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:44.965+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:45.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:44 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:44.965+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:45.399 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:44 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:44.965+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:46.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:46 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:46.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:46.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:46 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:46.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:46.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:46 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:46.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:46.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:46 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:46.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:46.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:46 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:46.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:46.316 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.9.service' 2023-12-14T14:22:46.358 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:22:46.358 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-12-14T14:22:46.359 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-12-14T14:22:46.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.10 2023-12-14T14:22:46.389 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:45 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:45.926+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:46.390 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:45 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:45.926+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:46.390 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:45 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:45.926+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:46.390 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:45 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:45.926+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:46.390 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:45 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:45.926+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:46.390 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:45 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:45.926+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:46.648 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 systemd[1]: Stopping Ceph osd.10 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:22:46.648 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.607+0000 7fdc46964700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:22:46.648 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.607+0000 7fdc46964700 -1 osd.10 98 *** Got signal Terminated *** 2023-12-14T14:22:46.648 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.607+0000 7fdc46964700 -1 osd.10 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:22:47.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.881+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:47.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.881+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:47.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.881+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:47.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.881+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:47.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.881+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:47.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.881+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:47.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:46 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:46.881+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:22.380078+0000 front 2023-12-14T14:22:22.380129+0000 (oldest deadline 2023-12-14T14:22:46.479920+0000) 2023-12-14T14:22:47.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:47 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:47.037+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:47.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:47 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:47.037+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:47.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:47 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:47.037+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:47.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:47 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:47.037+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:47.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:47 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:47.037+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:47.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:47 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:47.037+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:48.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:47 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:47.833+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:48.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:47 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:47.833+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:48.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:47 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:47.833+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:48.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:47 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:47.833+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:48.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:47 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:47.833+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:48.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:47 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:47.833+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:48.150 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:47 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:47.833+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:22.380078+0000 front 2023-12-14T14:22:22.380129+0000 (oldest deadline 2023-12-14T14:22:46.479920+0000) 2023-12-14T14:22:48.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:48 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:48.026+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:48.527 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:48 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:48.026+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:48.527 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:48 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:48.026+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:48.527 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:48 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:48.026+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:48.527 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:48 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:48.026+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:48.527 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:48 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:48.026+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:49.151 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:48 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:48.880+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:49.155 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:48 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:48.880+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:49.155 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:48 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:48.880+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:49.155 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:48 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:48.880+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:49.155 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:48 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:48.880+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:49.155 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:48 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:48.880+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:49.156 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:48 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:48.880+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:22.380078+0000 front 2023-12-14T14:22:22.380129+0000 (oldest deadline 2023-12-14T14:22:46.479920+0000) 2023-12-14T14:22:49.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:49.054+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:49.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:49.054+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:49.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:49.054+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:49.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:49.054+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:49.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:49.054+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:49.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:49 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:49.054+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:50.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:49 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:49.834+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:50.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:49 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:49.834+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:50.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:49 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:49.834+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:50.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:49 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:49.834+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:50.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:49 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:49.834+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:50.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:49 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:49.834+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:50.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:49 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:49.834+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:22.380078+0000 front 2023-12-14T14:22:22.380129+0000 (oldest deadline 2023-12-14T14:22:46.479920+0000) 2023-12-14T14:22:50.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:50 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:50.021+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:50.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:50 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:50.021+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:50.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:50 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:50.021+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:50.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:50 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:50.021+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:50.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:50 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:50.021+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:50.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:50 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:50.021+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:51.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:50 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:50.814+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:33.272077+0000 front 2023-12-14T14:21:33.272172+0000 (oldest deadline 2023-12-14T14:22:02.672921+0000) 2023-12-14T14:22:51.148 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:50 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:50.814+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:44.973892+0000 front 2023-12-14T14:21:44.973916+0000 (oldest deadline 2023-12-14T14:22:07.874076+0000) 2023-12-14T14:22:51.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:50 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:50.814+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:53.775276+0000 front 2023-12-14T14:21:53.775220+0000 (oldest deadline 2023-12-14T14:22:17.875243+0000) 2023-12-14T14:22:51.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:50 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:50.814+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T14:22:00.776736+0000 front 2023-12-14T14:22:00.776764+0000 (oldest deadline 2023-12-14T14:22:25.476488+0000) 2023-12-14T14:22:51.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:50 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:50.814+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:05.977455+0000 front 2023-12-14T14:22:05.977499+0000 (oldest deadline 2023-12-14T14:22:31.877622+0000) 2023-12-14T14:22:51.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:50 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:50.814+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:14.779064+0000 front 2023-12-14T14:22:14.779102+0000 (oldest deadline 2023-12-14T14:22:40.678929+0000) 2023-12-14T14:22:51.149 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:50 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10[64444]: 2023-12-14T14:22:50.814+0000 7fdc42f5a700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:22.380078+0000 front 2023-12-14T14:22:22.380129+0000 (oldest deadline 2023-12-14T14:22:46.479920+0000) 2023-12-14T14:22:51.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:51 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:51.029+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:51.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:51 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:51.029+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:51.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:51 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:51.029+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:51.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:51 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:51.029+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:51.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:51 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:51.029+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:51.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:51 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:51.029+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:51.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:51 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:51.029+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2023-12-14T14:22:29.286688+0000 front 2023-12-14T14:22:29.286661+0000 (oldest deadline 2023-12-14T14:22:50.986579+0000) 2023-12-14T14:22:52.398 INFO:journalctl@ceph.osd.10.smithi081.stdout:Dec 14 14:22:52 smithi081 bash[74983]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-10 2023-12-14T14:22:52.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.032+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:52.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.032+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:52.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.032+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:52.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.032+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:52.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.032+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:52.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.032+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:52.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.032+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2023-12-14T14:22:29.286688+0000 front 2023-12-14T14:22:29.286661+0000 (oldest deadline 2023-12-14T14:22:50.986579+0000) 2023-12-14T14:22:53.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.987+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:53.277 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.987+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:53.277 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.987+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:53.278 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.987+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:53.278 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.987+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:53.278 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.987+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:53.278 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:52 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:52.987+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2023-12-14T14:22:29.286688+0000 front 2023-12-14T14:22:29.286661+0000 (oldest deadline 2023-12-14T14:22:50.986579+0000) 2023-12-14T14:22:53.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.10.service' 2023-12-14T14:22:53.467 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:22:53.467 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-12-14T14:22:53.468 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-12-14T14:22:53.468 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.11 2023-12-14T14:22:53.775 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 systemd[1]: Stopping Ceph osd.11 for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:22:53.775 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.715+0000 7fa492b23700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:22:53.775 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.716+0000 7fa492b23700 -1 osd.11 98 *** Got signal Terminated *** 2023-12-14T14:22:53.776 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.716+0000 7fa492b23700 -1 osd.11 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T14:22:54.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.988+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:54.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.988+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:54.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.988+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:54.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.988+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:54.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.988+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:54.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.988+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:54.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:53 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:53.988+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2023-12-14T14:22:29.286688+0000 front 2023-12-14T14:22:29.286661+0000 (oldest deadline 2023-12-14T14:22:50.986579+0000) 2023-12-14T14:22:55.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:55 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:55.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:55.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:55 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:55.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:55.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:55 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:55.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:55.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:55 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:55.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:55.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:55 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:55.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:55.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:55 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:55.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:55.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:55 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:55.004+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2023-12-14T14:22:29.286688+0000 front 2023-12-14T14:22:29.286661+0000 (oldest deadline 2023-12-14T14:22:50.986579+0000) 2023-12-14T14:22:56.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:56 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:56.043+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:56.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:56 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:56.043+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:56.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:56 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:56.043+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:56.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:56 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:56.043+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:56.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:56 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:56.043+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:56.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:56 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:56.043+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:56.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:56 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:56.043+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2023-12-14T14:22:29.286688+0000 front 2023-12-14T14:22:29.286661+0000 (oldest deadline 2023-12-14T14:22:50.986579+0000) 2023-12-14T14:22:57.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.030+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:57.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.030+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:57.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.030+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:57.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.030+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:57.525 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.030+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:57.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.030+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:57.526 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.030+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2023-12-14T14:22:29.286688+0000 front 2023-12-14T14:22:29.286661+0000 (oldest deadline 2023-12-14T14:22:50.986579+0000) 2023-12-14T14:22:58.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.985+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T14:21:38.077771+0000 front 2023-12-14T14:21:38.077667+0000 (oldest deadline 2023-12-14T14:22:03.977751+0000) 2023-12-14T14:22:58.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.985+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2023-12-14T14:21:46.179515+0000 front 2023-12-14T14:21:46.179674+0000 (oldest deadline 2023-12-14T14:22:09.679490+0000) 2023-12-14T14:22:58.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.985+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T14:21:49.679850+0000 front 2023-12-14T14:21:49.679946+0000 (oldest deadline 2023-12-14T14:22:14.979984+0000) 2023-12-14T14:22:58.275 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.985+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2023-12-14T14:22:06.682438+0000 front 2023-12-14T14:22:06.682377+0000 (oldest deadline 2023-12-14T14:22:29.582392+0000) 2023-12-14T14:22:58.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.985+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T14:22:13.484442+0000 front 2023-12-14T14:22:13.484498+0000 (oldest deadline 2023-12-14T14:22:39.384595+0000) 2023-12-14T14:22:58.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.985+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T14:22:20.485738+0000 front 2023-12-14T14:22:20.485778+0000 (oldest deadline 2023-12-14T14:22:46.385647+0000) 2023-12-14T14:22:58.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.985+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2023-12-14T14:22:29.286688+0000 front 2023-12-14T14:22:29.286661+0000 (oldest deadline 2023-12-14T14:22:50.986579+0000) 2023-12-14T14:22:58.276 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:57 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11[65889]: 2023-12-14T14:22:57.985+0000 7fa48d115700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.8 since back 2023-12-14T14:22:36.187665+0000 front 2023-12-14T14:22:36.187638+0000 (oldest deadline 2023-12-14T14:22:57.887665+0000) 2023-12-14T14:22:59.775 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 14:22:59 smithi119 bash[76819]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-osd-11 2023-12-14T14:23:00.545 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@osd.11.service' 2023-12-14T14:23:00.586 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:00.587 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-12-14T14:23:00.587 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-12-14T14:23:00.587 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.a 2023-12-14T14:23:01.086 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 14:23:00 smithi069 systemd[1]: Stopping Ceph mds.a for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:01.087 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 14:23:00 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-a[76409]: 2023-12-14T14:23:00.851+0000 7fcf9c4a5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:01.087 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 14:23:00 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-a[76409]: 2023-12-14T14:23:00.851+0000 7fcf9c4a5700 -1 mds.a *** got signal Terminated *** 2023-12-14T14:23:03.586 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 14:23:03 smithi069 bash[205545]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-a 2023-12-14T14:23:03.622 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.a.service' 2023-12-14T14:23:03.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:03.660 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-12-14T14:23:03.660 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-12-14T14:23:03.660 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.d 2023-12-14T14:23:03.917 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 14:23:03 smithi069 systemd[1]: Stopping Ceph mds.d for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:04.336 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 14:23:03 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-d[75496]: 2023-12-14T14:23:03.917+0000 7fa4e47a2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:04.336 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 14:23:03 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-d[75496]: 2023-12-14T14:23:03.917+0000 7fa4e47a2700 -1 mds.d *** got signal Terminated *** 2023-12-14T14:23:07.562 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 14:23:07 smithi069 bash[205683]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-d 2023-12-14T14:23:07.568 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.d.service' 2023-12-14T14:23:07.603 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:07.604 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-12-14T14:23:07.604 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-12-14T14:23:07.604 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.g 2023-12-14T14:23:07.836 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 14:23:07 smithi069 systemd[1]: Stopping Ceph mds.g for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:08.336 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 14:23:07 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-g[76019]: 2023-12-14T14:23:07.884+0000 7f1a2daf3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:08.336 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 14:23:07 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-g[76019]: 2023-12-14T14:23:07.884+0000 7f1a2daf3700 -1 mds.g *** got signal Terminated *** 2023-12-14T14:23:09.835 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 14:23:09 smithi069 bash[205825]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-g 2023-12-14T14:23:09.921 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.g.service' 2023-12-14T14:23:09.954 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:09.954 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-12-14T14:23:09.954 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-12-14T14:23:09.954 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.j 2023-12-14T14:23:10.223 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 14:23:10 smithi069 systemd[1]: Stopping Ceph mds.j for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:10.586 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 14:23:10 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-j[75113]: 2023-12-14T14:23:10.224+0000 7fce28fee700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:10.586 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 14:23:10 smithi069 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-j[75113]: 2023-12-14T14:23:10.224+0000 7fce28fee700 -1 mds.j *** got signal Terminated *** 2023-12-14T14:23:13.836 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 14:23:13 smithi069 bash[205963]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-j 2023-12-14T14:23:13.853 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.j.service' 2023-12-14T14:23:13.887 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:13.887 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-12-14T14:23:13.887 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-12-14T14:23:13.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.b 2023-12-14T14:23:14.398 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:23:13 smithi081 systemd[1]: Stopping Ceph mds.b for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:14.398 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:23:14 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-b[68177]: 2023-12-14T14:23:14.135+0000 7f49de0cb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:14.398 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:23:14 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-b[68177]: 2023-12-14T14:23:14.135+0000 7f49de0cb700 -1 mds.b *** got signal Terminated *** 2023-12-14T14:23:17.009 INFO:journalctl@ceph.mds.b.smithi081.stdout:Dec 14 14:23:16 smithi081 bash[75248]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-b 2023-12-14T14:23:17.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.b.service' 2023-12-14T14:23:17.049 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:17.049 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-12-14T14:23:17.049 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-12-14T14:23:17.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.e 2023-12-14T14:23:17.311 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:23:17 smithi081 systemd[1]: Stopping Ceph mds.e for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:17.648 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:23:17 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-e[67496]: 2023-12-14T14:23:17.311+0000 7f54f65dd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:17.648 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:23:17 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-e[67496]: 2023-12-14T14:23:17.311+0000 7f54f65dd700 -1 mds.e *** got signal Terminated *** 2023-12-14T14:23:21.112 INFO:journalctl@ceph.mds.e.smithi081.stdout:Dec 14 14:23:20 smithi081 bash[75387]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-e 2023-12-14T14:23:21.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.e.service' 2023-12-14T14:23:21.154 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:21.154 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-12-14T14:23:21.154 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-12-14T14:23:21.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.h 2023-12-14T14:23:21.398 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:23:21 smithi081 systemd[1]: Stopping Ceph mds.h for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:21.898 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:23:21 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-h[67837]: 2023-12-14T14:23:21.420+0000 7fde94160700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:21.899 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:23:21 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-h[67837]: 2023-12-14T14:23:21.420+0000 7fde94160700 -1 mds.h *** got signal Terminated *** 2023-12-14T14:23:25.148 INFO:journalctl@ceph.mds.h.smithi081.stdout:Dec 14 14:23:24 smithi081 bash[75525]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-h 2023-12-14T14:23:25.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.h.service' 2023-12-14T14:23:25.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:25.209 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-12-14T14:23:25.209 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-12-14T14:23:25.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.k 2023-12-14T14:23:25.468 INFO:journalctl@ceph.mds.k.smithi081.stdout:Dec 14 14:23:25 smithi081 systemd[1]: Stopping Ceph mds.k for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:25.898 INFO:journalctl@ceph.mds.k.smithi081.stdout:Dec 14 14:23:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-k[67156]: 2023-12-14T14:23:25.468+0000 7f65f3c11700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:25.898 INFO:journalctl@ceph.mds.k.smithi081.stdout:Dec 14 14:23:25 smithi081 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-k[67156]: 2023-12-14T14:23:25.468+0000 7f65f3c11700 -1 mds.k *** got signal Terminated *** 2023-12-14T14:23:28.118 INFO:journalctl@ceph.mds.k.smithi081.stdout:Dec 14 14:23:27 smithi081 bash[75664]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-k 2023-12-14T14:23:28.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.k.service' 2023-12-14T14:23:28.156 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:28.156 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-12-14T14:23:28.157 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-12-14T14:23:28.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.c 2023-12-14T14:23:28.525 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:23:28 smithi119 systemd[1]: Stopping Ceph mds.c for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:28.525 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:23:28 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-c[69468]: 2023-12-14T14:23:28.419+0000 7f1502f61700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:28.525 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:23:28 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-c[69468]: 2023-12-14T14:23:28.419+0000 7f1502f61700 -1 mds.c *** got signal Terminated *** 2023-12-14T14:23:32.908 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 14:23:32 smithi119 bash[77086]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-c 2023-12-14T14:23:32.914 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.c.service' 2023-12-14T14:23:32.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:32.951 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-12-14T14:23:32.951 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-12-14T14:23:32.952 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.f 2023-12-14T14:23:33.271 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:23:33 smithi119 systemd[1]: Stopping Ceph mds.f for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:33.524 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:23:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-f[69124]: 2023-12-14T14:23:33.270+0000 7f131c2fd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:33.525 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:23:33 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-f[69124]: 2023-12-14T14:23:33.270+0000 7f131c2fd700 -1 mds.f *** got signal Terminated *** 2023-12-14T14:23:37.025 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 14:23:36 smithi119 bash[77226]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-f 2023-12-14T14:23:37.109 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.f.service' 2023-12-14T14:23:37.144 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:37.144 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-12-14T14:23:37.144 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-12-14T14:23:37.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.i 2023-12-14T14:23:37.409 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:23:37 smithi119 systemd[1]: Stopping Ceph mds.i for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:37.774 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:23:37 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-i[69819]: 2023-12-14T14:23:37.408+0000 7f31e64cb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:37.775 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:23:37 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-i[69819]: 2023-12-14T14:23:37.408+0000 7f31e64cb700 -1 mds.i *** got signal Terminated *** 2023-12-14T14:23:41.162 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 14:23:40 smithi119 bash[77364]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-i 2023-12-14T14:23:41.168 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.i.service' 2023-12-14T14:23:41.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:41.203 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-12-14T14:23:41.203 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-12-14T14:23:41.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.l 2023-12-14T14:23:41.492 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 14:23:41 smithi119 systemd[1]: Stopping Ceph mds.l for 5d58180a-9a89-11ee-95a3-87774f69a715... 2023-12-14T14:23:41.774 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 14:23:41 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-l[68783]: 2023-12-14T14:23:41.492+0000 7f2863e42700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T14:23:41.775 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 14:23:41 smithi119 ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-l[68783]: 2023-12-14T14:23:41.492+0000 7f2863e42700 -1 mds.l *** got signal Terminated *** 2023-12-14T14:23:46.025 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 14:23:45 smithi119 bash[77504]: ceph-5d58180a-9a89-11ee-95a3-87774f69a715-mds-l 2023-12-14T14:23:46.068 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5d58180a-9a89-11ee-95a3-87774f69a715@mds.l.service' 2023-12-14T14:23:46.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T14:23:46.102 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-12-14T14:23:46.103 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-14T14:23:48.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-14T14:23:49.976 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-14T14:23:51.625 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T14:23:51.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T14:23:51.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T14:23:51.730 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-14T14:23:51.732 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/remote/smithi069/crash 2023-12-14T14:23:51.733 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/crash -- . 2023-12-14T14:23:51.778 INFO:teuthology.orchestra.run.smithi069.stderr:tar: /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-14T14:23:51.779 INFO:teuthology.orchestra.run.smithi069.stderr:tar: Error is not recoverable: exiting now 2023-12-14T14:23:51.781 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/remote/smithi081/crash 2023-12-14T14:23:51.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/crash -- . 2023-12-14T14:23:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-14T14:23:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2023-12-14T14:23:51.829 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/remote/smithi119/crash 2023-12-14T14:23:51.830 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/crash -- . 2023-12-14T14:23:51.864 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-14T14:23:51.864 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2023-12-14T14:23:51.865 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-14T14:23:51.866 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-12-14T14:23:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:grep: /var/log/ceph/5d58180a-9a89-11ee-95a3-87774f69a715/ceph.log: No such file or directory 2023-12-14T14:23:51.903 INFO:tasks.cephadm:Compressing logs... 2023-12-14T14:23:51.903 DEBUG:teuthology.orchestra.run.smithi069:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T14:23:51.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T14:23:51.948 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T14:23:51.974 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-14T14:23:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-14T14:23:52.005 INFO:teuthology.orchestra.run.smithi069.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-14T14:27:38.405 INFO:tasks.cephadm:Archiving logs... 2023-12-14T14:27:38.406 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/remote/smithi069/log 2023-12-14T14:27:38.407 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-14T14:27:43.334 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/remote/smithi081/log 2023-12-14T14:27:43.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-14T14:28:03.098 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/remote/smithi119/log 2023-12-14T14:28:03.099 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-14T14:28:24.521 INFO:tasks.cephadm:Removing cluster... 2023-12-14T14:28:24.521 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 --force 2023-12-14T14:28:25.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 --force 2023-12-14T14:28:25.761 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5d58180a-9a89-11ee-95a3-87774f69a715 --force 2023-12-14T14:28:26.450 INFO:tasks.cephadm:Removing cephadm ... 2023-12-14T14:28:26.450 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-14T14:28:26.482 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-14T14:28:26.502 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-14T14:28:26.520 INFO:tasks.cephadm:Teardown complete 2023-12-14T14:28:26.521 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-14T14:28:26.532 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-14T14:28:26.532 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-14T14:28:26.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-14T14:28:26.545 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-14T14:28:26.670 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-14T14:28:26.682 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-14T14:28:26.682 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T14:28:26.685 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T14:28:26.688 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T14:28:26.701 INFO:teuthology.orchestra.run.smithi069.stderr:bash: ntpq: command not found 2023-12-14T14:28:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-12-14T14:28:26.704 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2023-12-14T14:28:26.708 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T14:28:26.709 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-12-14T14:28:26.709 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 5 +536us[ +536us] +/- 74ms 2023-12-14T14:28:26.709 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -317us[ -319us] +/- 60ms 2023-12-14T14:28:26.709 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -119us[ -119us] +/- 63ms 2023-12-14T14:28:26.709 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T14:28:26.711 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T14:28:26.711 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-12-14T14:28:26.711 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 6 +527us[ +525us] +/- 74ms 2023-12-14T14:28:26.712 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -315us[ -317us] +/- 60ms 2023-12-14T14:28:26.712 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -128us[ -130us] +/- 63ms 2023-12-14T14:28:26.712 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T14:28:26.721 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T14:28:26.722 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-12-14T14:28:26.722 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 +554us[ +554us] +/- 74ms 2023-12-14T14:28:26.722 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv02.front.sepia.ceph.com 3 6 377 6 -293us[ -257us] +/- 60ms 2023-12-14T14:28:26.722 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -101us[ -65us] +/- 63ms 2023-12-14T14:28:26.722 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T14:28:26.724 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-14T14:28:26.735 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-14T14:28:26.735 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-14T14:28:26.748 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-14T14:28:26.915 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-14T14:28:26.982 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-14T14:28:27.043 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T14:28:27.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T14:28:27.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T14:28:27.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T14:28:27.109 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T14:28:27.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T14:28:27.139 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-14T14:28:27.150 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-14T14:28:27.162 INFO:teuthology.task.internal:Duration was 2150.616397 seconds 2023-12-14T14:28:27.162 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-14T14:28:27.174 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-14T14:28:27.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-14T14:28:27.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-14T14:28:27.180 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-14T14:28:27.226 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T14:28:27.227 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T14:28:27.276 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T14:28:27.667 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-14T14:28:27.667 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T14:28:27.667 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-14T14:28:27.741 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2023-12-14T14:28:27.741 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-14T14:28:27.765 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2023-12-14T14:28:27.765 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-14T14:28:27.788 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-14T14:28:27.789 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T14:28:27.792 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T14:28:27.808 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T14:28:27.888 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-14T14:28:27.888 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-14T14:28:27.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-14T14:28:27.894 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-14T14:28:27.995 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-14T14:28:28.007 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-14T14:28:28.007 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-14T14:28:28.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-14T14:28:28.061 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-14T14:28:28.089 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-14T14:28:28.101 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-14T14:28:28.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-14T14:28:28.106 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-14T14:28:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2023-12-14T14:28:28.144 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2023-12-14T14:28:28.155 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2023-12-14T14:28:28.189 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-14T14:28:28.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T14:28:28.216 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-14T14:28:28.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T14:28:28.237 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-14T14:28:28.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T14:28:28.255 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-14T14:28:28.266 INFO:teuthology.task.internal:Transferring archived files... 2023-12-14T14:28:28.267 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/remote/smithi069 2023-12-14T14:28:28.267 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-14T14:28:28.307 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/remote/smithi081 2023-12-14T14:28:28.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-14T14:28:28.344 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228/remote/smithi119 2023-12-14T14:28:28.344 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-14T14:28:28.381 INFO:teuthology.task.internal:Removing archive directory... 2023-12-14T14:28:28.381 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-14T14:28:28.384 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-14T14:28:28.386 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-14T14:28:28.432 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-14T14:28:28.445 INFO:teuthology.task.internal:Not uploading archives. 2023-12-14T14:28:28.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-14T14:28:28.457 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-14T14:28:28.457 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-14T14:28:28.460 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-14T14:28:28.462 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-14T14:28:28.474 INFO:teuthology.orchestra.run.smithi069.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 14 14:28 /home/ubuntu/cephtest 2023-12-14T14:28:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 14 14:28 /home/ubuntu/cephtest 2023-12-14T14:28:28.488 INFO:teuthology.orchestra.run.smithi119.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 14 14:28 /home/ubuntu/cephtest 2023-12-14T14:28:28.490 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-14T14:28:28.502 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-14T14:28:28.527 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T14:28:28.554 DEBUG:teuthology.nuke:shortname: smithi069 2023-12-14T14:28:28.554 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T14:28:28.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 13:46:38.794538', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0MpaWITb2yPBjlsUtdX85sS/+Fm3iDVls/rpN3t132rN7VuoMxQ/K5xSJTzQxFppO2qfDQP9WBt1NdmoxFiSo='} 2023-12-14T14:28:28.583 DEBUG:teuthology.nuke:shortname: smithi081 2023-12-14T14:28:28.584 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T14:28:28.610 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 13:46:38.795791', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEYoLpwep/KALGS9o8NFWPC0O8/CzDiojFPIfswo7IEWeQVMyw1Pyn/5bUxFPBf4iocSFgdkfxnGfVQ6LGGPu5k='} 2023-12-14T14:28:28.611 DEBUG:teuthology.nuke:shortname: smithi119 2023-12-14T14:28:28.611 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T14:28:28.643 INFO:teuthology.orchestra.console.smithi069:Power off 2023-12-14T14:28:28.644 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T14:28:28.652 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_13:45:56-fs-wip-choffman-62793-distro-default-smithi/7491228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 13:46:38.793007', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDrQjfaVi0brQbPkFg4ltWtvaLkwZy/PKKttmu5tLhOYgTZyPUjr5c7WJ9SgyPJCT7iIB5jFWUQrBkozNfNCq/0='} 2023-12-14T14:28:28.672 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-12-14T14:28:28.672 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:28.690 INFO:teuthology.orchestra.console.smithi081:Power off 2023-12-14T14:28:28.690 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T14:28:28.701 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-14T14:28:28.713 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-12-14T14:28:28.713 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:28.729 INFO:teuthology.orchestra.console.smithi119:Power off 2023-12-14T14:28:28.730 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T14:28:28.739 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-14T14:28:28.752 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-12-14T14:28:28.752 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:28.773 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-14T14:28:32.702 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:32.740 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:32.774 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:32.812 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-14T14:28:32.850 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-14T14:28:32.884 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-14T14:28:36.817 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:36.851 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:36.885 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:36.933 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-14T14:28:36.964 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-12-14T14:28:36.995 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-12-14T14:28:37.065 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-12-14T14:28:37.096 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-12-14T14:28:40.937 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T14:28:41.048 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-14T14:28:41.149 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-12-14T14:28:41.255 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} duration: 2150.6163969039917 failure_reason: 'Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi069 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh''' flavor: default owner: scheduled_choffman@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7177138649364c3d802a45aa3932a79e status: fail success: false 2023-12-14T14:28:41.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T14:28:41.339 INFO:teuthology.run:FAIL